Frontier LLMs are increasingly useful to researchers in math and theoretical physics. In some cases, important open problems have been solved by AIs. I review these developments and discuss their relevance to model Recursive Self-Improvement (RSI). Reasoning about model architectures and training methods strongly resembles reasoning in math/physics research. Hence, AIs may soon propose, code, and test improvements to their own architecture and training.
30 minute talk followed by questions