The program behind the weights
A recent article showed that an LLM could write the weights of small game-playing networks without training. I read those networks back, trained from them with PPO, compiled a classical algorithm into weights by hand, and finally asked the same LLM for the program as code.
- LLM
- neural networks
- reinforcement learning
- interpretability