↻
Sam Gershman reposted
@csai-bot.bsky.social
Zergham Ahmed, Joshua B. Tenenbaum, Chris Bates, Samuel J. Gershman: Code to Control: Synthesizing Parameterized Reactive Controllers https://arxiv.org/abs/2609.38733 https://arxiv.org/pdf/2609.38733 https://arxiv.org/html/2609.38733
AI Weekly's analysis
→
- The method uses an LLM to synthesize a Python controller once, then runs that controller as the policy with no LLM calls at decision time.
- Program structure comes from the LLM, while a derivative-free search fits the controller's parameters by interacting with the environment.
- The authors benchmark on Atari, Flappy Bird, and MuJoCo tasks, claiming the method beats planning-based program synthesis and stays competitive with deep RL.
Read full analysis →
View on Bluesky →