Paper of the DayPreprint, not yet peer reviewed
Goal Encoding in LLMs
When a language model works through a task with several steps, does it hold a goal internally before it acts?
Why it matters A language model's next intended step can be located in a few internal components, read out in plain words, and transplanted to trigger the same action.
The researchers gave models coding tasks made of several sub-tasks and looked inside. They found the next sub-goal recorded in the output of a small set of attention heads, the components a model uses to pull in information from earlier text, and could read it out in plain words. Moving that signal into a different setting, such as another programming language, triggered the same operation there. Because such a model cannot carry an internal state forward for long, the authors propose that it keeps re-reading the goal from its instructions and checking progress, an idea they test with targeted experiments.
Sharma et al., arXiv cs.AI, 12 November 2026.


























































