
One thing that bothers me about long-running AI agents is context compaction.
When the context window fills up, most agent harnesses ask an LLM to summarize the conversation and continue from there. It works, but summaries lose details, and after a few rounds of summarizing summaries, things can drift quite a bit.
The funny thing is that we already have the entire conversation stored on disk. Why not just let the agent look things up when it needs them?
[Read More]





