MIT Researchers Introduce Recursive Language Models

MIT CSAIL researchers publish a design for Recursive Language Models (RLMs), a technique that uses a programming environment to recursively decompose inputs and process long-context tasks, reportedly handling prompts up to 100x longer than base LLMs. Implemented as a Python REPL notebook and open-sourced on GitHub, RLMs outperformed context-compaction baselines on multiple long-context benchmarks, offering a task-agnostic approach to reduce context rot and improve needle-in-haystack retrieval.