ReSum introduces RL-based self-summarization for LLM reasoning

The arXiv paper "ReSum: Synergizing LLM Reasoning and Summarization with Reinforcement Learning" (submitted 11 Jun 2026) by Xucong Wang et al. proposes ReSum, an RLVR framework that incorporates model-driven self-summarization into long-horizon reasoning rollouts. Per the paper, ReSum implements a summarization-aware adaptive rollout: when the model emits a spontaneous summarization token sequence, the method masks that "summarization" phrase to create a contrastive branch; for non-summarization positions, the method randomly injects the phrase to create a matched branch. According to the arXiv paper, pilot studies show self-summarization reduces token-level entropy and mitigates error propagation from incorrect rollout prefixes. The authors report that ReSum improves average task performance by 4% and reduces rollout length by 18.6%.

ReSum sits at the intersection of two active research threads: reinforcement learning to improve LLM reasoning (RLVR) and memory- or compression-based approaches for long-context management. Industry and academic work on rollout organization often relies on external controllers or retrieval buffers; the paper instead explores enabling the model to generate intermediate compressed summaries and uses contrastive rollouts to evaluate their utility. Contrastive branching and a summarization-aware advantage function resemble techniques from policy-gradient contrastive estimators, adapted here to sequence-level compression decisions.

For practitioners, methods that shorten effective rollout length while preserving or improving reasoning accuracy matter because they trade context budget for stability. Industry-pattern observations: reported single-digit relative gains coupled with nearly 20% rollout reduction are meaningful in settings where context cost or latency is constrained, such as long-document QA, program synthesis, or multi-step decision generation.

Observers should look for open-source code, benchmarks and dataset details in the paper's companion materials, replication on standard multi-step reasoning suites, and comparisons to retrieval-augmented or hierarchical planning baselines. The arXiv submission contains experimental summaries but readers will need the full code and task breakdowns to assess engineering applicability and generalization.