[2609.14858] Dream-RSI: Recursive Self-Improvement through Evolving Worlds

Tong Zheng and 16 co-authors propose Dream-RSI, a framework in which an agent's exploration strategy improves itself, recursively, while the base agent stays unchanged. A lightweight orchestration layer makes exploration explicit and programmable, and the history of past discoveries becomes a replay simulator in which exploration policies are evaluated and refined cheaply ("dreaming"), before the improved policy goes back online and its discoveries expand the simulator in turn. Across 9 tasks in 4 domains, the abstract reports that Dream-RSI "achieves competitive quality and improves discovery efficiency in several settings". The dreaming is replay over discoveries already made.

Visit Original Article →