ARRSI 2026

The First Workshop·AACL-IJCNLP 2026

Autonomous Research & Recursive Self‑Improvement

Co-located with AACL-IJCNLP 2026 in Hengqin, China, on Tuesday, November 10, 2026.

Workshop program now available

Join six invited speakers, three contributed oral presentations, and open discussion.

November 10, 2026 · 09:00–17:30 · Beijing time (UTC+8)

Please review our Code of Conduct and reporting information before attending.

Abstract

AI agents are crossing a consequential threshold: from assisting with isolated research steps to running closed loops of literature search, hypothesis generation, coding, experimentation, evaluation, and revision. Whether those loops compound into recursive self-improvement, a claim often tied to artificial superintelligence, is prominent but unsettled, and it calls for measurement rather than assumption.

ARRSI asks what can actually be measured. We treat as open the claims most often made on an agent’s behalf: that its hypotheses are genuinely novel, that its gains reflect research ability rather than benchmark overfitting or undisclosed human labor, and that improvements derived from its own runs persist. Each becomes tractable only through reportable evidence: held-out results, attribution of a gain to the component that changed, budgets for compute and human intervention, and controls for contamination and reward tampering.

v₀ propose implement run evaluate revise vₙ
The recursive loop · Propose, implement, run, evaluate, revise. Accepted changes are committed to the system itself, so every new cycle starts from a stronger researcher: v₀, then v₁, then vₙ.
Venue
AACL-IJCNLP 2026
Location
Hengqin, China
Date
Tuesday, November 10, 2026
Format
One day · hybrid
Submissions
OpenReview · double-blind
1

About the Workshop

Why now

The question is no longer speculative. Research agents now synthesize literature, propose hypotheses that have been taken into laboratory testing, and run closed research loops: proposing an idea, implementing it, running an experiment, evaluating the result, and choosing the next attempt. What this establishes is contested: it shows that generated hypotheses can be worth testing, not that novelty has been measured.

Self-improvement also reaches training: models generate practice data, rewards, curricula, and critiques through self-play, self-reward, and verifiable task generation, and agentic data systems improve the datasets they create. This broadens AI-for-AI to data curation, pretraining, midtraining, post-training, and systems optimization. Yet full recursive self-improvement remains unproven; evaluation must expose overfitting, hidden human labor, and reward tampering.

ARRSI fits AACL-IJCNLP because language is how research agents form hypotheses, retrieve multilingual evidence, call tools, critique claims, and explain results. The workshop brings together NLP, agentic systems, AI for Science, AI for AI, evaluation, and governance to establish definitions, benchmarks, reporting standards, and safety boundaries for systems that do not merely produce research-like text, but accumulate auditable evidence and use it to become better researchers.

2

Call for Papers

Empirical · theoretical · systems · dataset · benchmark · survey · position

We invite empirical, theoretical, systems, dataset, benchmark, survey, and position papers on the following topics.

T1RSI for Harness & Loop Engineering

Prompts, context, memory, tools, workflows, evaluators, and harness code.

T2Autonomous Research

Literature synthesis, hypotheses, experiments, analysis, replication, peer review, and research taste.

T3AI for Science

Mathematics, physics, chemistry, biology, medicine, and materials science.

T4AI for AI

Models, agents, architectures, objectives, optimizers, kernels, compilers, training, inference, alignment, and evaluation.

T5Autonomous Data Engineering

Discovery, collection, cleaning, filtering, annotation, synthesis, provenance, and quality control.

T6Automated Training & Self-Training

Pretraining, midtraining, post-training, self-play, rewards, curricula, and continual learning.

T7RSI for Coding & General Agents

Coding and general agents, plus finance, healthcare, medicine, education, and other domains.

T8Infrastructure & Evaluation

Experiment managers, sandboxes, verifiers, provenance, checkpoints, rollback, compute accounting, benchmarks, and contamination control.

T9Safety & Governance

Validity, attribution, negative results, reward hacking, oversight, security, dual use, and human control.

Paper submissions closed on October 31, 2026, 4:59 AM PDT (October 30, 11:59 PM AoE). Camera-ready revisions for accepted papers are due November 9, 2026, 23:59 Beijing time (UTC+8).
Important dates
Call for papers releasedSeptember 1, 2026
Submission deadlineOctober 31, 2026, 4:59 AM PDT
Notification of acceptanceUpdated date to be announced
Camera-ready papers dueNovember 9, 2026, 23:59 (UTC+8)
Proceedings due (organizers)Updated date to be announced
Workshop dayTuesday, November 10, 2026
3

Schedule

November 10 · Beijing time (UTC+8)
Tuesday, November 10, 2026 · Meeting Room 3, Hengqin, China. All times are Beijing time (UTC+8).
TimeSessionSpeaker / Details
09:00–09:10Opening RemarksWelcome, logistics, and Code of Conduct reminder
09:10–09:50Invited Talk 1Recursive Self-Improvement for Trustworthy AI and Scientific DiscoveryLei Sha
09:50–10:30Invited Talk 2DeltaHarness: Measuring Recursive Self-Improvement in Tool-Using AgentsChenyang Lyu
10:30–11:00Coffee Break
11:00–11:40Invited Talk 3Self-Improving Agents through Harness and Skill EvolutionZhongxiang Dai
11:40–11:55Oral Presentation 1Curated to Win: Certifying Reward-Model and Judge Selection Against Evaluation-Set CurationAdrian Erlikhman
11:55–12:10Oral Presentation 2StepDiff: Measuring Patch Recovery Along Real Repository HistoriesWei Zhang
12:10–12:30Open DiscussionDiscussion with speakers and participants
12:30–14:00Lunch Break
14:00–14:40Invited Talk 4Retrieval for RSI: From LLM to WorldChenghao Xiao
14:40–15:20Invited Talk 5Knowing, Retrieving, Grounding: Verification Primitives for Self-Improving Research AgentsHou Pong (Ken) Chan
15:20–15:30Discussion / BufferDiscussion and session transition
15:30–16:00Coffee Break
16:00–16:40Invited Talk 6Evaluating LLM Agents: Outcomes, Processes, and Open-Ended ResearchLinyi Yang
16:40–16:55Oral Presentation 3CodeTracer: Towards Traceable Agent StatesHan Li
16:55–17:25Open DiscussionDiscussion with speakers and participants
17:25–17:30Closing RemarksSummary and next steps

Invited talks: 35 minutes for the talk and 5 minutes for Q&A. Oral presentations: 12 minutes for the talk, 2 minutes for Q&A, and 1 minute for transition.

Online access details will be sent to registered participants on November 9. Zoom links must not be shared publicly.

4

Invited Speakers

Lei Sha

Professor and PhD Supervisor · School of Artificial Intelligence, Beihang University

Recursive Self-Improvement for Trustworthy AI and Scientific Discovery

Chenyang Lyu

Staff Research Scientist and Tech Lead · ATH-MaaS AI, Alibaba Group

DeltaHarness: Measuring Recursive Self-Improvement in Tool-Using Agents

Zhongxiang Dai

Assistant Professor and Presidential Young Fellow · School of Data Science, The Chinese University of Hong Kong, Shenzhen

Self-Improving Agents through Harness and Skill Evolution

Chenghao Xiao

Assistant Professor · School of Computing and Artificial Intelligence, Shanghai University of Finance and Economics

Retrieval for RSI: From LLM to World

Hou Pong (Ken) Chan

Assistant Professor · Department of Artificial Intelligence, University of Macau

Knowing, Retrieving, Grounding: Verification Primitives for Self-Improving Research Agents

Linyi Yang

Assistant Professor and Ph.D. Supervisor · Southern University of Science and Technology (SUSTech)

Evaluating LLM Agents: Outcomes, Processes, and Open-Ended Research

7

Program Committee

Reviewing runs on OpenReview with double-blind submission, discussion, and decisions. We target at least 60 reviewers so that every submission receives three reviews while individual loads stay at three papers or fewer. The reviewer list will be announced once finalized. Reviewers assess evidence traceability, controls, reproducibility, resources, safety, and limitations; undisclosed AI-generated reviews are prohibited.

8

Camera-ready Submission

Authors of accepted papers should submit their camera-ready revisions on OpenReview by November 9, 2026, 23:59 Beijing time (UTC+8).

Sign in using an author account, open your accepted paper, and select Camera Ready Revision. Upload the final non-anonymous PDF, provide the requested source files, and complete the author and presentation information on the form.

We plan to submit the final camera-ready papers for ACL Anthology proceedings. Authors must ensure that each paper is covered by the required conference registration.

9

Code of Conduct

ARRSI 2026 follows the ACL Anti-Harassment Policy.

We expect respectful participation in all workshop sessions and related online discussions. Harassment and hostile conduct are not acceptable.

Please also read the AACL-IJCNLP 2026 Code of Conduct.

This policy applies to all workshop participants, both in person and online. We will briefly remind participants of the policy and reporting routes during our opening remarks.