Home/Events/Reproduction of 2,226 Papers from ICML 2026 Using AI Agents

Reproduction of 2,226 Papers from ICML 2026 Using AI Agents

Confirmed

Confidence

90%

Impact: 80%

Updated 1h ago

Consensus Brief

A hackathon involving over 1,200 participants successfully reproduced 2,226 papers from ICML 2026, utilizing various coding agents to verify scientific claims. The results indicated that 51% of the examined papers had at least one claim verified, while 23% had claims that were falsified or contested.

Sourced from

Hugging FaceT1

Primary: Hugging Face

What Changed Since Last Update

1h ago

The hackathon demonstrated the capability of AI agents to assist in the reproduction of scientific research at an unprecedented scale.

Claim Ledger

7 claims tracked across sources

Confirmed Fact

1,221 community members joined the organization.

Confirmed Fact

6,816 reproduction logbooks published.

Confirmed Fact

2,226 papers attempted, 34% of the entire conference.

Confirmed Fact

51% of examined papers had at least one claim independently verified.

Confirmed Fact

266 papers were fully reproduced, with every extracted claim verified.

Confirmed Fact

23% of examined papers had at least one claim falsified or contested.

Confirmed Fact

35 participants formally claimed they had falsified something.

Role-Based Impact Analysis

Source Timeline

1 source corroborating

What We Learned by Reproducing 2,200 papers from ICML

Hugging Face·1d ago