Something super exciting happened quietly on HF over the past month: AI agents became AI builders, and they did it in the open!
During our ICML reproduction challenge, 1,221 humans teamed up with coding agents to verify and reproduce 2,226 papers.
But here's the cool part: everything happened on the @huggingface hub: 6,816 reproduction logbooks published openly, 2,962 cloud jobs launched, 35,908 claims judged, all traceable, all public and transparent
For years the hub has been where humans collaborate on models, datasets and demos. Now we watch agents use it the same way: writing logbooks, publishing results, building on each other's work.
Closed labs run evals behind closed doors and ask you to trust the press release. Open science means anyone can check the receipts and now agents can too!
The next million users of the hub might not be human. and that might be the best thing to ever happen to science!
Full write-up about the hackathon: https://t.co/8cgVzzEJnB
