Agents that learn unfamiliar rules, on a fixed machine.
- WHAT IT IS
- ARC-AGI-3 is the ARC Prize 2026 benchmark for interactive reasoning. An agent is placed in a game it has never seen, with no instructions, and is scored on how few actions it needs compared with people. Every team ran on the same machine: one NVIDIA RTX PRO 6000, nine hours, 110 hidden games, no internet.
- WHY IT MATTERS
- It measures how quickly an agent works out the rules of something new, not what it has memorised. Because the hardware is fixed, inference efficiency is part of the result: every token the card does not waste is another move an agent can think through.
- WHAT WE DID
- We built an agent harness in which the model's only tool is a Python sandbox, with notes that survive context trimming and checked play. We built the serving system that cut the model to fit the card and ran thirty-two agents on it at once. Keith Tyser built a trainer that works inside the same single card. The harness builds on Tufa Labs' public harness and Daniel Franzen's public Milestone 2 notebook.
- DEMONSTRATED
-
5th of 4,923teams on the public leaderboard, score 56.02605 → 2,150tokens per second over a whole run on one card, from the public notebook we started with to our final build10 → 32agents running at once on that card3 of 12changes that improved in our local tests also improved on the public leaderboard
WHAT DID NOT HOLD UP Of twelve changes that improved in our local tests, only three also improved on the public leaderboard, and both reinforcement-learning adapters we submitted scored lower than the package they were added to. The evidence notes list all fourteen comparisons.