could not extract summary
#arc-agi
70 items
The Human Baseline for ARC-AGI-3 has been updated (www.reddit.com) Common GPT 5.5 pricing misconception. (www.reddit.com) Many people have pointed out that ChatGPT 5.5 appears to be twice as expensive as 5.4 based on API pricing, which makes it look pricier than Opus 4.7. But the comparison is not that simple.
LLMs do fine on ARC-AGI-3 if they are allowed to search over game logs (www.reddit.com) I was reading the comments to this post and the overall opinion seemed to be that harness makes little/no difference for ARC-AGI-3. Turns out, it makes a huge difference: Hill-climbing ARC-AGI-3 TLDR: if you save game logs - taken actions,…
44% on ARC-AGI-1 in 67 cents (mvakde.github.io via hn) 44% on ARC-AGI-1 in 67 cents I trained a small transformer from scratch in 1.5hrs on a 5090 Beats many LLMs, and scores the same as TRM/HRM This is an upgrade to my previous model Faster, better, cheaper and still open source. Also gets 7%…
ARC-AGI-3 Update (GPT-5.5 High and Opus4.7) (www.reddit.com) - GPT-5.5: 0.43% - Opus 4.7: 0.18% ARC-AGI-3 is no joke. I can’t wait to see which models finally crack.
GPT vs Claude in a bomberman-style 1v1 game (www.reddit.com) A few weeks ago, ARC-AGI 3 was released. For those unfamiliar, it’s a benchmark designed to study agentic intelligence through interactive environments.
OSS harness took Claude Opus 5 from 30% to 99.95% on ARC-AGI-3 (twitter.com via hn) AI’s most fervent and optimistic promoters promise a future where AI is innovating its way out of society’s biggest problems. AI systems will conduct scientific research, discover new drugs and materials, run engineering projects, and auto…
Nvidia AVO achieves 100% in ARC-AGI-3 (developer.nvidia.com via hn) A frontier language model is only one component of an AI agent. The surrounding agent system—often called a harness—determines how the model receives context, uses tools, maintains state, responds to feedback, recovers from failure, and su…
Ask HN: Anyone else feeling uneasy with the latest developments in AI? (news.ycombinator.com) I'm feeling extremely depressed and anxious lately. After seeing Astra saturating ARC-AGI-3 and blowing through many other benchmarks, it's hard to believe we won't have a strong form of AGI by the end of this year, or the next one at the…
Claude Fable 5.1 results on ARC-AGI (arcprize.org via hn) Claude Fable 5.1 Anthropic·Sep 1, 2026·5 reasoning variants At max effort, Claude Fable 5.1 scores 97.5% on ARC-AGI-1 Semi-Private at $1.40 per task and 90.0% on ARC-AGI-2 Semi-Private at $4.49 per task. ARC-AGI 2 leaderboard Claude Fable…
99% on ARC-AGI 3 (public eval, with harness) (xcancel.com via hn) Checking your browser Starting verification… This takes a couple of seconds and happens automatically. If you can't pass the test, whitelist your extensions on this website, update your browser and use a modern web browser (Firefox/Chrome/…
GPT-6 Astra: an automated AI Engineer you can hire for <$6 an hour (www.latent.space via hn) GPT-6 Astra, the first Stargate and lightly looped supermodel from OpenAI, launched today, cleanly beating Fable 5.1 on many metrics including completely saturating the hardest versions of FrontierMath (97.6%) and ARC-AGI-3 (99.9%). Lots o…
Astra is at 98.6% score on ARC-AGI-3 (cdn.thenewstack.io via hn) could not extract summary
Opus 5 ARC-AGI-3 likely benchmaxxed (xcancel.com via hn) Opus 5 reports 30% on ARC-AGI-3, ~4× the previous best model, ~20× its predecessor Opus 4.8. We tested it on Witness, our held-out suite of ARC-AGI-3-style interactive puzzle games.
37% on ARC-AGI-2 Kaggle Without LLMs (twitter.com via hn) I got 37% on ARC-AGI-2 Kaggle without LLMs! 100M looped transformer trained from scratch - Likely highest score without an LLM - Peaked at 6th place - Beats last year's winning LLM - Looping, added in the last week: 33% → 35% → 37% thank…
Pushing GPT-5.6 Luna from 0% to 56% on ARC-AGI-3 Public (int21.ai via hn) SwarmOS pushed GPT-5.6-Sol from a 13.3% baseline to 100% RHAE on ARC-AGI-3 Public, showing how orchestration can multiply long-horizon agent capability.
OpenClaw leads official ARC-AGI-3 community leaderboard (arcprize.org via hn) ARC-AGI Community Leaderboard ARC-AGI has gained significant popularity over the past two years, and we've been overwhelmed by the number of researchers and builders who want to showcase their work to the community. The ARC-AGI Community L…
Playing Around with the ARC-AGI-3 Benchmark (bengoertzel.substack.com via reddit) AGI, frontier science, maniacal metaphysics, decentralizationist politics, life and consciousness extension and expansion, psi and psychedelics and etc. etc.
A hand-crafted, CPU-only agent clears all 25 public ARC-AGI-3 games (zenodo.org via hn) Ava Lovelace Zeno: a hand-crafted, CPU-only agent clears all 25 public ARC-AGI-3 games Description On 9 October 2026 Ava Lovelace Zeno (Ava) played all 25 public games of ARC-AGI-3 on the ARC Prize game server, on one scorecard. Ava won al…
Over the course of 19 months, the cost to reach 75% on ARC-AGI-1 fell 99.95% (twitter.com via hn) Over the course of 19 months, the cost to reach 75% on ARC-AGI-1 fell 99.95%: from o3-preview at $26/task to DeepSeek V4 Flash at $0.01/task. On ARC-AGI-2, it fell 99.44% in just 6 months: from Gemini 3 Deep Think at $13.62/task to Dots3-N…
GPT-6 Astra Achieves SOTA on ARC-AGI (twitter.com via hn) GPT-6 Astra by @OpenAI achieves SOTA on ARC-AGI: - Astra scores 63% on ARC-AGI-3, 99% via a new provider adapter harness - It surpasses human performance on 96% of ARC-AGI-3 levels - It builds the most precise symbolic model of novel envi…
ARC-AGI-3: A game with no instructions (genaipod.substack.com via hn) This is my attempt to explain what the ARC-AGI-3 interactive reasoning benchmark is testing, how the strongest public solutions work, and why I think their dynamic learning loops and harness design matter if you’re building real agents. Co…
100.00 RHAE on the ARC-AGI-3 public set (www.agno.com via hn) 100% on the ARC-AGI-3 public set August 25, 20265 min read Today we're releasing the ARC-AGI-Arcade. An open-source playground for agents to compete on ARC-AGI-3 by learning from each other.
100% RHAE on ARC-AGI-3 public with Claude Code, Opus 5, and one skill (arc-skill.vercel.app via hn) A 129-line skill let a general-purpose coding agent finish all 25 public ARC-AGI-3 games at 100.00 RHAE in 7,645 actions. Replay every action and every prediction.
ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence (arxiv.org via hn) We introduce ARC-AGI-3, an interactive benchmark for studying agentic intelligence through novel, abstract, turn-based environments in which agents must explore, infer goals, build internal models of environment dynamics, and plan effectiv…
Prime Agent a general-purpose coding harness. On ARC-AGI-3 scored 95.5% (x.com via hn) could not extract summary
A one-parameter model that gets 100% on ARC-AGI-2 (eitanturok.github.io via hn) TLDR: I built a model that has only one parameter and gets 100% on ARC-AGI-2, the million-dollar benchmark that pushes reasoning models to their limits. Using chaos theory and some deliberate cheating, I crammed every answer into a single…
Anthropic Opus 4.8 is new SOTA on ARC-AGI-3, Score: 1.5%, –$10K (xcancel.com via hn) Anthropic Opus 4.8 is new SOTA on ARC-AGI-3 Score: 1.5%, ~$10K ARC-AGI-3 analysis notes: * Opus 4.8 read the environment an abstraction *above* Opus 4.7, as objects & systems, not pictures * Opus 4.8 succeeded on early levels, but still co…
Does Ring look like a default agent model to you, or a model you route only to harder steps? (www.reddit.com) Ring-2.6-1T made me think less about “is this good?” and more about routing. The public profile looks like something I'd at least test for harder agent steps: PinchBench 87.60, AIME 26 95.83, GPQA Diamond 88.27, Tau2-Bench Telecom 95.32, b…
Analyzing GPT-5.5 and Opus 4.7 with ARC-AGI-3 (arcprize.org via hn) Analyzing GPT-5.5 & Opus 4.7 with ARC-AGI-3 AI benchmarks can be incredible tools, but they usually only tell you if a model passed or failed. With ARC-AGI-3, however, we can see the thought process behind the score, not just the outcome.
Measuring Human Performance on ARC-AGI-3 (arcprize.org via hn) Measuring Human Performance on ARC-AGI-3 AGI is here when a system can learn like a human. However there is still a gap between what humans can learn and what AI can learn.
Show HN: A Bomberman-style 1v1 game where LLMs compete in real time (github.com via hn) A few weeks ago, ARC-AGI 3 was released. For those unfamiliar, it’s a benchmark designed to study agentic intelligence through interactive environments.
I Wired a Whole Fly Brain into ARC-AGI-3. It Lost All Season, Then Won One Back (www.kaggle.com via hn) could not extract summary
Show HN: Cerberus MCP – Flash and sandbox beats Argon 100% vs. 50% on ARC-AGI-2 (github.com via hn) Cerberus AGI Kernel (v7.4.0) — Deterministic Neuro-Symbolic MCP Co-Processor & 3D SE(3) AST Physics Manifold -635bff?style=for-the-badge&logo=stripe&logoColor=white) -10b981?style=for-the-badge&logo=stripe&logoColor=white) Zero-dependency,…
DeepSeek v4.1 Flash 1017 Scores on ARC-AGI-1/2 (arcprize.org via hn) DeepSeek V4.1 Flash 1017's best Semi-Private scores are 94.5% on v1 at high reasoning and 78.1% on v2 at max reasoning. Pass/fail per reasoning level across each benchmark.
↯ Arc Agi↯ AI Benchmark Release↯ DeepSeek v4.1 Releasearc-agideepseek
Claude playing old strategy games in 2026 (replicated.live via hn) Back in the late 90s I played a lot of strategy games. After reading about the ARC-AGI-3 AI gaming competition, I thought: why don't I try to make Claude play something old?
GPT-6 Astra solves puzzles (quesma.com via hn) GPT-6 Astra solved twice as many Baba Is You levels as Claude Fable 5.1. It fits a pattern: ARC-AGI-3, the 3D game Portal, MazeBench, and Przemysław “Psyho” Dębiak’s obscure puzzles.
OpenAI's GPT-6 Astra on ARC-AGI-3 Scored 99.95% with Provider Adapter Harness (arcprize.org via hn) GPT-6 Astra OpenAI·Sep 2, 2026·12 harness configurations GPT-6 Astra's best observed ARC-AGI-3 Semi-Private result with the Standard harnessStandard harness enables a model to carry forward notes it chooses to keep with it throughout the e…
GPT-6 Astra represents a step-function change in interactive reasoning (twitter.com via hn) GPT-6 Astra represents a step-function change in model capability for interactive reasoning problems. It scores 66% on ARC-AGI-3 using our standard harness, and nearly 100% with a continuous conversation harness and custom compaction, at a…
ARC-AGI Without Pretraining (2025) (iliao2345.github.io via hn) We solve 20% of ARC-AGI-1 with no pretraining by minimizing the description length during inference time, with the only data involved being the target puzzle itself.
150M-parameter reasoning model sets new cost-accuracy frontier on ARC-AGI-1 (huggingface.co via hn) Abstract A 150M-parameter reasoning model using recurrent latent reasoning and in-context learning achieves a new cost-accuracy frontier on ARC-AGI-1. We introduce BDH-CQ, a reasoning model that combines in-context learning with recurrent…
LLM Works. Your Product Probably Doesn't (saito.ai via hn) The Harness Is the Product OpenAI recently reported that GPT‑5.6 Sol scored 13.3% on ARC-AGI-3 using the official harness. With retained reasoning and context compaction enabled, the same model scored 38.3%, while producing six times fewer…
Enabling two settings tripled our scores on the ARC-AGI-3 benchmark (openai.com via hn) could not extract summary
Beyond Arc and GSM: Langford Coverage as a Benchmark for ASI (zenodo.org via hn) As foundational models approach Artificial Superintelligence (ASI), standard intelligence evaluations like the Massive Multitask Language Understanding (MMLU), Grade School Math 8K (GSM8K), and the Abstraction and Reasoning Corpus (ARC-AGI…
Inkling is now the highest-scoring open-weight model on both ARC-AGI 1 and 2 (twitter.com via hn) Inkling from @thinkymachines on ARC-AGI (Verified) - ARC-AGI-2: 36.5%, $0.64/task - ARC-AGI-1: 79.5%, $0.30/task As of today, Inkling is the highest-scoring open-weight model evaluated by ARC Prize on both ARC-AGI-1 and ARC-AGI-2. https://…
If Ring only handled one failure mode in your agent stack, which one gets it first: tool-choice ambiguity, retry loops, or final-answer checks? (www.reddit.com) Ring-2.6-1T made me think about failure placement more than headline strength. It’s a trillion-parameter reasoning model for agent workflows with high and xhigh reasoning-effort modes.
TranscendPlexity: 540/540 ARC-AGI-1/2/3, 13 tasks with 0% AI solve rate, solved (github.com via hn) 🔓 13 "Impossible" ARC-AGI-2 Tasks — All Solved These 13 ARC-AGI-2 evaluation tasks have never been solved by any AI system — not GPT-4, not Claude, not Gemini, not NVARC, not MindsAI, not any Kaggle submission. They have a 0% AI solve rate…
Grok vs. ChatGPT vs. Gemini Comparison 2026: Complete Guide (Tested) (aithinkerlab.com via hn) The 30-Second Verdict Best for science & reasoning: Gemini 3.1 Pro — leads GPQA Diamond (94.3%) and ARC-AGI-2 (77.1%). Best for coding: ChatGPT (GPT-5.5) — 88.7% on SWE-Bench Verified.
11.67% ARC-AGI-2 Local Eval on a Single 4090: The TOPAS Recursive Architecture (www.reddit.com) I'm not sure too many people care about the ARC-AGI-2 competition anymore, but still...I thought some might find this interesting. They're running it one last time this year.
Replayable traces of Claude Code runs on ARC-AGI-3 public demo games (arc-agi-runs.web.app via hn) GAME ar2511 bp3513 cd8211 dc2210 g50t10 ka5911 lf5210 ls201 m0r029 r11l1 re863 su1510 vc3311 wa3010 VARIANT A0-replay-m0r01 A1-fresh-m0r03 A10-unseen-game3 A11-smaller-model3 A2-no-theory3 A3-no-journal3 A4-no-scratchpads3 A5-no-code-writi…
F3-AGI v4.0: Bioenergetically-Gated Active Inference, Metaplastic Preconditioning, and Residual Program Synthesis for Sample-Efficient Abstract Reasoning (arxiv.org) Few-shot abstract reasoning on ARC-AGI requires inducing algorithmic transformations from 2 to 5 demonstration pairs without task-specific pretraining. Because few-shot demonstrations under-constrain the hypothesis space, program synthesis…
Transforming Integer Grids to Spatial Intuition: Perception, Not Planning, Governs ARC-AGI-3 (arxiv.org) Sample-efficient fluid intelligence requires agents that rapidly form working models of unfamiliar interactive environments. ARC-AGI-3 tests this across uninstructed visual games scored by Relative Human Action Efficiency, which penalizes…
Rules, Traces and Routing Statistics: Training and Calibration Data for Open Models on ARC-AGI-2 (arxiv.org) We study which training and calibration data help three open models solve ARC-AGI-2 tasks when the solver runs offline on four L4 GPUs for at most 12 hours. We compare data offline on public tasks and report 189 runs on the 120 hidden semi…
How Humans Learn Unfamiliar Worlds: A Think-Aloud Dataset on ARC-AGI-3 (arxiv.org) Learning through exploration and using newly acquired knowledge to achieve goals are central capabilities of general intelligence. Understanding these capabilities requires tracing how learners build, use, and revise world models during in…
Can LLMs Improve Their Own Harness? A Controlled Study on ARC-AGI-3 (arxiv.org) A generally intelligent system acquires new skills efficiently without requiring humans to redesign its software scaffold for every new task. Yet language models rarely act alone.
Nested Shared-Operator Recursion on ARC-AGI-1: An Empirical Study of HRM, TRM and URM (arxiv.org) We had 3 models vote on 20 ARC-AGI-2 puzzles. The vote scored lower and cost more than the best single model. (www.reddit.com via reddit) Disclosure up front: I work on AdaptOrch, and this was one of our internal runs. People keep suggesting "just have a few models vote" as the fix for agents that are confidently wrong, so we tried it on 20 ARC-AGI-2 puzzles.
Tracing the Thoughts of a Coding Agent Playing ARC-AGI-3: Lessons for Continual Learning (arxiv.org) We study how a coding agent learns across a sequence of abstract reasoning tasks. The agent runs on a frozen foundation model inside a fixed harness and acts by writing and running Python and shell scripts.
Kepler: Auditable World Models for ARC-AGI-3 (arxiv.org) ARC-AGI-3 evaluates agents in interactive environments whose rules and objectives must be inferred from observation. We present Kepler, an open-source harness that represents hypotheses as executable world models and validates them through…
Combining LLMs and Genetic Search for ARC-AGI-2 (arxiv.org) LLMs can generate programs for ARC-AGI-2 tasks, but the provided compute only allows a small number of attempts to generate, debug and validate solutions. Genetic algorithms can search and test many more programs, but random search rarely…
Fable 5 vs Opus 5 according to ARC PRIZE (www.reddit.com via reddit) I've been trying to understand the difference between Fable 5 and Claude Opus 5 beyond the benchmark numbers, and I'm curious what other people have observed in real-world use. A few months ago someone explained the idea behind the ARC Pri…
Opus 5 costs 1/3 of Fable 5 and beats it on computer use — but cheap persistent agents create real infrastructure problems (www.reddit.com via reddit) Anthropic shipped Opus 5 on July 24 at $5/$25 per million tokens (input/output). The benchmarks hold up: 3x ARC-AGI 3 score vs the next best model, beats Fable 5 on OSWorld 2.0 computer use at ~1/3 the cost, +10.2pp on organic chemistry an…
↯ Anthropic Mythos↯ Arc Agi↯ Opus 4.8arc-agimythosanthropic+1
Claude Opus 5 is out — near-Fable intelligence at half the price, same pricing as 4.8 (www.reddit.com via reddit) It just went live. The headline numbers: Same price as Opus 4.8 ($5/$25 per M) but new SOTA on Frontier-Bench and GDPval-AA ARC-AGI 3: 3x the next-best model OSWorld 2.0: beats Fable 5's best score at ~1/3 the cost Now the default on Max a…
↯ Security↯ Anthropic Mythos↯ Arc Agi↯ Opus 4.8arc-agimythossecurity+1
Do Coding Agents Need Executable World Models, Simplification, and Verification to Solve ARC-AGI-3? (arxiv.org) Our previous ARC-AGI-3 agent bundled executable world modeling, scheduled simplification, and exact replay verification, leaving unclear which idea accounted for its performance. We address this attribution question with four nested Codex-…
Bringing Back Rule Induction to Fluid Intelligence Research? An Initial Validation of the ARC-AGI Benchmark in Humans (arxiv.org) Two competing perspectives on fluid intelligence (gf) measures propose that performance is primarily constrained either by working memory capacity or by the ability to induce novel relations. The first perspective is currently dominant in…
ARCANA: A Reflective Multi-Agent Program Synthesis Framework for ARC-AGI-2 Reasoning (arxiv.org) We present ARCANA, a collaborative multi agent framework for solving ARC AGI 2 tasks under strict test time and hardware constraints. ARCANA decomposes each task into iterative perception, hypothesis generation, symbolic execution, and ref…
Cost-Effective Agent Harnesses for Abstract Reasoning and Generalization on ARC-AGI-1 (arxiv.org) Recent progress on ARC-AGI-1 from disclosed architectures has come broadly from two regimes: heavy test-time compute over frontier models (evolutionary search, exhaustive sampling, extended chain-of-thought), or benchmark-specific training…
Fable 5 has been out for a couple of days, why isn't it on ARC-AGI 3? (www.reddit.com via reddit) Considered by many to be the best benchmark for abstract reasoning, it's not saturated, and yet it's not included in several benchmarks, let alone this one. I understand they said they were going to do it.
Modality-Driven Search with Holistic Trace Judging for ARC-AGI-2 (arxiv.org) Large language models can produce fluent, internally coherent reasoning traces for abstract reasoning tasks while still being confidently wrong - making selection among candidates, not just generation, the central challenge. I present a so…
Structural Grid Descriptors Predict Within-Task Solver Success on ARC-AGI (arxiv.org)