CoolFace
Modelpublic

kofdai/Verantyx-arc-agi2-7.4

sourceHugging Facemitupdated 7mo agoView on Hugging Face
0likes10downloads
Model Card

Verantyx ARC-AGI-2 — 7.4%

Pure program synthesis solver for ARC-AGI-2 — no neural networks, no LLMs, no hardcoded patterns.

Score

SplitScoreMethod
Training (1000 tasks)74/1000 = 7.4%DSL synthesis + CEGIS verification

Approach

Zero-shot program synthesis:

  1. 1.Decompose — Break input→output relationships into composable grid transformations
  2. 2.Synthesize — Generate candidate programs from 50+ DSL operations
  3. 3.Verify — CEGIS against ALL training pairs (must match exactly)
  4. 4.Compose — 2-step pipelines when single rules don't suffice

No cheating: Test outputs are never accessed. Only training I/O pairs are used for rule discovery.

Key Innovation: Neighborhood Rule Learning

The most powerful operation: learns a deterministic mapping from each cell's local neighborhood (3×3 or 5×5 window) to its output value. Solves 240 of 1000 training tasks alone.

This is not a neural network — it's an exact lookup table built from training examples and verified to be consistent across all pairs.

DSL Operations (50+)

CategoryOperations
Geometricrotate90/180/270, fliph/v, mirrorh/v/hv, transpose, reverserows/cols, roll_rows/cols
Structuralcropbbox, croptocolor, extractlargest/smallestregion, extractunique_subgrid
Morphologicalerode, dilate, hollowregions, fillinterior, extractborder, fillenclosed
Colorcolormap, replacecolor, recolorbysize, keeponecolor, removecolor
Sortingrowsort, colsort (by colorcount, sum, firstnonbg)
Gravitygravity_all/up/down/left/right
Connectionconnecth/v/hv, spreadcolor (4 directions)
Tilingtiletooutput, cornersmirror, stackh/v/hflip/vflip, selftile, diagonaltile
Subgridsubgrid_select/overlay/diff (automatic separator detection)
Dedupdeduprows, dedupcols
Learnedneighborhood_rule (radius 1-2 neighborhood mapping)

Score Progression

VersionScoreKey Change
v11.6%Initial DSL: colormap, mirror, scale
v52.5%WholeGridProgram class, rotations
v102.9%Subgrid ops, CompositeProgram
v124.1%extract_region, stack ops
v145.3%corners_mirror, connect ops
v176.1%neighborhood_rule learning
v197.4%+18 DSL ops, priority reorder

Usage

bash
git clone https://github.com/Ag3497120/verantyx-arc-agi2
cd verantyx-arc-agi2

# Download ARC-AGI-2 data
git clone https://github.com/arcprize/arc-agi-2.git /tmp/arc-agi-2

# Run evaluation
python -m arc.eval_cross --split training

Properties

  • —✅ No neural networks — pure symbolic reasoning
  • —✅ No LLMs — no language model of any kind
  • —✅ No hardcoded patterns — all rules are synthesized from training data
  • —✅ No test data leakage — only training I/O pairs are used
  • —✅ Deterministic — same input always produces same output
  • —✅ Zero dependencies — pure Python, no pip install needed
  • —✅ Fast — ~0.4s per task average

Links