ARC grid tasks

The Abstraction and Reasoning Corpus (ARC) is a psychometric benchmark: 1000 unique grid-based tasks evaluating an AI's general fluid intelligence via few-shot abstract reasoning.

ARC grid tasks, formally the Abstraction and Reasoning Corpus, serve as a critical benchmark for Artificial General Intelligence (AGI). Introduced by François Chollet in 2019, the corpus comprises 1000 unique tasks: 400 for training and 400 for evaluation. Each task presents a small set (typically three) of input-output pairs, which are 2D colored grids (10 possible colors). The core challenge is to deduce the implicit transformation rule from these few examples (few-shot learning) and apply it to an unseen test grid, generating the correct output grid. This methodology specifically targets an agent’s capacity for abstract reasoning and generalization, prioritizing skill-acquisition efficiency over brute-force pattern recognition.

https://github.com/fchollet/ARC-AGI