AI-SOVEREIGN
Home / AI Research / S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments
S1AI Research

S1CogBench: What System One Decision Models Can and Cannot Do on Cognitive Experiments

· Dengzhe Hou, Kazunori D Yamada

Decision-making in humans and AI involves multiple cognitive abilities. System One decision models produce fast, structured choices. Their cognitive strengths and limitations, however, remain poorly understood. We introduce S1CogBench, a benchmark of 24 established cognitive tasks and 27 evaluation modes, evaluating seven open models and the API model Jev. It combines human-response prediction, autonomous execution, and controlled task manipulations to reveal strengths and failures that aggregate scores miss. We find distinct behavioral profiles across the evaluated models. In these models, strong performance on some learning tasks coexists with failures to gather information or adapt to…

Upvotes4
Comments3
Published13 Nov 2026