AI-SOVEREIGN
Home / AI Research / TwinLab-Bench: Evaluating AI Scientists in Agentic Twins of Real Labs
TWAI Research

TwinLab-Bench: Evaluating AI Scientists in Agentic Twins of Real Labs

by zju-community · Yang Wan, Linchao Zhu

AI agents are increasingly expected to act as AI scientists, which requires three increasingly open abilities: carrying out a given computational workflow correctly, choosing the next measurements from a given design space, and designing their own experiments. Existing benchmarks mainly evaluate the first two abilities, in a terminal or in a closed loop that selects from predefined candidates. Evaluating the third ability requires reliably executing an experiment that an agent designs, with readings grounded in a real laboratory. We introduce TwinLab-Bench, which evaluates AI scientists on self-designed experiments in 52 tasks from laboratories in the physical sciences, the life sciences,…

Upvotes5
Comments2
Published18 Nov 2026