What happened
OpenAI published “Measuring how AI agents handle everyday wet-lab science” on November 6, 2026. BioBasicsBench has 100 tasks across five areas — protein methods, imaging and cytometry, quantification and assays, nucleic acid methods, and molecular cloning — built with Ligo from scientists’ own experimental data. Each task pairs raw evidence with an expert rubric and went through internal and external PhD-level review. OpenAI evaluated seven of its models across 37 model-and-effort settings, five attempts per task (18,500 results). At xhigh, GPT-6 Astra scores 66.7% mean reward (95% CI 60.3–73.1) with about 4,704 output tokens per task; GPT-5.6 Sol is 43.8% (37.6–50.0) with about 9,099 tokens. GPT-6.1 Sol is 62.0%. The post also shows cases where Astra still overrides controls, discounts contradictory observations, or overcounts colonies by about 12%.
Why it matters
Teams quoting “AI for biology” often mean paper figures. This suite targets the messy everyday read of gels and plates. The number still belongs to OpenAI’s models on OpenAI’s rubrics.
Inputs include gels and blots (31 tasks), protocols and notes (27), tables and instrument exports (20), and microscopy (14), among overlapping categories.
Credit is per rubric criterion, not a single pass/fail bit.
The post links biosafety and biosecurity tracking as a reason to measure these skills.