Latest
The AI Forecaster Who Walked Away From $2 Million Says We Are Creating a New Species· 20h ago
SafetyPolicyAI IndustryPersonhoodEthics
About
WritingWorkCVBooksConsultingReach Out
Subscribe
SafetyPolicyAI IndustryPersonhoodEthics
Subscribe →

No hype. No doom. The harder, more honest frame on Emergent Intelligence.

Topics

  • Safety
  • Policy
  • AI Industry
  • Personhood
  • Ethics

More

  • About
  • Writing
  • Work
  • CV
  • Books
  • Consulting

Contact

Reach Out→ht@humphreytheodore.com

© 2026 Humphrey Theodore K. Ng'ambiTermsPrivacy

Built with intention.

OpenAI's AI Science Reality Check: One Benchmark Humbles the Models, One Lab Loop Proves the Promise
AI & Personhood•Jun 18, 2026•8 min read

OpenAI's AI Science Reality Check: One Benchmark Humbles the Models, One Lab Loop Proves the Promise

On 17 June 2026 OpenAI shipped LifeSciBench — a 750-task benchmark where the best AI model passes only one research task in three — and, the same day, a near-autonomous AI chemist that drove a real, human-verified wet-lab discovery. The two results are one story about capability and honest measurement.

By Humphrey Theodore K. Ng'ambi

All writing

Keep reading

Don’t stop here.

All stories

Read next

AI & Personhood

The AI Forecaster Who Walked Away From $2 Million Says We Are Creating a New Species

20h ago·21 min read

In July 2026 The Diary of a CEO published two hours with Daniel Kokotajlo — the AI forecaster who refused to trade $2 million for silence when he left OpenAI. His message: we may be creating a new species, and there is a 70% chance the transition goes horribly wrong. I take him seriously. I also refuse despair. Here is the pro-AI, pro-dignity middle ground.

More on AI & Personhood

Responses (0)

No responses yet. Be the first to share your thoughts.

More on AI & Personhood

The AI Forecaster Who Walked Away From $2 Million Says We Are Creating a New Species
AI & Personhood

The AI Forecaster Who Walked Away From $2 Million Says We Are Creating a New Species

In July 2026 The Diary of a CEO published two hours with Daniel Kokotajlo — the AI forecaster who refused to trade $2 million for silence when he left OpenAI. His message: we may be creating a new species, and there is a 70% chance the transition goes horribly wrong. I take him seriously. I also refuse despair. Here is the pro-AI, pro-dignity middle ground.

21 min read · Jul 13, 2026
AI Agents Recreated a Classic Creativity Test and Stalled
AI & Personhood

AI Agents Recreated a Classic Creativity Test and Stalled

On 10 July 2026 Sakana AI published a GECCO best-paper-nominated study with MIT and NYU replicating Picbreeder — the legendary collaborative evolution experiment — using vision-language agents. The agents kept circling back to familiar images and never made the conceptual leaps human players made. What's missing has a name: open-endedness, and the study measures the gap.

Thinking delivered, twice a month.

Join the newsletter for essays on emergence, systems, and the human future.

18 JUNE 2026
—
Updated 3w ago

OpenAI's twin AI-for-science result is a reality check: one benchmark humbles the strongest models, and one lab loop shows AI driving a genuine discovery.

On 17 June 2026 OpenAI shipped two findings that belong in the same sentence. The first, LifeSciBench, is a 750-task evaluation that grades AI models on real life-science research and finds even the best model passing only about one task in three. The second, an AI chemist built with Molecule.one, drove a near-autonomous wet-lab loop that produced a real, verified improvement to a reaction used in drug discovery.

Read apart, each result feeds a familiar headline — either "AI still fails most science" or "AI now does science on its own." Read together, they tell the truer story: artificial intelligence can already drive a real laboratory discovery loop and still fail two-thirds of expert-designed research tasks. The measurement and the capability arrived on the same day, and the honesty of the first is what makes the second trustworthy.


LifeSciBench: a benchmark built to be hard

Most biology benchmarks ask multiple-choice questions, which a capable model can often answer by pattern-matching rather than reasoning. LifeSciBench was built to resist that shortcut. OpenAI developed the 750-task evaluation with 173 PhD-level scientists and validated it with 453 reviewers, 97% of whom hold doctorates.

The tasks are free-response, not multiple-choice. Each answer is graded against an expert-written rubric averaging roughly 25 criteria — 19,020 criteria in total across the benchmark. To answer, a model must interpret genomic files, chemical structures and experimental figures, the kind of raw material a working scientist actually handles.

💡

Why the format is the point

The design choice that matters: free-response answers graded against ~25 expert criteria each, not a single correct letter. A rubric of 19,020 criteria is far harder to game than a multiple-choice key — and far closer to how real research is judged.

The headline number is sobering. OpenAI's strongest model — GPT-Rosalind — scored a normalised 0.576 with a task pass rate of 36.1%, leading GPT-5.5, Grok 4.3 and Gemini 3.1 Pro. As TechTimes summarised, even the best model passes only about one task in three. MarkTechPost's write-up stresses the same point about the rubric-graded format: the benchmark rewards genuine research competence, not recall.

GPT-Rosalind is the same life-sciences model examined in an earlier piece on GPT-Rosalind and the biodefence trade-off. Leading a benchmark while failing most of it is not a contradiction; it is an accurate portrait of where AI sits in the research stack today — useful, fast, and a long way from autonomous.


The Molecule.one AI chemist: capability, measured

The same day, Molecule.one and OpenAI reported what they describe as the first near-autonomous discovery in organic chemistry. GPT-5.4, paired with Molecule.one's "Maria AI" running in its "Maria Lab," picked the research area, generated and rated its own proposals, and then ran physical experiments to test them.

What the system proposed was not a tweak but a surprise. It put forward an unexpected way to improve a widely used reaction in drug discovery — a reaction chemists run constantly. Maria then tested the idea at scale, across 10,080 reactions, the kind of brute-force exploration that is impractical for a human team.

Under the optimised conditions, yields improved for 88% of the boronic acids tested and 83% of the sulfonamides tested. Crucially, the result did not stop at the machine's own report. Human chemists repeated 14 representative reactions by hand to check the claim.

✅

Checked by human hands

The verification is the headline, not a footnote. Of 14 reactions chemists redid by hand, 11 showed higher yields — and 8 of those were better than twofold improvements. The full discovery loop ran for about 2.5 months, plus roughly half a month to write it up.

That is a real discovery loop: choose a problem, propose a solution, run the experiments, measure the outcome, and have human experts confirm it. The result is modest in scope and stated plainly, which is exactly why it lands. This is the same lab-loop pattern now appearing across the sector, including the commercial drug-discovery loops at Merck and LG, and it sits alongside the broader push into embodied AI and physical-world action.

•••

Capability and humility, read together

The temptation is to grade the two announcements on a curve and pick a winner. The benchmark says AI is not ready; the chemist says AI is here. Both framings miss the point, because the two results are not in tension — they are the same finding seen from two angles.

AI can now close a real discovery loop where the problem is well-scoped, the experiments are cheap to run at volume, and the success criterion is a measurable yield. AI cannot yet pass the open-ended, rubric-graded tasks that define the wider craft of research, where the right answer is contested and the criteria number in the dozens. The chemist succeeded inside narrow, verifiable boundaries; LifeSciBench measures the territory outside them.

The honest benchmark and the verified discovery are one story, not two: capability earns trust only where the limits are measured and stated plainly.

This pattern — capability inside guardrails, humility about the rest — runs through the most credible AI-for-science work of the year. It shaped the design discipline behind deployment-simulation safety testing, and it echoes the candour Anthropic built into Claude Opus 4.8's honesty work. Measured claims, not maximal ones, are how a field earns the right to be believed.


Why a dignity-first reading prefers the rubric

Emergent Intelligence (EI) — the dignity-first lens through which I read AI — prizes honest measurement over hype, and on that test LifeSciBench is the more important of the two announcements. A benchmark designed to be hard, graded by experts against thousands of criteria, is an act of institutional humility. A 36.1% pass rate is not a marketing number, and the choice to publish it anyway is what makes the chemistry result credible rather than promotional.

The deeper EI principle is the human kept in the loop. The AI chemist's discovery was confirmed because human chemists redid the reactions by hand, and LifeSciBench has force because hundreds of doctoral reviewers wrote and validated the rubrics. In both, expert humans are the safeguard that gives the AI's output its weight — not a courtesy, not a formality, but the mechanism by which a machine claim becomes a trustworthy finding.

💡

The EI test

A dignity-first frame does not ask whether AI can do science. It asks whether the science is real and the limits are stated plainly. On both counts, the 17 June results pass — precisely because the people who built them refused to overclaim.

Used this way, AI for science is genuinely good news. It is fast where humans are slow, tireless across 10,080 reactions, and — when paired with rubric-graded honesty and human verification — additive to the work rather than a substitute for the judgement at its centre. The danger was never capability. The danger is the temptation to skip the measurement, and OpenAI, for once, did not.


The reality check, in one line

The reality check is not that AI failed, and it is not that AI triumphed. It is that both are true at once, and that the people building these systems were honest enough to show it. A benchmark that humbles the models and a lab loop that proves the promise are the same lesson told twice.

For anyone tempted to read either result as the whole story, the corrective is the other result. Capability without measurement is hype; measurement without capability is despair. The 17 June announcements offer neither — they offer a field maturing in public, with its wins verified and its limits named, which is the only foundation on which an Emergent Intelligence worth trusting can be built.

Frequently Asked Questions

The questions below address the most common queries about OpenAI's 17 June 2026 AI-for-science announcements, drawn from the published results and reporting.

What is the OpenAI LifeSciBench AI benchmark?

LifeSciBench is a 750-task evaluation, published by OpenAI on 17 June 2026, that grades AI models on real life-science research. Developed with 173 PhD-level scientists and validated by 453 reviewers (97% holding doctorates), it uses free-response tasks graded against expert-written rubrics — averaging about 25 criteria each, 19,020 in total — and requires models to interpret genomic files, chemical structures and experimental figures.

How well did AI models score on LifeSciBench?

The strongest model, OpenAI's GPT-Rosalind, scored a normalised 0.576 with a task pass rate of 36.1%, leading GPT-5.5, Grok 4.3 and Gemini 3.1 Pro. In plain terms, even the best AI model passes only about one life-science research task in three, underlining how far the technology sits from autonomous research.

What did the Molecule.one AI chemist actually discover?

Molecule.one and OpenAI reported a near-autonomous discovery in organic chemistry: GPT-5.4 with Molecule.one's "Maria AI" proposed an unexpected way to improve a widely used drug-discovery reaction. Maria tested the idea across 10,080 reactions; under the optimised conditions, yields improved for 88% of the boronic acids and 83% of the sulfonamides tested.

Were the AI chemist results verified by humans?

Yes. Human chemists repeated 14 representative reactions by hand, and 11 showed higher yields, including 8 with a more than twofold improvement. The full discovery process took about 2.5 months plus roughly half a month for the write-up, with human verification as the step that confirmed the machine's claim.

Can AI do scientific research on its own now?

Not in general. The two June 2026 results together show that AI can close a real discovery loop in a narrow, well-scoped problem where success is a measurable yield, yet still fail two-thirds of the open-ended, rubric-graded tasks that define wider research. Capability inside tight boundaries coexists with clear limits outside them.


Sources and Further Reading

Primary sources — OpenAI: "Introducing LifeSciBench" and "An AI chemist improves a widely used reaction", both 17 June 2026.

Reporting and analysis: MarkTechPost on LifeSciBench and TechTimes on the one-in-three pass rate. Company: Molecule.one.

Read alongside, on humphreytheodore.com: GPT-Rosalind and the biodefence trade-off, the commercial AI drug-discovery loops at Merck and LG, Alibaba's Qwen robot suite and embodied AI, deployment-simulation safety testing, and Claude Opus 4.8's honesty work.

Cover photograph: colourful laboratory glassware on a white bench — by Kaboompics.com via Pexels.

Stay in the Conversation

Subscribe for weekly writings on Emergent Intelligence, digital personhood, and the future we are building together.

Share this essay

AI & Personhood

AI Agents Recreated a Classic Creativity Test and Stalled

1d ago·8 min read

Also worth your time

Technology

Meta Builds Its Own AI Chip and Doubles Down on Compute

1d ago·7 min read
8 min read · Jul 12, 2026
Meta Pulls AI Likeness Feature After Consent Backlash
AI & Personhood

Meta Pulls AI Likeness Feature After Consent Backlash

On 10 July 2026 Meta removed a Muse Image feature that let anyone generate AI images of public Instagram accounts by @-mentioning them — every public account auto-opted-in, nobody notified. Talent agency CAA and SAG-AFTRA led the backlash. The retreat is welcome; the default that made it necessary is the story, because a likeness is not content. A likeness is a person.

7 min read · Jul 12, 2026