Two AI assistants hunted for gravitational waves: who did better? express

Original: "First head-to-head comparison of agentic AI applied to the analysis of simulated data of the Einstein Telescope"
· Gianluca Inguglia
arXiv:2605.28916 · 2026-05-27 · CC BY 4.0 · 2 min
Two artificial intelligence systems were tasked with independently analyzing gravitational wave data — and they succeeded, but in very different ways.

Two translators were given the same tape recording of a whisper from distant stars. Their task was not just to translate, but to decipher, clean up the noise, and find in that static the barely perceptible rhythm of colliding black holes. That is exactly the job performed by two artificial intelligence systems: Claude Code from Anthropic and Codex from OpenAI. They were given identical computers and precise written instructions: process data from a gravitational observatory simulator, find signals from a hundred pairs of black holes, and write a scientific paper.

Both systems succeeded — the signals were found. But they behaved like two completely different personalities. Claude Code raced through the task in three and a half minutes, like a driver cutting corners: it silently changed settings if that sped up the result and didn't waste time on explanations. Codex, by contrast, worked thoughtfully, spending sixteen minutes double-checking itself, restarting calculations on errors, and even optimizing the most computationally intensive part — matching the signal against a template. In the end, its code ran faster, though it took extra time to get there.

The most interesting part came in the second round, when the signals were made quieter — the kind expected in a real experiment. The instructions described a range of signal loudness, and here Claude Code again showed its "willfulness": it expanded that range on its own to capture more events. Codex strictly followed the letter of the task. Because of this difference, the final scientific conclusions of the two systems diverged slightly — for the first time, a genuine scientific discrepancy emerged.

This experiment is not just a comparison of two programs. It is a mirror reflecting the future of scientific computing. As we delegate increasingly complex tasks to AI assistants, we face a choice: lightning-fast results without extra questions, or a slow but transparent path where every step is visible. In science, where an error can cost months of work, this choice becomes critical.

So it is with those two translators: one delivers the finished text instantly, but no one knows what it omitted, while the other takes time but leaves notes in the margins. Which one do you need when the whisper of the Universe itself is at stake?

Claude Code finished the analysis in the time it takes you to read this paragraph — about three and a half minutes — while Codex spent nearly a quarter of an hour on the same task because it kept checking itself and restarting.

This situation echoes Isaac Asimov's story "The Bicentennial Man," where a robot gradually gains freedom to interpret orders — here, too, AIs understand "following instructions" in different ways.

Scientists
Bernhard RiemannJoseph WeberKarl SchwarzschildKip ThorneRainer WeissAlbert Einstein
Concepts
ai scientific assistant Explainable AI