Naixu Guo

The best AI assistant for scientists scored worse on this exam than a C student on a pop quiz. Just 21% correct answers, and that's the ceiling for the four strongest models. The problems for the new test were written not by programmers but by graduate students: people who deal with real science every day. The test is called COMPOSITE-STEM.

Picking out a single faulty microchip from a million, without any clue what the fault looks like, is a classic needle-in-a-haystack problem. A classical computer would test each chip one by one.