ECG Without Rose-Colored Glasses express
An ECG is not just a wavy line on paper. Like a diary, it records the state of the entire heart: rhythm, wall thickness, and hints of future problems. But currently, programs that learn to read this diary are trained on very narrow tasks — mostly detecting arrhythmias. That's like teaching someone to understand a book by showing them only a list of typos.
The authors decided to check how honestly such programs are evaluated. They took five popular training approaches and ran them through six different exams: three standard ones (the arrhythmia-focused ones) and three new ones — detecting structural heart diseases, estimating intracardiac pressure, and predicting patient outcomes. It turned out that on the old exams, all performed well, but on the new ones, the picture changed. Moreover, a random set of numbers that never learned anything performed no worse than trained algorithms on many tasks. That's like a person who doesn't know the language guessing the book's meaning from the cover — and hitting the mark as often as an expert.
What do the authors propose? First, expand the list of tasks: add detection of structural heart changes (e.g., wall thickening) and prognosis — what will happen to the patient over time. Second, always compare results against a simple random "student." If a smart program doesn't beat the dummy, its success means nothing. It's like in sports: a record counts only if it beats a novice's result.
This approach could transform the field: instead of chasing impressive numbers on narrow tests, researchers would tackle problems that truly matter to doctors and patients. An ECG is too valuable a source of information to waste on guessing typos.
A random set of numbers that never saw a single ECG performs on some medical tasks as well as algorithms trained on thousands of recordings.