statistics

type i error

Rejecting a true null hypothesis — a false discovery.
3 related articles

Description

A Type I error, also known as a false positive, occurs when a statistical test rejects a true null hypothesis. In plain terms, it means concluding that an effect or difference exists when in reality it does not. This is the error that scientists most often guard against, because it leads to claiming discoveries that are not real.

History

The formal concept was developed in the early 20th century by statisticians such as Ronald Fisher and Jerzy Neyman, with Neyman and Egon Pearson explicitly distinguishing Type I and Type II errors in the 1920s–1930s.

How it works

In hypothesis testing, you start with a null hypothesis (e.g., 'the drug has no effect') and an alternative hypothesis (e.g., 'the drug has an effect'). You collect data and compute a test statistic. If the statistic falls into a region of extreme values (the rejection region) that would be unlikely if the null hypothesis were true, you reject the null. The probability of this happening by chance is the significance level, typically set at 0.05. A Type I error is exactly this: rejecting the null when it is actually true, and the significance level is the probability you allow for that mistake.

In practice

Used in every field that relies on statistical inference—medicine (drug efficacy trials), psychology, economics, and quality control—to set thresholds for what counts as a 'significant' result.

Fun fact

The standard 5% significance level means that if you test 20 truly ineffective drugs, on average one will appear effective purely by chance.

Concept graph →

Related articles · 3

Instrumentation2026-05-031 minarXiv:2605.02969express
Diagnosis for Distant Worlds: How Not to Mistake Life for Noise
The hunt for life on distant planets is like diagnosing a rare disease with a test of unknown accuracy. A single positive result means nothing: maybe it's a glitch? We search the atmospheres of exoplanets (worlds around other stars) for traces of water and other compounds, but any signal could be a false alarm.
Materials2026-01-241 minarXiv:2601.17253express
Neural Network Distinguishes Real Crystals from Fantasies
Porous zeolite minerals work like tiny sponges with holes of a strictly defined size. Through such holes, molecules of one kind pass while others get stuck: this is the basis for water purification, gas separation, and catalysis in petrochemistry.
Exoplanets2026-01-051 minarXiv:2601.02171express
Star Counterfeiter: How a Twin Mimicked a Planet
The hunt for exoplanets is like catching shadows: an invisible planet gives itself away only by a microscopic dimming of starlight. The space telescope TESS caught such a dip for star TOI 864 — it lasted half a day and its strength hinted at a rocky world the size of Earth, spinning almost in the embrace of its sun.