A machine learning approach where the algorithm selects the most informative data points to learn from, improving efficiency.Active learning is a subfield of machine learning where the algorithm itself chooses which data points to label or query from a pool of unlabeled data. Instead of passively learning from a fixed, randomly sampled training set, the model iteratively selects the most informative examples to request labels for, aiming to achieve high accuracy with as few labeled examples as possible. This is particularly valuable when labeling data is expensive or time-consuming, such as in medical imaging, drug discovery, or natural language processing, where expert annotation is costly.
Active learning has roots in the 1980s and 1990s, with foundational work by David Cohn, Les Atlas, and Richard Ladner in 1994 on 'Improving generalization with active learning'. The concept of querying informative data points dates back to earlier work in statistics and experimental design.
The process typically starts with a small set of labeled data to train an initial model. The model then evaluates the unlabeled pool and selects the most informative points according to a query strategy. Common strategies include uncertainty sampling (choosing points where the model is least confident), query-by-committee (selecting points where multiple models disagree), and expected model change (picking points that would most alter the current model if labeled). The selected points are labeled (by a human or an automated oracle) and added to the training set, and the model is retrained. This loop repeats until a stopping criterion is met, such as a performance threshold or a labeling budget.
Active learning is used in applications where labeled data is scarce or expensive, such as classifying astronomical objects from telescope surveys, detecting fraud in financial transactions, and training speech recognition systems with limited transcribed audio.
Active learning can reduce the amount of labeled data needed by up to 90% compared to random sampling in some tasks, making it a key tool for efficient AI development.


















