
Weakly supervised learning is a method where models are trained using incomplete or noisy labels instead of fully annotated data.In fully supervised learning, each training image comes with a pixel-perfect mask or label. Weakly supervised learning, in contrast, uses labels of lower quality: presence/absence of an object in the whole image, a coarse bounding box instead of exact contours, labels at the bag level (it is known that a set contains positive examples, but not which ones). The algorithm must infer details on its own by focusing on recurring features. For instance, if whiskers and a distinctive ear shape appear across a hundred images labeled 'cat,' the model associates them with the class without knowing precise locations.
The concept traces back to partially supervised learning works of the 1990s, but it gained wide recognition in the 2010s thanks to deep neural networks. In 2015, an influential paper "Weakly Supervised Learning with Deep Convolutional Neural Networks" showed how to train classifiers using only image-level labels, not object-level ones. Multiple Instance Learning (MIL) methods, which originated in the 1990s in the context of drug molecule activity, experienced a revival. Today, weakly supervised learning is a standard tool in medical imaging, natural language processing, and time series analysis.
A typical approach: a neural network takes input X and produces intermediate predictions, which are then aggregated into a final answer that matches the weak label. For example, for pixel-level tumor segmentation, the model outputs an activation map, and averaging over all pixels is compared to the image-level label 'healthy/pathological.' Gradients propagate through the aggregation operation, forcing the model to highlight relevant regions. In MIL, the network learns to predict at the level of 'bags' (collections of instances): it is known that a bag contains at least one positive instance, and the model identifies it by maximizing the difference between bags. Additionally, Teacher-Student models are used, where weak labels are iteratively refined.
In medicine, this approach saves hours of manual work: a doctor merely brushes over a shadow on an image, and the program outlines the tumor boundaries for diagnosis.
Weak supervision has enabled models that classify documents into categories using only keywords for training, rather than full sentences.


















