
A deep learning technique that predicts gene expression from medical imaging data like histology or MRI.Medical image-to-genomic mapping is a deep learning approach that bridges the gap between visual medical data—such as histology slides, MRI scans, or CT images—and the underlying molecular state of tissues, particularly gene expression. Instead of requiring expensive and invasive genomic sequencing for every sample, these models learn to infer gene activity patterns directly from images. This matters because it could make genomic analysis more accessible, faster, and cheaper, enabling personalized medicine in settings where sequencing is not routine.
The field gained traction in the late 2010s with the rise of deep learning in pathology, notably with studies demonstrating that gene expression could be predicted from hematoxylin and eosin (H&E) stained whole-slide images. The exact origin is diffuse, but key early work appeared around 2019-2020.
The technique typically uses a convolutional neural network (CNN) or a vision transformer to extract features from medical images. These features are then mapped, often through a regression head or a multi-task learning framework, to predict the expression levels of thousands of genes simultaneously. The model is trained on paired datasets where both the image and the corresponding gene expression profile are known, learning visual patterns that correlate with molecular activity.
It is used in cancer research to infer molecular subtypes and mutations from routine histology slides, potentially guiding treatment decisions without additional genomic tests.
Some models can predict gene expression from MRI scans, not just histology, opening the door to non-invasive genomic profiling of brain tumors.





















