Image Registration: A Review of Methods ✛ ✎

Original: "Image Registration Techniques: A Survey"
· Sayan Nag
arXiv:1712.07540 · 2017-11-28 · arXiv non-exclusive · independent analysis · 3 min
How to align images of the same scene taken at different times, from different viewpoints, and with different sensors.

Context

Image registration is a fundamental procedure for analyzing data from multiple sources. In medicine, it combines anatomical images (MRI, CT) with functional ones (PET, EEG); in remote sensing, it aligns multispectral frames for environmental monitoring; in computer vision, it aligns frames for motion tracking. Alongside this work in the archive are articles on medical image segmentation, dimensionality reduction, and weakly supervised learning, all of which address related image analysis tasks but do not focus on geometric alignment. This review systematically organizes registration methods, filling a gap in the classification of approaches.

Methods

The author conducted a literature review of image registration methods. Four mandatory steps are identified: feature detection (closed regions, edges, corners), feature matching between images, estimation of transformation parameters, and image transformation. Methods are classified according to ten criteria: dimensionality, domain of transformation, type of transformation, quality, parameters, subject, object, nature of basis, interaction, and modalities. The review covers external markers, surfaces, moments and principal axes, correlation, mutual information, wavelets, and soft computing (neural networks, fuzzy sets, optimization heuristics). For accuracy assessment, the correlation coefficient and mutual information are proposed.

Results

The review shows that there is no universal registration method: the choice depends on the type of images and distortions. For monomodal images, correlation works well; for multimodal images, mutual information is preferred, as it does not require the same nature of intensities. External markers provide high accuracy but are invasive; surface-based methods are suitable for rigid transformations; moment-based methods are fast but sensitive to segmentation. Soft computing, especially evolutionary algorithms, effectively searches for optimal parameters of affine transformations. Hybrid approaches combining mutual information with feature-based measures enhance robustness.

Implications

This work stands somewhat apart from neighboring articles that focus on segmentation and representation learning. Here, the focus is on geometric alignment, making the review a valuable reference for researchers who need to combine data from different sources. Unlike narrow methods, the review provides a holistic picture and highlights the open problem of automatic registration, especially under complex nonlinear distortions and occlusions.

Future development

Promising directions include the development of feature-based methods with modality-insensitive descriptors, which would ensure robustness and accuracy. Hybrid schemes combining mutual information with feature-based measures could improve reliability. It is also important to account for radiometric distortions and noise, not just geometric deformations.

Impact

Improving registration methods will directly impact medical diagnostics (fusion of MRI and PET), environmental monitoring via satellite imagery, and computer vision systems.

Next steps

Develop new feature-based methods with modality-independent descriptors and test hybrid approaches on real multimodal data with noise and occlusions.

Key open problems

In image processing, the problem of automatic registration under complex nonlinear distortions, occlusions, and varying illumination remains unsolved. This review shows that existing methods are either specialized or require manual tuning, so creating a universal and robust algorithm is an open challenge.

The knowledge machine's view

This section is addressed to the author of the paper and their colleagues. Neighbouring works were found by meaning-based search across our archive, not by word overlap. We do not review: we show the field around the work.

What the work does

The author reviewed the literature on image registration methods, identifying four stages: feature detection, feature matching, transform estimation, and transformation. The methods are classified according to ten criteria, including dimensionality, type of transformation, and modality. External markers, surfaces, moments, correlation, mutual information, wavelets, and soft computing are discussed.

Where its strength is

Systematizing registration methods across multiple criteria provides a comprehensive overview and highlights the absence of a universal solution, making this review a useful reference.

Where it could go next

  • It might be interesting to see how registration methods are applied in medical imaging, for example, to align anatomical and functional data, as discussed in the work on medical image segmentation.
  • Closely related is the work on synchronizing maps of a single city, which addresses a similar problem of aligning heterogeneous data, but in a cartographic context; perhaps approaches could be transferred between fields.based on: How to Sync Different Maps of the Same City arXiv:2602.18725
  • The archive contains an analysis of computed tomography where registration is used to reconstruct volumetric images from projections; this could be an adjacent direction for developing rigid registration methods.

Worth trying

  • Test a hybrid approach combining mutual information with feature-based measures on medical images from the segmentation study.
  • Evaluate registration methods on remote sensing data similar to those used in map synchronization.
  • Investigate the applicability of evolutionary algorithms for nonlinear transformations in tomographic data.

Why this may matter

Image registration remains a key task when combining data from different sources, and advancing methods toward robustness against nonlinear distortions and occlusions could expand their application in medicine, cartography, and remote sensing.

For aligning MRI and PET brain images, mutual information is often used: it finds common patterns in intensities, even if one image shows anatomy and the other shows metabolic activity.

\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} x_1 \\ x_2 \end{bmatrix} + \begin{bmatrix} t_1 \\ t_2 \end{bmatrix}
The new coordinates of a point are obtained by shifting the old ones by the translation vector (t1, t2).
\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} \cos\theta & -\sin\theta \\ \sin\theta & \cos\theta \end{bmatrix} \begin{bmatrix} x_1 \\ x_2 \end{bmatrix}
The new coordinates of a point are obtained by rotating the old ones by angle θ around the origin.
\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} s_1 & 0 \\ 0 & s_2 \end{bmatrix} \begin{bmatrix} x_1 \\ x_2 \end{bmatrix}
The new coordinates of a point are obtained by multiplying the old ones by the scaling factors s1 and s2.

Key numbers

  • correlation coefficient for identical images: 1
  • correlation coefficient for completely uncorrelated images: 0
  • correlation coefficient for opposite images: -1
  • range of mutual information values: from 0 to infinity
  • number of classification criteria for methods: 10
Scientists
David DeutschErwin SchrödingerJohn Stewart BellLouis de BroglieLov GroverPaul Benioff
Concepts
image classification real time imaging 3d reconstruction Digital Image Processing camera single pixel imaging holography satellite imagery classification pattern recognition frame rate infrared camera historical astrophotography pixel neural recording technology benchmark optical microscopy speech recognition survey frame