How to Overlay Two Images ✛ ✎

Original: "Image Registration Techniques: A Survey"
· Sayan Nag
arXiv:1712.07540 · 2017-11-28 · arXiv non-exclusive · independent analysis · 1 min
Image registration is like finding a common language between two photos of the same place taken differently.

Two shots of the same place: one taken in the morning from a drone, the other in the evening from a satellite. The first shows tree shadows, the second shows glints on the water. It's like two accounts of the same event in different dialects. Image registration is the interpreter that finds common ground between such frames.

The interpreter looks for anchor points: building corners, river bends. Then it matches them, estimates how one image needs to be shifted or rotated to align with the other, and applies that transformation. For images of the same type, the correlation coefficient (a measure of brightness similarity) works; for different types, mutual information (a measure of statistical dependence) is used.

Previously, there was no common map of methods. Now a classification based on ten criteria has emerged: it's like a dictionary that specifies the best interpreter for each pair of dialects.

There is no universal interpreter. For simple shifts, markers work; for complex distortions, neural networks and evolutionary algorithms come into play. But when the image is covered by clouds, anchor points are lost, and the problem remains open.

For aligning MRI and PET brain images, mutual information is often used: it finds common patterns in intensities, even if one image shows anatomy and the other shows metabolic activity.

\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} x_1 \\ x_2 \end{bmatrix} + \begin{bmatrix} t_1 \\ t_2 \end{bmatrix}
The new coordinates of a point are obtained by shifting the old ones by the translation vector (t1, t2).
\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} \cos\theta & -\sin\theta \\ \sin\theta & \cos\theta \end{bmatrix} \begin{bmatrix} x_1 \\ x_2 \end{bmatrix}
The new coordinates of a point are obtained by rotating the old ones by angle θ around the origin.
\begin{bmatrix} y_1 \\ y_2 \end{bmatrix} = \begin{bmatrix} s_1 & 0 \\ 0 & s_2 \end{bmatrix} \begin{bmatrix} x_1 \\ x_2 \end{bmatrix}
The new coordinates of a point are obtained by multiplying the old ones by the scaling factors s1 and s2.
Scientists
David DeutschErwin SchrödingerJohn Stewart BellLouis de BroglieLov GroverPaul Benioff
Concepts
image classification real time imaging 3d reconstruction Digital Image Processing camera single pixel imaging holography satellite imagery classification pattern recognition frame rate infrared camera historical astrophotography pixel neural recording technology benchmark optical microscopy speech recognition survey frame