How to See Shape When Data Are Unevenly Sampled ✎ express

Original: "Density-Reweighted Entropic Optimal Transport: Decoupling Geometry from Sampling Density"
· Keyi Li, Yuval Kluger, Boris Landa
arXiv:2608.16506v1 · 2026-08-17 · arXiv non-exclusive · independent analysis · 1 min
A new way to match datasets keeps measurement density from fooling you.

📄 Showing the "Simple" version — "Popular" is not ready yet. Add it to favorites to help prioritize it.

Two photographers shoot the same mountain. One takes a hundred shots from the summit and only a couple from the base; the other does the opposite. If you try to align their images, the algorithm might decide that the summit in one photo matches the summit in the other simply because there are many similar points there, not because it's the same spot. Sampling density throws it off.

In data science, this task is called dataset matching: you need to find which observations in one set correspond to observations in another.

The usual method, entropic optimal transport, builds a transport plan that accounts for both point similarity and point counts. But when densities differ a lot, it can produce geometrically wrong pairings. The authors propose a weighted rescaling: you can weaken the influence of density as much as you like, even down to ignoring it entirely. It's like giving the algorithm glasses that cut the glare from uneven sampling.

Mathematically, they prove that under certain conditions the rescaled plan converges to a family of plans where the dependence on density is explicitly controlled.

On model data, the method recovers geometrically accurate correspondences and outperforms existing approaches when point densities differ sharply. This is useful in medicine, biology, astronomy — anywhere you need to compare shapes, not observation counts.

Optimal transport was invented back in the 18th century to figure out the cheapest way to move dirt from a ditch to a mound. Today it helps compare images, texts, and even cells.

Scientists
Edward WittenJuan MaldacenaMax BornAlbert EinsteinJohn von NeumannAndrey Markov
Concepts
optimal transport dataset data assimilation neural network regression genetic algorithm empirical orthogonal function bootstrap weight dimensionality reduction autoencoder data analysis navigation optimization parameter fitting model selection least squares fitting survey network energy landscape neural networks in spatial mapping