How to Hear the Call-and-Response in Data Noise ✎

Original: "Explicit Granger causality in kernel Hilbert spaces"
arXiv:2011.14444 · 2020-11-29 · arXiv non-exclusive · independent analysis · 1 min
A new method uncovers causal links by listening not only to individual signals but also to how they respond to one another.

An interpreter at negotiations hears not only individual voices but also how the speakers trade off: one falls silent, another picks up. Remove that interplay, and you're left with monologues, and the meaning is lost. The same goes for data: ocean temperature, soil moisture, air pressure—all respond to each other with a delay. Catching that call-and-response is what it means to find a cause.

Previously, Granger causality was tested simply: does the past of one variable help predict the future of another? But that approach assumes the relationship is linear, like a straight thread. In reality, relationships are often nonlinear: an influence can grow, fade, or change sign. The new method (XKGC) maps the data into a space where the similarity between points is defined by a flexible function, and adds cross terms—those very responses of one variable to another.

The cross kernel combines four parts: two where a variable influences itself, and two where one influences another. It's like recording not only the lines but also the pauses between them.

On real data, the method showed that about half of the global changes in soil moisture are driven by El Niño. It even found an influence in Northwestern Europe, where none had been noticed before. Now such an interpreter could prove useful wherever data are nonlinear, from climate to economics.

Using data from the SMOS satellite (measuring soil moisture in the top 5 cm), the XKGC method found that El Niño explains half of the interannual variability in soil moisture on a global scale, with the influence visible even in Northwestern Europe, where it had not been detected before.

The idea of detecting causal links in time series echoes Isaac Asimov's Foundation series, where psychohistory predicts the future based on analysis of mass data, although there causality is statistical rather than individual.

Concepts
granger causality fr gravity causal set theory gravity theories linear regression general relativity causality tensor Gleason's theorem Jin-Timmermann model gravitational constant Einstein field equations equivalence principle gravitational theory Multivariate ENSO Index