Where Does the Boundary Lie: Algorithm Finds Groups by Gaps in Data ✎

Original: "A New Spectral Clustering Algorithm"
· W. R. Casper, Balu Nadiga
arXiv:1710.02756 · 2017-10-07 · arXiv non-exclusive · independent analysis · 2 min
A new algorithm, SP-MGM, finds communities in graphs by analyzing gaps in the components of Laplacian eigenvectors.

Imagine a border river that separates two countries. On one bank live one group of people, on the other, another. The boundary between them is not always obvious: in some places the river is wide and calm, in others narrow and turbulent. But it is exactly where the current changes abruptly that the border becomes most noticeable. The SP-MGM algorithm looks for such natural gaps in data to understand where one group ends and another begins.

The method rests on the idea that every graph has its own natural oscillations, which describe how its vertices are connected. These oscillations can be thought of as waves spreading through the network. If two parts of a graph are weakly linked, a wave will sharply change its amplitude at the boundary between them. The algorithm finds the largest amplitude change and draws the boundary right there. This approach allows the number of clusters to be determined automatically, without setting it in advance.

Instead of deciding in advance how many groups the data should have, the algorithm looks at the data itself and finds natural gaps in it. It is like cutting a cake along the lines that are already there, rather than along pre-marked ones.

Tests on standard graphs showed that SP-MGM often outperforms popular algorithms, especially when the network is small and groups are well separated. At the same time, it almost always yields one more cluster than the number of eigenmodes. This surprising property suggests that gaps in the eigenvectors indeed reflect the graph's structure.

Applying the algorithm to sea surface temperature data in the Niño 3.4 region identified seven clusters, which correspond to different phases of El Niño and La Niña. Interestingly, these clusters are not determined solely by the ONI index, meaning the method captures subtle differences in the "flavors" of this climate phenomenon. Such clustering could help better understand how different types of El Niño affect weather in different regions.

In summary, the SP-MGM algorithm offers a simple and elegant way to find hidden boundaries in data. It relies on the graph's internal structure rather than external parameters, and it can be applied across a wide range of fields, from social network analysis to climate regime classification. Returning to the river image: the algorithm finds the places where the current changes, and that reveals where one country ends and another begins.

The SP-MGM algorithm almost always outputs exactly m+1 clusters for m eigenmodes, although theoretically there could be up to $2^m$. This points to a deep connection between gaps in eigenvectors and graph structure.

The idea of finding hidden structures by gaps in data recalls the analysis of 'patterns' in William Gibson's novel 'Pattern Recognition', where the protagonist intuitively finds anomalies in video streams. The algorithm formalizes such a search for graphs.

L = I - D^{-1/2} A D^{-1/2}
A matrix describing graph connectivity; its eigenvectors encode cluster structure.
A_{ij} = \exp(-d_{ij}^2 / (2\sigma))
Similarity matrix entries decrease as the distance between objects increases.
\max_{i \neq m} \frac{(n_i - 1) \rho_1}{\lambda_{i,2}} < \frac{1}{4 n_m^{1/2}}
If inter-cluster connections are weak relative to intra-cluster connectivity, the algorithm is guaranteed to find clusters.
Concepts
clustering nonlinear laplacian spectral analysis k means clustering climate network least squares ensemble forecast spectral pattern ENSO pattern recognition El Niño index cls method neural networks matched filtering Multivariate ENSO Index cross correlation El Niño-Southern Oscillation signal stacking classification least squares fitting neural network polarimetry