Optimal Response of Complex Systems: How to Find the Ideal Perturbation ✛ ✎

Original: "Data-driven methods for computation of optimal linear response in high-dimensional dynamical systems"
arXiv:2606.06728 · 2026-06-04 · arXiv non-exclusive · independent analysis · 3 min
A new method finds the best small perturbation to a system's dynamics using only observational data.

Context

Assessing how complex systems respond to external perturbations is a fundamental problem in physics, climatology, and engineering. Direct perturbation is often impossible: we have only one realization of Earth's climate or a single time series of observations. Classical linear response theory requires knowledge of the dynamical equations, which is rarely available for real data. This work sits among methods for extracting Koopman operators from data (e.g., neighboring works on forecasting and noise analysis), but focuses on optimizing the response rather than on prediction or identification. This fills a gap between perturbation theory and the practice of analyzing high-dimensional observations.

Methods

The authors use kernel smoothing to approximate the Koopman operator from an observed trajectory. When necessary, Takens' delay embedding is used to reconstruct hidden states. The resulting transition matrix of a finite Markov chain approximates the dynamics. Then an optimization problem is solved: find a perturbation matrix with zero row sums and constraints on allowed transitions that maximizes the derivative of the modulus or argument of a chosen eigenvalue. The solution is given by an explicit formula involving the left and right eigenvectors. For visualization, an 'optimal response vector field' is introduced, constructed by multiplying the perturbation matrix by the observation matrix.

Results

For the example of nonuniform rotation on a circle, the optimal perturbation to speed up the cycle turned out to be tangential to the trajectory and inversely proportional to the current speed. For the Lorenz system, the perturbation that accelerates rotation around the wings is orthogonal to the level lines of the argument of the complex eigenvector, not along the flow direction. In the El Niño climate example, the optimal perturbation to increase frequency leads the cycle by π/2, while that to strengthen correlations is in phase. A connection with the Indian Ocean Dipole phase was found: negative IOD during El Niño buildup and positive during La Niña.

Implications

This work differs from neighboring methods in that it is the first to allow optimizing the response in observation space without knowing the dynamical equations. Neighboring approaches either predict the future or extract patterns, but do not seek a targeted perturbation. Here, optimization is performed over the Koopman operator spectrum, yielding physically interpretable vector fields. This expands the toolkit for analyzing complex systems, especially in climatology, where experiments are impossible.

Future development

The method can be extended to general linear response problems, not only spectral properties. It may also apply to stochastic systems and nonstationary data. Investigating the robustness of optimal perturbations to the choice of kernel parameters and delay is promising.

Impact

The method could influence climate modeling, El Niño forecasting, control of chaotic systems, and analysis of biological rhythms.

Next steps

The next step will be to test the method on real climate data and compare with direct model experiments.

Key open problems

This work is directly related to the problem of identifying and controlling complex systems from partial observations. In dynamical systems, the question of rigorous convergence conditions for kernel approximations on chaotic attractors remains open.

The knowledge machine's view

This section is addressed to the author of the paper and their colleagues. Neighbouring works were found by meaning-based search across our archive, not by word overlap. We do not review: we show the field around the work.

What the work does

The authors construct a kernel-smoothed approximation of the Koopman operator from a time series of observations, possibly in a high-dimensional space, and formulate an optimization problem to find the infinitesimal perturbation that maximally changes selected spectral properties: the frequency or decay rate of almost-cycles, or the stability of almost-invariant sets. The method is illustrated with examples ranging from circle rotations to El Niño in a climate model. Explicit formulas for the optimal perturbation are derived, and an optimal response vector field is introduced.

Where its strength is

This work is the first to optimize the response in the observation space without knowing the dynamics equations, using the Koopman operator spectrum. The physical interpretability of the vector fields and the applicability to climate data make the approach valuable for analyzing complex systems where experiments are impossible.

Where it could go next

Worth trying

  • Test the robustness of optimal perturbations to noise, using ideas from the work on extracting laws from noise.
  • Apply model selection methods to automatically choose kernel and delay parameters.
  • Investigate how squire-like diagnostics can identify regions where the linear response is unreliable.

Why this may matter

If the proposed approach can be extended to more realistic noisy data and integrated with model selection methods, it could provide a practical tool for targeted intervention in complex systems, for example, to control climate modes or engineering systems without a full model.

To speed up rotation of a nonuniform circle, the optimal perturbation is stronger in slow regions: this follows from Jensen's inequality, which states that to minimize the time for one revolution, one should equalize the speed.

Key numbers

  • El Niño period: 49.33 months
  • Lorenz cycle frequency: 1.309 (empirical 1.332)
  • El Niño embedded data dimension: 537252
  • fraction of nonzero entries in perturbation matrix for El Niño: 9%
Scientists
Emmy NoetherGottfried Wilhelm LeibnizHenri PoincaréLeonhard EulerRichard Feynman
Concepts
koopman operator linear regression quantum dynamics Dynamical Systems computational fluid dynamics optimal transport control theory data processing integral operator nonlinear laplacian spectral analysis perturbation theory neural network neural networks in spatial mapping hamiltonian computational method autoencoder support vector machine optimization molecular dynamics acceleration parameter fitting