The classical neuron is a chamber musician, drawing only one note from each string: it takes a weighted sum of inputs, adds a bias, and passes it through a nonlinearity. But perform canonical quantization – the procedure born from the genius of Paul Dirac to create quantum mechanics – and the soloist transforms into a philharmonic orchestra. Now it’s an orchestra where every instrument plays all possible parts simultaneously. Instead of a fixed energy function $w^T$ z + b, we get a parameterized quantum Hamiltonian H(θ) = $Σ_j$ $θ_j$ $H_j$, controlling qubits. Non-commuting terms, like dissonant chords, give rise to a rich harmony of superpositions and entanglement, inaccessible to the classical 'ear'.
The quantum neuron is an observable φ(H(θ)), where φ is a nonlinear activation, such as the hyperbolic tangent with a temperature parameter T. This parameter defines the quantum-statistical regime, turning the neuron into a miniature heat engine. Measuring the observable on the input quantum state ρ gives the neuron's output. Learning becomes a hybrid quantum-classical algorithm: gradients are computed using the Hadamard test and simulation of time evolution – the very same described by the Schrödinger equation (discovered by Erwin Schrödinger). Methods like 'single-qumode force' and 'Schrödingerization', inspired by the work of Seth Lloyd, allow the neuron to process quantum data directly, without intermediaries.
The prospects are thrilling: from fundamental physics to practical quantum computers. Already today, we are talking about systematically building quantum neural networks that learn on entangled states without information loss. But there is a challenge – the problem of barren plateaus: gradients vanish like a whisper in a hurricane. Studying the gradient landscapes of quantized neurons promises not only to overcome this difficulty but also to shed light on the nature of learning itself – perhaps our brains also use quantum effects for efficient information processing. In the more distant future, such neurons will form the basis of quantum analogs of deep networks working with data from quantum chemistry and solid-state physics, opening the door to understanding matter at the deepest level.
The secret to computing gradients lies in the integral representation of the hyperbolic tangent via the hyperbolic secant. Physicists recognize this distribution as the derivative of Fermi-Dirac statistics, and statisticians as the logistic curve. Thus one formula links three worlds: quantum thermodynamics, data analysis, and neural network training.