A neural network with randomly assigned connections, used as a baseline for comparison.A random network is a neural network whose connections are assigned randomly, without any training. It serves as a baseline in machine learning research to understand what structure and learning actually contribute. Surprisingly, random networks can perform better than expected, especially when combined with certain architectures or when used as feature extractors.
The idea of random networks dates back to the 1980s with the echo state networks and liquid state machines, but the modern revival came with the observation that randomly initialized deep networks can be surprisingly effective, as shown in studies around 2010.
In a random network, the weights between neurons are initialized with random values and then frozen. The network is not trained via backpropagation. Instead, its output is either used directly (e.g., for classification with a simple readout layer) or its hidden activations serve as features for another model. The randomness acts as a fixed, nonlinear transformation of the input, which can sometimes separate data in useful ways.
Random networks are used in reservoir computing for time-series prediction, in extreme learning machines for fast classification, and as a baseline to evaluate the benefit of training in deep learning.
A random network with a single hidden layer can approximate any continuous function on a compact domain, provided the hidden layer is wide enough—a result known as the universal approximation theorem for random features.

















