Orchestra Without a Conductor: An Elastic Gang for LLM Inference
Seven cores froze at an invisible barrier. The eighth lingered on someone else's process, and the entire LLM inference hung. That's the central collision of machine learning tasks and ordinary processes sharing a CPU. An inference gang demands that all cores strike in perfect unison — otherwise silence.