Advances in Distributed Inference for LLMs on Mobile Devices
Introduction
The landscape of artificial intelligence is undergoing a seismic shift. For much of the last decade, the power of Large Language Models (LLMs) has been tethered to massive, energy-hungry data centers. However, as we move through 2026, the frontier is