Huawei

P/D-Device prefills in the cloud and decodes on the phone, cutting TTFT 60%

Huawei researchers split prefill and decoding between cloud and phone, reporting time to first token down at least 60% and cloud throughput up to 15x.