KV cache prefix reuse, Experimental Machines
A phone that skips re-reading a 2,050-token agent prompt.
Built twice, because the app's two runtimes have different cache constraints.
27×
faster prefill on a second turn: Qwen3-1.7B on ExecuTorch, reusing 1,192 tokens
- First turn5,852 ms
- Second turn215 ms






