DeepSeek Input Is 50x Cheaper, but You May Never Hit the Cache

DeepSeek Input Is 50x Cheaper, but You May Never Hit the Cache

A cache hit costs 0.02 yuan and a miss costs 1 yuan per million tokens, a 50x gap. I measured it locally: the hit rate is roughly the share of tokens before your insertion point, so inserting at the start keeps 7% while appending at the end keeps 97%.

2026-11-17 · 6 min · 1260 words · Trevor Wang