Show HN: KV-psi, using Linux PSI to to trim an LLM KV cache

8 points | by infiniteregrets a day ago