Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs
Paper
•
2512.03324
•
Published
Ngoc Bui
ngocbh
·
AI & ML interests
None yet
Recent Activity
authored
a paper
16 days ago
Cache What Lasts: Token Retention for Memory-Bounded KV Cache in LLMs
updated
a model
16 days ago
ngocbh/TrimKV-DeepSeek-R1-Distill-Llama-8B
updated
a model
16 days ago
ngocbh/TrimKV-Qwen3-14B-Math
Organizations
None yet
authored
a
paper
16 days ago