Key-Value Means
Paper • 2605.09877 • Published • 25
Dan Goldstein
SmerkyG
AI & ML interests
None yet
Recent Activity
upvoted a paper 18 days ago
Normalized Low-Rank Adaptation updated a dataset 3 months ago
SmerkyG/dclm-10B published a dataset 3 months ago
SmerkyG/dclm-10BOrganizations
submitted a
paper to Daily Papers 4 months ago
authored 4
papers over 1 year ago
RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale
Paper • 2505.03005 • Published • 36
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Paper • 2404.05892 • Published • 39
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
Paper • 2407.12077 • Published • 56
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 155