squeezebits/Llama-3.1-8B-Instruct-FP8-dynamic
8B • Updated
AI & ML interests
SqueezeBits is building an ecosystem for designing, training, and deploying highly compressed Neural Networks.
Recent Activity
View all activity
models 8
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16
2B • Updated • 1
squeezebits/Llama-3.1-8B-Instruct-quantized.w4a16.per_channel
2B • Updated • 11
squeezebits/kanana-1.5-2.1b-instruct-2505-mlx
Text Generation • 0.4B • Updated • 1
squeezebits/Qwen3-32B-AWQ
33B • Updated • 1
squeezebits/Qwen3-32B-AWQ-G32
33B • Updated
squeezebits/Qwen-32B-FP8-Dynamic
Text Generation • 33B • Updated • 1
squeezebits/dummy_slm
Text Generation • 13.4M • Updated • 6