relaxml
/

Llama-2-13b-chat-E8P-2Bit

Text Generation

text-generation-inference

Model card Files Files and versions

No model card

Downloads last month: 6

Safetensors

Model size

0.7B params

Tensor type

I64

·

F16

·

Collection including relaxml/Llama-2-13b-chat-E8P-2Bit

QuIP# Quantized Models

https://github.com/Cornell-RelaxML/quip-sharp • 16 items • Updated 5 days ago • 3