GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper
•
2210.17323
•
Published
•
10
4-bit GPTQ quantized version of openhands-lm-32b-v0.1 for use with the Private LLM app.
- Downloads last month
- -
Model tree for numen-tech/openhands-lm-32b-v0.1-GPTQ-Int4
Base model
Qwen/Qwen2.5-32B
Finetuned
Qwen/Qwen2.5-Coder-32B
Finetuned
Qwen/Qwen2.5-Coder-32B-Instruct
Finetuned
OpenHands/openhands-lm-32b-v0.1