Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43

Base only

Active filters: fp_quant

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-MXFP4

Text Generation • 5B • Updated Jul 15, 2025 • 35

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-GPTQ-MXFP4

5B • Updated Jul 20, 2025 • 18

ISTA-DASLab/Qwen3-8B-FPQuant-RTNv2-MXFP4

5B • Updated Jul 19, 2025 • 15

ISTA-DASLab/Qwen3-8B-FPQuant-GPTQ-MXFP4

5B • Updated Jul 24, 2025 • 23

ISTA-DASLab/Qwen3-14B-FPQuant-GPTQ-MXFP4

9B • Updated Jul 24, 2025 • 17

ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4

18B • Updated Jul 24, 2025 • 18

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-MXFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 50 • 1

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-NVFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 40

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-MXFP4

Text Generation • 2B • Updated Aug 4, 2025 • 38

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-NVFP4

Text Generation • 2B • Updated Aug 4, 2025 • 41

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-NVFP4

Text Generation • 1B • Updated Aug 4, 2025 • 41

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-MXFP4

Text Generation • 1B • Updated Aug 4, 2025 • 37

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-NVFP4

Text Generation • 5B • Updated Aug 4, 2025 • 36

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-200steps

Text Generation • 1B • Updated Aug 10, 2025 • 44

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-600steps

Text Generation • 1B • Updated Aug 10, 2025 • 32

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-200steps

Text Generation • 5B • Updated Aug 10, 2025 • 29

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-600steps

Text Generation • 5B • Updated Aug 10, 2025 • 26

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1400steps

Text Generation • 5B • Updated Aug 11, 2025 • 23

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1000steps

Text Generation • 5B • Updated Aug 11, 2025 • 26

ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-nvfp

Image-Text-to-Text • 5B • Updated Oct 3, 2025 • 28

ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-mxfp

Image-Text-to-Text • 5B • Updated Oct 3, 2025 • 29

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4

5B • Updated Oct 27, 2025 • 54

ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4

0.8B • Updated Oct 27, 2025 • 23

ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4

0.8B • Updated Oct 27, 2025 • 23

ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4

2B • Updated Oct 27, 2025 • 52 • 1

ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4

2B • Updated Oct 27, 2025 • 14

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-MXFP4

5B • Updated Oct 27, 2025 • 210

ISTA-DASLab/Qwen3-0.6B-FPQuant-QAT-NVFP4

Text Generation • 0.4B • Updated Oct 16, 2025 • 30

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4

Text Generation • 1B • Updated Oct 16, 2025 • 42

ISTA-DASLab/Qwen3-4B-FPQuant-QAT-NVFP4

Text Generation • 2B • Updated Oct 16, 2025 • 118 • 1