Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

164

Base only

Active filters: 2bit

majentik/Ornith-1.0-35B-MLX-2bit

Image-Text-to-Text • 4B • Updated Jul 4 • 206

majentik/Qwen-AgentWorld-35B-A3B-MLX-2bit

Text Generation • 3B • Updated Jul 4 • 77 • 1

majentik/Qwen3-Coder-Next-MLX-2bit

Text Generation • 80B • Updated Jul 4 • 256

majentik/Qwen3.6-27B-MLX-2bit

Image-Text-to-Text • 3B • Updated 23 days ago • 162

sapidlabs/GLM-5.2-2bit-MoE-planes-pruned208-tp2

Text Generation • Updated Jul 13 • 2

9prodhi/DeepSeek-V4-Flash-moet2pf

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated Jul 18 • 36 • 1

MarkChen1214/cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 0.2B • Updated Jul 18 • 49 • 1

mlx-community/Laguna-S-2.1-OptiQ-2bit

Text Generation • 118B • Updated Jul 31 • 508 • 2

mlx-community/DeepSeek-V4-Flash-0731-OptiQ-2bit

Text Generation • 26B • Updated 8 days ago • 7.31k • 10

9prodhi/Qwen3.6-35B-A3B-moet2pf

Text Generation • Updated 23 days ago

AutomatosX/AX-DeepSeek-V4-Flash-MLX-AXQ-2bit-MTP

Text Generation • 38B • Updated 12 days ago • 1.3k

bombdefuser-124/Qwen3.8-27B-heretic-ara-exl3-2.00bpw

Image-Text-to-Text • 5B • Updated 17 days ago • 42

asjadilahi/danAI-55M-Reasoning

Text Generation • 54.5M • Updated 7 days ago • 810 • 11