Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,277

Base only

Active filters: 4-bit

Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32

Text-to-Image • Updated Dec 3, 2025 • 14k • 56

unsloth/Ministral-3-14B-Reasoning-2512-unsloth-bnb-4bit

14B • Updated Dec 6, 2025 • 361 • 2

ZanderM98/Qwen3-Embedding-8B-bnb-4bit

Feature Extraction • 8B • Updated Dec 2, 2025 • 654 • 2

mlx-community/Ministral-3-3B-Instruct-2512-4bit

Updated Dec 3, 2025 • 21.9k • 5

mlx-community/LFM2.5-VL-1.6B-4bit

Image-Text-to-Text • 0.6B • Updated Jan 6 • 5.12k • 3

steampunque/GLM-4.7-Flash-MP-GGUF

30B • Updated about 11 hours ago • 367 • 1

mlx-community/DeepSeek-OCR-2-4bit

Image-Text-to-Text • 0.9B • Updated Jan 28 • 241 • 1

campedersen/cad0

Text Generation • 8B • Updated Feb 4 • 80 • 1

sitatech/Qwen3-VL-8B-Instruct-GPTQ-Int4

Image-Text-to-Text • 9B • Updated Feb 6 • 331 • 1

lmstudio-community/MiniMax-M2.5-MLX-4bit

Text Generation • 229B • Updated Feb 13 • 22k • 1

tokyotech-llm/Qwen3-Swallow-8B-RL-v0.2-AWQ-INT4

Text Generation • 8B • Updated Feb 23 • 975 • 1

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 347 • 14

saricles/Qwen3-Coder-Next-NVFP4-GB10

Text Generation • Updated Mar 1 • 8.69k • 28

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated Feb 24 • 96.6k • 47

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated Feb 24 • 10.9k • 14

aufklarer/Qwen3-ASR-0.6B-MLX-4bit

0.3B • Updated Apr 12 • 106k • 3

TheCluster/Qwen3.5-9B-Heretic-MLX-mxfp4

Image-Text-to-Text • 2B • Updated Apr 25 • 717 • 9

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated Apr 24 • 41.9k • 29

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated Apr 24 • 449k • 55

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated Apr 24 • 1.01M • 85

lukey03/Qwen3.5-9B-abliterated-MLX-4bit

Text Generation • 1B • Updated Mar 3 • 1.16k • 10

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated Mar 6 • 38.4k • 203

z-lab/Qwen3.5-9B-PARO

Image-Text-to-Text • 3B • Updated 15 days ago • 57.6k • 52

aufklarer/Qwen3-ASR-1.7B-MLX-4bit

Automatic Speech Recognition • 0.9B • Updated Apr 12 • 823 • 2

baicai1145/s2-pro-w4a16

Text-to-Speech • 5B • Updated Mar 10 • 216 • 8

Jackrong/MLX-Qwen3.5-9B-Gemini-3.1-Pro-Reasoning-Distill-4bit

Text Generation • 1B • Updated Mar 11 • 102 • 2

dataslab/DLM-2.0-14B-GPTQ

Text Generation • 3B • Updated about 1 month ago • 6 • 2

dataslab/DLM-2.1-14B-GPTQ

Text Generation • 3B • Updated about 1 month ago • 5 • 2

TheCluster/Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive-MLX-mxfp4

Image-Text-to-Text • 35B • Updated Mar 18 • 4.24k • 13

Jackrong/MLX-Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-v2-4bit

Text Generation • 0.7B • Updated Mar 19 • 289 • 6