Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

222

Base only

Active filters: mxfp8

Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX

Text Generation • 59B • Updated 6 days ago • 8.82k • 14

DreamFast/Qwen3-VL-4b-Heretic-ComfyUI

Image-Text-to-Text • Updated 23 days ago • 58

DreamFast/gemma-3-12b-it-heretic-v2

Text Generation • 12B • Updated 23 days ago • 12.5k • • 85

MiniMaxAI/MiniMax-M3-MXFP8

Image-Text-to-Text • 440B • Updated 29 days ago • 471k • 51

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 22

TheCluster/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Apr 25 • 8.17k • 35

OsaurusAI/VibeThinker-3B-MXFP8

Text Generation • 0.9B • Updated Jun 18 • 145 • 1

OsaurusAI/Qwen-AgentWorld-35B-A3B-MXFP8

Text Generation • 10B • Updated Jun 25 • 313 • 5

OsaurusAI/Ornith-1.0-9B-MXFP8

Image-Text-to-Text • 3B • Updated Jun 26 • 654 • 2

madeby561/GLM-5.2-MXFP8-NVFP4-NF3-Hybrid

318B • Updated 12 days ago • 2.71k • 68

nightmedia/Qwen3.5-9B-DS9-USS-Defiant

Image-Text-to-Text • 10B • Updated 28 days ago • 250 • 2

nightmedia/Qwen3.5-9B-Holodeck-Lounge-q8-hi-mlx

Image-Text-to-Text • 3B • Updated 13 days ago • 541 • 3

jacklarmer/GLM-5.2-Abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 318B • Updated 10 days ago • 168 • 4

LibraxisAI/Qwen3-VL-235B-A22B-Instruct-mlx-mxfp8

Image-Text-to-Text • 67B • Updated May 11 • 106 • 1

nightmedia/Qwen3-MOE-4x8B-Janus-Blossom-Claude-Gemini-mxfp8-mlx

Text Generation • 24B • Updated Jan 31 • 22

Foxtr0t/Ministral-3-14B-Reasoning-2512-mlx-mxfp8

4B • Updated Feb 8 • 21

vincentzed-hf/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Feb 11 • 25 • 1

TheCluster/GLM-4.6V-Flash-Heretic-MLX-mxfp8

Image-Text-to-Text • 10B • Updated Feb 27 • 43

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-mxfp8

Image-Text-to-Text • 35B • Updated Apr 17 • 74 • 4

zianglih/Qwen3-30B-A3B-MXFP8

Text Generation • 31B • Updated Mar 2 • 20

zianglih/Qwen3-30B-A3B-Instruct-2507-MXFP8

Text Generation • 31B • Updated Mar 2 • 3.71k

TheCluster/Qwen3.5-9B-Heretic-MLX-mxfp8

Image-Text-to-Text • 9B • Updated Mar 15 • 75 • 2

AxionML/Kimi-K2.5-MXFP8

Image-Text-to-Text • 1T • Updated Mar 3 • 672

zianglih/Qwen2.5-0.5B-Instruct-MXFP8

Text Generation • 0.5B • Updated Mar 4 • 24

TheCluster/Qwen3.5-4B-Heretic-MLX-mxfp8

Image-Text-to-Text • 1B • Updated Mar 5 • 59 • 2

TheCluster/Qwen3.5-27B-Heretic-Text-MLX-mxfp8

Text Generation • 27B • Updated Mar 8 • 17

AITRADER/Jackrong-Qwen3.5-9B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 3B • Updated Mar 13 • 257 • 3

AITRADER/Jackrong-Qwen3.5-2B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 0.9B • Updated Mar 13 • 33

AITRADER/Jackrong-Qwen3.5-4B-Claude-Reasoning-abliterated-mxfp8-MLX

Text Generation • 2B • Updated Mar 13 • 32 • 1

zianglih/Qwen3-30B-A3B-Instruct-2507-MXFP8-last-8-BF16

Text Generation • 31B • Updated Mar 9 • 30