Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

67

Base only

Active filters: mac

brabooObrabo/Qwen3-4B-Instruct-2507-MLX-4bit-GS32-embed-8bit-GS32

Text Generation • 4B • Updated Oct 7, 2025 • 44

caiovicentino1/Qwen3.5-9B-HLWQ-MLX-4bit

Text Generation • 9B • Updated Apr 13 • 74 • 5

Outlier-Ai/Outlier-10B

Text Generation • Updated May 5 • 30 • 2

Outlier-Ai/Outlier-10B-V2

Text Generation • 8B • Updated May 5 • 27 • 1

Outlier-Ai/Outlier-40B

Text Generation • 15B • Updated May 5 • 22 • 1

mradermacher/Outlier-10B-V2-GGUF

Text Generation • 8B • Updated Apr 30 • 64 • 1

ancs21/parakeet-ctc-0.6b-vi-coreml

Automatic Speech Recognition • Updated Apr 10

Outlier-Ai/Outlier-70B-V3.2

Text Generation • Updated May 5 • 25 • 3

Outlier-Ai/Outlier-40B-V3.2

Text Generation • Updated May 5 • 28 • 1

Outlier-Ai/Outlier-150B-V3.2

Text Generation • Updated May 5 • 336 • 1

Outlier-Ai/Outlier-10B-V3.2

Text Generation • 23B • Updated May 5 • 37 • 1

Outlier-Ai/Outlier-70B-V3.3

Text Generation • Updated May 5 • 12 • 1

worthdoing/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 67

worthdoing/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Apr 17 • 85

worthdoing/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 17 • 158

worthdoing/Phi-4-mini-GGUF

Text Generation • 4B • Updated Apr 17 • 145

worthdoing/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 17 • 44

worthdoing/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 149

worthdoing/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Apr 17 • 288

worthdoing/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Apr 17 • 57

worthdoing/Stablelm-2-Zephyr-1.6B-GGUF

Text Generation • 2B • Updated Apr 17 • 63

worthdoing/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Apr 17 • 36

worthdoing/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Apr 17 • 44

worthdoing/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated Apr 17 • 341

worthdoing/Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation • 47B • Updated Apr 17 • 52

Outlier-Ai/Outlier-Compact-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 18

Outlier-Ai/Outlier-Nano-1.7B-MLX-4bit

Text Generation • 2B • Updated May 5 • 26

Outlier-Ai/Outlier-Lite-7B-MLX-4bit

Text Generation • 8B • Updated May 5 • 19

Outlier-Ai/Outlier-Lite-7B-GGUF

Text Generation • 8B • Updated May 5 • 50

Outlier-Ai/Outlier-Compact-14B-GGUF

Text Generation • 15B • Updated May 5 • 59 • 1