Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,621

Base only

Active filters: on-device

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated about 12 hours ago • 2.88k • 632

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated about 10 hours ago • 7.76k • 116

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 8 days ago • 639k • • 1.29k

Cactus-Compute/needle2

Text Generation • Updated 5 days ago • 52.2k • 285

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated 22 days ago • 724k • 1.11k

openbmb/MiniCPM5-2B-DSpark

Text Generation • 0.3B • Updated 2 days ago • 344 • 25

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 458k • 843

openbmb/MiniCPM5-2B-SFT

Text Generation • 3B • Updated about 10 hours ago • 47 • 20

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated about 10 hours ago • 288 • 20

openbmb/MiniCPM5-2B-Midtrain

Text Generation • 3B • Updated about 10 hours ago • 51 • 17

openbmb/MiniCPM5-2B-Base

Text Generation • 3B • Updated about 10 hours ago • 54 • 17

Abiray/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated about 16 hours ago • 7 • 12

openbmb/MiniCPM5-2B-GPTQ

Text Generation • 3B • Updated about 10 hours ago • 82 • 12

samuel-vitorino/sopro-v2-turbo

Text-to-Speech • 0.1B • Updated 8 days ago • 992 • 27

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 121k • 779

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 29.7k • 943

dogenthq/KorvaTTS

Text-to-Speech • Updated 6 days ago • 6

openbmb/MiniCPM5-1B-Base

Text Generation • 1B • Updated 22 days ago • 8.91k • 18

facebook/MobileMoE-L-QAT

Text Generation • 3B • Updated 10 days ago • 12 • 6

facebook/MobileMoE-S-Base

Text Generation • 1B • Updated 14 days ago • 214 • 14

desert-ant-labs/voz

Automatic Speech Recognition • Updated 6 days ago • 4

NANI-Nithin/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated about 22 hours ago • 1.3k • 4

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 21.6k • 60

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.34M • 235

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated 22 days ago • 36.6k • 251

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 374k • 148

PeppX/gemma-4-e2b-uncensored-litertlm

Updated Jul 17 • 3.26k • 21

facebook/MobileMoE-S-QAT

Text Generation • 0.7B • Updated 10 days ago • 144 • 5

qvac/VisionPsy-Nano-460M

Image-Text-to-Text • 0.5B • Updated Jul 29 • 1.27k • 22

zaakirio/kokoro-ru

Text-to-Speech • Updated 14 days ago • 10.1k • 5