Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,564

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 7 days ago • 638k • • 1.28k

Cactus-Compute/needle2

Text Generation • Updated 4 days ago • 51.2k • 278

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 462k • 841

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated 21 days ago • 737k • 1.11k

samuel-vitorino/sopro-v2-turbo

Text-to-Speech • 0.1B • Updated 6 days ago • 757 • 27

facebook/MobileMoE-S-Base

Text Generation • 1B • Updated 13 days ago • 211 • 14

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 120k • 778

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 29.4k • 942

dogenthq/KorvaTTS

Text-to-Speech • Updated 5 days ago • 6

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.41M • 235

FermionResearch/Phonon-1

Automatic Speech Recognition • Updated 5 days ago • 218 • 9

desert-ant-labs/voz

Automatic Speech Recognition • Updated 5 days ago • 4

PeppX/gemma-4-e2b-uncensored-litertlm

Updated Jul 17 • 3.16k • 21

openbmb/MiniCPM5-1B-GGUF

Text Generation • 1B • Updated 21 days ago • 36.7k • 249

facebook/MobileMoE-L-QAT

Text Generation • 3B • Updated 8 days ago • 12 • 5

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 21.2k • 59

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 5.48k • 34

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 372k • 148

DuoNeural/Gemma-4-Abliterated-LiteRT

Text Generation • Updated May 1 • 17

openbmb/MiniCPM5-1B-Base

Text Generation • 1B • Updated 21 days ago • 9.45k • 15

facebook/MobileMoE-L-SFT

Text Generation • 5B • Updated 11 days ago • 35 • 3

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.4M • 186

qvac/VisionPsy-Nano-460M

Image-Text-to-Text • 0.5B • Updated Jul 29 • 1.28k • 22

zaakirio/kokoro-ru

Text-to-Speech • Updated 13 days ago • 10k • 5

badtheorylabs/Macaw

Text Generation • 3B • Updated Aug 7 • 376 • 11

litert-community/Neo_Dragon

Text-to-Video • Updated 5 days ago • 45 • 2

Shusek00/kokoro-kmp-models

Text-to-Speech • Updated 3 days ago • 2

pnnbao-ump/VieNeu-TTS-v3-Nano

Text-to-Speech • Updated 2 days ago • 426 • 2

abr-ai/niagara-19m-batch.en

Automatic Speech Recognition • Updated 11 days ago • 144 • 11

xuanwulab/HaS_Image_0209_FP32

Image Segmentation • Updated Mar 3 • 79 • 4