Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

34

Base only

Active filters: 1.58bit

rileyseaburg/distillix-100m-v0.4

Text Generation • 0.1B • Updated Jan 3 • 20

kgrabko/JiRackTernary_1b

Text Generation • 1B • Updated Jun 16 • 126 • 5

kgrabko/JiRackTernary_70b

Text Generation • Updated about 7 hours ago • 266 • 6

kgrabko/JiRackTernary_405b

Text Generation • 108B • Updated about 7 hours ago • 60 • 4

TT0518/qwen25-3b-1.58bit-qat

3B • Updated Apr 29 • 74

Cukinator/cpu1-ablations-final

Text Generation • Updated Jun 13

FiShota/hinomoto-1b-bitnet158-v1

Text Generation • 1.0B • Updated May 18 • 6

CMSManhattan/JiRackTernaryPro_1b

Text Generation • 1B • Updated about 7 hours ago • 208 • 1

MicheRomChis/micro-terse

Text Generation • 0.4B • Updated Jun 26 • 19

ShiningSon/Leviathan-MLGRU-30M-TinyStories-Instruct-v02b

Text Generation • Updated Jun 30

ShiningSon/Leviathan-MLGRU-30M-TinyStories-Instruct-v02g

Text Generation • Updated Jul 2

ShiningSon/Leviathan-MLGRU-70M-TinyStories-Instruct-v07b

Text Generation • Updated Jul 7

ShiningSon/Leviathan-MLGRU-100M-TinyStories-Instruct-v08a

Text Generation • Updated Jul 7

ShiningSon/Leviathan-MLGRU-200M-TinyStories-Instruct-v09a

Text Generation • Updated Jul 9

brianbellx/ternary15M

Text Generation • Updated Jul 24 • 3

CMSManhattan/JiRackUltra_7b

Text Generation • 8B • Updated about 7 hours ago • 9.99k • 1

CMSManhattan/JiRackUltra_1b

Text Generation • 2B • Updated about 7 hours ago • 5.6k

mradermacher/JiRackUltra_7b-GGUF

Text Generation • 8B • Updated about 1 month ago • 488

CMSManhattan/JiRackUltra_14b

Text Generation • 15B • Updated about 7 hours ago • 71.3k • 1

mradermacher/JiRackUltra_7b-i1-GGUF

Text Generation • 8B • Updated about 1 month ago • 847

CMSManhattan/JiRackUltra_32b

Text Generation • 33B • Updated about 7 hours ago • 8.31k

mradermacher/JiRackUltra_1b-GGUF

Text Generation • 2B • Updated about 1 month ago • 218

mradermacher/JiRackUltra_1b-i1-GGUF

Text Generation • 2B • Updated about 1 month ago • 523

mradermacher/JiRackUltra_14b-GGUF

Text Generation • 15B • Updated about 1 month ago • 349 • 1

mradermacher/JiRackUltra_32b-GGUF

Text Generation • 33B • Updated 30 days ago • 533

mradermacher/JiRackUltra_14b-i1-GGUF

Text Generation • 15B • Updated about 1 month ago • 954 • 1

mradermacher/JiRackUltra_32b-i1-GGUF

Text Generation • 33B • Updated about 1 month ago • 1.06k

Ooriginador/Granite-3.2-2B-ArkCompact-1.58bit

Text Generation • Updated 7 days ago

Ooriginador/Qwen2.5-Coder-1.5B-ArkCompact-1.58bit

Text Generation • Updated 7 days ago

Ooriginador/LLaMA-3.2-3B-ArkCompact-1.58bit

Text Generation • Updated 7 days ago