Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,161

Base only

Active filters: granite

ibm-granite/granite-4.1-8b

Text Generation • 9B • Updated May 4 • 2.27M • 221

ibm-granite/granite-docling-258M

Image-Text-to-Text • 0.3B • Updated Sep 23, 2025 • 74.6k • 1.22k

ibm-granite/granite-4.1-3b

Text Generation • 3B • Updated May 4 • 356k • 91

ibm-granite/granite-embedding-311m-multilingual-r2

Feature Extraction • 0.3B • Updated May 18 • 49.5k • • 112

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5-GGUF

Text Generation • 8B • Updated 2 days ago • 858 • 2

AnkitAI/Parable-Granite-4.1-8B-Claude-Fable-5

Text Generation • 8B • Updated 4 days ago • 1.16k • 2

cobrakenji/granite-3b-code-base-Q5_K_M-GGUF

Text Generation • 3B • Updated May 11, 2024 • 38 • 1

mozilla-ai/granite-34b-code-instruct-llamafile

Text Generation • Updated Jul 17, 2024 • 120 • 6

ibm-granite/granite-embedding-125m-english

Sentence Similarity • 0.1B • Updated Aug 19, 2025 • 41.8k • • 38

glogwa68/granite-4.0-h-tiny-DISTILL-OPUS-4.5-think-GGUF

Text Generation • 7B • Updated Dec 23, 2025 • 518 • 1

ibm-granite/granite-4.1-30b

Text Generation • 29B • Updated May 4 • 68.5k • 137

beaupi/granite-embedding-97m-multilingual-r2-oQ8

Feature Extraction • 27.4M • Updated Apr 29 • 46 • 1

roger33303/Jarvis_granite_4.1_3b_finetuned_gguf

3B • Updated 27 days ago • 844 • 1

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5-GGUF

Text Generation • 3B • Updated about 24 hours ago • 773 • 1

AnkitAI/Parable-Granite-4.1-3B-Claude-Fable-5

Text Generation • 3B • Updated 2 days ago • 460 • 1

litert-community/granite-4.0-350m-litert-lm

Text Generation • Updated 3 days ago • 91 • 1

instructlab/granite-7b-lab

Text Generation • 7B • Updated Jun 5, 2024 • 131 • • 43

instructlab/granite-7b-lab-GGUF

7B • Updated Apr 24, 2024 • 574 • 26

ibm-granite/granite-20b-code-base-8k

Text Generation • 20B • Updated Apr 25 • 1.05k • 14

ibm-granite/granite-8b-code-base-4k

Text Generation • 8B • Updated Apr 25 • 1.24k • 30

ibm-granite/granite-34b-code-base-8k

Text Generation • 34B • Updated Apr 25 • 87 • 20

ibm-granite/granite-3b-code-base-2k

Text Generation • 3B • Updated Apr 25 • 18.4k • 38

ibm-granite/granite-3b-code-instruct-2k

Text Generation • 3B • Updated Apr 25 • 3.29k • 40

ibm-granite/granite-8b-code-instruct-4k

Text Generation • 8B • Updated Apr 25 • 4.5k • 115

ibm-granite/granite-20b-code-instruct-8k

Text Generation • 20B • Updated Apr 25 • 7.08k • 43

ibm-granite/granite-34b-code-instruct-8k

Text Generation • 34B • Updated Apr 25 • 345 • 78

mlx-community/granite-20b-code-instruct-4bit

Text Generation • 3B • Updated May 14, 2024 • 22

mlx-community/granite-20b-code-instruct-8bit

Text Generation • 6B • Updated May 14, 2024 • 12

mlx-community/granite-20b-code-base-4bit

Text Generation • 3B • Updated May 14, 2024 • 9

mlx-community/granite-20b-code-base-8bit

Text Generation • 6B • Updated May 14, 2024 • 10