Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,229

Base only

Active filters: vllm

crushleorey/Qwopus3.6-27B-v2-NVFP4

Image-Text-to-Text • 15B • Updated 6 days ago • 5.69k • 2

mistralai/Mixtral-8x7B-Instruct-v0.1

47B • Updated Jul 24, 2025 • 893k • 4.69k

mistralai/Mixtral-8x22B-v0.1

141B • Updated Jul 24, 2025 • 4.97k • 238

RedHatAI/DeepSeek-Coder-V2-Lite-Instruct-FP8

Text Generation • 16B • Updated Jul 18, 2024 • 153k • 13

mistralai/Ministral-8B-Instruct-2410

8B • Updated Jul 31, 2025 • 267k • 580

mistralai/Mistral-Large-Instruct-2411

123B • Updated Jul 28, 2025 • 11.5k • 260

mradermacher/Mistral-Small-24B-Instruct-2501-i1-GGUF

24B • Updated Jul 25, 2025 • 564 • 6

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • 8B • Updated Apr 10, 2025 • 1.59k • • 362

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8

Text Generation • 24B • Updated Oct 29, 2025 • 16k • 2

mistralai/Voxtral-Mini-3B-2507

5B • Updated Jul 28, 2025 • 447k • 653

mistralai/Voxtral-Small-24B-2507

Audio-Text-to-Text • 24B • Updated Dec 20, 2025 • 46.7k • 496

ByteDance-Seed/Seed-OSS-36B-Instruct

Text Generation • 36B • Updated Aug 26, 2025 • 37.3k • 499

RedHatAI/gpt-oss-20b

Text Generation • 22B • Updated Apr 28 • 26.8k • 6

unsloth/Magistral-Small-2509-GGUF

24B • Updated Sep 17, 2025 • 12.8k • 100

openai/gpt-oss-safeguard-120b

Text Generation • 120B • Updated Oct 29, 2025 • 39.4k • 97

KaLM-Embedding/KaLM-embedding-multilingual-mini-instruct-v2.5

Feature Extraction • 0.5B • Updated Apr 22 • 4.71k • 61

mistralai/Ministral-3-8B-Instruct-2512-BF16

9B • Updated Jan 15 • 51.5k • 21

mistralai/Ministral-3-14B-Instruct-2512-BF16

14B • Updated Jan 15 • 15.3k • 22

mistralai/Ministral-3-14B-Reasoning-2512

14B • Updated Jan 15 • 14.1k • 138

mistralai/Ministral-3-8B-Instruct-2512

9B • Updated Jan 15 • 185k • 172

mistralai/Ministral-3-14B-Instruct-2512-GGUF

14B • Updated Jan 15 • 7.09k • 58

tencent/KaLM-Embedding-Gemma3-12B-2511

Sentence Similarity • 12B • Updated Feb 10 • 86.7k • 95

mistralai/Devstral-2-123B-Instruct-2512

125B • Updated Feb 25 • 10.3k • 322

unsloth/Ministral-3-14B-Reasoning-2512-GGUF

14B • Updated Dec 4, 2025 • 15.5k • 47

unsloth/Ministral-3-3B-Reasoning-2512-GGUF

3B • Updated Dec 4, 2025 • 9.78k • 18

unsloth/Ministral-3-8B-Instruct-2512-GGUF

8B • Updated Dec 4, 2025 • 14k • 34

mlx-community/Ministral-3-3B-Instruct-2512-4bit

Updated Dec 3, 2025 • 21.7k • 5

GadflyII/GLM-4.6V-NVFP4

Image-Text-to-Text • 62B • Updated Jan 12 • 684 • 11

mistralai/Voxtral-Mini-4B-Realtime-2602

Automatic Speech Recognition • 4B • Updated Mar 11 • 1.19M • 861

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 45.3k • 26