Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

61

Base only

Active filters: tensorrt-llm

Shoolife/Phi-4-mini-instruct-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 26 • 8

Shoolife/Qwen2.5-1.5B-Instruct-TensorRT-LLM-Checkpoint-BF16

Text Generation • Updated Mar 29 • 5

Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-BF16

Text Generation • Updated Mar 29 • 7

Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-FP16

Text Generation • Updated Mar 29 • 7

Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 3

Shoolife/Qwen3-0.6B-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 8

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-BF16

Text Generation • Updated Mar 29 • 7

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP16

Text Generation • Updated Mar 29 • 7

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 4

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 7

Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 4

Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 7

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated Apr 2 • 2

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated Apr 2 • 1

sbull-dell/gemma-4-26B-A4B-NVFP4

14B • Updated Apr 17 • 69

GumbiiDigital/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Apr 23 • 20 • 1

SCIO911/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV

Text Generation • 8B • Updated May 6 • 20

tss-deposium/gemma-4-E4B-text-only-nvfp4

Text Generation • 6B • Updated May 8 • 29

tss-deposium/PaddleOCR-VL-1.5-nvfp4

Image-Text-to-Text • 0.6B • Updated May 10 • 6

tss-deposium/PaddleOCR-VL-1.5-mxfp4

Image-Text-to-Text • 0.8B • Updated May 10 • 7

Reza2kn/mega-asr-nvfp4

Automatic Speech Recognition • Updated May 22

BareMetalAI/Qwen3-4B-W4A16-AWQ

Text Generation • 2B • Updated Jun 9 • 9

BareMetalAI/Qwen3-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 13

BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 48

BareMetalAI/Mistral-7B-Instruct-v0.3-W4A16-AWQ

Text Generation • 4B • Updated Jun 12 • 9

Luni/Ornith-1.0-9B-NVFP4-AWQ

Text Generation • 6B • Updated 26 days ago • 4.03k • 3

xThr45hx/TensorRT-LLM-Windows-RTX40

Updated 21 days ago

xThr45hx/Josiefied-Qwen3-4B-TRT-LLM

Updated 21 days ago

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-bf16

Text Generation • Updated 19 days ago • 236

Quatfit/Quatfit-Mini-FP8

Image-Text-to-Text • 8B • Updated 10 days ago • 79 • 1