Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

884

Full-text search

Active filters: autoround

fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 25 • 6

hell0ks/command-a-translate-08-2025-AutoRound-GPTQ-4bit

Text Generation • 3B • Updated Sep 30 • 33 • 1

hell0ks/Smoothie-Seed-OSS-36B-Instruct-AutoRound-GPTQ-4bit

Text Generation • 2B • Updated Oct 9 • 29 • 1

hell0ks/Mistral-Large-Instruct-2411-AutoRound-GPTQ-4bit

Text Generation • 0.8B • Updated Oct 4 • 12

groxaxo/Qwen3-32B-Uncensored-Autoround-int4

2B • Updated Oct 9 • 22 • 1

hell0ks/Behemoth-X-123B-v2.1-AutoRound-GPTQ-4bit

Text Generation • 0.8B • Updated Oct 18 • 13

winninghealth/olmOCR-2-7B-1025-INT4

Image-to-Text • 2B • Updated Oct 23 • 125k

kaitchup/Qwen3-VL-2B-Instruct-W4A16

0.9B • Updated Nov 5 • 28 • 2

kaitchup/Qwen3-VL-8B-Instruct-W4A16

2B • Updated Nov 5 • 72

kaitchup/Qwen3-VL-8B-Instruct-NVFP4

2B • Updated Nov 5 • 50

hell0ks/Mistral-Large-Instruct-2407-AutoRound-GPTQ-4bit

Text Generation • 0.8B • Updated Nov 7 • 15

zandzpider/Qwen3-30B-A3B-abliterated-erotic-autoround-int4

0.6B • Updated 21 days ago • 23

0xSero/GLM-4.6-REAP-218B-A32B-W4A16-AutoRound

Text Generation • 2B • Updated 16 days ago • 508 • 3

TomoroAI/tomoro-ai-colqwen3-embed-8b-awq

Visual Document Retrieval • 2B • Updated 2 days ago • 18