Models

229

Full-text search

Active filters: llm-compressor

brandonbeiler/InternVL3_5-GPT-OSS-20B-A4B-Preview-FP8-Dynamic

Image-Text-to-Text • 21B • Updated Aug 30, 2025 • 19 • 2

brandonbeiler/InternVL3_5-14B-FP8-Dynamic

Image-Text-to-Text • 15B • Updated Aug 28, 2025 • 29

brandonbeiler/InternVL3_5-8B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated Aug 28, 2025 • 148 • 1

brandonbeiler/InternVL3_5-4B-FP8-Dynamic

Image-Text-to-Text • 5B • Updated Aug 28, 2025 • 5

brandonbeiler/InternVL3_5-2B-FP8-Dynamic

Image-Text-to-Text • 2B • Updated Aug 28, 2025 • 12 • 1

brandonbeiler/InternVL3_5-1B-FP8-Dynamic

Image-Text-to-Text • 1B • Updated Aug 28, 2025 • 34

benyamini/DSR1-8B-llmc-awq-w4

Text Generation • 2B • Updated Aug 29, 2025 • 5

edge-inference/DSR1-8B-llmc-awq-w4

Text Generation • 2B • Updated Aug 30, 2025 • 4

edge-inference/DSR1-14B-llmc-awq-w4

Text Generation • 3B • Updated Aug 30, 2025 • 2

edge-inference/DSR1-32B-llmc-awq-w4

Text Generation • 6B • Updated Aug 30, 2025 • 3

edge-inference/DSR1-1.5B-llmc-awq-w4

Text Generation • 0.6B • Updated Aug 30, 2025 • 3 • 1

kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-16klen-NVFP4

1B • Updated Sep 8, 2025

kaitchup/Qwen3-1.7B-calib-OpenR1-Math-220k-2klen-NVFP4

1B • Updated Sep 8, 2025 • 1

kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-16klen-NVFP4

3B • Updated Sep 8, 2025 • 1

kaitchup/Qwen3-4B-calib-OpenR1-Math-220k-2klen-NVFP4

3B • Updated Sep 8, 2025 • 1

itroot/Qwen3-4B-Instruct-2507-W8A8

Text Generation • 4B • Updated Sep 24, 2025 • 10

RedHatAI/Apertus-8B-Instruct-2509-FP8-dynamic

Text Generation • 8B • Updated 22 days ago • 323 • 3

RedHatAI/Apertus-70B-Instruct-2509-FP8-dynamic

Text Generation • 71B • Updated Sep 30, 2025 • 85 • 1

RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16

Text Generation • 11B • Updated Sep 23, 2025 • 101 • 1

kaitchup/Llama-3.1-8B-Instruct-NVFP4

5B • Updated Sep 24, 2025 • 8

itroot/Qwen3-4B-Thinking-2507-W8A8

Text Generation • 4B • Updated Sep 24, 2025 • 3

RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-dynamic

Text Generation • 236B • Updated Oct 3, 2025 • 93 • 4

RedHatAI/Qwen3-VL-235B-A22B-Instruct-FP8-block

Text Generation • 236B • Updated Oct 27, 2025 • 38 • 3

RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-FP8-dynamic

Text Generation • 9B • Updated Jan 23 • 3.72k • 3

RedHatAI/Llama-3.1-8B-Instruct-FP8-block

Text Generation • 8B • Updated Oct 29, 2025 • 50

nm-testing/Llama-3.1-70B-Instruct-FP8-block

Text Generation • Updated Oct 14, 2025

RedHatAI/Qwen3-14B-FP8-block

Text Generation • 15B • Updated Oct 24, 2025 • 18

nm-testing/Qwen3-30B-A3B-FP8-block

Text Generation • 3B • Updated Oct 27, 2025 • 6

RedHatAI/Qwen3-32B-FP8-block

Text Generation • 33B • Updated Oct 24, 2025 • 19

RedHatAI/Qwen3-8B-FP8-block

Text Generation • 8B • Updated Dec 31, 2025 • 72