Inference Providers
Active filters: autoawq
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• Updated • 149k
• 109
curiousmind147/microsoft-phi-4-AWQ-4bit-GEMM
Text Generation
• 15B • Updated • 401
• 2
Text Generation
• 7B • Updated • 373
• 2
Text Generation
• 6B • Updated • 6
kaitchup/Llama-3-8b-awq-4bit
Text Generation
• 8B • Updated • 7
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k
Text Generation
• Updated • 29
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GGUF
Text Generation
• Updated • 22
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-GPTQ
Text Generation
• Updated • 5
XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ
Text Generation
• Updated • 2
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
• 410B • Updated • 1.16k
• 36
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
• Updated • 251k
• 89
jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• 71B • Updated • 3
jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
• 410B • Updated • 1
Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom
Text Generation
• 71B • Updated • 9
UCLA-EMC/Meta-Llama-3.1-8B-AWQ-INT4
Text Generation
• 8B • Updated • 66
UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B
Text Generation
• 8B • Updated • 9
• 1
reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix
Text Generation
• 8B • Updated • 1
jburmeister/Meta-Llama-3.1-8B-Instruct-AWQ-INT4
Text Generation
• 8B • Updated • 21
awilliamson/Meta-Llama-3.1-70B-Instruct-AWQ
Text Generation
• 71B • Updated • 10
flowaicom/Flow-Judge-v0.1-AWQ
Text Generation
• 4B • Updated • 6.94k
• 6
hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4
Text Generation
• 47B • Updated • 11.3k
hugging-quants/gemma-2-9b-it-AWQ-INT4
Text Generation
• 9B • Updated • 1.36k
• 8
ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4
Text Generation
• 71B • Updated • 740
• 6
NeuML/Llama-3.1_OpenScholar-8B-AWQ
Text Generation
• 8B • Updated • 24
• 3
fbaldassarri/TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-asym
Text Generation
• 1B • Updated • 6
fbaldassarri/TinyLlama_TinyLlama_v1.1-autoawq-int4-gs128-sym
Text Generation
• 1B • Updated • 7
fbaldassarri/EleutherAI_pythia-14m-autoawq-int4-gs128-asym
Text Generation
• 14.1M • Updated • 3
fbaldassarri/EleutherAI_pythia-14m-autoawq-int4-gs128-sym
Text Generation
• 14.1M • Updated • 2
fbaldassarri/EleutherAI_pythia-31m-autoawq-int4-gs128-asym
Text Generation
• 30.5M • Updated fbaldassarri/EleutherAI_pythia-31m-autoawq-int4-gs128-sym
Text Generation
• 30.5M • Updated • 2