Hugging Face's logo

SicariusSicariiStuff
/
Assistant_Pepe_70B_GPTQ_AR_4-bit-128

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
gptq
Model card Files
xet
 Community
README.md exists but content is empty.
Downloads last month
724
Safetensors
Model size
11B params
Tensor type
I32
·
BF16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SicariusSicariiStuff/Assistant_Pepe_70B_GPTQ_AR_4-bit-128

Base model

meta-llama/Llama-3.1-70B
Finetuned
meta-llama/Llama-3.1-70B-Instruct
Finetuned
SicariusSicariiStuff/Assistant_Pepe_70B
Quantized
(7)
this model

Dataset used to train SicariusSicariiStuff/Assistant_Pepe_70B_GPTQ_AR_4-bit-128