You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

ReluFalcon-40B-PowerInfer-GGUF

Original model: SparseLLM/ReluFalcon-40B
Converted & distributed by: PowerInfer

This model is the downstream distribution of SparseLLM/ReluFalcon-40B in PowerInfer GGUF format consisting of the LLM model weights and predictor weights.

Downloads last month: 2

GGUF

Hardware compatibility

We're not able to determine the quantization variants.

View all variants

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support