Instructions to use aspctu/llama31-70b-engine-4gpu-basic with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aspctu/llama31-70b-engine-4gpu-basic with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aspctu/llama31-70b-engine-4gpu-basic", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download rank2.engine from aspctu/llama31-70b-engine-4gpu-basic: direct link, hf CLI and curl.
- Browser
- Download file 37 GB
-
https://huggingface.co/aspctu/llama31-70b-engine-4gpu-basic/resolve/3484ed87245e7e98396883a5aa7cab61b9256edc/rank2.engine
- Command line
-
hf download hf://aspctu/llama31-70b-engine-4gpu-basic@3484ed87245e7e98396883a5aa7cab61b9256edc/rank2.engine
-
curl -L -o rank2.engine https://huggingface.co/aspctu/llama31-70b-engine-4gpu-basic/resolve/3484ed87245e7e98396883a5aa7cab61b9256edc/rank2.engine
37 GB
- Xet hash:
- 48653f791c7f3816fde3dfe683a75cc1dca0e7eca8c3c21ccd13e07a616b372d
- Size of remote file:
- 37 GB
- SHA256:
- 7050dfe072c0d05032b1d053e2e9f812713797916827d2d2f47934061477a62e
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.