RedHatAI
/

Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation

8-bit precision

compressed-tensors

text-generation-inference

Model card Files Files and versions

Lin-K76 commited on Jul 25, 2024

Commit

c96bab5

·

verified ·

1 Parent(s): a0a38dd

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -129,7 +129,7 @@ oneshot(
 ## Evaluation
-The model was evaluated on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) leaderboard tasks (version 1) with the [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) and the [vLLM](https://docs.vllm.ai/en/stable/) engine, using the following command:
 A modified version of ARC-C was used for evaluations, in line with Llama 3.1's prompting.
 ```
 lm_eval \

 ## Evaluation
+The model was evaluated on the [OpenLLM](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard) leaderboard tasks (version 1) with the [lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness) and the [vLLM](https://docs.vllm.ai/en/stable/) engine, using the following command.
 A modified version of ARC-C was used for evaluations, in line with Llama 3.1's prompting.
 ```
 lm_eval \