Motif-Technologies
/

Motif-2.6B

Text Generation

text-generation-inference

Model card Files Files and versions

SungminLee commited on Jun 8

Commit

0315ff8

·

1 Parent(s): b78fd6b

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -40,9 +40,9 @@ The benchmarks and corresponding scores listed in the table below are taken dire
 |TriviaQA|5-shot|69.9|54.97|-21.36%|
 |HumanEval|0-shot|30.5|68.3|+123.93%|
 |MBPP|3-shot|47.5|60.3|+26.95%|
-|MATH|4-shot, maj@4|13.1|40.2*|+199.24%|
 |GSM8K|8-shot, maj@8|52.2|77.71|+48.87%|
-||||**Average**|**+33.01%**|
 \* : We report the 4-shot score instead of the 4-shot, maj@4.

 |TriviaQA|5-shot|69.9|54.97|-21.36%|
 |HumanEval|0-shot|30.5|68.3|+123.93%|
 |MBPP|3-shot|47.5|60.3|+26.95%|
+|MATH|4-shot, maj@4|13.1|40.2*|+206.87%|
 |GSM8K|8-shot, maj@8|52.2|77.71|+48.87%|
+||||**Average**|**+33.77%**|
 \* : We report the 4-shot score instead of the 4-shot, maj@4.