Motif-Technologies
/

Motif-2.6B

Text Generation

text-generation-inference

Model card Files Files and versions

leejunhyeok commited on Jul 13

Commit

b8cc4f6

·

verified ·

1 Parent(s): c771b53

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -54,10 +54,11 @@ The benchmarks and corresponding scores listed in the table below are taken dire
 |HumanEval|0-shot|30.5|68.3|+123.93%|
 |MBPP|3-shot|47.5|60.3|+26.95%|
 |MATH|4-shot, maj@4|13.1|40.2*|+206.87%|
-|GSM8K|8-shot, maj@8|52.2|80.21|+53.66%|
 ||||**Average**|**+34.25%**|
 \* : We report the 4-shot, maj@1 score instead of the 4-shot, maj@4.
 ### Comparison to the Gemma series by Google

 |HumanEval|0-shot|30.5|68.3|+123.93%|
 |MBPP|3-shot|47.5|60.3|+26.95%|
 |MATH|4-shot, maj@4|13.1|40.2*|+206.87%|
+|GSM8K|8-shot, maj@8|52.2|75.66**|+44.94%|
 ||||**Average**|**+34.25%**|
 \* : We report the 4-shot, maj@1 score instead of the 4-shot, maj@4.
+\** : We report the 8-shot, maj@1 score instead of the 8-shot, maj@8.
 ### Comparison to the Gemma series by Google