Hugging Face's logo

wyt2000
/
InverseCoder-CL-7B

Text Generation
Transformers
Safetensors
llama
code
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
wyt2000 commited on
Commit
733710d
·
verified ·
1 Parent(s): e6767d9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +157 -5
README.md CHANGED
@@ -1,5 +1,157 @@
1
- ---
2
- license: llama2
3
- license_name: deepseek
4
- license_link: LICENSE
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama2
3
+ license_name: deepseek
4
+ license_link: LICENSE
5
+ datasets:
6
+ - ise-uiuc/Magicoder-Evol-Instruct-110K
7
+ library_name: transformers
8
+ pipeline_tag: text-generation
9
+ tags:
10
+ - code
11
+ model-index:
12
+ - name: InverseCoder-CL-7B
13
+ results:
14
+ - task:
15
+ type: text-generation
16
+ dataset:
17
+ type: openai_humaneval
18
+ name: HumanEval
19
+ metrics:
20
+ - name: pass@1
21
+ type: pass@1
22
+ value: 0.762
23
+ verified: false
24
+
25
+ - task:
26
+ type: text-generation
27
+ dataset:
28
+ type: openai_humaneval
29
+ name: HumanEval(+)
30
+ metrics:
31
+ - name: pass@1
32
+ type: pass@1
33
+ value: 0.720
34
+ verified: false
35
+
36
+ - task:
37
+ type: text-generation
38
+ dataset:
39
+ type: mbpp
40
+ name: MBPP
41
+ metrics:
42
+ - name: pass@1
43
+ type: pass@1
44
+ value: 0.706
45
+ verified: false
46
+
47
+ - task:
48
+ type: text-generation
49
+ dataset:
50
+ type: mbpp
51
+ name: MBPP(+)
52
+ metrics:
53
+ - name: pass@1
54
+ type: pass@1
55
+ value: 0.601
56
+ verified: false
57
+
58
+ - task:
59
+ type: text-generation
60
+ dataset:
61
+ type: mbpp
62
+ name: MBPP
63
+ metrics:
64
+ - name: pass@1
65
+ type: pass@1
66
+ value: 0.601
67
+ verified: false
68
+
69
+ - task:
70
+ type: text-generation
71
+ dataset:
72
+ type: ds1000
73
+ name: DS-1000 (Overall Completion)
74
+ metrics:
75
+ - name: pass@1
76
+ type: pass@1
77
+ value: 0.399
78
+ verified: false
79
+
80
+ - task:
81
+ type: text-generation
82
+ dataset:
83
+ type: nuprl/MultiPL-E
84
+ name: MultiPL-HumanEval (Java)
85
+ metrics:
86
+ - name: pass@1
87
+ type: pass@1
88
+ value: 0.487
89
+ verified: false
90
+
91
+ - task:
92
+ type: text-generation
93
+ dataset:
94
+ type: nuprl/MultiPL-E
95
+ name: MultiPL-HumanEval (JavaScript)
96
+ metrics:
97
+ - name: pass@1
98
+ type: pass@1
99
+ value: 0.619
100
+ verified: false
101
+
102
+ - task:
103
+ type: text-generation
104
+ dataset:
105
+ type: nuprl/MultiPL-E
106
+ name: MultiPL-HumanEval (C++)
107
+ metrics:
108
+ - name: pass@1
109
+ type: pass@1
110
+ value: 0.526
111
+ verified: false
112
+
113
+ - task:
114
+ type: text-generation
115
+ dataset:
116
+ type: nuprl/MultiPL-E
117
+ name: MultiPL-HumanEval (PHP)
118
+ metrics:
119
+ - name: pass@1
120
+ type: pass@1
121
+ value: 0.552
122
+ verified: false
123
+
124
+ - task:
125
+ type: text-generation
126
+ dataset:
127
+ type: nuprl/MultiPL-E
128
+ name: MultiPL-HumanEval (Swift)
129
+ metrics:
130
+ - name: pass@1
131
+ type: pass@1
132
+ value: 0.530
133
+ verified: false
134
+
135
+ - task:
136
+ type: text-generation
137
+ dataset:
138
+ type: nuprl/MultiPL-E
139
+ name: MultiPL-HumanEval (Rust)
140
+ metrics:
141
+ - name: pass@1
142
+ type: pass@1
143
+ value: 0.461
144
+ verified: false
145
+
146
+ - task:
147
+ type: text-generation
148
+ dataset:
149
+ type: nuprl/MultiPL-E
150
+ name: MultiPL-HumanEval (Average for non-python languages)
151
+ metrics:
152
+ - name: pass@1
153
+ type: pass@1
154
+ value: 0.529
155
+ verified: false
156
+
157
+ ---