Hugging Face's logo

JetBrains-Research
/
ltmia-code-mia-classifier

Model card Files
xet
 Community
davidi123 commited on
Commit
f431fb0
·
verified ·
1 Parent(s): e799299

Upload manifest_eval.yaml with huggingface_hub

Browse files
Files changed (1) hide show
  1. manifest_eval.yaml +221 -0
manifest_eval.yaml ADDED
@@ -0,0 +1,221 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ combinations:
2
+ gpt2_google_research_datasets_mbpp:
3
+ model_name: gpt2
4
+ dataset_name: google-research-datasets/mbpp
5
+ path: features/eval/gpt2_google_research_datasets_mbpp
6
+ n_members: 300
7
+ n_nonmembers: 300
8
+ feature_dim: 154
9
+ sequence_length: 128
10
+ train_size: 270
11
+ val_size: 15
12
+ test_size: 15
13
+ gpt2_data_code_contests_java:
14
+ model_name: gpt2
15
+ dataset_name: data/code_contests_java
16
+ path: features/eval/gpt2_data_code_contests_java
17
+ n_members: 3500
18
+ n_nonmembers: 3500
19
+ feature_dim: 154
20
+ sequence_length: 128
21
+ train_size: 3150
22
+ val_size: 175
23
+ test_size: 175
24
+ eleutherai_pythia-2.8b_google_research_datasets_mbpp:
25
+ model_name: EleutherAI/pythia-2.8b
26
+ dataset_name: google-research-datasets/mbpp
27
+ path: features/eval/eleutherai_pythia-2.8b_google_research_datasets_mbpp
28
+ n_members: 300
29
+ n_nonmembers: 300
30
+ feature_dim: 154
31
+ sequence_length: 128
32
+ train_size: 270
33
+ val_size: 15
34
+ test_size: 15
35
+ eleutherai_pythia-2.8b_data_code_contests_java:
36
+ model_name: EleutherAI/pythia-2.8b
37
+ dataset_name: data/code_contests_java
38
+ path: features/eval/eleutherai_pythia-2.8b_data_code_contests_java
39
+ n_members: 3500
40
+ n_nonmembers: 3500
41
+ feature_dim: 154
42
+ sequence_length: 128
43
+ train_size: 3150
44
+ val_size: 175
45
+ test_size: 175
46
+ eleutherai_pythia-6.9b_google_research_datasets_mbpp:
47
+ model_name: EleutherAI/pythia-6.9b
48
+ dataset_name: google-research-datasets/mbpp
49
+ path: features/eval/eleutherai_pythia-6.9b_google_research_datasets_mbpp
50
+ n_members: 300
51
+ n_nonmembers: 300
52
+ feature_dim: 154
53
+ sequence_length: 128
54
+ train_size: 270
55
+ val_size: 15
56
+ test_size: 15
57
+ eleutherai_pythia-6.9b_data_code_contests_java:
58
+ model_name: EleutherAI/pythia-6.9b
59
+ dataset_name: data/code_contests_java
60
+ path: features/eval/eleutherai_pythia-6.9b_data_code_contests_java
61
+ n_members: 3500
62
+ n_nonmembers: 3500
63
+ feature_dim: 154
64
+ sequence_length: 128
65
+ train_size: 3150
66
+ val_size: 175
67
+ test_size: 175
68
+ facebook_opt-2.7b_google_research_datasets_mbpp:
69
+ model_name: facebook/opt-2.7b
70
+ dataset_name: google-research-datasets/mbpp
71
+ path: features/eval/facebook_opt-2.7b_google_research_datasets_mbpp
72
+ n_members: 300
73
+ n_nonmembers: 300
74
+ feature_dim: 154
75
+ sequence_length: 128
76
+ train_size: 270
77
+ val_size: 15
78
+ test_size: 15
79
+ facebook_opt-2.7b_data_code_contests_java:
80
+ model_name: facebook/opt-2.7b
81
+ dataset_name: data/code_contests_java
82
+ path: features/eval/facebook_opt-2.7b_data_code_contests_java
83
+ n_members: 3500
84
+ n_nonmembers: 3500
85
+ feature_dim: 154
86
+ sequence_length: 128
87
+ train_size: 3150
88
+ val_size: 175
89
+ test_size: 175
90
+ meta-llama_llama-2-7b-hf_google_research_datasets_mbpp:
91
+ model_name: meta-llama/Llama-2-7b-hf
92
+ dataset_name: google-research-datasets/mbpp
93
+ path: features/eval/meta-llama_llama-2-7b-hf_google_research_datasets_mbpp
94
+ n_members: 300
95
+ n_nonmembers: 300
96
+ feature_dim: 154
97
+ sequence_length: 128
98
+ train_size: 270
99
+ val_size: 15
100
+ test_size: 15
101
+ meta-llama_llama-2-7b-hf_data_code_contests_java:
102
+ model_name: meta-llama/Llama-2-7b-hf
103
+ dataset_name: data/code_contests_java
104
+ path: features/eval/meta-llama_llama-2-7b-hf_data_code_contests_java
105
+ n_members: 3500
106
+ n_nonmembers: 3500
107
+ feature_dim: 154
108
+ sequence_length: 128
109
+ train_size: 3150
110
+ val_size: 175
111
+ test_size: 175
112
+ microsoft_phi-2_google_research_datasets_mbpp:
113
+ model_name: microsoft/phi-2
114
+ dataset_name: google-research-datasets/mbpp
115
+ path: features/eval/microsoft_phi-2_google_research_datasets_mbpp
116
+ n_members: 300
117
+ n_nonmembers: 300
118
+ feature_dim: 154
119
+ sequence_length: 128
120
+ train_size: 270
121
+ val_size: 15
122
+ test_size: 15
123
+ microsoft_phi-2_data_code_contests_java:
124
+ model_name: microsoft/phi-2
125
+ dataset_name: data/code_contests_java
126
+ path: features/eval/microsoft_phi-2_data_code_contests_java
127
+ n_members: 3500
128
+ n_nonmembers: 3500
129
+ feature_dim: 154
130
+ sequence_length: 128
131
+ train_size: 3150
132
+ val_size: 175
133
+ test_size: 175
134
+ mistralai_mistral-7b-v0.1_google_research_datasets_mbpp:
135
+ model_name: mistralai/Mistral-7B-v0.1
136
+ dataset_name: google-research-datasets/mbpp
137
+ path: features/eval/mistralai_mistral-7b-v0.1_google_research_datasets_mbpp
138
+ n_members: 300
139
+ n_nonmembers: 300
140
+ feature_dim: 154
141
+ sequence_length: 128
142
+ train_size: 270
143
+ val_size: 15
144
+ test_size: 15
145
+ mistralai_mistral-7b-v0.1_data_code_contests_java:
146
+ model_name: mistralai/Mistral-7B-v0.1
147
+ dataset_name: data/code_contests_java
148
+ path: features/eval/mistralai_mistral-7b-v0.1_data_code_contests_java
149
+ n_members: 3500
150
+ n_nonmembers: 3500
151
+ feature_dim: 154
152
+ sequence_length: 128
153
+ train_size: 3150
154
+ val_size: 175
155
+ test_size: 175
156
+ gpt2_jetbrains_kexercises:
157
+ model_name: gpt2
158
+ dataset_name: JetBrains/KExercises
159
+ path: features/eval/gpt2_jetbrains_kexercises
160
+ n_members: 7000
161
+ n_nonmembers: 7000
162
+ feature_dim: 154
163
+ sequence_length: 128
164
+ train_size: 6300
165
+ val_size: 350
166
+ test_size: 350
167
+ eleutherai_pythia-2.8b_jetbrains_kexercises:
168
+ model_name: EleutherAI/pythia-2.8b
169
+ dataset_name: JetBrains/KExercises
170
+ path: features/eval/eleutherai_pythia-2.8b_jetbrains_kexercises
171
+ n_members: 7000
172
+ n_nonmembers: 7000
173
+ feature_dim: 154
174
+ sequence_length: 128
175
+ train_size: 6300
176
+ val_size: 350
177
+ test_size: 350
178
+ eleutherai_pythia-6.9b_jetbrains_kexercises:
179
+ model_name: EleutherAI/pythia-6.9b
180
+ dataset_name: JetBrains/KExercises
181
+ path: features/eval/eleutherai_pythia-6.9b_jetbrains_kexercises
182
+ n_members: 7000
183
+ n_nonmembers: 7000
184
+ feature_dim: 154
185
+ sequence_length: 128
186
+ train_size: 6300
187
+ val_size: 350
188
+ test_size: 350
189
+ facebook_opt-2.7b_jetbrains_kexercises:
190
+ model_name: facebook/opt-2.7b
191
+ dataset_name: JetBrains/KExercises
192
+ path: features/eval/facebook_opt-2.7b_jetbrains_kexercises
193
+ n_members: 7000
194
+ n_nonmembers: 7000
195
+ feature_dim: 154
196
+ sequence_length: 128
197
+ train_size: 6300
198
+ val_size: 350
199
+ test_size: 350
200
+ microsoft_phi-2_jetbrains_kexercises:
201
+ model_name: microsoft/phi-2
202
+ dataset_name: JetBrains/KExercises
203
+ path: features/eval/microsoft_phi-2_jetbrains_kexercises
204
+ n_members: 7000
205
+ n_nonmembers: 7000
206
+ feature_dim: 154
207
+ sequence_length: 128
208
+ train_size: 6300
209
+ val_size: 350
210
+ test_size: 350
211
+ mistralai_mistral-7b-v0.1_jetbrains_kexercises:
212
+ model_name: mistralai/Mistral-7B-v0.1
213
+ dataset_name: JetBrains/KExercises
214
+ path: features/eval/mistralai_mistral-7b-v0.1_jetbrains_kexercises
215
+ n_members: 7000
216
+ n_nonmembers: 7000
217
+ feature_dim: 154
218
+ sequence_length: 128
219
+ train_size: 6300
220
+ val_size: 350
221
+ test_size: 350