learn3r commited on
Commit
e2b0062
1 Parent(s): 4218bdf

End of training

Browse files
Files changed (5) hide show
  1. README.md +21 -8
  2. all_results.json +18 -0
  3. eval_results.json +13 -0
  4. train_results.json +8 -0
  5. trainer_state.json +1128 -0
README.md CHANGED
@@ -1,11 +1,24 @@
1
  ---
 
2
  tags:
3
  - generated_from_trainer
 
 
4
  metrics:
5
  - rouge
6
  model-index:
7
  - name: longt5_xl_sfd_bp_40
8
- results: []
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -13,14 +26,14 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # longt5_xl_sfd_bp_40
15
 
16
- This model was trained from scratch on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 3.3211
19
- - Rouge1: 42.5239
20
- - Rouge2: 17.4102
21
- - Rougel: 28.6868
22
- - Rougelsum: 40.6537
23
- - Gen Len: 200.3798
24
 
25
  ## Model description
26
 
 
1
  ---
2
+ base_model: /exports/eddie/scratch/s1970716/models/summarization/longt5_xl_sfd_bp_20/checkpoint-280
3
  tags:
4
  - generated_from_trainer
5
+ datasets:
6
+ - learn3r/summ_screen_fd_bp
7
  metrics:
8
  - rouge
9
  model-index:
10
  - name: longt5_xl_sfd_bp_40
11
+ results:
12
+ - task:
13
+ name: Summarization
14
+ type: summarization
15
+ dataset:
16
+ name: learn3r/summ_screen_fd_bp
17
+ type: learn3r/summ_screen_fd_bp
18
+ metrics:
19
+ - name: Rouge1
20
+ type: rouge
21
+ value: 40.6965
22
  ---
23
 
24
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
26
 
27
  # longt5_xl_sfd_bp_40
28
 
29
+ This model is a fine-tuned version of [/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_sfd_bp_20/checkpoint-280](https://huggingface.co//exports/eddie/scratch/s1970716/models/summarization/longt5_xl_sfd_bp_20/checkpoint-280) on the learn3r/summ_screen_fd_bp dataset.
30
  It achieves the following results on the evaluation set:
31
+ - Loss: 2.8277
32
+ - Rouge1: 40.6965
33
+ - Rouge2: 17.2793
34
+ - Rougel: 27.8429
35
+ - Rougelsum: 39.0726
36
+ - Gen Len: 294.0890
37
 
38
  ## Model description
39
 
all_results.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "eval_gen_len": 294.08902077151333,
4
+ "eval_loss": 2.8276827335357666,
5
+ "eval_rouge1": 40.6965,
6
+ "eval_rouge2": 17.2793,
7
+ "eval_rougeL": 27.8429,
8
+ "eval_rougeLsum": 39.0726,
9
+ "eval_runtime": 1755.6328,
10
+ "eval_samples": 337,
11
+ "eval_samples_per_second": 0.192,
12
+ "eval_steps_per_second": 0.024,
13
+ "train_loss": 0.049460863295410364,
14
+ "train_runtime": 102546.6903,
15
+ "train_samples": 3673,
16
+ "train_samples_per_second": 0.716,
17
+ "train_steps_per_second": 0.003
18
+ }
eval_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "eval_gen_len": 294.08902077151333,
4
+ "eval_loss": 2.8276827335357666,
5
+ "eval_rouge1": 40.6965,
6
+ "eval_rouge2": 17.2793,
7
+ "eval_rougeL": 27.8429,
8
+ "eval_rougeLsum": 39.0726,
9
+ "eval_runtime": 1755.6328,
10
+ "eval_samples": 337,
11
+ "eval_samples_per_second": 0.192,
12
+ "eval_steps_per_second": 0.024
13
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 19.48,
3
+ "train_loss": 0.049460863295410364,
4
+ "train_runtime": 102546.6903,
5
+ "train_samples": 3673,
6
+ "train_samples_per_second": 0.716,
7
+ "train_steps_per_second": 0.003
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,1128 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 2.8276827335357666,
3
+ "best_model_checkpoint": "/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_sfd_bp_40/checkpoint-71",
4
+ "epoch": 19.47826086956522,
5
+ "eval_steps": 500,
6
+ "global_step": 280,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.14,
13
+ "learning_rate": 0.001,
14
+ "loss": 0.0873,
15
+ "step": 2
16
+ },
17
+ {
18
+ "epoch": 0.28,
19
+ "learning_rate": 0.001,
20
+ "loss": 0.1042,
21
+ "step": 4
22
+ },
23
+ {
24
+ "epoch": 0.42,
25
+ "learning_rate": 0.001,
26
+ "loss": 0.1006,
27
+ "step": 6
28
+ },
29
+ {
30
+ "epoch": 0.56,
31
+ "learning_rate": 0.001,
32
+ "loss": 0.1057,
33
+ "step": 8
34
+ },
35
+ {
36
+ "epoch": 0.7,
37
+ "learning_rate": 0.001,
38
+ "loss": 0.1157,
39
+ "step": 10
40
+ },
41
+ {
42
+ "epoch": 0.83,
43
+ "learning_rate": 0.001,
44
+ "loss": 0.1099,
45
+ "step": 12
46
+ },
47
+ {
48
+ "epoch": 0.97,
49
+ "learning_rate": 0.001,
50
+ "loss": 0.1033,
51
+ "step": 14
52
+ },
53
+ {
54
+ "epoch": 0.97,
55
+ "eval_gen_len": 279.7507418397626,
56
+ "eval_loss": 3.109584331512451,
57
+ "eval_rouge1": 40.3355,
58
+ "eval_rouge2": 16.0557,
59
+ "eval_rougeL": 27.4642,
60
+ "eval_rougeLsum": 38.6436,
61
+ "eval_runtime": 1755.4356,
62
+ "eval_samples_per_second": 0.192,
63
+ "eval_steps_per_second": 0.024,
64
+ "step": 14
65
+ },
66
+ {
67
+ "epoch": 1.11,
68
+ "learning_rate": 0.001,
69
+ "loss": 0.0862,
70
+ "step": 16
71
+ },
72
+ {
73
+ "epoch": 1.25,
74
+ "learning_rate": 0.001,
75
+ "loss": 0.086,
76
+ "step": 18
77
+ },
78
+ {
79
+ "epoch": 1.39,
80
+ "learning_rate": 0.001,
81
+ "loss": 0.0666,
82
+ "step": 20
83
+ },
84
+ {
85
+ "epoch": 1.53,
86
+ "learning_rate": 0.001,
87
+ "loss": 0.0732,
88
+ "step": 22
89
+ },
90
+ {
91
+ "epoch": 1.67,
92
+ "learning_rate": 0.001,
93
+ "loss": 0.0981,
94
+ "step": 24
95
+ },
96
+ {
97
+ "epoch": 1.81,
98
+ "learning_rate": 0.001,
99
+ "loss": 0.0995,
100
+ "step": 26
101
+ },
102
+ {
103
+ "epoch": 1.95,
104
+ "learning_rate": 0.001,
105
+ "loss": 0.0836,
106
+ "step": 28
107
+ },
108
+ {
109
+ "epoch": 1.95,
110
+ "eval_gen_len": 368.4658753709199,
111
+ "eval_loss": 3.036095142364502,
112
+ "eval_rouge1": 38.2411,
113
+ "eval_rouge2": 16.5448,
114
+ "eval_rougeL": 26.6409,
115
+ "eval_rougeLsum": 36.5841,
116
+ "eval_runtime": 1798.7338,
117
+ "eval_samples_per_second": 0.187,
118
+ "eval_steps_per_second": 0.024,
119
+ "step": 28
120
+ },
121
+ {
122
+ "epoch": 2.09,
123
+ "learning_rate": 0.001,
124
+ "loss": 0.091,
125
+ "step": 30
126
+ },
127
+ {
128
+ "epoch": 2.23,
129
+ "learning_rate": 0.001,
130
+ "loss": 0.072,
131
+ "step": 32
132
+ },
133
+ {
134
+ "epoch": 2.37,
135
+ "learning_rate": 0.001,
136
+ "loss": 0.0779,
137
+ "step": 34
138
+ },
139
+ {
140
+ "epoch": 2.5,
141
+ "learning_rate": 0.001,
142
+ "loss": 0.0598,
143
+ "step": 36
144
+ },
145
+ {
146
+ "epoch": 2.64,
147
+ "learning_rate": 0.001,
148
+ "loss": 0.0624,
149
+ "step": 38
150
+ },
151
+ {
152
+ "epoch": 2.78,
153
+ "learning_rate": 0.001,
154
+ "loss": 0.0823,
155
+ "step": 40
156
+ },
157
+ {
158
+ "epoch": 2.92,
159
+ "learning_rate": 0.001,
160
+ "loss": 0.0717,
161
+ "step": 42
162
+ },
163
+ {
164
+ "epoch": 2.99,
165
+ "eval_gen_len": 489.2047477744807,
166
+ "eval_loss": 2.9388694763183594,
167
+ "eval_rouge1": 32.0114,
168
+ "eval_rouge2": 13.7953,
169
+ "eval_rougeL": 22.278,
170
+ "eval_rougeLsum": 30.726,
171
+ "eval_runtime": 1801.0686,
172
+ "eval_samples_per_second": 0.187,
173
+ "eval_steps_per_second": 0.024,
174
+ "step": 43
175
+ },
176
+ {
177
+ "epoch": 3.06,
178
+ "learning_rate": 0.001,
179
+ "loss": 0.0677,
180
+ "step": 44
181
+ },
182
+ {
183
+ "epoch": 3.2,
184
+ "learning_rate": 0.001,
185
+ "loss": 0.0665,
186
+ "step": 46
187
+ },
188
+ {
189
+ "epoch": 3.34,
190
+ "learning_rate": 0.001,
191
+ "loss": 0.0732,
192
+ "step": 48
193
+ },
194
+ {
195
+ "epoch": 3.48,
196
+ "learning_rate": 0.001,
197
+ "loss": 0.0573,
198
+ "step": 50
199
+ },
200
+ {
201
+ "epoch": 3.62,
202
+ "learning_rate": 0.001,
203
+ "loss": 0.0537,
204
+ "step": 52
205
+ },
206
+ {
207
+ "epoch": 3.76,
208
+ "learning_rate": 0.001,
209
+ "loss": 0.0787,
210
+ "step": 54
211
+ },
212
+ {
213
+ "epoch": 3.9,
214
+ "learning_rate": 0.001,
215
+ "loss": 0.0614,
216
+ "step": 56
217
+ },
218
+ {
219
+ "epoch": 3.97,
220
+ "eval_gen_len": 477.7240356083086,
221
+ "eval_loss": 3.0221002101898193,
222
+ "eval_rouge1": 32.969,
223
+ "eval_rouge2": 13.7053,
224
+ "eval_rougeL": 22.7428,
225
+ "eval_rougeLsum": 31.6951,
226
+ "eval_runtime": 1800.6727,
227
+ "eval_samples_per_second": 0.187,
228
+ "eval_steps_per_second": 0.024,
229
+ "step": 57
230
+ },
231
+ {
232
+ "epoch": 4.03,
233
+ "learning_rate": 0.001,
234
+ "loss": 0.0598,
235
+ "step": 58
236
+ },
237
+ {
238
+ "epoch": 4.17,
239
+ "learning_rate": 0.001,
240
+ "loss": 0.055,
241
+ "step": 60
242
+ },
243
+ {
244
+ "epoch": 4.31,
245
+ "learning_rate": 0.001,
246
+ "loss": 0.0485,
247
+ "step": 62
248
+ },
249
+ {
250
+ "epoch": 4.45,
251
+ "learning_rate": 0.001,
252
+ "loss": 0.0482,
253
+ "step": 64
254
+ },
255
+ {
256
+ "epoch": 4.59,
257
+ "learning_rate": 0.001,
258
+ "loss": 0.0586,
259
+ "step": 66
260
+ },
261
+ {
262
+ "epoch": 4.73,
263
+ "learning_rate": 0.001,
264
+ "loss": 0.0612,
265
+ "step": 68
266
+ },
267
+ {
268
+ "epoch": 4.87,
269
+ "learning_rate": 0.001,
270
+ "loss": 0.1275,
271
+ "step": 70
272
+ },
273
+ {
274
+ "epoch": 4.94,
275
+ "eval_gen_len": 294.08902077151333,
276
+ "eval_loss": 2.8276827335357666,
277
+ "eval_rouge1": 40.6965,
278
+ "eval_rouge2": 17.2793,
279
+ "eval_rougeL": 27.8429,
280
+ "eval_rougeLsum": 39.0726,
281
+ "eval_runtime": 1758.653,
282
+ "eval_samples_per_second": 0.192,
283
+ "eval_steps_per_second": 0.024,
284
+ "step": 71
285
+ },
286
+ {
287
+ "epoch": 5.01,
288
+ "learning_rate": 0.001,
289
+ "loss": 0.0615,
290
+ "step": 72
291
+ },
292
+ {
293
+ "epoch": 5.15,
294
+ "learning_rate": 0.001,
295
+ "loss": 0.0422,
296
+ "step": 74
297
+ },
298
+ {
299
+ "epoch": 5.29,
300
+ "learning_rate": 0.001,
301
+ "loss": 0.04,
302
+ "step": 76
303
+ },
304
+ {
305
+ "epoch": 5.43,
306
+ "learning_rate": 0.001,
307
+ "loss": 0.0439,
308
+ "step": 78
309
+ },
310
+ {
311
+ "epoch": 5.57,
312
+ "learning_rate": 0.001,
313
+ "loss": 0.0797,
314
+ "step": 80
315
+ },
316
+ {
317
+ "epoch": 5.7,
318
+ "learning_rate": 0.001,
319
+ "loss": 0.1061,
320
+ "step": 82
321
+ },
322
+ {
323
+ "epoch": 5.84,
324
+ "learning_rate": 0.001,
325
+ "loss": 0.0778,
326
+ "step": 84
327
+ },
328
+ {
329
+ "epoch": 5.98,
330
+ "learning_rate": 0.001,
331
+ "loss": 0.0511,
332
+ "step": 86
333
+ },
334
+ {
335
+ "epoch": 5.98,
336
+ "eval_gen_len": 476.84569732937683,
337
+ "eval_loss": 3.043327808380127,
338
+ "eval_rouge1": 33.6479,
339
+ "eval_rouge2": 15.0729,
340
+ "eval_rougeL": 23.5443,
341
+ "eval_rougeLsum": 32.3304,
342
+ "eval_runtime": 1800.1403,
343
+ "eval_samples_per_second": 0.187,
344
+ "eval_steps_per_second": 0.024,
345
+ "step": 86
346
+ },
347
+ {
348
+ "epoch": 6.12,
349
+ "learning_rate": 0.001,
350
+ "loss": 0.0429,
351
+ "step": 88
352
+ },
353
+ {
354
+ "epoch": 6.26,
355
+ "learning_rate": 0.001,
356
+ "loss": 0.0405,
357
+ "step": 90
358
+ },
359
+ {
360
+ "epoch": 6.4,
361
+ "learning_rate": 0.001,
362
+ "loss": 0.0431,
363
+ "step": 92
364
+ },
365
+ {
366
+ "epoch": 6.54,
367
+ "learning_rate": 0.001,
368
+ "loss": 0.0481,
369
+ "step": 94
370
+ },
371
+ {
372
+ "epoch": 6.68,
373
+ "learning_rate": 0.001,
374
+ "loss": 0.0598,
375
+ "step": 96
376
+ },
377
+ {
378
+ "epoch": 6.82,
379
+ "learning_rate": 0.001,
380
+ "loss": 0.0788,
381
+ "step": 98
382
+ },
383
+ {
384
+ "epoch": 6.96,
385
+ "learning_rate": 0.001,
386
+ "loss": 0.0666,
387
+ "step": 100
388
+ },
389
+ {
390
+ "epoch": 6.96,
391
+ "eval_gen_len": 390.43620178041544,
392
+ "eval_loss": 3.1150412559509277,
393
+ "eval_rouge1": 37.743,
394
+ "eval_rouge2": 16.2368,
395
+ "eval_rougeL": 26.2524,
396
+ "eval_rougeLsum": 36.1313,
397
+ "eval_runtime": 1800.3794,
398
+ "eval_samples_per_second": 0.187,
399
+ "eval_steps_per_second": 0.024,
400
+ "step": 100
401
+ },
402
+ {
403
+ "epoch": 7.1,
404
+ "learning_rate": 0.001,
405
+ "loss": 0.0532,
406
+ "step": 102
407
+ },
408
+ {
409
+ "epoch": 7.23,
410
+ "learning_rate": 0.001,
411
+ "loss": 0.0591,
412
+ "step": 104
413
+ },
414
+ {
415
+ "epoch": 7.37,
416
+ "learning_rate": 0.001,
417
+ "loss": 0.0325,
418
+ "step": 106
419
+ },
420
+ {
421
+ "epoch": 7.51,
422
+ "learning_rate": 0.001,
423
+ "loss": 0.0362,
424
+ "step": 108
425
+ },
426
+ {
427
+ "epoch": 7.65,
428
+ "learning_rate": 0.001,
429
+ "loss": 0.0424,
430
+ "step": 110
431
+ },
432
+ {
433
+ "epoch": 7.79,
434
+ "learning_rate": 0.001,
435
+ "loss": 0.0405,
436
+ "step": 112
437
+ },
438
+ {
439
+ "epoch": 7.93,
440
+ "learning_rate": 0.001,
441
+ "loss": 0.0398,
442
+ "step": 114
443
+ },
444
+ {
445
+ "epoch": 8.0,
446
+ "eval_gen_len": 203.40059347181008,
447
+ "eval_loss": 3.2224972248077393,
448
+ "eval_rouge1": 41.3177,
449
+ "eval_rouge2": 16.6663,
450
+ "eval_rougeL": 28.7806,
451
+ "eval_rougeLsum": 39.5914,
452
+ "eval_runtime": 1514.3306,
453
+ "eval_samples_per_second": 0.223,
454
+ "eval_steps_per_second": 0.028,
455
+ "step": 115
456
+ },
457
+ {
458
+ "epoch": 8.07,
459
+ "learning_rate": 0.001,
460
+ "loss": 0.0391,
461
+ "step": 116
462
+ },
463
+ {
464
+ "epoch": 8.21,
465
+ "learning_rate": 0.001,
466
+ "loss": 0.0372,
467
+ "step": 118
468
+ },
469
+ {
470
+ "epoch": 8.35,
471
+ "learning_rate": 0.001,
472
+ "loss": 0.0317,
473
+ "step": 120
474
+ },
475
+ {
476
+ "epoch": 8.49,
477
+ "learning_rate": 0.001,
478
+ "loss": 0.0333,
479
+ "step": 122
480
+ },
481
+ {
482
+ "epoch": 8.63,
483
+ "learning_rate": 0.001,
484
+ "loss": 0.04,
485
+ "step": 124
486
+ },
487
+ {
488
+ "epoch": 8.77,
489
+ "learning_rate": 0.001,
490
+ "loss": 0.1656,
491
+ "step": 126
492
+ },
493
+ {
494
+ "epoch": 8.9,
495
+ "learning_rate": 0.001,
496
+ "loss": 0.0396,
497
+ "step": 128
498
+ },
499
+ {
500
+ "epoch": 8.97,
501
+ "eval_gen_len": 123.83086053412462,
502
+ "eval_loss": 3.1462180614471436,
503
+ "eval_rouge1": 39.9605,
504
+ "eval_rouge2": 16.6732,
505
+ "eval_rougeL": 28.3459,
506
+ "eval_rougeLsum": 38.226,
507
+ "eval_runtime": 1008.3447,
508
+ "eval_samples_per_second": 0.334,
509
+ "eval_steps_per_second": 0.043,
510
+ "step": 129
511
+ },
512
+ {
513
+ "epoch": 9.04,
514
+ "learning_rate": 0.001,
515
+ "loss": 0.0464,
516
+ "step": 130
517
+ },
518
+ {
519
+ "epoch": 9.18,
520
+ "learning_rate": 0.001,
521
+ "loss": 0.066,
522
+ "step": 132
523
+ },
524
+ {
525
+ "epoch": 9.32,
526
+ "learning_rate": 0.001,
527
+ "loss": 0.0693,
528
+ "step": 134
529
+ },
530
+ {
531
+ "epoch": 9.46,
532
+ "learning_rate": 0.001,
533
+ "loss": 0.038,
534
+ "step": 136
535
+ },
536
+ {
537
+ "epoch": 9.6,
538
+ "learning_rate": 0.001,
539
+ "loss": 0.0311,
540
+ "step": 138
541
+ },
542
+ {
543
+ "epoch": 9.74,
544
+ "learning_rate": 0.001,
545
+ "loss": 0.0331,
546
+ "step": 140
547
+ },
548
+ {
549
+ "epoch": 9.88,
550
+ "learning_rate": 0.001,
551
+ "loss": 0.0466,
552
+ "step": 142
553
+ },
554
+ {
555
+ "epoch": 9.95,
556
+ "eval_gen_len": 298.55786350148367,
557
+ "eval_loss": 3.2544760704040527,
558
+ "eval_rouge1": 40.7977,
559
+ "eval_rouge2": 16.9616,
560
+ "eval_rougeL": 27.427,
561
+ "eval_rougeLsum": 38.8973,
562
+ "eval_runtime": 1774.1286,
563
+ "eval_samples_per_second": 0.19,
564
+ "eval_steps_per_second": 0.024,
565
+ "step": 143
566
+ },
567
+ {
568
+ "epoch": 10.02,
569
+ "learning_rate": 0.001,
570
+ "loss": 0.0309,
571
+ "step": 144
572
+ },
573
+ {
574
+ "epoch": 10.16,
575
+ "learning_rate": 0.001,
576
+ "loss": 0.0311,
577
+ "step": 146
578
+ },
579
+ {
580
+ "epoch": 10.3,
581
+ "learning_rate": 0.001,
582
+ "loss": 0.0305,
583
+ "step": 148
584
+ },
585
+ {
586
+ "epoch": 10.43,
587
+ "learning_rate": 0.001,
588
+ "loss": 0.0323,
589
+ "step": 150
590
+ },
591
+ {
592
+ "epoch": 10.57,
593
+ "learning_rate": 0.001,
594
+ "loss": 0.034,
595
+ "step": 152
596
+ },
597
+ {
598
+ "epoch": 10.71,
599
+ "learning_rate": 0.001,
600
+ "loss": 0.0344,
601
+ "step": 154
602
+ },
603
+ {
604
+ "epoch": 10.85,
605
+ "learning_rate": 0.001,
606
+ "loss": 0.0347,
607
+ "step": 156
608
+ },
609
+ {
610
+ "epoch": 10.99,
611
+ "learning_rate": 0.001,
612
+ "loss": 0.043,
613
+ "step": 158
614
+ },
615
+ {
616
+ "epoch": 10.99,
617
+ "eval_gen_len": 425.13946587537095,
618
+ "eval_loss": 3.3188469409942627,
619
+ "eval_rouge1": 36.6349,
620
+ "eval_rouge2": 16.1781,
621
+ "eval_rougeL": 25.1327,
622
+ "eval_rougeLsum": 35.1793,
623
+ "eval_runtime": 1793.8451,
624
+ "eval_samples_per_second": 0.188,
625
+ "eval_steps_per_second": 0.024,
626
+ "step": 158
627
+ },
628
+ {
629
+ "epoch": 11.13,
630
+ "learning_rate": 0.001,
631
+ "loss": 0.0421,
632
+ "step": 160
633
+ },
634
+ {
635
+ "epoch": 11.27,
636
+ "learning_rate": 0.001,
637
+ "loss": 0.03,
638
+ "step": 162
639
+ },
640
+ {
641
+ "epoch": 11.41,
642
+ "learning_rate": 0.001,
643
+ "loss": 0.0294,
644
+ "step": 164
645
+ },
646
+ {
647
+ "epoch": 11.55,
648
+ "learning_rate": 0.001,
649
+ "loss": 0.0259,
650
+ "step": 166
651
+ },
652
+ {
653
+ "epoch": 11.69,
654
+ "learning_rate": 0.001,
655
+ "loss": 0.0306,
656
+ "step": 168
657
+ },
658
+ {
659
+ "epoch": 11.83,
660
+ "learning_rate": 0.001,
661
+ "loss": 0.0644,
662
+ "step": 170
663
+ },
664
+ {
665
+ "epoch": 11.97,
666
+ "learning_rate": 0.001,
667
+ "loss": 0.0538,
668
+ "step": 172
669
+ },
670
+ {
671
+ "epoch": 11.97,
672
+ "eval_gen_len": 394.86053412462905,
673
+ "eval_loss": 2.8277456760406494,
674
+ "eval_rouge1": 36.7878,
675
+ "eval_rouge2": 15.1186,
676
+ "eval_rougeL": 24.9774,
677
+ "eval_rougeLsum": 35.275,
678
+ "eval_runtime": 1794.0118,
679
+ "eval_samples_per_second": 0.188,
680
+ "eval_steps_per_second": 0.024,
681
+ "step": 172
682
+ },
683
+ {
684
+ "epoch": 12.1,
685
+ "learning_rate": 0.001,
686
+ "loss": 0.0703,
687
+ "step": 174
688
+ },
689
+ {
690
+ "epoch": 12.24,
691
+ "learning_rate": 0.001,
692
+ "loss": 0.0298,
693
+ "step": 176
694
+ },
695
+ {
696
+ "epoch": 12.38,
697
+ "learning_rate": 0.001,
698
+ "loss": 0.0228,
699
+ "step": 178
700
+ },
701
+ {
702
+ "epoch": 12.52,
703
+ "learning_rate": 0.001,
704
+ "loss": 0.0279,
705
+ "step": 180
706
+ },
707
+ {
708
+ "epoch": 12.66,
709
+ "learning_rate": 0.001,
710
+ "loss": 0.0254,
711
+ "step": 182
712
+ },
713
+ {
714
+ "epoch": 12.8,
715
+ "learning_rate": 0.001,
716
+ "loss": 0.0281,
717
+ "step": 184
718
+ },
719
+ {
720
+ "epoch": 12.94,
721
+ "learning_rate": 0.001,
722
+ "loss": 0.028,
723
+ "step": 186
724
+ },
725
+ {
726
+ "epoch": 12.94,
727
+ "eval_gen_len": 188.1780415430267,
728
+ "eval_loss": 3.4398186206817627,
729
+ "eval_rouge1": 42.9644,
730
+ "eval_rouge2": 18.1812,
731
+ "eval_rougeL": 29.1539,
732
+ "eval_rougeLsum": 41.0465,
733
+ "eval_runtime": 1387.7431,
734
+ "eval_samples_per_second": 0.243,
735
+ "eval_steps_per_second": 0.031,
736
+ "step": 186
737
+ },
738
+ {
739
+ "epoch": 13.08,
740
+ "learning_rate": 0.001,
741
+ "loss": 0.0322,
742
+ "step": 188
743
+ },
744
+ {
745
+ "epoch": 13.22,
746
+ "learning_rate": 0.001,
747
+ "loss": 0.0253,
748
+ "step": 190
749
+ },
750
+ {
751
+ "epoch": 13.36,
752
+ "learning_rate": 0.001,
753
+ "loss": 0.0538,
754
+ "step": 192
755
+ },
756
+ {
757
+ "epoch": 13.5,
758
+ "learning_rate": 0.001,
759
+ "loss": 0.0417,
760
+ "step": 194
761
+ },
762
+ {
763
+ "epoch": 13.63,
764
+ "learning_rate": 0.001,
765
+ "loss": 0.0664,
766
+ "step": 196
767
+ },
768
+ {
769
+ "epoch": 13.77,
770
+ "learning_rate": 0.001,
771
+ "loss": 0.1414,
772
+ "step": 198
773
+ },
774
+ {
775
+ "epoch": 13.91,
776
+ "learning_rate": 0.001,
777
+ "loss": 0.1056,
778
+ "step": 200
779
+ },
780
+ {
781
+ "epoch": 13.98,
782
+ "eval_gen_len": 261.2967359050445,
783
+ "eval_loss": 3.33475661277771,
784
+ "eval_rouge1": 41.1626,
785
+ "eval_rouge2": 17.1605,
786
+ "eval_rougeL": 27.6558,
787
+ "eval_rougeLsum": 39.2548,
788
+ "eval_runtime": 1747.9005,
789
+ "eval_samples_per_second": 0.193,
790
+ "eval_steps_per_second": 0.025,
791
+ "step": 201
792
+ },
793
+ {
794
+ "epoch": 14.05,
795
+ "learning_rate": 0.001,
796
+ "loss": 0.0509,
797
+ "step": 202
798
+ },
799
+ {
800
+ "epoch": 14.19,
801
+ "learning_rate": 0.001,
802
+ "loss": 0.0251,
803
+ "step": 204
804
+ },
805
+ {
806
+ "epoch": 14.33,
807
+ "learning_rate": 0.001,
808
+ "loss": 0.0302,
809
+ "step": 206
810
+ },
811
+ {
812
+ "epoch": 14.47,
813
+ "learning_rate": 0.001,
814
+ "loss": 0.0228,
815
+ "step": 208
816
+ },
817
+ {
818
+ "epoch": 14.61,
819
+ "learning_rate": 0.001,
820
+ "loss": 0.0261,
821
+ "step": 210
822
+ },
823
+ {
824
+ "epoch": 14.75,
825
+ "learning_rate": 0.001,
826
+ "loss": 0.0289,
827
+ "step": 212
828
+ },
829
+ {
830
+ "epoch": 14.89,
831
+ "learning_rate": 0.001,
832
+ "loss": 0.0303,
833
+ "step": 214
834
+ },
835
+ {
836
+ "epoch": 14.96,
837
+ "eval_gen_len": 231.60830860534125,
838
+ "eval_loss": 3.0237529277801514,
839
+ "eval_rouge1": 42.2372,
840
+ "eval_rouge2": 17.7292,
841
+ "eval_rougeL": 28.8099,
842
+ "eval_rougeLsum": 40.3325,
843
+ "eval_runtime": 1583.6175,
844
+ "eval_samples_per_second": 0.213,
845
+ "eval_steps_per_second": 0.027,
846
+ "step": 215
847
+ },
848
+ {
849
+ "epoch": 15.03,
850
+ "learning_rate": 0.001,
851
+ "loss": 0.0474,
852
+ "step": 216
853
+ },
854
+ {
855
+ "epoch": 15.17,
856
+ "learning_rate": 0.001,
857
+ "loss": 0.0252,
858
+ "step": 218
859
+ },
860
+ {
861
+ "epoch": 15.3,
862
+ "learning_rate": 0.001,
863
+ "loss": 0.019,
864
+ "step": 220
865
+ },
866
+ {
867
+ "epoch": 15.44,
868
+ "learning_rate": 0.001,
869
+ "loss": 0.0222,
870
+ "step": 222
871
+ },
872
+ {
873
+ "epoch": 15.58,
874
+ "learning_rate": 0.001,
875
+ "loss": 0.0241,
876
+ "step": 224
877
+ },
878
+ {
879
+ "epoch": 15.72,
880
+ "learning_rate": 0.001,
881
+ "loss": 0.0236,
882
+ "step": 226
883
+ },
884
+ {
885
+ "epoch": 15.86,
886
+ "learning_rate": 0.001,
887
+ "loss": 0.0216,
888
+ "step": 228
889
+ },
890
+ {
891
+ "epoch": 16.0,
892
+ "learning_rate": 0.001,
893
+ "loss": 0.0234,
894
+ "step": 230
895
+ },
896
+ {
897
+ "epoch": 16.0,
898
+ "eval_gen_len": 306.16023738872406,
899
+ "eval_loss": 3.34845232963562,
900
+ "eval_rouge1": 41.714,
901
+ "eval_rouge2": 17.7161,
902
+ "eval_rougeL": 27.9345,
903
+ "eval_rougeLsum": 39.8519,
904
+ "eval_runtime": 1759.4496,
905
+ "eval_samples_per_second": 0.192,
906
+ "eval_steps_per_second": 0.024,
907
+ "step": 230
908
+ },
909
+ {
910
+ "epoch": 16.14,
911
+ "learning_rate": 0.001,
912
+ "loss": 0.021,
913
+ "step": 232
914
+ },
915
+ {
916
+ "epoch": 16.28,
917
+ "learning_rate": 0.001,
918
+ "loss": 0.0232,
919
+ "step": 234
920
+ },
921
+ {
922
+ "epoch": 16.42,
923
+ "learning_rate": 0.001,
924
+ "loss": 0.0223,
925
+ "step": 236
926
+ },
927
+ {
928
+ "epoch": 16.56,
929
+ "learning_rate": 0.001,
930
+ "loss": 0.0286,
931
+ "step": 238
932
+ },
933
+ {
934
+ "epoch": 16.7,
935
+ "learning_rate": 0.001,
936
+ "loss": 0.024,
937
+ "step": 240
938
+ },
939
+ {
940
+ "epoch": 16.83,
941
+ "learning_rate": 0.001,
942
+ "loss": 0.0326,
943
+ "step": 242
944
+ },
945
+ {
946
+ "epoch": 16.97,
947
+ "learning_rate": 0.001,
948
+ "loss": 0.0263,
949
+ "step": 244
950
+ },
951
+ {
952
+ "epoch": 16.97,
953
+ "eval_gen_len": 210.71216617210683,
954
+ "eval_loss": 3.2419376373291016,
955
+ "eval_rouge1": 42.0014,
956
+ "eval_rouge2": 17.2719,
957
+ "eval_rougeL": 28.499,
958
+ "eval_rougeLsum": 40.2024,
959
+ "eval_runtime": 1510.2771,
960
+ "eval_samples_per_second": 0.223,
961
+ "eval_steps_per_second": 0.028,
962
+ "step": 244
963
+ },
964
+ {
965
+ "epoch": 17.11,
966
+ "learning_rate": 0.001,
967
+ "loss": 0.0238,
968
+ "step": 246
969
+ },
970
+ {
971
+ "epoch": 17.25,
972
+ "learning_rate": 0.001,
973
+ "loss": 0.0218,
974
+ "step": 248
975
+ },
976
+ {
977
+ "epoch": 17.39,
978
+ "learning_rate": 0.001,
979
+ "loss": 0.0249,
980
+ "step": 250
981
+ },
982
+ {
983
+ "epoch": 17.53,
984
+ "learning_rate": 0.001,
985
+ "loss": 0.0257,
986
+ "step": 252
987
+ },
988
+ {
989
+ "epoch": 17.67,
990
+ "learning_rate": 0.001,
991
+ "loss": 0.036,
992
+ "step": 254
993
+ },
994
+ {
995
+ "epoch": 17.81,
996
+ "learning_rate": 0.001,
997
+ "loss": 0.0328,
998
+ "step": 256
999
+ },
1000
+ {
1001
+ "epoch": 17.95,
1002
+ "learning_rate": 0.001,
1003
+ "loss": 0.0225,
1004
+ "step": 258
1005
+ },
1006
+ {
1007
+ "epoch": 17.95,
1008
+ "eval_gen_len": 248.5786350148368,
1009
+ "eval_loss": 3.3452718257904053,
1010
+ "eval_rouge1": 41.7766,
1011
+ "eval_rouge2": 17.7154,
1012
+ "eval_rougeL": 28.4692,
1013
+ "eval_rougeLsum": 39.9749,
1014
+ "eval_runtime": 1646.4459,
1015
+ "eval_samples_per_second": 0.205,
1016
+ "eval_steps_per_second": 0.026,
1017
+ "step": 258
1018
+ },
1019
+ {
1020
+ "epoch": 18.09,
1021
+ "learning_rate": 0.001,
1022
+ "loss": 0.0225,
1023
+ "step": 260
1024
+ },
1025
+ {
1026
+ "epoch": 18.23,
1027
+ "learning_rate": 0.001,
1028
+ "loss": 0.0211,
1029
+ "step": 262
1030
+ },
1031
+ {
1032
+ "epoch": 18.37,
1033
+ "learning_rate": 0.001,
1034
+ "loss": 0.0201,
1035
+ "step": 264
1036
+ },
1037
+ {
1038
+ "epoch": 18.5,
1039
+ "learning_rate": 0.001,
1040
+ "loss": 0.0235,
1041
+ "step": 266
1042
+ },
1043
+ {
1044
+ "epoch": 18.64,
1045
+ "learning_rate": 0.001,
1046
+ "loss": 0.0209,
1047
+ "step": 268
1048
+ },
1049
+ {
1050
+ "epoch": 18.78,
1051
+ "learning_rate": 0.001,
1052
+ "loss": 0.0211,
1053
+ "step": 270
1054
+ },
1055
+ {
1056
+ "epoch": 18.92,
1057
+ "learning_rate": 0.001,
1058
+ "loss": 0.0225,
1059
+ "step": 272
1060
+ },
1061
+ {
1062
+ "epoch": 18.99,
1063
+ "eval_gen_len": 248.6379821958457,
1064
+ "eval_loss": 3.4440982341766357,
1065
+ "eval_rouge1": 42.1727,
1066
+ "eval_rouge2": 17.598,
1067
+ "eval_rougeL": 28.5122,
1068
+ "eval_rougeLsum": 40.4005,
1069
+ "eval_runtime": 1700.2721,
1070
+ "eval_samples_per_second": 0.198,
1071
+ "eval_steps_per_second": 0.025,
1072
+ "step": 273
1073
+ },
1074
+ {
1075
+ "epoch": 19.06,
1076
+ "learning_rate": 0.001,
1077
+ "loss": 0.0213,
1078
+ "step": 274
1079
+ },
1080
+ {
1081
+ "epoch": 19.2,
1082
+ "learning_rate": 0.001,
1083
+ "loss": 0.0221,
1084
+ "step": 276
1085
+ },
1086
+ {
1087
+ "epoch": 19.34,
1088
+ "learning_rate": 0.001,
1089
+ "loss": 0.0189,
1090
+ "step": 278
1091
+ },
1092
+ {
1093
+ "epoch": 19.48,
1094
+ "learning_rate": 0.001,
1095
+ "loss": 0.0211,
1096
+ "step": 280
1097
+ },
1098
+ {
1099
+ "epoch": 19.48,
1100
+ "eval_gen_len": 200.37982195845697,
1101
+ "eval_loss": 3.321052074432373,
1102
+ "eval_rouge1": 42.5239,
1103
+ "eval_rouge2": 17.4102,
1104
+ "eval_rougeL": 28.6868,
1105
+ "eval_rougeLsum": 40.6537,
1106
+ "eval_runtime": 1595.3839,
1107
+ "eval_samples_per_second": 0.211,
1108
+ "eval_steps_per_second": 0.027,
1109
+ "step": 280
1110
+ },
1111
+ {
1112
+ "epoch": 19.48,
1113
+ "step": 280,
1114
+ "total_flos": 4.895224157149471e+18,
1115
+ "train_loss": 0.049460863295410364,
1116
+ "train_runtime": 102546.6903,
1117
+ "train_samples_per_second": 0.716,
1118
+ "train_steps_per_second": 0.003
1119
+ }
1120
+ ],
1121
+ "logging_steps": 2,
1122
+ "max_steps": 280,
1123
+ "num_train_epochs": 20,
1124
+ "save_steps": 500,
1125
+ "total_flos": 4.895224157149471e+18,
1126
+ "trial_name": null,
1127
+ "trial_params": null
1128
+ }