pszemraj autoevaluator HF staff commited on
Commit
d4cee63
1 Parent(s): b7307be

Add evaluation results on the y config and test split of big_patent (#5)

Browse files

- Add evaluation results on the y config and test split of big_patent (fb8f83e7fcbc2f946404aaf640b13064e04e3ae9)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -318,6 +318,39 @@ model-index:
318
  type: gen_len
319
  value: 200.6785
320
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
321
  ---
322
 
323
  # pszemraj/pegasus-x-large-book-summary
 
318
  type: gen_len
319
  value: 200.6785
320
  verified: true
321
+ - task:
322
+ type: summarization
323
+ name: Summarization
324
+ dataset:
325
+ name: big_patent
326
+ type: big_patent
327
+ config: y
328
+ split: test
329
+ metrics:
330
+ - name: ROUGE-1
331
+ type: rouge
332
+ value: 37.376
333
+ verified: true
334
+ - name: ROUGE-2
335
+ type: rouge
336
+ value: 11.4432
337
+ verified: true
338
+ - name: ROUGE-L
339
+ type: rouge
340
+ value: 22.2754
341
+ verified: true
342
+ - name: ROUGE-LSUM
343
+ type: rouge
344
+ value: 32.5087
345
+ verified: true
346
+ - name: loss
347
+ type: loss
348
+ value: 2.9867310523986816
349
+ verified: true
350
+ - name: gen_len
351
+ type: gen_len
352
+ value: 172.7776
353
+ verified: true
354
  ---
355
 
356
  # pszemraj/pegasus-x-large-book-summary