autoevaluator HF staff commited on
Commit
fb8f83e
1 Parent(s): b7307be

Add evaluation results on the y config and test split of big_patent

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the y config and test split of the [big_patent](https://huggingface.co/datasets/big_patent) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-big_patent-y-b4cccf-1519855005).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=big_patent).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=big_patent).

Files changed (1) hide show
  1. README.md +33 -0
README.md CHANGED
@@ -318,6 +318,39 @@ model-index:
318
  type: gen_len
319
  value: 200.6785
320
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
321
  ---
322
 
323
  # pszemraj/pegasus-x-large-book-summary
 
318
  type: gen_len
319
  value: 200.6785
320
  verified: true
321
+ - task:
322
+ type: summarization
323
+ name: Summarization
324
+ dataset:
325
+ name: big_patent
326
+ type: big_patent
327
+ config: y
328
+ split: test
329
+ metrics:
330
+ - name: ROUGE-1
331
+ type: rouge
332
+ value: 37.376
333
+ verified: true
334
+ - name: ROUGE-2
335
+ type: rouge
336
+ value: 11.4432
337
+ verified: true
338
+ - name: ROUGE-L
339
+ type: rouge
340
+ value: 22.2754
341
+ verified: true
342
+ - name: ROUGE-LSUM
343
+ type: rouge
344
+ value: 32.5087
345
+ verified: true
346
+ - name: loss
347
+ type: loss
348
+ value: 2.9867310523986816
349
+ verified: true
350
+ - name: gen_len
351
+ type: gen_len
352
+ value: 172.7776
353
+ verified: true
354
  ---
355
 
356
  # pszemraj/pegasus-x-large-book-summary