autoevaluator HF staff commited on
Commit
347f7ba
1 Parent(s): 0a69e46

Add evaluation results on the kmfoda--booksum config and test split of kmfoda/booksum

Browse files

Beep boop, I am a bot from Hugging Face's automatic model evaluator 👋!\
Your model has been evaluated on the kmfoda--booksum config and test split of the [kmfoda/booksum](https://huggingface.co/datasets/kmfoda/booksum) dataset by

@pszemraj

, using the predictions stored [here](https://huggingface.co/datasets/autoevaluate/autoeval-eval-kmfoda__booksum-kmfoda__booksum-9f206e-47938145232).\
Accept this pull request to see the results displayed on the [Hub leaderboard](https://huggingface.co/spaces/autoevaluate/leaderboards?dataset=kmfoda/booksum).\
Evaluate your model on more datasets [here](https://huggingface.co/spaces/autoevaluate/model-evaluator?dataset=kmfoda/booksum).

Files changed (1) hide show
  1. README.md +42 -0
README.md CHANGED
@@ -211,6 +211,48 @@ parameters:
211
  length_penalty: 0.4
212
  num_beams: 4
213
  base_model: pszemraj/long-t5-tglobal-base-16384-book-summary
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
214
  ---
215
 
216
 
 
211
  length_penalty: 0.4
212
  num_beams: 4
213
  base_model: pszemraj/long-t5-tglobal-base-16384-book-summary
214
+ model-index:
215
+ - name: pszemraj/long-t5-tglobal-base-16384-booksci-summary-v1
216
+ results:
217
+ - task:
218
+ type: summarization
219
+ name: Summarization
220
+ dataset:
221
+ name: kmfoda/booksum
222
+ type: kmfoda/booksum
223
+ config: kmfoda--booksum
224
+ split: test
225
+ metrics:
226
+ - type: rouge
227
+ value: 36.7976
228
+ name: ROUGE-1
229
+ verified: true
230
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzk0ZDQ3MDI1MmRhZDZhOTkzMGY3MWZmNGM2MzMwYTI1Y2MyZDQ0ZWZiZTRkZjI2YzJhMTRkOWE2MmM0MzEzNyIsInZlcnNpb24iOjF9.U_h6vUEz3UYWsk90uBckLpUJqSE9L_XlQiwcBdpDLE_lBPTZZ_V0hoFNrR3c2kUKBLZPPrRWsqCqca_uzhTgDw
231
+ - type: rouge
232
+ value: 6.1002
233
+ name: ROUGE-2
234
+ verified: true
235
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWMwNWVjMDMwYTNlNmQ5Yjc3NzQ0Y2MyNjg2NzA3ZTYyN2NkMmUxMTU3YjUwYzZjNmJlZWQwZTc5ODk0ZjhmOSIsInZlcnNpb24iOjF9.efVyAzcR7ay-Yy3jCzgaF7FnRXdjCLxxEz6crKVjsqwdW7B3eBBdFD5AXRItMk5_yGdrZTSjEFjpgb15Qt3yDw
236
+ - type: rouge
237
+ value: 16.5037
238
+ name: ROUGE-L
239
+ verified: true
240
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2UwYTU3NzAzNDBmNjRhMWNiOGU2NDE5ZGIwMmY3MzI1NjczZDUxYzVjM2VlNDI5OTgzYjI5NTk3YTgwYjNjZSIsInZlcnNpb24iOjF9.yTuu6tK7MLOf2y_RAG7RAcOrm7uX5OYnYYJ0Nts7ZocojFM45FA4p_DLGwrIKtw8gRWQOj5Y8aUgvRc3ZvPnAA
241
+ - type: rouge
242
+ value: 33.6126
243
+ name: ROUGE-LSUM
244
+ verified: true
245
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGMyMmUwNTkzZTBjYzg2NTFkY2M5ODkzOTIwOGYzNWEwNWM4ODFiODg5MGM2ZjBmODNkNGJhZTI3ZjY2YzRiOCIsInZlcnNpb24iOjF9.F4clVCMlK2AvTrsBX9LGmbMoI618Iq_gkhyRyNo0s2gJG4y73nZC6s_TH7zolpIDfo-bcn46ALFX7LGmZALrCw
246
+ - type: loss
247
+ value: 2.3926444053649902
248
+ name: loss
249
+ verified: true
250
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOWU3MmJmYmU0ODBhMDJiYWMzN2M3ZTdkM2YzMzI5YzVkM2YwNTA3YjQ5MDBmYmZjOWQ1ZDMwYjUyYTI0ZDQ3YyIsInZlcnNpb24iOjF9.BvumB3q-msXpO1fYkrsy7x9q1ai2mNkRpc18RqfKdUc1pipPnmBOfQYemc9GGZqT8yVAigF2sjWIsZDh4FcICQ
251
+ - type: gen_len
252
+ value: 279.9161
253
+ name: gen_len
254
+ verified: true
255
+ verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZWM0NDkzZTNiZjhiZjMzMzM5NWUwOGRlYTI4ZjkzNWVjMDNlZTVjMTE2NzdjMTE4ZDJjNDVmZjQxOWZjMDk2MCIsInZlcnNpb24iOjF9.kHWjbQmcBTWxHkhibyIy4S_5Ze759i2nuR8MEB6LIYAQDy0aQgpaOH32Ux0juqENHr390AcxSa04FN8EIQJkCw
256
  ---
257
 
258