pszemraj autoevaluator HF staff commited on
Commit
4d7a41b
1 Parent(s): 45a2786

Add evaluation results on the default config of xsum (#5)

Browse files

- Add evaluation results on the default config of xsum (a0c1156157e6c73caf8fe51e9425cbc1a01a75d0)


Co-authored-by: Evaluation Bot <[email protected]>

Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -10,7 +10,7 @@ datasets:
10
  - kmfoda/booksum
11
  metrics:
12
  - rouge
13
- inference: False
14
  model-index:
15
  - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
16
  results:
@@ -80,6 +80,39 @@ model-index:
80
  type: gen_len
81
  value: 47.6532
82
  verified: true
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
83
  ---
84
 
85
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
 
10
  - kmfoda/booksum
11
  metrics:
12
  - rouge
13
+ inference: false
14
  model-index:
15
  - name: pszemraj/long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP
16
  results:
 
80
  type: gen_len
81
  value: 47.6532
82
  verified: true
83
+ - task:
84
+ type: summarization
85
+ name: Summarization
86
+ dataset:
87
+ name: xsum
88
+ type: xsum
89
+ config: default
90
+ split: test
91
+ metrics:
92
+ - name: ROUGE-1
93
+ type: rouge
94
+ value: 19.3209
95
+ verified: true
96
+ - name: ROUGE-2
97
+ type: rouge
98
+ value: 2.7978
99
+ verified: true
100
+ - name: ROUGE-L
101
+ type: rouge
102
+ value: 12.5816
103
+ verified: true
104
+ - name: ROUGE-LSUM
105
+ type: rouge
106
+ value: 15.0239
107
+ verified: true
108
+ - name: loss
109
+ type: loss
110
+ value: 4.483709335327148
111
+ verified: true
112
+ - name: gen_len
113
+ type: gen_len
114
+ value: 82.729
115
+ verified: true
116
  ---
117
 
118
  # long-t5-tglobal-large-pubmed-3k-booksum-16384-WIP