UNIST-Eunchan
commited on
Commit
•
c0ec00c
1
Parent(s):
7427deb
Update README.md
Browse files
README.md
CHANGED
@@ -45,21 +45,6 @@ should probably proofread and complete it, then remove this comment. -->
|
|
45 |
|
46 |
This model is a fine-tuned version of [google/pegasus-x-base](https://huggingface.co/google/pegasus-x-base) on the arxiv-summarization dataset.
|
47 |
|
48 |
-
It achieves the following results on the evaluation set:
|
49 |
-
- Loss: 2.0127
|
50 |
-
|
51 |
-
### Training results
|
52 |
-
|
53 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
54 |
-
|:-------------:|:-----:|:-----:|:---------------:|
|
55 |
-
| 2.6153 | 1.0 | 3172 | 2.1045 |
|
56 |
-
| 2.202 | 2.0 | 6344 | 2.0511 |
|
57 |
-
| 2.1547 | 3.0 | 9516 | 2.0282 |
|
58 |
-
| 2.132 | 4.0 | 12688 | 2.0164 |
|
59 |
-
| 2.1222 | 5.0 | 15860 | 2.0127 |
|
60 |
-
|
61 |
-
|
62 |
-
|
63 |
|
64 |
**Base Model**: [Pegasus-x-base (State-of-the-art for Long Context Summarization)](https://huggingface.co/google/pegasus-x-base)
|
65 |
|
@@ -139,6 +124,20 @@ num_epochs: 5
|
|
139 |
```
|
140 |
|
141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
142 |
### Framework versions
|
143 |
|
144 |
- Transformers 4.32.1
|
|
|
45 |
|
46 |
This model is a fine-tuned version of [google/pegasus-x-base](https://huggingface.co/google/pegasus-x-base) on the arxiv-summarization dataset.
|
47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
48 |
|
49 |
**Base Model**: [Pegasus-x-base (State-of-the-art for Long Context Summarization)](https://huggingface.co/google/pegasus-x-base)
|
50 |
|
|
|
124 |
```
|
125 |
|
126 |
|
127 |
+
### Training results
|
128 |
+
|
129 |
+
| Training Loss | Epoch | Step | Validation Loss |
|
130 |
+
|:-------------:|:-----:|:-----:|:---------------:|
|
131 |
+
| 2.6153 | 1.0 | 3172 | 2.1045 |
|
132 |
+
| 2.202 | 2.0 | 6344 | 2.0511 |
|
133 |
+
| 2.1547 | 3.0 | 9516 | 2.0282 |
|
134 |
+
| 2.132 | 4.0 | 12688 | 2.0164 |
|
135 |
+
| 2.1222 | 5.0 | 15860 | 2.0127 |
|
136 |
+
|
137 |
+
|
138 |
+
|
139 |
+
|
140 |
+
|
141 |
### Framework versions
|
142 |
|
143 |
- Transformers 4.32.1
|