UNIST-Eunchan commited on
Commit
7427deb
1 Parent(s): 1a89701

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -7
README.md CHANGED
@@ -60,13 +60,25 @@ It achieves the following results on the evaluation set:
60
 
61
 
62
 
63
- ## Model description
64
 
65
- More information needed
 
 
 
 
 
 
 
 
 
 
 
66
 
67
  ## Intended uses & limitations
68
 
69
- Paper Summarization
 
 
70
 
71
  ## Compare to Baseline
72
  - Pegasus-X-base **zero-shot** Performance:
@@ -104,10 +116,6 @@ Paper Summarization
104
 
105
 
106
 
107
- ## Training and evaluation data
108
-
109
- We use full of dataset 'ccdv/arxiv-summarization'.
110
-
111
  ## Training procedure
112
 
113
  We use huggingface-based environment such as datasets, trainer, etc.
 
60
 
61
 
62
 
 
63
 
64
+ **Base Model**: [Pegasus-x-base (State-of-the-art for Long Context Summarization)](https://huggingface.co/google/pegasus-x-base)
65
+
66
+ **Finetuning Dataset**:
67
+ - We used **full of ArXiv Dataset (Cohan et al., 2018, NAACL-HLT 2018)** [[PDF]](https://arxiv.org/abs/1804.05685)
68
+ - (Full length is 200,000+)
69
+
70
+ **GPU**: (RTX A6000) x 1
71
+
72
+ **Train time**: About 120 hours for 5 epochs
73
+
74
+ **Test time**: About 8 hours for test dataset.
75
+
76
 
77
  ## Intended uses & limitations
78
 
79
+ - **Research Paper Summarization**
80
+
81
+
82
 
83
  ## Compare to Baseline
84
  - Pegasus-X-base **zero-shot** Performance:
 
116
 
117
 
118
 
 
 
 
 
119
  ## Training procedure
120
 
121
  We use huggingface-based environment such as datasets, trainer, etc.