Hugging Face's logo

rizvi-rahil786
/
t5-small-pakQuakeKP

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
rizvi-rahil786 commited on
Commit
f0ba46b
•
1 Parent(s): dcd8eb5

End of training

Browse files
Files changed (7) hide show
  1. README.md +18 -15
  2. config.json +1 -1
  3. generation_config.json +1 -1
  4. logs/events.out.tfevents.1712422012.dddb5f68e1c2.2131.0 +3 -0
  5. logs/events.out.tfevents.1712431203.dddb5f68e1c2.2131.1 +3 -0
  6. model.safetensors +1 -1
  7. training_args.bin +2 -2
README.md CHANGED
@@ -17,12 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.4253
21
- - Rouge1: 44.2359
22
- - Rouge2: 30.5507
23
- - Rougel: 44.2106
24
- - Rougelsum: 44.1741
25
- - Gen Len: 6.7217
26
 
27
  ## Model description
28
 
@@ -42,27 +42,30 @@ More information needed
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 5e-05
45
- - train_batch_size: 8
46
- - eval_batch_size: 8
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
- - num_epochs: 5
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
56
- | 1.2431 | 1.0 | 3043 | 1.4989 | 43.2366 | 29.8274 | 43.0806 | 43.0779 | 6.9448 |
57
- | 1.0853 | 2.0 | 6086 | 1.4253 | 44.2359 | 30.5507 | 44.2106 | 44.1741 | 6.7217 |
58
- | 1.0113 | 3.0 | 9129 | 1.4410 | 44.6368 | 30.9222 | 44.508 | 44.5001 | 6.9632 |
59
- | 0.9523 | 4.0 | 12172 | 1.4296 | 43.9811 | 30.0401 | 43.9184 | 43.8937 | 6.6369 |
60
- | 0.9512 | 5.0 | 15215 | 1.4403 | 44.4396 | 30.8244 | 44.382 | 44.3671 | 6.8264 |
 
 
 
61
 
62
 
63
  ### Framework versions
64
 
65
- - Transformers 4.39.1
66
  - Pytorch 2.2.1+cu121
67
  - Datasets 2.18.0
68
  - Tokenizers 0.15.2
 
17
 
18
  This model is a fine-tuned version of [t5-small](https://huggingface.co/t5-small) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.4801
21
+ - Rouge1: 43.5728
22
+ - Rouge2: 29.7242
23
+ - Rougel: 43.4217
24
+ - Rougelsum: 43.5037
25
+ - Gen Len: 6.0567
26
 
27
  ## Model description
28
 
 
42
 
43
  The following hyperparameters were used during training:
44
  - learning_rate: 5e-05
45
+ - train_batch_size: 4
46
+ - eval_batch_size: 4
47
  - seed: 42
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 8
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |
55
  |:-------------:|:-----:|:-----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
56
+ | 1.1732 | 1.0 | 6086 | 1.4855 | 44.3939 | 30.5367 | 44.3029 | 44.2892 | 6.4530 |
57
+ | 1.0189 | 2.0 | 12172 | 1.4801 | 43.5728 | 29.7242 | 43.4217 | 43.5037 | 6.0567 |
58
+ | 0.9379 | 3.0 | 18258 | 1.5378 | 43.8028 | 30.5358 | 43.6786 | 43.7252 | 6.9653 |
59
+ | 0.8248 | 4.0 | 24344 | 1.5389 | 43.8363 | 29.5076 | 43.6659 | 43.7408 | 6.5986 |
60
+ | 0.832 | 5.0 | 30430 | 1.5519 | 44.9435 | 30.0837 | 44.7905 | 44.8729 | 6.5894 |
61
+ | 0.732 | 6.0 | 36516 | 1.5944 | 42.8507 | 28.9669 | 42.7438 | 42.7529 | 6.4045 |
62
+ | 0.778 | 7.0 | 42602 | 1.5845 | 44.1834 | 29.2917 | 44.0298 | 44.0912 | 6.4285 |
63
+ | 0.702 | 8.0 | 48688 | 1.6057 | 44.2474 | 29.458 | 44.0837 | 44.1208 | 6.6088 |
64
 
65
 
66
  ### Framework versions
67
 
68
+ - Transformers 4.39.3
69
  - Pytorch 2.2.1+cu121
70
  - Datasets 2.18.0
71
  - Tokenizers 0.15.2
config.json CHANGED
@@ -55,7 +55,7 @@
55
  }
56
  },
57
  "torch_dtype": "float32",
58
- "transformers_version": "4.39.1",
59
  "use_cache": true,
60
  "vocab_size": 32128
61
  }
 
55
  }
56
  },
57
  "torch_dtype": "float32",
58
+ "transformers_version": "4.39.3",
59
  "use_cache": true,
60
  "vocab_size": 32128
61
  }
generation_config.json CHANGED
@@ -2,5 +2,5 @@
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
- "transformers_version": "4.39.1"
6
  }
 
2
  "decoder_start_token_id": 0,
3
  "eos_token_id": 1,
4
  "pad_token_id": 0,
5
+ "transformers_version": "4.39.3"
6
  }
logs/events.out.tfevents.1712422012.dddb5f68e1c2.2131.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:edabebe9cc24c1d132f419e53ad3b99f754290fca60a0eaa34c509077752a93e
3
+ size 30922
logs/events.out.tfevents.1712431203.dddb5f68e1c2.2131.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6c617e9d472c2fefce1b04d19eb2c3ae7f1ce8030512ac7dde264c1a84fcc48
3
+ size 623
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:878bfd280be4f1d2702e2caa25a2c5f15cf6707d12f9dd706ab6ee09e8812831
3
  size 242041896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c228c5d31871faec415ac5df4b28b60fc1609c98f867db4d220532cd78e4fe8
3
  size 242041896
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ccef0fa08400dac97eea3243766b465b08095227932ea8d6547639801ac70799
3
- size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a667d60d7f1c5db8437f8e9945bf40431a0d0d378a48c77cd32c3225ed026809
3
+ size 5112