retnet-summarization-small

README.md

@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [kaizerBox/retnet-summarization_small](https://huggingface.co/kaizerBox/retnet-summarization_small) on the xsum dataset.
 It achieves the following results on the evaluation set:
-- Loss: 4.1548
+- Loss: 4.1299
 
 ## Model description
 
@@ -35,7 +35,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
+- learning_rate: 0.001
 - train_batch_size: 10
 - eval_batch_size: 10
 - seed: 42
@@ -51,9 +51,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step  | Validation Loss |
 |:-------------:|:-----:|:-----:|:---------------:|
-| 4.3508        | 1.0   | 4610  | 4.1581          |
-| 4.3471        | 2.0   | 9220  | 4.1551          |
-| 4.3446        | 3.0   | 13830 | 4.1548          |
+| 4.3711        | 1.0   | 4610  | 4.1533          |
+| 4.3448        | 2.0   | 9220  | 4.1370          |
+| 4.3247        | 3.0   | 13830 | 4.1299          |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:10e909aa1a3aa9a5354a04476d7b9c9497bb4f3c9efc2dfaa95067eecd387e6a
+oid sha256:caf1cc2a4be82f9fd82e3344c9ad7fd5175e2ec0ede933bfe5a28a992ba922ce
 size 53857264

runs/Nov17_00-10-39_f8b4e62bfa50/events.out.tfevents.1700179839.f8b4e62bfa50.964.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:887b6b68536cf46be542b6d215e34d0b6691768ebe99870d171a114413c8f70a
+size 6238

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a4faff7697c8861a7d2773edb4ddf18938f973965f3955bab32edc7e832ebb87
+oid sha256:6b2b4dc8bfd54696c62fbd1d3fcce38a7ace36bd3aa5f3933bd93904c4ecb140
 size 4600