nvl-og/finetuned-ai

README.md

@@ -0,0 +1,58 @@
+---
+library_name: transformers
+license: llama3.1
+base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
+tags:
+- generated_from_trainer
+model-index:
+- name: results
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# results
+
+This model is a fine-tuned version of [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) on the None dataset.
+It achieves the following results on the evaluation set:
+- eval_loss: 0.5104
+- eval_runtime: 12.1037
+- eval_samples_per_second: 17.598
+- eval_steps_per_second: 2.231
+- epoch: 1.7778
+- step: 6
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 3e-05
+- train_batch_size: 4
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 16
+- total_train_batch_size: 64
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- num_epochs: 5
+
+### Framework versions
+
+- Transformers 4.45.0
+- Pytorch 2.4.1+cu121
+- Datasets 3.0.0
+- Tokenizers 0.20.0

generation_config.json

@@ -0,0 +1,12 @@
+{
+  "bos_token_id": 128000,
+  "do_sample": true,
+  "eos_token_id": [
+    128001,
+    128008,
+    128009
+  ],
+  "temperature": 0.6,
+  "top_p": 0.9,
+  "transformers_version": "4.45.0"
+}

model-00001-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8c2dc38744903d6ec27d3549d2663c1a0f14196dbb2d7c882345ce8935cfc95e
+oid sha256:b5fba9a33bfb5151db0445229f9fbd9da67d6274bf2f2e163862ed3346e4f25d
 size 4976698672

model-00002-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6b2559ce799b19ada7f7f891a5a9d94c308e35ac4ff9c8af4f9b0ae275667ec6
+oid sha256:4b4e9c12b7ef9f107ec0b3e95c547242557f361cf4a8cca4ab99d5ed9504d4e9
 size 4999802720

model-00003-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c499baff6e24d4ab996fe77040f88c0396854f9f00c4c7602d500822c1306da5
+oid sha256:f3cb3d35ed277b68ff621150ad54eb78843576cead2c8f4aff92b514e9e68736
 size 4915916176

model-00004-of-00004.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d8cf515a5b46001b6a8787189e521b280fe61c5faf15431a8ff3def2dbefcc25
+oid sha256:526c272e911512cdde86296722b1b96610885b9c6150e71e8985ae2dd8f608a8
 size 1168138808

runs/Sep26_00-28-43_b9223b6a75d1/events.out.tfevents.1727310525.b9223b6a75d1.5077.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5e1f26d04dcdfa972f97bf3a086f0546348f205f01e2b7c6d697cec6d276ed73
-size 5459
+oid sha256:bd4b3043545eccdc1b2bfc1bcdddad3fcd8b00fef6301e323020ba1bd36e69c7
+size 5725