Training in progress, epoch 1

README.md

@@ -0,0 +1,75 @@
+---
+base_model: klue/roberta-large
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+- f1
+- precision
+- recall
+model-index:
+- name: 0320_cosmetic2_roberta
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# 0320_cosmetic2_roberta
+
+This model is a fine-tuned version of [klue/roberta-large](https://huggingface.co/klue/roberta-large) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.4218
+- Accuracy: 0.8535
+- F1: 0.8554
+- Precision: 0.8632
+- Recall: 0.8535
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 500
+- num_epochs: 10
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| 0.4995        | 1.0   | 273  | 0.3611          | 0.8713   | 0.8724 | 0.8767    | 0.8713 |
+| 0.4616        | 2.0   | 546  | 0.4809          | 0.8419   | 0.8435 | 0.8658    | 0.8419 |
+| 0.2517        | 3.0   | 819  | 0.7009          | 0.8640   | 0.8651 | 0.8772    | 0.8640 |
+| 0.6884        | 4.0   | 1092 | 0.7427          | 0.7978   | 0.8007 | 0.8425    | 0.7978 |
+| 0.4318        | 5.0   | 1365 | 0.4725          | 0.8640   | 0.8647 | 0.8660    | 0.8640 |
+| 0.2824        | 6.0   | 1638 | 0.6081          | 0.875    | 0.8759 | 0.8798    | 0.875  |
+| 0.317         | 7.0   | 1911 | 0.5933          | 0.8676   | 0.8665 | 0.8672    | 0.8676 |
+| 0.2067        | 8.0   | 2184 | 0.6951          | 0.8676   | 0.8671 | 0.8702    | 0.8676 |
+| 0.037         | 9.0   | 2457 | 0.6081          | 0.8860   | 0.8851 | 0.8896    | 0.8860 |
+| 0.1009        | 10.0  | 2730 | 0.7525          | 0.8640   | 0.8642 | 0.8651    | 0.8640 |
+
+
+### Framework versions
+
+- Transformers 4.38.1
+- Pytorch 2.2.1+cu121
+- Datasets 2.17.1
+- Tokenizers 0.15.2

logs/events.out.tfevents.1710950183.f9f164fee68c

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d6636caecd7b01c37fcd7f9486c9336c4308d8d014a3e79b4ae1e5e1a6f283ce
-size 47810
+oid sha256:054231d58a6a1c8e30f3a509b6d78582476b46bfc03e8ab0207df1b984fe059c
+size 67354

logs/events.out.tfevents.1710951148.f9f164fee68c

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:349422fd9c12dec1aead14cfb0667a81e7d760fc9e17943ba4ce24669edc021c
+size 512

logs/events.out.tfevents.1711073913.f9f164fee68c

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4461e0e8b97437d2a9d688e1d401c2e388c311673094b91c8ce74f7df59410c
+size 10374

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c5e56aef5dfae7870f0f15c4634777e3e61ceca5a3354c17d680baac0dfe921a
+oid sha256:820524f4ed83619c6705f31c180f36aecad9756fae876cda8b7fe1d976b32be8
 size 1346686020

special_tokens_map.json

@@ -0,0 +1,51 @@
+{
+  "bos_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,59 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "4": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "[CLS]",
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": false,
+  "eos_token": "[SEP]",
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "never_split": null,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}