ausboss
/

llygma-13b-lora

Model card Files Files and versions Community

ausboss commited on May 3, 2023

Commit

9bd7284

•

1 Parent(s): f3e0ea6

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -1,3 +1,4 @@
 training_arguments = transformers.TrainingArguments(
     per_device_train_batch_size=4,
     gradient_accumulation_steps=BATCH_SIZE // MICRO_BATCH_SIZE,
@@ -28,4 +29,4 @@ MICRO_BATCH_SIZE = 4
 GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE
 LEARNING_RATE = 3e-4
 TRAIN_STEPS = 300
-OUTPUT_DIR = "llygmaV2-13B"

+```
 training_arguments = transformers.TrainingArguments(
     per_device_train_batch_size=4,
     gradient_accumulation_steps=BATCH_SIZE // MICRO_BATCH_SIZE,
 GRADIENT_ACCUMULATION_STEPS = BATCH_SIZE // MICRO_BATCH_SIZE
 LEARNING_RATE = 3e-4
 TRAIN_STEPS = 300
+```