Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,9 @@ datasets:
|
|
6 |
## LoRA Info:
|
7 |
Please note that this is a highly experimental LoRA model. It may do some good stuff, it may be bad, it may do nothing and not work. Hopefully after training is fully done, it'll be good!
|
8 |
|
9 |
-
Current upload: checkpoint of epoch 0
|
10 |
|
11 |
-
The alpaca-lora repo by tloen doesn't *seem* to create
|
|
|
|
|
|
|
|
6 |
## LoRA Info:
|
7 |
Please note that this is a highly experimental LoRA model. It may do some good stuff, it may be bad, it may do nothing and not work. Hopefully after training is fully done, it'll be good!
|
8 |
|
9 |
+
Current upload: checkpoint of epoch 1.0 (of 3)
|
10 |
|
11 |
+
The alpaca-lora repo by tloen doesn't *seem* to create an immediately working adapter/peft model until the training is finalized, but I attempted to turn a checkpoint into one.
|
12 |
+
I hope it works for y'all ^~^ Thanks to MetaIX for initial seemingly successful testing of the first uploaded checkpoint (epoch 0.8).
|
13 |
+
|
14 |
+
**Wikitext2 eval benchmark for epoch 0.8 upload:** 4.548329830169678 (Thanks to Metal/MetaIX)
|