FPHam commited on
Commit
6073b4d
1 Parent(s): 5b6f409

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -33,6 +33,7 @@ This is a version 0.2 and finetuned just so it retains the underlaying Vicuna qu
33
  Example:
34
  Input
35
  ```
 
36
  unce upon time lived name John who have pet monkey Jackie.
37
  one day while walkin down the street he saw his friend Tom coming to him.
38
  "Hey Tom" said John "hows it going?"
@@ -45,7 +46,7 @@ Tom struggle to keep his balance as he laugh hystericaly.
45
  ```
46
  Output
47
  ```
48
- Once upon a time there lived a man named John who had a pet monkey called Jackie.
49
  One day while walking down the street he saw his friend Tom approaching him.
50
  "Hey Tom," said John. "How's it going?"
51
 
@@ -61,3 +62,4 @@ Goal: to create the best grammar checker you have ever seen
61
  To do:
62
  - train on even larger dataset
63
  - see if finetuning on just plain LLAMA without Vicuna would work better or worse (the theoryu is that it will became very focused on editing and nothing else)
 
 
33
  Example:
34
  Input
35
  ```
36
+ USER: Edit the following for spelling and grammar mistakes:
37
  unce upon time lived name John who have pet monkey Jackie.
38
  one day while walkin down the street he saw his friend Tom coming to him.
39
  "Hey Tom" said John "hows it going?"
 
46
  ```
47
  Output
48
  ```
49
+ ASSISTANT: Once upon a time there lived a man named John who had a pet monkey called Jackie.
50
  One day while walking down the street he saw his friend Tom approaching him.
51
  "Hey Tom," said John. "How's it going?"
52
 
 
62
  To do:
63
  - train on even larger dataset
64
  - see if finetuning on just plain LLAMA without Vicuna would work better or worse (the theoryu is that it will became very focused on editing and nothing else)
65
+ - explore what different settings (temperature, top_p, top_k do for this type of finetune)