mlinmg commited on
Commit
4dcfeb3
1 Parent(s): 4c001c4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -53,7 +53,11 @@ dolphin-2_2-yi-34b
53
  - range 65, 80
54
  OrionStar-Yi-34B-Chat
55
  ```
 
56
 
 
 
 
57
 
58
  # Benchmarks
59
  Coming soon.
 
53
  - range 65, 80
54
  OrionStar-Yi-34B-Chat
55
  ```
56
+ # Tips
57
 
58
+ Being a Yi model, try disabling the BOS token and/or running a lower temperature with MinP (and no other samplers) if output doesn't seem right. Yi tends to run "hot" by default.
59
+
60
+ Sometimes the model "spells out" the stop token as </s> like Capybara, so you may need to add </s> as an additional stopping condition.
61
 
62
  # Benchmarks
63
  Coming soon.