Alignment-Lab-AI commited on
Commit
3e49e6f
1 Parent(s): 8876aa6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -29
README.md CHANGED
@@ -47,6 +47,33 @@ We will also give sneak-peak announcements on our Discord, which you can find he
47
 
48
  https://AlignmentLab.ai
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
 
51
  # Evaluation
52
 
@@ -112,35 +139,6 @@ Commodity cost was ~$600.
112
  Please await our full releases for further training details.
113
 
114
 
115
- # Prompt Template
116
-
117
- We use our own prompt template which we call "`OpenChat Llama2 V1`"
118
-
119
-
120
- Examples:
121
- ```
122
- # Single-turn V1 Llama 2
123
- tokenize("User: Hello<|end_of_turn|>Assistant:")
124
- # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
125
-
126
- # Multi-turn V1 Llama 2
127
- tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
128
- # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
129
- ```
130
-
131
- For UIs with Prefix and Suffix fields, these will likely work:
132
-
133
- Prefix (include a space after colon):
134
- ```
135
- User:
136
- ```
137
-
138
- Suffix (space after colon):
139
- ```
140
- <|end_of_turn|>\nAssistant:
141
- ```
142
-
143
-
144
  # Serving
145
 
146
  This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.
 
47
 
48
  https://AlignmentLab.ai
49
 
50
+ # Prompt Template
51
+
52
+ We use our own prompt template which we call "`OpenChat Llama2 V1`"
53
+
54
+
55
+ Examples:
56
+ ```
57
+ # Single-turn V1 Llama 2
58
+ tokenize("User: Hello<|end_of_turn|>Assistant:")
59
+ # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
60
+
61
+ # Multi-turn V1 Llama 2
62
+ tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
63
+ # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
64
+ ```
65
+
66
+ For UIs with Prefix and Suffix fields, these will likely work:
67
+
68
+ Prefix (include a space after colon):
69
+ ```
70
+ User:
71
+ ```
72
+
73
+ Suffix (space after colon):
74
+ ```
75
+ <|end_of_turn|>\nAssistant:
76
+ ```
77
 
78
  # Evaluation
79
 
 
139
  Please await our full releases for further training details.
140
 
141
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
142
  # Serving
143
 
144
  This model is most easily served with [OpenChat's](https://github.com/imoneoi/openchat) customized vLLM OpenAI-compatible API server.