Text Generation
Transformers
PyTorch
English
llama
text-generation-inference
Inference Endpoints
bleysg commited on
Commit
4f7146c
1 Parent(s): e0dc121

Update README.md

Browse files

Add sysprompt / context to prompt format.

Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -57,12 +57,12 @@ The model is heavily conditioned to work using this format only and will likely
57
  Examples:
58
  ```
59
  # Single-turn V1 Llama 2
60
- tokenize("User: Hello<|end_of_turn|>Assistant:")
61
- # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
62
 
63
  # Multi-turn V1 Llama 2
64
- tokenize("User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
65
- # Result: [1, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
66
  ```
67
 
68
  For UIs with Prefix and Suffix fields, these will likely work:
 
57
  Examples:
58
  ```
59
  # Single-turn V1 Llama 2
60
+ tokenize("You are OpenOrcaChat.<|end_of_turn|>User: Hello<|end_of_turn|>Assistant:")
61
+ # [1, 887, 526, 4673, 2816, 1113, 1451, 271, 29889, 32000, 4911, 29901, 15043, 32000, 4007, 22137, 29901]
62
 
63
  # Multi-turn V1 Llama 2
64
+ tokenize("You are OpenOrcaChat.<|end_of_turn|>User: Hello<|end_of_turn|>Assistant: Hi<|end_of_turn|>User: How are you today?<|end_of_turn|>Assistant:")
65
+ # [1, 887, 526, 4673, 2816, 1113, 1451, 271, 29889, 32000, 4911, 29901, 15043, 32000, 4007, 22137, 29901, 6324, 32000, 4911, 29901, 1128, 526, 366, 9826, 29973, 32000, 4007, 22137, 29901]
66
  ```
67
 
68
  For UIs with Prefix and Suffix fields, these will likely work: