LPN64 commited on
Commit
9b6af1b
1 Parent(s): de15183

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -3,4 +3,6 @@ license: llama3.1
3
  base_model:
4
  - THUDM/LongCite-llama3.1-8b
5
  ---
6
- GGUF version of longcite, you need to add the following tokens as stop tokens : `[128000, 128007, 128009]` or `["<|begin_of_text|>", "<|end_header_id|>", "<|eot_id|>"]`
 
 
 
3
  base_model:
4
  - THUDM/LongCite-llama3.1-8b
5
  ---
6
+ GGUF version of longcite, you need to add the following tokens as stop tokens : `[128000, 128007, 128009]` or `["<|begin_of_text|>", "<|end_header_id|>", "<|eot_id|>"]`
7
+
8
+ Be default, and it seems to be working so far, EOS token is 128007 (end_header_id). Working for citation and naive question-answer mode.