Update README.md
Browse files
README.md
CHANGED
@@ -3,4 +3,6 @@ license: llama3.1
|
|
3 |
base_model:
|
4 |
- THUDM/LongCite-llama3.1-8b
|
5 |
---
|
6 |
-
GGUF version of longcite, you need to add the following tokens as stop tokens : `[128000, 128007, 128009]` or `["<|begin_of_text|>", "<|end_header_id|>", "<|eot_id|>"]`
|
|
|
|
|
|
3 |
base_model:
|
4 |
- THUDM/LongCite-llama3.1-8b
|
5 |
---
|
6 |
+
GGUF version of longcite, you need to add the following tokens as stop tokens : `[128000, 128007, 128009]` or `["<|begin_of_text|>", "<|end_header_id|>", "<|eot_id|>"]`
|
7 |
+
|
8 |
+
Be default, and it seems to be working so far, EOS token is 128007 (end_header_id). Working for citation and naive question-answer mode.
|