Update README.md
Browse files
README.md
CHANGED
@@ -35,6 +35,6 @@ World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Da
|
|
35 |
|
36 |
Training: set --my_testing "r" for latest RWKV-LM
|
37 |
|
38 |
-
Inference: Use rwkv pip package 0.8.
|
39 |
|
40 |
inference algorithm reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
|
|
|
35 |
|
36 |
Training: set --my_testing "r" for latest RWKV-LM
|
37 |
|
38 |
+
Inference: Use rwkv pip package 0.8.6+ for RWKV-5. Might overflow in fp16. Use fp32.
|
39 |
|
40 |
inference algorithm reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
|