Update README.md
Browse files
README.md
CHANGED
@@ -25,7 +25,7 @@ datasets:
|
|
25 |
|
26 |
# RWKV-5 World (Training in Progress)
|
27 |
|
28 |
-
|
29 |
|
30 |
Use rwkv pip package 0.8.7+ for RWKV-5 inference.
|
31 |
|
@@ -35,7 +35,7 @@ RWKV-5 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
|
35 |
|
36 |
World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
37 |
|
38 |
-
RWKV-5 training: set --my_testing "r" in latest RWKV-LM
|
39 |
|
40 |
RWKV-5 inference implementation reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
|
41 |
|
|
|
25 |
|
26 |
# RWKV-5 World (Training in Progress)
|
27 |
|
28 |
+
RWKV-5 Details: https://twitter.com/BlinkDL_AI/status/1685230712247795713
|
29 |
|
30 |
Use rwkv pip package 0.8.7+ for RWKV-5 inference.
|
31 |
|
|
|
35 |
|
36 |
World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
37 |
|
38 |
+
RWKV-5 training: set --my_testing "r" ("r2" is better) in latest RWKV-LM
|
39 |
|
40 |
RWKV-5 inference implementation reference: https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_v5_demo.py
|
41 |
|