Hugging Face's logo

zirui3
/
llm-zh-tokenizer

Model card Files Community
zirui3 commited on
Commit
fe523d6
•
1 Parent(s): 6ad8aa3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -1,3 +1,5 @@
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
  ---
4
+
5
+ Chinese tokenizer trained on Baike by using BPE algorithm