Tian Xie
tianxie-sf
·
AI & ML interests
LLMs
Organizations
None yet
tianxie-sf's activity
AttributeError: 'XgenTokenizer' object has no attribute 'encoder'
1
#15 opened about 1 year ago
by
StevenLyp
xgen-7b-8k-base model tokenizer has a problem: AttributeError: 'XgenTokenizer' object has no attribute 'encoder'
3
#29 opened about 1 year ago
by
awesomenes
Update tokenization_xgen.py
#16 opened about 1 year ago
by
tianxie-sf
Update tokenization_xgen.py
#11 opened about 1 year ago
by
tianxie-sf
Update tokenization_xgen.py
#10 opened about 1 year ago
by
tianxie-sf
add codegen2 tokens
#27 opened about 1 year ago
by
tianxie-sf
Update tokenization_xgen.py
#28 opened about 1 year ago
by
rooa
Regarding Choosing TPU over GPU for training
1
#23 opened over 1 year ago
by
eshamanideep
tokenizer.get_vocab() method is not working
2
#17 opened over 1 year ago
by
Zangs3011
fix issue in get vocab
#9 opened over 1 year ago
by
tianxie-sf
fix issue in get vocab
#18 opened over 1 year ago
by
tianxie-sf
fix issue in get vocab
#14 opened over 1 year ago
by
tianxie-sf
Error loading model into Test Generation Web UI (ooba)
8
#11 opened over 1 year ago
by
viktor-ferenczi
_convert_id_to_token
#12 opened over 1 year ago
by
tianxie-sf
update _convert_id_to_token
#11 opened over 1 year ago
by
tianxie-sf
update _convert_id_to_token
#7 opened over 1 year ago
by
tianxie-sf
add pad token and default eos token
#6 opened over 1 year ago
by
tianxie-sf
add pad token and default eos token
#5 opened over 1 year ago
by
tianxie-sf
add pad token and default eos token
#5 opened over 1 year ago
by
tianxie-sf
add pad token and default eos token
#6 opened over 1 year ago
by
tianxie-sf