Salesforce
/

xgen-7b-8k-base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

xgen-7b-8k-base / tokenization_xgen.py

Commit History

fix tokenizer save_pretrained method

927e4b7
verified

katuni4ka commited on May 20

Update _decode method to accept integer element and convert it to sequence (#30)

582db72
verified

ramkrithiks commited on Feb 7

Update tokenization_xgen.py

a473726

tianxie-sf commited on Oct 24, 2023

Update tokenization_xgen.py (#28)

6d7139b

rooa commited on Aug 18, 2023

fix issue in get vocab (#18)

1a0f468

tianxie-sf commited on Jul 7, 2023

_convert_id_to_token (#12)

3987e09

tianxie-sf commited on Jul 2, 2023

Tokenization updates (#8)

f12f979

psinger commited on Jun 30, 2023

add pad token and default eos token (#6)

e9a901f

tianxie-sf commited on Jun 29, 2023

.

d2cc612

rooa commited on Jun 28, 2023

.

b9f4adf

rooa commited on Jun 28, 2023

.

04d6513

rooa commited on Jun 28, 2023