tokenizer.model

#5
by bartowski - opened

Would it be possible to get the tokenizer.model file? This would enable ExLlamaV2 quantization

Berkeley-Nest org

Thanks for the reminder! Just copied from Openchat 3.5 lol.

Are you trying the GPTQ quant? @bartowski

@rjmehta nah exllama v2, made some for this here:

https://huggingface.co/bartowski/Starling-LM-7B-alpha-exl2

bartowski changed discussion status to closed

Sign up or log in to comment