flyingfishinwater
/

chinese-baby-llama2

Text2Text Generation

text-generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Why is vocab_size larget than tokens?

#6

by wjq521168 - opened Apr 27

Apr 27

The README.md shows: vocab_size = 32000, but tokens is 65534, i am not sure there's an error here.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment