Sequence/Context Length

#10

by Birdman13 - opened Jan 8

Jan 8

Was hoping you could clear up some confusion with regard to knowing the real context length of your models.
In the Model Card of this model, it states the Sequence Length is 8k. However, in the config.json the sliding window is 4k.

What is the most trustworthy place to determine the context length of each model?

Thanks!

MinaiRoderon

Apr 16

@Birdman13 the official website: https://mistral.ai/news/mixtral-of-experts/#:~:text=It%20gracefully%20handles%20a%20context%20of%2032k%20tokens.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment