What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")

#63

by brando - opened Mar 7

Mar 7

What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")

Sylvestre

Mar 7

8192
see https://huggingface.co/google/gemma-7b/blob/main/config.json#L14

osanseviero changed discussion status to closed Apr 9

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment