BigBird Model

#4
by rafaellaae - opened

Your github repo only has the BERT model available, yet I was looking to use the BigBird model due to the larger input size (24000 vs 3000). Is that possible?

AIRI - Artificial Intelligence Research Institute org

Hi! Weights for all pre-trained models are uploaded to the Huggingface model hub.
Yes, you can use the BigBird model as shown in the model card examples: https://huggingface.co/AIRI-Institute/gena-lm-bigbird-base-t2t#examples

Sign up or log in to comment