This model trains T5-V1_1-base on the Qazaq dataset of Oscar. Note that the original configuration is slightly change (dropout is set to 0).
The official run_t5_mlm_flax.py is copied into the repository and is run using the hyperparameters as defined in run_t5.sh.
- Downloads last month
- 6
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.