| language: | |
| - ms | |
| # Pretrain BASE 512 masking context length T5 on Malaysian text | |
| README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/nanoT5 | |
| WandB, https://wandb.ai/mesolitica/nanoT5-base?workspace=user-husein-mesolitica |
| language: | |
| - ms | |
| # Pretrain BASE 512 masking context length T5 on Malaysian text | |
| README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/nanoT5 | |
| WandB, https://wandb.ai/mesolitica/nanoT5-base?workspace=user-husein-mesolitica |