README.md

metadata

language:
  - bal
tags:
  - balochi
  - tokenizer
license: apache-2.0

Balochi Tokenizers

Custom tokenizers for the Balochi language.

• 🤗 Tokenizer
• Spacy Tokenizer (WIP)