「tokenizer_class」:「GPTNeoXTokenizerFast」に変更 (#2)

- Update tokenizer_config.json (71a334b5029b1febbcf8b4bb2ec430ea41ec3199)


Co-authored-by: Yasunori Ozaki <[email protected]>

tokenizer_config.json

@@ -23,6 +23,6 @@
   "eos_token": "<|endoftext|>",
   "model_max_length": 1000000000000000019884624838656,
   "pad_token": "<|padding|>",
-  "tokenizer_class": "GPTNeoXTokenizer",
+  "tokenizer_class": "GPTNeoXTokenizerFast",
   "unk_token": "<|endoftext|>"
 }