Fill-Mask
Transformers
Safetensors
Gujarati
mt5
text2text-generation
trimmed
mt5-base-guj-32768 / tokenizer_config.json
lbourdois's picture
Trimmed google/mt5-base for Gujarati (32768 tokens)
c60bc91 verified
Raw History Blame Contribute Delete
96 Bytes
{
"eos_token": "</s>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"extra_ids": 0
}