How to use NetherQuartz/ilo-toki-1.1-MiLMMT-46-1b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NetherQuartz/ilo-toki-1.1-MiLMMT-46-1b", device_map="auto")
https://huggingface.co/NetherQuartz/ilo-toki-1.1-MiLMMT-46-1b/resolve/main/tokenizer_config.json
hf download hf://NetherQuartz/ilo-toki-1.1-MiLMMT-46-1b/tokenizer_config.json
curl -L -o tokenizer_config.json https://huggingface.co/NetherQuartz/ilo-toki-1.1-MiLMMT-46-1b/resolve/main/tokenizer_config.json
