Training low-bit ternary models with Axolotl
• 8
AI & ML interests
None defined yet.
Articles
A collection of fine-tuned Falcon-E BitNet models using Axolotl. https://huggingface.co/blog/axolotl-ai-co/finetuning-ternary-llms-tii-axolotl
Model and Datasets for Qwen 2.5 Math PRM 7B
A collection of fine-tuned Falcon-E BitNet models using Axolotl. https://huggingface.co/blog/axolotl-ai-co/finetuning-ternary-llms-tii-axolotl
A collection of tiny models of common model architectures. Useful for e2e smoke tests across real pretrained models to validate loss behavior.
Model and Datasets for Qwen 2.5 Math PRM 7B