IlyaGusev/saiga_preferences
Viewer • Updated • 30.6k • 94 • 7
Improved quality on hard tasks by 25 percent relative to the base model Qwen2.5-32B-Instruct. Improved multilingual support.
Fine-tuning on A100 in 4-bit with unsloth using SIMPO and custom dataset
LoRA adapter: radm/Qwen2.5-32B-simpo-LoRA
Eval results on ZebraLogic