DeepSeek-R1-Distill-Llama-8B SpectralPO/DeepSeek-R1-Distill-Llama-8B-SPO 8B • Updated May 18 • 5 SpectralPO/DeepSeek-R1-Distill-Llama-8B-GRPO 8B • Updated May 18 • 9
Qwen2.5-32B-Instruct SpectralPO/Qwen2.5-32B-Instruct-SPO 33B • Updated May 13 • 6 SpectralPO/Qwen2.5-32B-Instruct-GRPO 33B • Updated May 13 • 7
DeepSeek-R1-Distill-Qwen-7B SpectralPO/DeepSeek-R1-Distill-Qwen-7B-GRPO 8B • Updated May 2 • 7 SpectralPO/DeepSeek-R1-Distill-Qwen-7B-SPO 8B • Updated May 2 • 7
Offline RL with Neg Samples SpectralPO/s1K-7B-RSPO-neg 8B • Updated Apr 12 • 6 SpectralPO/Qwen2.5-32B-Instruct-neg 33B • Updated Apr 13 • 7 SpectralPO/Qwen2.5-14B-Instruct-neg 15B • Updated Apr 18 • 9
DeepSeek-R1-Distill-Qwen-32B SpectralPO/DeepSeek-R1-Distill-Qwen-32B-SPO Updated Jul 19 SpectralPO/DeepSeek-R1-Distill-Qwen-32B-GRPO Updated Jul 19
Qwen2.5-14B-Instruct SpectralPO/Qwen2.5-14B-Instruct-GRPO 15B • Updated May 9 • 5 SpectralPO/Qwen2.5-14B-Instruct-SPO 15B • Updated May 9 • 5
Qwen2.5-7B-Instruct SpectralPO/Qwen2.5-7B-Instruct-GRPO 8B • Updated Apr 27 • 9 SpectralPO/Qwen2.5-7B-Instruct-SPO 8B • Updated Apr 27 • 5
DeepSeek-R1-Distill-Llama-8B SpectralPO/DeepSeek-R1-Distill-Llama-8B-SPO 8B • Updated May 18 • 5 SpectralPO/DeepSeek-R1-Distill-Llama-8B-GRPO 8B • Updated May 18 • 9
DeepSeek-R1-Distill-Qwen-32B SpectralPO/DeepSeek-R1-Distill-Qwen-32B-SPO Updated Jul 19 SpectralPO/DeepSeek-R1-Distill-Qwen-32B-GRPO Updated Jul 19
Qwen2.5-32B-Instruct SpectralPO/Qwen2.5-32B-Instruct-SPO 33B • Updated May 13 • 6 SpectralPO/Qwen2.5-32B-Instruct-GRPO 33B • Updated May 13 • 7
Qwen2.5-14B-Instruct SpectralPO/Qwen2.5-14B-Instruct-GRPO 15B • Updated May 9 • 5 SpectralPO/Qwen2.5-14B-Instruct-SPO 15B • Updated May 9 • 5
DeepSeek-R1-Distill-Qwen-7B SpectralPO/DeepSeek-R1-Distill-Qwen-7B-GRPO 8B • Updated May 2 • 7 SpectralPO/DeepSeek-R1-Distill-Qwen-7B-SPO 8B • Updated May 2 • 7
Qwen2.5-7B-Instruct SpectralPO/Qwen2.5-7B-Instruct-GRPO 8B • Updated Apr 27 • 9 SpectralPO/Qwen2.5-7B-Instruct-SPO 8B • Updated Apr 27 • 5
Offline RL with Neg Samples SpectralPO/s1K-7B-RSPO-neg 8B • Updated Apr 12 • 6 SpectralPO/Qwen2.5-32B-Instruct-neg 33B • Updated Apr 13 • 7 SpectralPO/Qwen2.5-14B-Instruct-neg 15B • Updated Apr 18 • 9
