view article Article Introducing harness adapters: adapt your favorite model to your harness to improve performance and cost +8 ybelkada, burtenshaw, SaylorTwift, lysandre, aminediroHF, AdithyaSK, evalstate, sergiopaniego, joelniklaus, lewtun • 3 days ago • 49
view article Article MOPD: how frontier labs merge RL experts into one model and how to do it using TRL sergiopaniego • 19 days ago • 25
view article Article Welcome RL Environments to the hub +6 burtenshaw, AdithyaSK, sergiopaniego, xeophon, ryanmarten, merve, lhoestq, julien-c • Sep 28 • 47
view article Article One sandbox per rollout, or how labs run RL for agents in 2026 sergiopaniego • Sep 11 • 13
view article Article Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL +2 aminediroHF, qgallouedec, kashif, sergiopaniego • Sep 10 • 55
view article Article Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps +1 iamleonie, burtenshaw, sergiopaniego • Sep 3 • 161
view article Article Training a coding model to paint watercolours with TRL and OpenEnv sergiopaniego • Sep 3 • 85
view article Article Training a coding agent using the OpenCode harness in remote HF sandboxes with TRL and OpenEnv sergiopaniego • Aug 5 • 32
view article Article Can you train a model on Simon Willison's deeply unscientific pelican benchmark? sergiopaniego • Jul 30 • 2
view article Article Profiling in PyTorch (Part 3): Attention is all you profile +2 ariG23498, sergiopaniego, sayakpaul, ror • Jul 10 • 55
view article Article Distillation in 2026 (so far): which frontier models use it and how sergiopaniego • Jul 8 • 25
view article Article I fine-tuned a model for free from one prompt, with TRL and the Google Colab CLI sergiopaniego • Jun 15 • 8
view article Article Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP +3 ariG23498, ror, sergiopaniego, pcuenq, sayakpaul • Jun 11 • 64
view article Article The Open Source Community is backing OpenEnv for Agentic RL +18 burtenshaw, spisakjo, lysandre, darktex, willcb, qjoy, pawalt, cwing-nv, danielhanchen, andrewzhou, thegovind, shimmyshimmer, Hamid-Nazeri, Sanyam, zkwentz, emre0, lewtun, sergiopaniego, banghua, unseenmars • Jun 8 • 124