Recovered 8x DDP adapter (step 185, eval_loss 0.4275)

91665fb verified 2 months ago

268 Bytes

base_model: Hcompany/Holo-3.1-35B-A3B
library_name: peft
tags:
  - roblox
  - game-dev

Holo-3.1-35B-A3B game-dev LoRA (ARM A)

8x DDP SFT on the cybus game-dev + grounding mix, 185 steps @ 7168 seq, eval_loss 0.4275. Load on top of Hcompany/Holo-3.1-35B-A3B.