Was this also trained on 7000 steps?

by Xianjun - opened Aug 8, 2024

Hi,

I noticed in another link https://huggingface.co/EleutherAI/sae-llama-3-8b-32x-v2 you mentioned that they were trained on 7000 steps. Were this repo also trained on 7000 steps?

EleutherAI org Aug 16, 2024

It was trained for over 30k steps on over 8B tokens.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment