llama3.1-8b-refinedbase v1 continued pretraining of llama3.1 8b on refinedweb for ~80M tokens to try to undo the annealing step and make it act more like an actual base model from-our-page/llama3.1-8b-refinedbase-checkpoint-5120 8B • Updated Mar 28, 2025 • 6 from-our-page/llama3.1-8b-refinedbase-checkpoint-4480 8B • Updated Mar 28, 2025 from-our-page/llama3.1-8b-refinedbase-checkpoint-3840 8B • Updated Mar 28, 2025 • 1 from-our-page/llama3.1-8b-refinedbase-checkpoint-3200 8B • Updated Mar 28, 2025
llama3.1-8b-refinedbase v1 continued pretraining of llama3.1 8b on refinedweb for ~80M tokens to try to undo the annealing step and make it act more like an actual base model from-our-page/llama3.1-8b-refinedbase-checkpoint-5120 8B • Updated Mar 28, 2025 • 6 from-our-page/llama3.1-8b-refinedbase-checkpoint-4480 8B • Updated Mar 28, 2025 from-our-page/llama3.1-8b-refinedbase-checkpoint-3840 8B • Updated Mar 28, 2025 • 1 from-our-page/llama3.1-8b-refinedbase-checkpoint-3200 8B • Updated Mar 28, 2025
