341b tokens model

README.md

@@ -52,8 +52,6 @@ language:
 pipeline_tag: text-generation
 ---
 
-# <span style="color:red"><b>WARNING:</b> This is an <b>intermediary checkpoint</b>. It is not fully trained yet. You might want to use [Bloom-1B3](https://huggingface.co/bigscience/bloom-1b3) if you want a model that has completed training.</span>
-
 <h1 style='text-align: center '>BLOOM LM</h1> 
 <h2 style='text-align: center '><em>BigScience Large Open-science Open-access Multilingual Language Model</em> </h2> 
 <h3 style='text-align: center '>Model Card</h3>
@@ -455,7 +453,7 @@ Includes:
 And multiple different metrics for specific tasks. _(More evaluation metrics forthcoming upon completion of evaluation protocol.)_
 
 ### Factors 
-*This section lists some different aspects of what BLOOM models. Its focus is on those aspects that are likely to give rise to high variance in model behavior.*
+*This section lists some different aspects of BLOOM models. Its focus is on those aspects that are likely to give rise to high variance in model behavior.*
 
 - Language, such as English or Yoruba
 
@@ -470,11 +468,11 @@ And multiple different metrics for specific tasks. _(More evaluation metrics for
 
 As of 25.May.2022, 15:00 PST:
 
-- Training Loss: 2.0
+- Training Loss: 2.7
 
-- Validation Loss: 2.2
+- Validation Loss: 3.1
 
-- Perplexity: 8.9
+- Perplexity: 21.9
 
 (More evaluation scores forthcoming at the end of model training.)
 
@@ -563,5 +561,5 @@ Initial prompting experiments using interim checkpoints: https://huggingface.co/
 ## Model Card Authors
 *Ordered roughly chronologically and by amount of time spent.*
 
-Margaret Mitchell, Giada Pistilli, Yacine Jernite, Ezinwanne Ozoani, Marissa Gerchick, Nazneen Rajani, Sasha Luccioni, Irene Solaiman, Maraim Masoud, Somaieh Nikpoor, Carlos Muñoz Ferrandis, Stas Bekman, Christopher Akiki, Danish Contractor, David Lansky, Angelina McMillan-Major, Tristan Thrush, Suzana Ilić, Gérard Dupont, Shayne Longpre, Manan Dey, Stella Biderman, Douwe Kiela, Emi Baylor, Teven Le Scao, Aaron Gokaslan, Julien Launay
+Margaret Mitchell, Giada Pistilli, Yacine Jernite, Ezinwanne Ozoani, Marissa Gerchick, Nazneen Rajani, Sasha Luccioni, Irene Solaiman, Maraim Masoud, Somaieh Nikpoor, Carlos Muñoz Ferrandis, Stas Bekman, Christopher Akiki, Danish Contractor, David Lansky, Angelina McMillan-Major, Tristan Thrush, Suzana Ilić, Gérard Dupont, Shayne Longpre, Manan Dey, Stella Biderman, Douwe Kiela, Emi Baylor, Teven Le Scao, Aaron Gokaslan, Julien Launay, Niklas Muennighoff
 

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2b4d86036fedc35137a5955c8f72167923ed04b093ac1d3438488f2d9d598912
-size 2130730359
+oid sha256:ae458039e2615e851d4e4e77f36869e1c6daf8ac00f6cfbe8a4c0252dc80de97
+size 2130731319