bigscience
/

bloom-1b7

Text Generation

text-generation-inference

Model card Files Files and versions

cakiki commited on May 27, 2022

Commit

3be6707

·

1 Parent(s): 006a5e8

Update hardware info

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -144,7 +144,7 @@ Please see [the BLOOM training README](https://github.com/bigscience-workshop/bi
     *   CPU memory: 160GB per node
-    *   GPU memory: 64GB or 32GB (depending on cluster availability) per node
     *   Inter-node connect: Omni-Path Architecture (OPA)

     *   CPU memory: 160GB per node
+    *   GPU memory: 64GB or 128GB (depending on node availability during training) per node
     *   Inter-node connect: Omni-Path Architecture (OPA)