Spaces:

nanotron
/

predict_memory

Running

nouamanetazi HF Staff commited on Feb 7, 2025

Commit

4e75254

1 Parent(s): 0b99db3

update

Files changed (1) hide show

app.py CHANGED Viewed

@@ -79,7 +79,7 @@ def format_config_display(config):
         + (config['hidden_size'] * 2 * config['intermediate_size'])  # gate_up_proj
         + (config['intermediate_size'] * config['hidden_size'])      # down_proj
     )
-    total_params = (vocab_embeddings + config['num_layers'] * layer_params) / config['tp']
     params_billions = total_params / 1_000_000_000
     sections = {

         + (config['hidden_size'] * 2 * config['intermediate_size'])  # gate_up_proj
         + (config['intermediate_size'] * config['hidden_size'])      # down_proj
     )
+    total_params = (vocab_embeddings + config['num_layers'] * layer_params)
     params_billions = total_params / 1_000_000_000
     sections = {