Create config.json

config.json

@@ -0,0 +1,7 @@
+{
+  "model_type": "llama",
+  "architectures": ["LlamaForCausalLM"],
+  "hidden_size": 3200, 
+  "num_attention_heads": 32, 
+  "num_hidden_layers": 80 
+}