Update README.md

README.md

@@ -19,6 +19,31 @@ tags:
 This model was converted to GGUF format from [`tiiuae/Falcon3-3B-Instruct`](https://huggingface.co/tiiuae/Falcon3-3B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
 Refer to the [original model card](https://huggingface.co/tiiuae/Falcon3-3B-Instruct) for more details on the model.
 
+---
+Model details:
+-
+Falcon3 family of Open Foundation Models is a set of pretrained and instruct LLMs ranging from 1B to 10B parameters.
+
+Falcon3-3B-Instruct achieves strong results on reasoning, language understanding, instruction following, code and mathematics tasks. Falcon3-3B-Instruct supports 4 languages (English, French, Spanish, Portuguese) and a context length of up to 32K.
+Model Details
+
+    Architecture
+        Transformer-based causal decoder-only architecture
+        22 decoder blocks
+        Grouped Query Attention (GQA) for faster inference: 12 query heads and 4 key-value heads
+        Wider head dimension: 256
+        High RoPE value to support long context understanding: 1000042
+        Uses SwiGLU and RMSNorm
+        32K context length
+        131K vocab size
+    Pruned and healed from Falcon3-7B-Base on only 100 Gigatokens of datasets comprising of web, code, STEM, high quality and mutlilingual data using 1024 H100 GPU chips
+    Posttrained on 1.2 million samples of STEM, conversational, code, safety and function call data
+    Supports EN, FR, ES, PT
+    Developed by Technology Innovation Institute
+    License: TII Falcon-LLM License 2.0
+    Model Release Date: December 2024
+
+---
 ## Use with llama.cpp
 Install llama.cpp through brew (works on Mac and Linux)