Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,87 @@
+
+---
+
+license: apache-2.0
+datasets:
+- 0-hero/Matter-0.1
+language:
+- en
+
+---
+
+[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
+
+
+# QuantFactory/Matter-0.1-7B-GGUF
+This is quantized version of [0-hero/Matter-0.1-7B](https://huggingface.co/0-hero/Matter-0.1-7B) created using llama.cpp
+
+# Original Model Card
+
+
+## Matter 7B - 0.1 (Mistral 7B Finetune)
+
+Matter 7B is full-finetune on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1), which is curated from over 35 datsets analyzing >6B tokens
+
+### Training
+
+Prompt format: This model uses ChatML prompt format.
+```
+<|im_start|>system
+You are a helpful AI assistant.<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+```
+### Function Calling
+
+Model also supports function calling. Additional tokens for function calling 
+
+Model function call tokens
+- <|begin_func|> - Function call start token
+- <|end_func|> - Function call end token
+
+Function call response tokens
+- <|begin_func_response|> - Function response start token
+- <|end_func_response|> - Function response end token
+
+Example
+```
+<|im_start|>system
+  You are a helpful assistant with access to the following functions. Use them if required -
+  { "name": "get_news_headlines",
+    "description": "Get the latest news headlines",
+    "parameters":
+      { "type": "object",
+        "properties":
+        { "country":
+          { "type": "string",
+            "description": "The country for which to fetch news"
+          }
+        },
+      "required": [ "country" ]
+    }
+  }
+<|im_end|>
+<|im_start|>user
+   Can you tell me the latest news headlines for the United States?<|im_end|>
+<|im_start|>assistant
+  <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
+<|im_start|>user
+  <|begin_func_response|>{
+    "headlines":
+      [
+        "Biden announces new vaccine mandates",
+        "Hurricane Ida devastates Louisiana",
+        "Apple unveils new iPhone",
+        "NASA's Perseverance rover collects first Mars rock sample"
+      ]
+  }<|end_func_response|>
+<|im_end|>
+<|im_start|>assistant
+  Here are the latest news headlines for the United States:
+  1. Biden announces new vaccine mandates
+  2. Hurricane Ida devastates Louisiana
+  3. Apple unveils new iPhone
+  4. NASA's Perseverance rover collects first Mars rock sample
+<|im_end|>
+```