Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-2-super-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,105 @@
+---
+license: mit
+license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
+language:
+- en
+widget:
+- text: Hello who are you?
+  example_title: Identity
+- text: What can you do?
+  example_title: Capabilities
+- text: Create a fastapi endpoint to retrieve the weather given a zip code.
+  example_title: Coding
+tags:
+- convAI
+- conversational
+- TensorBlock
+- GGUF
+pipeline_tag: text-generation
+base_model: abacaj/phi-2-super
+model-index:
+- name: phi-2-super
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: Instruction Following Eval
+      type: wis-k/instruction-following-eval
+    metrics:
+    - type: acc
+      value: 0.2717
+      name: prompt_level_loose_acc
+    source:
+      url: https://github.com/huggingface/lighteval
+      name: LightEval
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## abacaj/phi-2-super - GGUF
+
+This repo contains GGUF format model files for [abacaj/phi-2-super](https://huggingface.co/abacaj/phi-2-super).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+<div style="text-align: left; margin: 20px 0;">
+    <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
+        Run them on the TensorBlock client using your local machine ↗
+    </a>
+</div>
+
+## Prompt template
+
+```
+<|endoftext|>[INST] {prompt} [/INST]
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [phi-2-super-Q2_K.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q2_K.gguf) | Q2_K | 1.110 GB | smallest, significant quality loss - not recommended for most purposes |
+| [phi-2-super-Q3_K_S.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q3_K_S.gguf) | Q3_K_S | 1.251 GB | very small, high quality loss |
+| [phi-2-super-Q3_K_M.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q3_K_M.gguf) | Q3_K_M | 1.426 GB | very small, high quality loss |
+| [phi-2-super-Q3_K_L.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q3_K_L.gguf) | Q3_K_L | 1.575 GB | small, substantial quality loss |
+| [phi-2-super-Q4_0.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q4_0.gguf) | Q4_0 | 1.602 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [phi-2-super-Q4_K_S.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q4_K_S.gguf) | Q4_K_S | 1.619 GB | small, greater quality loss |
+| [phi-2-super-Q4_K_M.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q4_K_M.gguf) | Q4_K_M | 1.738 GB | medium, balanced quality - recommended |
+| [phi-2-super-Q5_0.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q5_0.gguf) | Q5_0 | 1.933 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [phi-2-super-Q5_K_S.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q5_K_S.gguf) | Q5_K_S | 1.933 GB | large, low quality loss - recommended |
+| [phi-2-super-Q5_K_M.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q5_K_M.gguf) | Q5_K_M | 2.003 GB | large, very low quality loss - recommended |
+| [phi-2-super-Q6_K.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q6_K.gguf) | Q6_K | 2.285 GB | very large, extremely low quality loss |
+| [phi-2-super-Q8_0.gguf](https://huggingface.co/tensorblock/phi-2-super-GGUF/blob/main/phi-2-super-Q8_0.gguf) | Q8_0 | 2.958 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/phi-2-super-GGUF --include "phi-2-super-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/phi-2-super-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

phi-2-super-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f84a9888104977de21e7982ed10833e90552bc6448e3982454b07c51775ce057
+size 1109720704

phi-2-super-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c72835292f055490c36b01e4f6bab76366cf814b9ffad361a7efa747e4b7ad2
+size 1575231104

phi-2-super-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e76ea7a0f15e2769cbb57c9039e311215fb86247781ef9b00cc50e0f8ccc3748
+size 1426136704

phi-2-super-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:381c898b8b9310512592572ef309a9d7252498f0f1ba752a3dcbba8461ae4dd3
+size 1250827904

phi-2-super-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:451032f0d4a307c14fb1f010d0b28f4ffc77e4eeeffb64cb60cb3d686c548646
+size 1602469504

phi-2-super-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:19c4c073490f4ab89c6e2bb578533e293ff5c292cd0862cb284482a25594f2dc
+size 1737637504

phi-2-super-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9aa361a94bf545aa7105bd4eaa8b2c00806389433d782acf37d7ae0c6aa428b5
+size 1618853504

phi-2-super-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:deb233baeb1a54469f4f27bf96ae365968d12d8ca32c545cf3b268e8c56568bc
+size 1933426304

phi-2-super-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da9c14f6566c38fb3f5a164aceaa1d69dbca87ada5e0026495b749ddf6677502
+size 2003058304

phi-2-super-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c214b4e0a117dbf18323ff37b3a8b1daba4a83815b8a7e5d1ade767b7b60e61
+size 1933426304

phi-2-super-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95860e31b6da92c0e56d6ec3520f7af4143ed1b46593c0491e070140fb662025
+size 2285067904

phi-2-super-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d41fe7d67b752a53b2bef5ee77b745cd9478f9e5866edf5e679a4606499c8d9
+size 2958040704