Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,20 @@
+---
+license: apache-2.0
+tags:
+- gguf
+- llama.cpp
+- quantized
+---
+
+# FP16
+
+This repository contains the `FP16.gguf` model in GGUF format, quantized with llama.cpp.
+
+## Usage
+
+```python
+from llama_cpp import Llama
+model = Llama(model_path="FP16.gguf")
+output = model("Hello, world!")
+print(output)
+```