---
license: apache-2.0
language:
- en
base_model:
- HyzeAI/HyzeMini
pipeline_tag: text-generation
library_name: transformers.js
tags:
- gguf
- hyze
- local
- chat
- Hitesh_V_Founder
---
<p align="center">
  <img src="https://i.imgur.com/ePJMLNp.png" alt="Hyze Logo" width="405"/>
</p>

<h1 align="center">HyzeMini (GGUF)</h1>

<p align="center">
  Lightweight GGUF builds of <b>HyzeMini</b> for fast local inference
</p>

<p align="center">
  🔗 <a href="https://hyzebot.vercel.app">hyzebot.vercel.app</a> •  
  📘 <a href="https://hyzedocs.vercel.app">hyzedocs.vercel.app</a> •  
  🧠 <a href="https://hyzecode.vercel.app">hyzecode.vercel.app</a>
</p>

---

## 🚀 Overview

**HyzeMini (GGUF)** provides **quantized GGUF versions** of the HyzeMini model, optimized for **local execution** using tools like **llama.cpp**, **LM Studio**, **Ollama**, and other GGUF-compatible runtimes.

This version keeps the same **Space + General Chat focus**, while enabling:

- ⚡ Faster inference  
- 🧠 Lower memory usage  
- 💻 CPU-friendly execution  

---

## 🧠 Model Details

- **Base model:** HyzeAI / HyzeMini  
- **Parameters:** ~0.1B  
- **Architecture:** Transformer (LLaMA-style)  
- **Format:** GGUF  
- **Language:** English  
- **License:** Apache-2.0  

---

## 🧪 Available Quantizations

*(Exact files may vary depending on upload)*

Common GGUF variants include:

- `Q2_K` – Ultra-low memory, fastest
- `Q4_K_M` – Balanced quality & speed (recommended)
- `Q5_K_M` – Higher quality, slightly slower
- `Q8_0` – Best quality, highest memory usage

> 💡 If you’re unsure, start with **Q4_K_M**.

---

## ⚙️ Usage

### llama.cpp

```bash
./main -m HyzeMini-Q4_K_M.gguf -p "Tell me a cool space fact:"

---