---
license: apache-2.0
tags:
- gguf
- llama.cpp
- qwen
- llama
- gemma
- phi
- smollm
- quantized
- edge-ai
- iot
- smart-home
- llm
- inference
---

#  Lightweight GGUF LLM Collection (Edge AI / IoT Ready)

##  Overview

This repository contains a collection of **quantized GGUF models** optimized for **edge devices, CPU inference, and IoT applications**.

These models are designed for:
- Smart home assistants
- Lightweight chat systems
- Offline inference
- Jetson / Raspberry Pi / CPU-only environments