---
base_model:
- inference-net/Schematron-3B
pipeline_tag: text-generation
tags:
- open4bits
license: llama3.2
---
# Open4bits / Schematron-3B-GGUF

This repository provides the **Schematron-3B model converted to GGUF format**, published by Open4bits to enable efficient local inference with reduced memory usage and broad CPU compatibility.

The underlying base model is **meta-llama/Llama-3.2-3B-Instruct**, fine-tuned by Inference-Net. This repository contains a quantized GGUF conversion of the fine-tuned model weights produced by Open4bits.

The model is designed for instruction-based text generation tasks and is suitable for resource-constrained and local deployments.

---

## Model Overview

Schematron-3B is an instruction-tuned language model built on the **LLaMA 3.2-3B architecture**. After fine-tuning by Inference-Net for enhanced instruction following and generation quality, the model has been quantized and released in GGUF format to support efficient CPU-friendly inference.

---

## Model Details

* **Base Model:** meta-llama/Llama-3.2-3B-Instruct
* **Fine-Tuned By:** Inference-Net
* **Parameters:** ~3 billion
* **Format:** GGUF (quantized)
* **Task:** Instruction-based text generation
* **Weight tying:** Preserved
* **Compatibility:** GGUF-compatible inference engines and CPU environments

This quantized release is designed to balance performance and resource efficiency while maintaining strong instruction following capabilities.

---

## Intended Use

This model is intended for:

* Instruction-guided text generation
* Local and CPU-based inference workflows
* Research, prototyping, and experimentation
* Self-hosted or offline AI systems

---

## Limitations

* Reduced generation quality compared to larger or full-precision variants
* Performance depends on prompt design and inference parameters
* Not fine-tuned for highly specialized or domain-specific tasks

---

## License

This model follows the **original LLaMA 3.2 licensing terms** as defined by Meta AI.
Users must comply with the licensing conditions of the base model and the fine-tuning provider.

---

## Support

If you find this model valuable, please consider supporting the project.
Your support helps Open4bits continue releasing and maintaining high-quality quantized models for the community.