---
base_model:
- ibm-granite/granite-4.0-h-tiny
license: apache-2.0
library_name: transformers
tags:
  - language
  - granite-4.0
---

# Open4bits / Granite 4.0 H Tiny FP16

This repository provides the **Granite 4.0 H Tiny model converted to FP16 (float16) precision**, published by Open4bits for more efficient inference while preserving the original model behavior.

The underlying Granite model architecture and weights are **owned by IBM**. This repository contains only a precision-converted version of the original model.

The model is suitable for general-purpose text generation tasks and lightweight language model experimentation.

---

## Model Overview

Granite is a family of transformer-based language models developed by IBM, designed for efficient and scalable natural language processing tasks.

This release uses the **Granite 4.0 H Tiny** variant, focusing on lower memory usage and faster inference while maintaining architectural fidelity to the original model.

---

## Model Details

- **Architecture:** Granite 4.0 H Tiny  
- **Precision:** float16 (FP16)  
- **Task:** Text Generation  
- **Weight tying:** Preserved  
- **Compatibility:** Hugging Face Transformers, PyTorch  

The FP16 conversion reduces VRAM requirements and improves inference speed compared to FP32 versions, making the model suitable for deployment on resource-constrained hardware.

---

## Intended Use

This model is intended for:
- Text generation and completion
- Research and experimentation
- Lightweight inference workloads
- Prototyping and benchmarking language models

---


## Limitations

* Inherits limitations of the Granite Tiny architecture
* Output quality may be lower than larger Granite variants
* Not fine-tuned for domain-specific or instruction-following tasks

---

## License

This model is released under the **Apache License 2.0**.
The original Granite model and associated intellectual property are owned by IBM.

---

## Support

If you find this model useful, please consider supporting the project.
Your support helps us continue releasing and maintaining high-quality open models.
Support us with a heart.