Granite 3.3 8b Instruct FP8

This repository contains the FP8 version of Granite-3.3-8b-Instruct.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-instruct

Downloads last month: 7,843

Safetensors

Model size

8B params

Tensor type

BF16

F8_E4M3

Model tree for ibm-granite/granite-3.3-8b-instruct-FP8

Base model

ibm-granite/granite-3.3-8b-base

Finetuned

ibm-granite/granite-3.3-8b-instruct

Quantized

(28)

this model

Space using ibm-granite/granite-3.3-8b-instruct-FP8 1

Collection including ibm-granite/granite-3.3-8b-instruct-FP8

Granite Quantized Models

Collection

Quantized versions of IBM Granite models. • 37 items • Updated 15 days ago • 32