Phi-3-mini-128k-instruct - bnb 4bit

Description

This model is 4bit quantized version of Phi-3-mini-128k-instruct using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".

Downloads last month
2
Safetensors
Model size
2B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for slacktoid/Phi-3-mini-128k-instruct-bnb-4bit

Quantized
(84)
this model