Phi-3-mini-128k-instruct - bnb 4bit

Description

This model is 4bit quantized version of Phi-3-mini-128k-instruct using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "<|endoftext|>".

Downloads last month
17
Safetensors
Model size
2B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for slacktoid/Phi-3-mini-128k-instruct-bnb-4bit

Quantized
(87)
this model