unsloth

/

phi-4-unsloth-bnb-4bit

like 63

Follow

Unsloth AI 14.2k

I hope this request does not offend you.

in the cloab link with unslot is also inference example https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Phi_4-Conversational.ipynb#scrollTo=ekOmTR1hSNcr

or use vllm see how on top right. Use this model -> vllm or TGI (enable in your profile if not already)