How to use gorebradleyi/BitNetIR with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("microsoft/bitnet-b1.58-2B-4T-bf16") model = PeftModel.from_pretrained(base_model, "gorebradleyi/BitNetIR")
027c2b4
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:7e96f010f34ad90ba80366b1e4a8249eda6fdd350f6538003a726be6bf23197f size 17213195
