DOUBT
#2
by krishnAbadikelA - opened
hi @TheBloke
llm=load_model(model_id="TheBloke/orca_mini_v2_7B-GGML", device_type="mps", model_basename="orca-mini-v2_7b.ggmlv3.q4_0.bin")
I'm trying to load this model but what to include in the load_model because it's undefined
What are you using? llama-cpp-python?
This comment has been hidden
krishnAbadikelA changed discussion status to closed