BanBTP V5 & V6
Collection
Larger, faster, better. Distilled from V1 and BanBTP distilled dataset • 3 items • Updated
output = llm(
"Once upon a time,",
max_tokens=512,
echo=True
)
print(output)Introducing BanBTP6! This model is a 54M model like V5, trained on banbtp124m + tinyllama 1.1b + gpt2-large.
BanBTP is a series of million parameter LLMs that are designed to be chatbots for local pcs.
- Downloads last month
- 29
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="aaro765/BanBTPV6", filename="Banbtpv6-54M-F16.gguf", )