output = llm(
"Once upon a time,",
max_tokens=512,
echo=True
)
print(output)YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
this is just exported from the app and i uploaded it here
- Downloads last month
- 69
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="breadlicker45/futo-keyboard-lm", filename="ml4_1_f16_meta_fixed.gguf", )