How to use Justin22122002/Malware with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Justin22122002/Malware", filename="unsloth.F16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
How to use Justin22122002/Malware with llama.cpp:
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Justin22122002/Malware:F16 # Run inference directly in the terminal: llama-cli -hf Justin22122002/Malware:F16
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Justin22122002/Malware:F16 # Run inference directly in the terminal: llama-cli -hf Justin22122002/Malware:F16
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Justin22122002/Malware:F16 # Run inference directly in the terminal: ./llama-cli -hf Justin22122002/Malware:F16
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Justin22122002/Malware:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Justin22122002/Malware:F16
docker model run hf.co/Justin22122002/Malware:F16
How to use Justin22122002/Malware with Ollama:
ollama run hf.co/Justin22122002/Malware:F16
How to use Justin22122002/Malware with Unsloth Studio:
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Justin22122002/Malware to start chatting
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Justin22122002/Malware to start chatting
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Justin22122002/Malware to start chatting
How to use Justin22122002/Malware with Docker Model Runner:
How to use Justin22122002/Malware with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Justin22122002/Malware:F16
lemonade run user.Malware-F16
lemonade list
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
Log in or Sign Up to review the conditions and access this model content.
16-bit
