Instructions to use Maxixa/lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use Maxixa/lora with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Maxixa/lora", filename="gguf/speechless-sparsetral-mistral-16x7b-moe.Q5_K_M.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Maxixa/lora with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: llama-cli -hf Maxixa/lora:Q5_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: llama-cli -hf Maxixa/lora:Q5_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: ./llama-cli -hf Maxixa/lora:Q5_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Maxixa/lora:Q5_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Maxixa/lora:Q5_K_M
Use Docker
docker model run hf.co/Maxixa/lora:Q5_K_M
- LM Studio
- Jan
- Ollama
How to use Maxixa/lora with Ollama:
ollama run hf.co/Maxixa/lora:Q5_K_M
- Unsloth Studio
How to use Maxixa/lora with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Maxixa/lora to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Maxixa/lora to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Maxixa/lora to start chatting
- Docker Model Runner
How to use Maxixa/lora with Docker Model Runner:
docker model run hf.co/Maxixa/lora:Q5_K_M
- Lemonade
How to use Maxixa/lora with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Maxixa/lora:Q5_K_M
Run and chat with the model
lemonade run user.lora-Q5_K_M
List all available models
lemonade list
Upload with huggingface_hub
Browse files- binz-metal-2/last-000001.safetensors +3 -0
- binz-metal-2/last-000002.safetensors +3 -0
- binz-metal-2/last-000003.safetensors +3 -0
- binz-metal-2/last-000004.safetensors +3 -0
- binz-metal-2/last-000005.safetensors +3 -0
- binz-metal-2/last-000006.safetensors +3 -0
- binz-metal-2/last-000007.safetensors +3 -0
- binz-metal-2/last-000008.safetensors +3 -0
- binz-metal-2/last-000009.safetensors +3 -0
- binz-metal-2/last.safetensors +3 -0
- meganokko3-2/meganekko3-2-000001.safetensors +3 -0
- meganokko3-2/meganekko3-2-000002.safetensors +3 -0
- meganokko3-2/meganekko3-2-000003.safetensors +3 -0
- meganokko3-2/meganekko3-2-000004.safetensors +3 -0
- meganokko3-2/meganekko3-2-000005.safetensors +3 -0
- meganokko3-2/meganekko3-2-000006.safetensors +3 -0
- meganokko3-2/meganekko3-2-000007.safetensors +3 -0
- meganokko3-2/meganekko3-2-000008.safetensors +3 -0
- meganokko3-2/meganekko3-2-000009.safetensors +3 -0
- meganokko3-2/meganekko3-2.safetensors +3 -0
binz-metal-2/last-000001.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5a4fba26c7286b0376350c073493f793c15eeda471caeb9a045084f41080d5ec
|
| 3 |
+
size 37885669
|
binz-metal-2/last-000002.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:74880b3511d0057e479fc50f106ee1058af67e1af5f3a4a13f00dd8676f5048b
|
| 3 |
+
size 37885669
|
binz-metal-2/last-000003.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f293793162a8e0e51dc475d567e83b67e573adb9188ebecc9a9fcd568c97bbbe
|
| 3 |
+
size 37885669
|
binz-metal-2/last-000004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2b5690f3936ef59c593239cfd6a5d40d3eb7523f67e80dadcf2c763ab3e40cb9
|
| 3 |
+
size 37885668
|
binz-metal-2/last-000005.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42cccc35c40775f4b7eb37107212ebc49c70bc267b784441fc0407fd5daf9a68
|
| 3 |
+
size 37885669
|
binz-metal-2/last-000006.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29300579bc1288c8f8544f0fe1bed484719cc310a57e16d33536e3d66561d9c7
|
| 3 |
+
size 37885668
|
binz-metal-2/last-000007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b7386c5444322e7b93d8b141382248faef8b33dc04e45db49ae7a04cf7b5ac44
|
| 3 |
+
size 37885669
|
binz-metal-2/last-000008.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:704236d036a8fd9e8fce140b02d0589dc88cb11d4c26380d22d45d5ceca7fc8b
|
| 3 |
+
size 37885668
|
binz-metal-2/last-000009.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c80ee87b52247b5da1d77b72ec83ebb15955305a315135802d37bd1b10faebad
|
| 3 |
+
size 37885668
|
binz-metal-2/last.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:66572ca78130fe4aa709c11f3d6e20b7028b55ec5eb3120c5fb675871eefda1a
|
| 3 |
+
size 37885670
|
meganokko3-2/meganekko3-2-000001.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a2c485b3cbd4473103419afd9f7acb9af6ce4472ff556d8e34430501864e59f
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000002.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:deaabe55ebb28fc7fa6c5d1abf3b9a994c268593db50c40cf185a5c2eb5d8115
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000003.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9cc4df9ab5f7e452be2b6fb578ff7a5a253d992dff9556ff86c1505d2b864a1c
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000004.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af3e0ebf7887b192e15a129da1fb63e8c493136268e474711c4ef95d6debcb07
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000005.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:faf3349dbb108f3afcd5d8f937cf58c1f098be7de54712781a65031e34652adf
|
| 3 |
+
size 151133485
|
meganokko3-2/meganekko3-2-000006.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0330a29430bbbd49da15977dbb75f2cd39db9dcc34c24cd5d142a624614276db
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000007.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a6c7036d5d584029360ffaff546df14012232b366b81b665c9c046b0a60461e2
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2-000008.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e81ec40aed4c9d8f39b20e2dc8c6f0ab6364ce96449f0b639d5de9b64e440104
|
| 3 |
+
size 151133485
|
meganokko3-2/meganekko3-2-000009.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:68a2cbfc8bbf8798f274190912f8e32dd6dd6d40ad98b7c2ecce9f1ed42c920a
|
| 3 |
+
size 151133486
|
meganokko3-2/meganekko3-2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ecd2ace85649073f693f5ac2557302891db6bfc75aa24d26116112279ac0d284
|
| 3 |
+
size 151133487
|