Instructions to use benjamin-paine/taproot-common with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use benjamin-paine/taproot-common with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="benjamin-paine/taproot-common", filename="image-encoding-clip-llava-mmproj-v1-5-13b.fp16.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use benjamin-paine/taproot-common with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf benjamin-paine/taproot-common:F16 # Run inference directly in the terminal: llama-cli -hf benjamin-paine/taproot-common:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf benjamin-paine/taproot-common:F16 # Run inference directly in the terminal: llama-cli -hf benjamin-paine/taproot-common:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf benjamin-paine/taproot-common:F16 # Run inference directly in the terminal: ./llama-cli -hf benjamin-paine/taproot-common:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf benjamin-paine/taproot-common:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf benjamin-paine/taproot-common:F16
Use Docker
docker model run hf.co/benjamin-paine/taproot-common:F16
- LM Studio
- Jan
- Ollama
How to use benjamin-paine/taproot-common with Ollama:
ollama run hf.co/benjamin-paine/taproot-common:F16
- Unsloth Studio
How to use benjamin-paine/taproot-common with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for benjamin-paine/taproot-common to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for benjamin-paine/taproot-common to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for benjamin-paine/taproot-common to start chatting
- Docker Model Runner
How to use benjamin-paine/taproot-common with Docker Model Runner:
docker model run hf.co/benjamin-paine/taproot-common:F16
- Lemonade
How to use benjamin-paine/taproot-common with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull benjamin-paine/taproot-common:F16
Run and chat with the model
lemonade run user.taproot-common-F16
List all available models
lemonade list
Add files using upload-large-folder tool
Browse files- .gitattributes +11 -0
- text-generation-cosmos-v1-0-prompt-upsampler-q3-k-m.gguf +3 -0
- text-generation-cosmos-v1-0-prompt-upsampler-q4-k-m.gguf +3 -0
- text-generation-cosmos-v1-0-prompt-upsampler-q5-k-m.gguf +3 -0
- text-generation-cosmos-v1-0-prompt-upsampler-q6-k.gguf +3 -0
- text-generation-cosmos-v1-0-prompt-upsampler-q8-0.gguf +3 -0
- video-generation-hunyuan-transformer-q3-k-m.gguf +3 -0
- video-generation-hunyuan-transformer-q4-k-m.gguf +3 -0
- video-generation-hunyuan-transformer-q5-k-m.gguf +3 -0
- video-generation-hunyuan-transformer-q6-k.gguf +3 -0
- video-generation-hunyuan-transformer-q8-0.gguf +3 -0
- video-generation-wan-v2-1-transformer-14b-q8-0.gguf +3 -0
- video-generation-wan-v2-1-transformer-1b.fp16.safetensors +3 -0
.gitattributes
CHANGED
|
@@ -63,3 +63,14 @@ visual-question-answering-llava-v1-5-7b.fp16.gguf filter=lfs diff=lfs merge=lfs
|
|
| 63 |
text-generation-llama-v3-2-1b-instruct-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
image-encoding-clip-llava-mmproj-v1-5-7b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
text-generation-llama-v3-2-3b-instruct-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 63 |
text-generation-llama-v3-2-1b-instruct-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
image-encoding-clip-llava-mmproj-v1-5-7b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
text-generation-llama-v3-2-3b-instruct-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
text-generation-cosmos-v1-0-prompt-upsampler-q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 67 |
+
video-generation-hunyuan-transformer-q3-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
text-generation-cosmos-v1-0-prompt-upsampler-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
video-generation-hunyuan-transformer-q4-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
text-generation-cosmos-v1-0-prompt-upsampler-q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
video-generation-hunyuan-transformer-q5-k-m.gguf filter=lfs diff=lfs merge=lfs -text
|
| 72 |
+
text-generation-cosmos-v1-0-prompt-upsampler-q6-k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 73 |
+
video-generation-hunyuan-transformer-q6-k.gguf filter=lfs diff=lfs merge=lfs -text
|
| 74 |
+
text-generation-cosmos-v1-0-prompt-upsampler-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 75 |
+
video-generation-hunyuan-transformer-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 76 |
+
video-generation-wan-v2-1-transformer-14b-q8-0.gguf filter=lfs diff=lfs merge=lfs -text
|
text-generation-cosmos-v1-0-prompt-upsampler-q3-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30328d560d87a4f3c96486a9402274e7688d92c40baa402e3eb389b7a8d0d58f
|
| 3 |
+
size 6083093632
|
text-generation-cosmos-v1-0-prompt-upsampler-q4-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3482720a800645ee66db6ec96902ddd7fac1d8c2475f51491e27bcf21be54723
|
| 3 |
+
size 7477208192
|
text-generation-cosmos-v1-0-prompt-upsampler-q5-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a731c62c5c21b508797fea69cf4d76c0914e0729b03a92a11a19225b0073f953
|
| 3 |
+
size 8727635072
|
text-generation-cosmos-v1-0-prompt-upsampler-q6-k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9182476621e958b19c5465933ec44dab298a06b494e33a2789c37145d3ad6009
|
| 3 |
+
size 10056213632
|
text-generation-cosmos-v1-0-prompt-upsampler-q8-0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:22db222c8f08419d64cf36dc75b70cb39ac6f207fdc75f20511830fe9f383e78
|
| 3 |
+
size 13022372992
|
video-generation-hunyuan-transformer-q3-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4074e7f982fa9b3f8b53d76fdda7876b4e8b3370c949ad1f0def0f3b3c78d3f4
|
| 3 |
+
size 6238071552
|
video-generation-hunyuan-transformer-q4-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef5c2bb989fce20ab39341db98adfbb3d072d9dc709b02391603755d433c1446
|
| 3 |
+
size 7883680512
|
video-generation-hunyuan-transformer-q5-k-m.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0ece4b207ae2f21204e4b59f0c4a9ae11554da6e2768759fa6f3924cc7bf2d3d
|
| 3 |
+
size 9449663232
|
video-generation-hunyuan-transformer-q6-k.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7b146574ae6dde574718a841569fe2ffbbbb521e7d6b65a99a22ad577bd9436
|
| 3 |
+
size 10953714432
|
video-generation-hunyuan-transformer-q8-0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bae2fec6cbd340479ecbfe626efbf505b6dbccdc9fb8f4f0b5f3a5eb493a07d3
|
| 3 |
+
size 13970664192
|
video-generation-wan-v2-1-transformer-14b-q8-0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd4f1cc5cd4b63f25898340e997d6299984114e8755be5407bc585a1e0ec9f38
|
| 3 |
+
size 15879461504
|
video-generation-wan-v2-1-transformer-1b.fp16.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b9ff0535e2da4b3516d20fb3d504fcb5b7d00034bef5bbb599140bce1fbef6ef
|
| 3 |
+
size 2838076472
|