Feature Extraction
sentence-transformers
GGUF
sentence-similarity
dense-encoder
dense
retrieval
multimodal
multi-modal
crossmodal
cross-modal
aerospace
telepix
Instructions to use mykor/PIXIE-Rune-v1.5-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use mykor/PIXIE-Rune-v1.5-GGUF with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("mykor/PIXIE-Rune-v1.5-GGUF") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mykor/PIXIE-Rune-v1.5-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
Use Docker
docker model run hf.co/mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use mykor/PIXIE-Rune-v1.5-GGUF with Ollama:
ollama run hf.co/mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use mykor/PIXIE-Rune-v1.5-GGUF with Docker Model Runner:
docker model run hf.co/mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
- Lemonade
How to use mykor/PIXIE-Rune-v1.5-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mykor/PIXIE-Rune-v1.5-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.PIXIE-Rune-v1.5-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files- .gitattributes +8 -0
- PIXIE-Rune-567M-v1.5-BF16.gguf +3 -0
- PIXIE-Rune-567M-v1.5-F16.gguf +3 -0
- PIXIE-Rune-567M-v1.5-F32.gguf +3 -0
- PIXIE-Rune-567M-v1.5-Q3_K_L.gguf +3 -0
- PIXIE-Rune-567M-v1.5-Q4_K_M.gguf +3 -0
- PIXIE-Rune-567M-v1.5-Q5_K_M.gguf +3 -0
- PIXIE-Rune-567M-v1.5-Q6_K.gguf +3 -0
- PIXIE-Rune-567M-v1.5-Q8_0.gguf +3 -0
- README.md +99 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
PIXIE-Rune-567M-v1.5-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
PIXIE-Rune-567M-v1.5-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
PIXIE-Rune-567M-v1.5-F32.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
PIXIE-Rune-567M-v1.5-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
PIXIE-Rune-567M-v1.5-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
PIXIE-Rune-567M-v1.5-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
PIXIE-Rune-567M-v1.5-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
PIXIE-Rune-567M-v1.5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
PIXIE-Rune-567M-v1.5-BF16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40e747262663183fbd34ab2ecd2d50de3fe97277e924a215ecde629ffb3874b0
|
| 3 |
+
size 1157672288
|
PIXIE-Rune-567M-v1.5-F16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1813feca23fa1835c665d848abf20322c908046e6909097c8fcd93278ecd716e
|
| 3 |
+
size 1157672288
|
PIXIE-Rune-567M-v1.5-F32.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4c1cc1952a77f645a05130f095d90e7244a3bbd4ba660f26b4cc5884bf9ccef
|
| 3 |
+
size 2273656160
|
PIXIE-Rune-567M-v1.5-Q3_K_L.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:31a0292ce4d04d1ff0438beb579d70615e2259bc4ed1994102bdf6bc059b4aaa
|
| 3 |
+
size 420379776
|
PIXIE-Rune-567M-v1.5-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2efd228a8067197fccbd14cfdc2b724787b1f11cf07656f7ffa560a6fd5253f6
|
| 3 |
+
size 437779584
|
PIXIE-Rune-567M-v1.5-Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:174ff4e59d3b0b42cdbb6f9dc7cbba4f239ade8326b0514cddf7db1ddb11f187
|
| 3 |
+
size 467664000
|
PIXIE-Rune-567M-v1.5-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5badfb025b13622404c139f7ce7ff61e1472d639ff7d9f631fb9534e6119ff9d
|
| 3 |
+
size 499416192
|
PIXIE-Rune-567M-v1.5-Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1ce8e5fc7be6c95b84ed4aad82c360f794a6e6a143bb0cc088aee9da5cd4078d
|
| 3 |
+
size 634554848
|
README.md
ADDED
|
@@ -0,0 +1,99 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- sentence-transformers
|
| 4 |
+
- sentence-similarity
|
| 5 |
+
- dense-encoder
|
| 6 |
+
- dense
|
| 7 |
+
- feature-extraction
|
| 8 |
+
- retrieval
|
| 9 |
+
- multimodal
|
| 10 |
+
- multi-modal
|
| 11 |
+
- crossmodal
|
| 12 |
+
- cross-modal
|
| 13 |
+
- aerospace
|
| 14 |
+
- telepix
|
| 15 |
+
language:
|
| 16 |
+
- af
|
| 17 |
+
- ar
|
| 18 |
+
- az
|
| 19 |
+
- be
|
| 20 |
+
- bg
|
| 21 |
+
- bn
|
| 22 |
+
- ca
|
| 23 |
+
- ceb
|
| 24 |
+
- cs
|
| 25 |
+
- cy
|
| 26 |
+
- da
|
| 27 |
+
- de
|
| 28 |
+
- el
|
| 29 |
+
- en
|
| 30 |
+
- es
|
| 31 |
+
- et
|
| 32 |
+
- eu
|
| 33 |
+
- fa
|
| 34 |
+
- fi
|
| 35 |
+
- fr
|
| 36 |
+
- gl
|
| 37 |
+
- gu
|
| 38 |
+
- he
|
| 39 |
+
- hi
|
| 40 |
+
- hr
|
| 41 |
+
- ht
|
| 42 |
+
- hu
|
| 43 |
+
- hy
|
| 44 |
+
- id
|
| 45 |
+
- is
|
| 46 |
+
- it
|
| 47 |
+
- ja
|
| 48 |
+
- jv
|
| 49 |
+
- ka
|
| 50 |
+
- kk
|
| 51 |
+
- km
|
| 52 |
+
- kn
|
| 53 |
+
- ko
|
| 54 |
+
- ky
|
| 55 |
+
- lo
|
| 56 |
+
- lt
|
| 57 |
+
- lv
|
| 58 |
+
- mk
|
| 59 |
+
- ml
|
| 60 |
+
- mn
|
| 61 |
+
- mr
|
| 62 |
+
- ms
|
| 63 |
+
- my
|
| 64 |
+
- ne
|
| 65 |
+
- nl
|
| 66 |
+
- pa
|
| 67 |
+
- pl
|
| 68 |
+
- pt
|
| 69 |
+
- qu
|
| 70 |
+
- ro
|
| 71 |
+
- ru
|
| 72 |
+
- si
|
| 73 |
+
- sk
|
| 74 |
+
- sl
|
| 75 |
+
- so
|
| 76 |
+
- sq
|
| 77 |
+
- sr
|
| 78 |
+
- sv
|
| 79 |
+
- sw
|
| 80 |
+
- ta
|
| 81 |
+
- te
|
| 82 |
+
- th
|
| 83 |
+
- tl
|
| 84 |
+
- tr
|
| 85 |
+
- uk
|
| 86 |
+
- ur
|
| 87 |
+
- vi
|
| 88 |
+
- yo
|
| 89 |
+
- zh
|
| 90 |
+
pipeline_tag: feature-extraction
|
| 91 |
+
license: apache-2.0
|
| 92 |
+
base_model: telepix/PIXIE-Rune-v1.5
|
| 93 |
+
---
|
| 94 |
+
|
| 95 |
+
# PIXIE-Rune-v1.5-GGUF
|
| 96 |
+
|
| 97 |
+
`XLMRobertaModel` λͺ¨λΈμ GGUFλ‘ λ³ννλ €λ©΄, [`sentencepiece.bpe.model`](https://huggingface.co/sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2/resolve/main/sentencepiece.bpe.model) νμΌμ ν¨κ» λ°°ν¬νλ©΄ λ©λλ€.
|
| 98 |
+
|
| 99 |
+
llama.cpp μ μ₯μμ κ³ μ λ protobuf (>=4.21.0,<5.0.0) λ²μ μμλ [μλ¬](https://github.com/protocolbuffers/protobuf/issues/12186)κ° λ°μνλ―λ‘, νμ΄μ¬ 3.14μ΄μμμλ λ³νμ΄ μ€ν¨ν©λλ€.
|