Instructions to use MoYoYoTech/Translator with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use MoYoYoTech/Translator with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="MoYoYoTech/Translator", filename="moyoyo_asr_models/qwen2.5-1.5b-instruct-q5_0.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use MoYoYoTech/Translator with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf MoYoYoTech/Translator:Q5_0 # Run inference directly in the terminal: llama-cli -hf MoYoYoTech/Translator:Q5_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf MoYoYoTech/Translator:Q5_0 # Run inference directly in the terminal: llama-cli -hf MoYoYoTech/Translator:Q5_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf MoYoYoTech/Translator:Q5_0 # Run inference directly in the terminal: ./llama-cli -hf MoYoYoTech/Translator:Q5_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf MoYoYoTech/Translator:Q5_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf MoYoYoTech/Translator:Q5_0
Use Docker
docker model run hf.co/MoYoYoTech/Translator:Q5_0
- LM Studio
- Jan
- Ollama
How to use MoYoYoTech/Translator with Ollama:
ollama run hf.co/MoYoYoTech/Translator:Q5_0
- Unsloth Studio
How to use MoYoYoTech/Translator with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for MoYoYoTech/Translator to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for MoYoYoTech/Translator to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for MoYoYoTech/Translator to start chatting
- Pi
How to use MoYoYoTech/Translator with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf MoYoYoTech/Translator:Q5_0
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "MoYoYoTech/Translator:Q5_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use MoYoYoTech/Translator with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf MoYoYoTech/Translator:Q5_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default MoYoYoTech/Translator:Q5_0
Run Hermes
hermes
- Docker Model Runner
How to use MoYoYoTech/Translator with Docker Model Runner:
docker model run hf.co/MoYoYoTech/Translator:Q5_0
- Lemonade
How to use MoYoYoTech/Translator with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull MoYoYoTech/Translator:Q5_0
Run and chat with the model
lemonade run user.Translator-Q5_0
List all available models
lemonade list
Xin Zhang commited on
Commit ·
27c43dd
1
Parent(s): b11033f
[feature]: remove experimental models.
Browse files- moyoyo_asr_models/ggml-medium-encoder.mlmodelc/analytics/coremldata.bin +0 -3
- moyoyo_asr_models/ggml-medium-encoder.mlmodelc/coremldata.bin +0 -3
- moyoyo_asr_models/ggml-medium-encoder.mlmodelc/metadata.json +0 -64
- moyoyo_asr_models/ggml-medium-encoder.mlmodelc/model.mil +0 -0
- moyoyo_asr_models/ggml-medium-encoder.mlmodelc/weights/weight.bin +0 -3
- moyoyo_asr_models/ggml-medium-q5_0.bin +0 -3
- moyoyo_asr_models/ggml-small-encoder.mlmodelc/analytics/coremldata.bin +0 -3
- moyoyo_asr_models/ggml-small-encoder.mlmodelc/coremldata.bin +0 -3
- moyoyo_asr_models/ggml-small-encoder.mlmodelc/metadata.json +0 -64
- moyoyo_asr_models/ggml-small-encoder.mlmodelc/model.mil +0 -0
- moyoyo_asr_models/ggml-small-encoder.mlmodelc/weights/weight.bin +0 -3
- moyoyo_asr_models/ggml-small.bin +0 -3
- moyoyo_asr_models/qwen2.5-7b-instruct-q5_0-00001-of-00002.gguf +0 -3
- moyoyo_asr_models/qwen2.5-7b-instruct-q5_0-00002-of-00002.gguf +0 -3
moyoyo_asr_models/ggml-medium-encoder.mlmodelc/analytics/coremldata.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:adbe456375e7eb3407732a426ecb65bbda86860e4aa801f3a696b70b8a533cdd
|
| 3 |
-
size 207
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-medium-encoder.mlmodelc/coremldata.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:05fe28591b40616fa0c34ad7b853133623f5300923ec812acb11459c411acf3b
|
| 3 |
-
size 149
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-medium-encoder.mlmodelc/metadata.json
DELETED
|
@@ -1,64 +0,0 @@
|
|
| 1 |
-
[
|
| 2 |
-
{
|
| 3 |
-
"metadataOutputVersion" : "3.0",
|
| 4 |
-
"storagePrecision" : "Float16",
|
| 5 |
-
"outputSchema" : [
|
| 6 |
-
{
|
| 7 |
-
"hasShapeFlexibility" : "0",
|
| 8 |
-
"isOptional" : "0",
|
| 9 |
-
"dataType" : "Float32",
|
| 10 |
-
"formattedType" : "MultiArray (Float32)",
|
| 11 |
-
"shortDescription" : "",
|
| 12 |
-
"shape" : "[]",
|
| 13 |
-
"name" : "output",
|
| 14 |
-
"type" : "MultiArray"
|
| 15 |
-
}
|
| 16 |
-
],
|
| 17 |
-
"modelParameters" : [
|
| 18 |
-
|
| 19 |
-
],
|
| 20 |
-
"specificationVersion" : 6,
|
| 21 |
-
"mlProgramOperationTypeHistogram" : {
|
| 22 |
-
"Linear" : 144,
|
| 23 |
-
"Matmul" : 48,
|
| 24 |
-
"Cast" : 2,
|
| 25 |
-
"Conv" : 2,
|
| 26 |
-
"Softmax" : 24,
|
| 27 |
-
"Add" : 49,
|
| 28 |
-
"LayerNorm" : 49,
|
| 29 |
-
"Mul" : 48,
|
| 30 |
-
"Transpose" : 97,
|
| 31 |
-
"Gelu" : 26,
|
| 32 |
-
"Reshape" : 96
|
| 33 |
-
},
|
| 34 |
-
"computePrecision" : "Mixed (Float16, Float32, Int32)",
|
| 35 |
-
"isUpdatable" : "0",
|
| 36 |
-
"availability" : {
|
| 37 |
-
"macOS" : "12.0",
|
| 38 |
-
"tvOS" : "15.0",
|
| 39 |
-
"watchOS" : "8.0",
|
| 40 |
-
"iOS" : "15.0",
|
| 41 |
-
"macCatalyst" : "15.0"
|
| 42 |
-
},
|
| 43 |
-
"modelType" : {
|
| 44 |
-
"name" : "MLModelType_mlProgram"
|
| 45 |
-
},
|
| 46 |
-
"userDefinedMetadata" : {
|
| 47 |
-
|
| 48 |
-
},
|
| 49 |
-
"inputSchema" : [
|
| 50 |
-
{
|
| 51 |
-
"hasShapeFlexibility" : "0",
|
| 52 |
-
"isOptional" : "0",
|
| 53 |
-
"dataType" : "Float32",
|
| 54 |
-
"formattedType" : "MultiArray (Float32 1 × 80 × 3000)",
|
| 55 |
-
"shortDescription" : "",
|
| 56 |
-
"shape" : "[1, 80, 3000]",
|
| 57 |
-
"name" : "logmel_data",
|
| 58 |
-
"type" : "MultiArray"
|
| 59 |
-
}
|
| 60 |
-
],
|
| 61 |
-
"generatedClassName" : "coreml_encoder_medium",
|
| 62 |
-
"method" : "predict"
|
| 63 |
-
}
|
| 64 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-medium-encoder.mlmodelc/model.mil
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
moyoyo_asr_models/ggml-medium-encoder.mlmodelc/weights/weight.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:6a188b0e4e3109f28f38f1f47ea2497ffe623923419df8e1ae12cb5f809a1815
|
| 3 |
-
size 614507008
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-medium-q5_0.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:19fea4b380c3a618ec4723c3eef2eb785ffba0d0538cf43f8f235e7b3b34220f
|
| 3 |
-
size 539212467
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-small-encoder.mlmodelc/analytics/coremldata.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:18ad2072ae82872c2ba8a187071e1e7d6c1105253685e7aa95138adcf07874e0
|
| 3 |
-
size 207
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-small-encoder.mlmodelc/coremldata.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:05fe28591b40616fa0c34ad7b853133623f5300923ec812acb11459c411acf3b
|
| 3 |
-
size 149
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-small-encoder.mlmodelc/metadata.json
DELETED
|
@@ -1,64 +0,0 @@
|
|
| 1 |
-
[
|
| 2 |
-
{
|
| 3 |
-
"metadataOutputVersion" : "3.0",
|
| 4 |
-
"storagePrecision" : "Float16",
|
| 5 |
-
"outputSchema" : [
|
| 6 |
-
{
|
| 7 |
-
"hasShapeFlexibility" : "0",
|
| 8 |
-
"isOptional" : "0",
|
| 9 |
-
"dataType" : "Float32",
|
| 10 |
-
"formattedType" : "MultiArray (Float32)",
|
| 11 |
-
"shortDescription" : "",
|
| 12 |
-
"shape" : "[]",
|
| 13 |
-
"name" : "output",
|
| 14 |
-
"type" : "MultiArray"
|
| 15 |
-
}
|
| 16 |
-
],
|
| 17 |
-
"modelParameters" : [
|
| 18 |
-
|
| 19 |
-
],
|
| 20 |
-
"specificationVersion" : 6,
|
| 21 |
-
"mlProgramOperationTypeHistogram" : {
|
| 22 |
-
"Linear" : 72,
|
| 23 |
-
"Matmul" : 24,
|
| 24 |
-
"Cast" : 2,
|
| 25 |
-
"Conv" : 2,
|
| 26 |
-
"Softmax" : 12,
|
| 27 |
-
"Add" : 25,
|
| 28 |
-
"LayerNorm" : 25,
|
| 29 |
-
"Mul" : 24,
|
| 30 |
-
"Transpose" : 49,
|
| 31 |
-
"Gelu" : 14,
|
| 32 |
-
"Reshape" : 48
|
| 33 |
-
},
|
| 34 |
-
"computePrecision" : "Mixed (Float16, Float32, Int32)",
|
| 35 |
-
"isUpdatable" : "0",
|
| 36 |
-
"availability" : {
|
| 37 |
-
"macOS" : "12.0",
|
| 38 |
-
"tvOS" : "15.0",
|
| 39 |
-
"watchOS" : "8.0",
|
| 40 |
-
"iOS" : "15.0",
|
| 41 |
-
"macCatalyst" : "15.0"
|
| 42 |
-
},
|
| 43 |
-
"modelType" : {
|
| 44 |
-
"name" : "MLModelType_mlProgram"
|
| 45 |
-
},
|
| 46 |
-
"userDefinedMetadata" : {
|
| 47 |
-
|
| 48 |
-
},
|
| 49 |
-
"inputSchema" : [
|
| 50 |
-
{
|
| 51 |
-
"hasShapeFlexibility" : "0",
|
| 52 |
-
"isOptional" : "0",
|
| 53 |
-
"dataType" : "Float32",
|
| 54 |
-
"formattedType" : "MultiArray (Float32 1 × 80 × 3000)",
|
| 55 |
-
"shortDescription" : "",
|
| 56 |
-
"shape" : "[1, 80, 3000]",
|
| 57 |
-
"name" : "logmel_data",
|
| 58 |
-
"type" : "MultiArray"
|
| 59 |
-
}
|
| 60 |
-
],
|
| 61 |
-
"generatedClassName" : "coreml_encoder_small",
|
| 62 |
-
"method" : "predict"
|
| 63 |
-
}
|
| 64 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-small-encoder.mlmodelc/model.mil
DELETED
|
The diff for this file is too large to render.
See raw diff
|
|
|
moyoyo_asr_models/ggml-small-encoder.mlmodelc/weights/weight.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:87eed4ae76f11a2d4a50786bc7423d4b45c2d0d9ca05577a3bd2557452072eaf
|
| 3 |
-
size 176339456
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/ggml-small.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:951596a31b1c96a01b7a2b1bc511f665d900c679126134f6ec18db5ec4a485fe
|
| 3 |
-
size 487601984
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/qwen2.5-7b-instruct-q5_0-00001-of-00002.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:715a0c76b1b074ed65fe0fabf88b1df6f5f638318f15ba9f62a04d493e236d5f
|
| 3 |
-
size 4001112160
|
|
|
|
|
|
|
|
|
|
|
|
moyoyo_asr_models/qwen2.5-7b-instruct-q5_0-00002-of-00002.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:6a254c888ebffcddf98b0c277433a339d9a8cbf970f246b0b6e6a9195e5d6cfb
|
| 3 |
-
size 1314064416
|
|
|
|
|
|
|
|
|
|
|
|