Instructions to use twinkapp/mobileai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use twinkapp/mobileai with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf twinkapp/mobileai:Q4_K_M
Use Docker
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use twinkapp/mobileai with Ollama:
ollama run hf.co/twinkapp/mobileai:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use twinkapp/mobileai with Docker Model Runner:
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Lemonade
How to use twinkapp/mobileai with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull twinkapp/mobileai:Q4_K_M
Run and chat with the model
lemonade run user.mobileai-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Delete Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez
Browse files- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q4_k_m.gguf +0 -3
- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q4_k_s.gguf +0 -3
- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q5_k_m.gguf +0 -3
- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q5_k_s.gguf +0 -3
- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q6_k.gguf +0 -3
- Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q8_0.gguf +0 -3
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q4_k_m.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:bbc4a5f5f01c6a103ae7c524b3115f7f3ec39ec84815c56769f61c4dd7c974b9
|
| 3 |
-
size 2104934816
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q4_k_s.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:4ecc7b793eb1edb536f706652543c7b9289a4e8f184eb8238ee4031d21b7634a
|
| 3 |
-
size 2009416096
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q5_k_m.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:c99002fc1d19911addbd2b1db580d0ca5152125c0c3b783a6d107ab39a986667
|
| 3 |
-
size 2438742432
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q5_k_s.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:8bc66389158aab4ee3f889115e5b6b41c564dd91eb76e7332d64f6aa1233af79
|
| 3 |
-
size 2383593888
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q6_k.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:894fe8e9a56be5ff1fa1501e3cb58e78a1bff4ce46428b87c2ada3f2f4b1d173
|
| 3 |
-
size 2793413024
|
|
|
|
|
|
|
|
|
|
|
|
Qwen/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1=Goekdeniz-Guelmez/josiefied-qwen2.5-3b-instruct-abliterated-v1-q8_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:098506047a32350c7f9b941dd78da0b309cf28ef1c5d957a25582088c1fcaf90
|
| 3 |
-
size 3616090528
|
|
|
|
|
|
|
|
|
|
|
|