Instructions to use twinkapp/mobileai with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use twinkapp/mobileai with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: llama cli -hf twinkapp/mobileai:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf twinkapp/mobileai:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf twinkapp/mobileai:Q4_K_M
Use Docker
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use twinkapp/mobileai with Ollama:
ollama run hf.co/twinkapp/mobileai:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use twinkapp/mobileai with Docker Model Runner:
docker model run hf.co/twinkapp/mobileai:Q4_K_M
- Lemonade
How to use twinkapp/mobileai with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull twinkapp/mobileai:Q4_K_M
Run and chat with the model
lemonade run user.mobileai-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Upload 6 files
Browse files- .gitattributes +6 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_M.gguf +3 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_S.gguf +3 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_M.gguf +3 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_S.gguf +3 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q6_K.gguf +3 -0
- Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q8_0.gguf +3 -0
.gitattributes
CHANGED
|
@@ -266,3 +266,9 @@ Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q5_K_M.gguf filter=lfs diff=lfs
|
|
| 266 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 267 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 268 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 266 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 267 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 268 |
Phi/Dolphin-2_6-phi-2=TheBloke/dolphin-2_6-phi-2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 269 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 270 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 271 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 272 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
| 273 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 274 |
+
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8e6839fa0151e4f26fbd8d1d8647e3be968ca2e03fcb2fef874482abbd7a86d7
|
| 3 |
+
size 2393231680
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q4_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7e7b4e97c903b5a472dfb70408435ae676c14aac9e60652ff90d3bae71e3331b
|
| 3 |
+
size 2188759360
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d3c5f56b6ee651e112de9c9127e144cadbd6b244c114d2460ab275fb4bedb3d
|
| 3 |
+
size 2815275328
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q5_K_S.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:03c8f85337b73eb58fcc6ccb181f2bf03e3121015910a31e364c685e7f93dd3f
|
| 3 |
+
size 2641473856
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0864b97385bf83d75de86db939a3ffcc1f64cf46e0121b37d45d2adaae03e4d
|
| 3 |
+
size 3135852352
|
Phi/Phi-3-mini-4k-geminified=munish0838/Phi-3-mini-4k-geminified.Q8_0.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:205467a667a971bbe7f7c7055b3c66703897cc777edecfe1dbc401794c7c9001
|
| 3 |
+
size 4061221696
|