Instructions to use KillerBoss/functiongemma-plantgame-de with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use KillerBoss/functiongemma-plantgame-de with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use KillerBoss/functiongemma-plantgame-de with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Use Docker
docker model run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use KillerBoss/functiongemma-plantgame-de with Ollama:
ollama run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Unsloth Desktop
- Docker Model Runner
How to use KillerBoss/functiongemma-plantgame-de with Docker Model Runner:
docker model run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Lemonade
How to use KillerBoss/functiongemma-plantgame-de with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull KillerBoss/functiongemma-plantgame-de:F16
Run and chat with the model
lemonade run user.functiongemma-plantgame-de-F16
List all available models
lemonade list
- Atomic Chat
log: export v5 verify
Browse files- logs/export_v5.log +21 -0
logs/export_v5.log
CHANGED
|
@@ -936,3 +936,24 @@ Traceback (most recent call last):
|
|
| 936 |
File "/kaggle/src/script.py", line 183, in <module>
|
| 937 |
from mediapipe.tasks.python.genai import bundler
|
| 938 |
ModuleNotFoundError: No module named 'mediapipe.tasks.python.genai'
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 936 |
File "/kaggle/src/script.py", line 183, in <module>
|
| 937 |
from mediapipe.tasks.python.genai import bundler
|
| 938 |
ModuleNotFoundError: No module named 'mediapipe.tasks.python.genai'
|
| 939 |
+
>>> Log nach HF hochgeladen (task)
|
| 940 |
+
|
| 941 |
+
================================================================
|
| 942 |
+
STEP: 6/7 Verifikation (litert-lm-peek + CPU-Smoke-Test) (t+17.6 min)
|
| 943 |
+
================================================================
|
| 944 |
+
+ litert-lm-peek /kaggle/working/export_cpu/model.litertlm | head -50
|
| 945 |
+
stderr(tail):
|
| 946 |
+
usage: litert-lm-peek [-h] --litertlm_file LITERTLM_FILE
|
| 947 |
+
[--dump_files_dir DUMP_FILES_DIR]
|
| 948 |
+
litert-lm-peek: error: the following arguments are required: --litertlm_file
|
| 949 |
+
|
| 950 |
+
### Host-Smoke-Test des CPU/GPU-litertlm:
|
| 951 |
+
+ litert-lm run /kaggle/working/export_cpu/model.litertlm --prompt="Giesse die Tomatenpflanze." --max_tokens=80 --verbosity=1
|
| 952 |
+
RC=2
|
| 953 |
+
STDERR:
|
| 954 |
+
Usage: litert-lm run [OPTIONS]
|
| 955 |
+
[MODEL_REFERENCE]
|
| 956 |
+
Try 'litert-lm run -h' for help.
|
| 957 |
+
|
| 958 |
+
Error: No such option: --max_tokens Did you mean --max-num-tokens?
|
| 959 |
+
|