Instructions to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS # Run inference directly in the terminal: llama cli -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS # Run inference directly in the terminal: llama cli -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS # Run inference directly in the terminal: ./llama-cli -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS # Run inference directly in the terminal: ./build/bin/llama-cli -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Use Docker
docker model run hf.co/Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
- LM Studio
- Jan
- vLLM
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
- Ollama
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Ollama:
ollama run hf.co/Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
- Unsloth Studio
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS to start chatting
- Pi
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS" } ] } } }Run Pi
# Start Pi in your project directory: pi
- OpenClaw new
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Docker Model Runner:
docker model run hf.co/Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
- Lemonade
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Run and chat with the model
lemonade run user.ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS-IQ4_XS
List all available models
lemonade list
- Hermes Agent
How to use Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Clickbook/ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS:IQ4_XS
Run Hermes
hermes
- Atomic Chat
| license: apache-2.0 | |
| license_link: https://ai.google.dev/gemma/docs/gemma_4_license | |
| base_model: google/gemma-4-E2B-it | |
| library_name: gguf | |
| pipeline_tag: text-generation | |
| tags: | |
| - gguf | |
| - llama.cpp | |
| - on-device | |
| - mobile | |
| - vocabulary-pruned | |
| - quantized | |
| language: | |
| - en | |
| - de | |
| - ar | |
| - fr | |
| - es | |
| - it | |
| - pt | |
| - nl | |
| - pl | |
| - tr | |
| - ru | |
| # ClickBook Gemma 4 E2B β European + Arabic, IQ4_XS | |
| The **smallest** ClickBook on-device reading model, and the most thoroughly | |
| tested. Vocabulary pruned to Latin, Cyrillic and Arabic: eleven European | |
| languages plus Arabic. | |
| **1.666 GB.** | |
| A reader taps a word in a book; the model explains it in the sense that sentence | |
| gives it, writes fresh examples, translates the word, and translates the passage. | |
| ## Which of the three to use | |
| | model | size | languages | score | | |
| |---|---:|---|---:| | |
| | **this one** | **1.666 GB** | 11 β Latin, Cyrillic, Arabic | **78.4** | | |
| | [multi](https://huggingface.co/Clickbook/ClickBook-Gemma-4-E2B-multi-IQ4_XS) | 1.844 GB | 18 β adds CJK, Korean, Hindi, Tamil, Thai, Hebrew | 79.2 | | |
| | [allscripts](https://huggingface.co/Clickbook/ClickBook-Gemma-4-E2B-allscripts-IQ4_XS) | 1.950 GB | every script | 63.6 | | |
| **Take this one if you serve only these eleven languages.** It is 178 MB smaller | |
| than `multi` at the same quality, and these are the languages with the most | |
| benchmark evidence behind them. | |
| **Take `multi` if you need any Asian or Indic language.** The 178 MB it costs buys | |
| seven more languages at no measured quality cost β and note that on Android both | |
| files exceed Play's 1.5 GB asset-pack limit anyway, so the smaller file does not | |
| simplify packaging. | |
| ## Languages | |
| | language | reading | answering | evidence | | |
| |---|:--:|:--:|---| | |
| | English, German, Arabic | yes | yes | 90-item benchmark, **two seeds** | | |
| | French | yes | not yet | 183 items, older build: 86.3 | | |
| | Portuguese | yes | not yet | 183 items: 85.7 | | |
| | Spanish, Italian | yes | not yet | 183 items: 81.3 | | |
| | Russian | yes | not yet | 183 items: 81.2 | | |
| | Dutch | yes | not yet | 183 items: 79.2 | | |
| | Polish | yes | not yet | 183 items: 76.7 | | |
| | Turkish | yes | not yet | 183 items: **69.3 β weakest** | | |
| "Answering" means the model can produce the TRANSLATION and CONTEXT tabs in that | |
| language. Those templates exist for English, German and Arabic only; the other | |
| eight can be read *from*, with answers in one of those three. | |
| Turkish is the weakest language in the set by a clear margin β agglutinative | |
| morphology fragments hardest under a pruned vocabulary. | |
| ## Evaluation | |
| 90 held-out tapped words in English, German and Arabic, graded 0β100 by an LLM | |
| judge against a rubric containing a reference sense. | |
| | build | vocabulary | size | score | | |
| |---|---:|---:|---:| | |
| | same weights at f16 | 231,955 | 8.676 GB | 80.5 | | |
| | multi (18 languages) | 231,955 | 1.844 GB | 79.2 | | |
| | **this model** | 180,850 | **1.666 GB** | **79.0** / 77.7 (two seeds) | | |
| | unpruned vocabulary | 262,144 | 1.950 GB | 63.6 | | |
| **This is the only build measured at two seeds**, giving 78.4 Β± 0.7 β worth | |
| knowing, because single-seed differences of a point or so between these builds are | |
| inside that noise. The apparent 0.2 gap to `multi` is not meaningful; the 15.6 gap | |
| to the unpruned build is. | |
| Quantisation costs 1.3 points against f16 for a 4.7Γ smaller file. Pruning further | |
| β to this build's 180,850 tokens β costs nothing measurable. | |
| ## Usage | |
| ```bash | |
| llama-server -m ClickBook-Gemma-4-E2B-eu-ar-ru-IQ4_XS.gguf -c 2048 -ngl 99 --jinja | |
| ``` | |
| ```jsonc | |
| { | |
| "messages": [{ "role": "user", "content": "<prompt from prompts.json>" }], | |
| "temperature": 0.1, "top_k": 40, "top_p": 0.9, "repeat_penalty": 1.05, | |
| "max_tokens": 111, | |
| "chat_template_kwargs": { "enable_thinking": false } // REQUIRED | |
| } | |
| ``` | |
| ### `enable_thinking: false` is required | |
| Without it the model reasons before answering, spends the whole token budget in | |
| `reasoning_content`, and returns **empty `content` with `finish_reason: "length"`**. | |
| That is indistinguishable from a broken model. Raise all caps to 1000 first if you | |
| want reasoning deliberately. | |
| `prompts.json` here is filtered to this build's eleven languages. The wider file | |
| shipped with `multi` includes Chinese, Japanese, Korean, Hindi, Tamil, Thai and | |
| Hebrew β sending those prompts to **this** model would hand it text it has no | |
| tokens for. | |
| Per-tab caps: MEANING 111, EXAMPLE 222, TRANSLATION 111, CONTEXT 444. Measured on | |
| the benchmark, 0 of 360 panels reached them. | |
| ## Limitations | |
| - **Not a chat model.** Tuned for four narrow tasks driven by the supplied prompts. | |
| - Failures concentrate on polysemous common words β *bank*, *charge*, *Schloss* β | |
| 15 of 90 items. | |
| - No on-device dictionary is bundled. An external sense resource measured +12.7 | |
| points on this benchmark but is not included. | |
| - Turkish is materially weaker than the rest. | |
| ## License and provenance | |
| **Apache License 2.0**, matching the base model, | |
| [`google/gemma-4-E2B-it`](https://huggingface.co/google/gemma-4-E2B-it). Google | |
| also publishes a [Gemma 4 license page](https://ai.google.dev/gemma/docs/gemma_4_license), | |
| linked from the upstream card. | |
| **Modifications**, as Apache 2.0 requires derivative works to state: | |
| 1. **Vocabulary pruned** from 262,144 to 180,850 tokens, retaining Latin, Cyrillic | |
| and Arabic and removing CJK, Hangul, Devanagari, Thai, Hebrew, Greek and other | |
| scripts the product does not serve. | |
| 2. **Quantised** to IQ4_XS with Q2_K token embeddings under an importance matrix. | |
| No weights were fine-tuned, distilled or retrained. | |
| Gemma is a trademark of Google LLC. This is an independent derivative, not | |
| endorsed by or affiliated with Google. | |