File size: 1,089 Bytes
4f20ce0
730ed04
 
 
 
4f20ce0
 
730ed04
4f20ce0
 
730ed04
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
title: Gemma 4 26B Coding API
emoji: πŸš€
colorFrom: indigo
colorTo: green
sdk: docker
pinned: false
app_port: 7860
---

# Gemma 4 26B A4B β€” Coding API

Gemma 4 26B A4B (MoE) served as an Anthropic + OpenAI compatible API.  
Model: `unsloth/gemma-4-26B-A4B-it-GGUF` Β· `UD-IQ3_XXS` (11.2 GB)  
Params: temp=0.3, top_p=0.9, min_p=0.1, top_k=20 (coding-tuned)

## Claude Code setup

```bash
export ANTHROPIC_BASE_URL=https://YOUR_USERNAME-gemma-4-26b-coding-api.hf.space
export ANTHROPIC_API_KEY=gemma4-local
claude --model gemma-4-26b
```

## Environment variables (HF Space β†’ Settings β†’ Variables)

| Variable | Default | Description |
|----------|---------|-------------|
| `SPACE_URL` | `` | Your space URL β€” enables self-ping |
| `MODEL_REPO` | `unsloth/gemma-4-26B-A4B-it-GGUF` | HF repo |
| `MODEL_FILE` | `gemma-4-26B-A4B-it-UD-IQ3_XXS.gguf` | GGUF filename |
| `N_CTX` | `4096` | Context window |
| `N_THREADS` | `2` | CPU threads |
| `DEFAULT_TEMP` | `0.3` | Temperature |
| `DEFAULT_MIN_P` | `0.1` | Min-p (key for coding accuracy) |
| `DEFAULT_TOP_K` | `20` | Top-k |