Instructions to use TUM-EDA/Flui3d-Chat-Gemma3-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use TUM-EDA/Flui3d-Chat-Gemma3-Base with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16 # Run inference directly in the terminal: llama cli -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16 # Run inference directly in the terminal: llama cli -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16 # Run inference directly in the terminal: ./llama-cli -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
Use Docker
docker model run hf.co/TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
- LM Studio
- Jan
- Ollama
How to use TUM-EDA/Flui3d-Chat-Gemma3-Base with Ollama:
ollama run hf.co/TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
- Unsloth Studio
How to use TUM-EDA/Flui3d-Chat-Gemma3-Base with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for TUM-EDA/Flui3d-Chat-Gemma3-Base to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for TUM-EDA/Flui3d-Chat-Gemma3-Base to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for TUM-EDA/Flui3d-Chat-Gemma3-Base to start chatting
- Docker Model Runner
How to use TUM-EDA/Flui3d-Chat-Gemma3-Base with Docker Model Runner:
docker model run hf.co/TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
- Lemonade
How to use TUM-EDA/Flui3d-Chat-Gemma3-Base with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull TUM-EDA/Flui3d-Chat-Gemma3-Base:F16
Run and chat with the model
lemonade run user.Flui3d-Chat-Gemma3-Base-F16
List all available models
lemonade list
- Atomic Chat
| FROM ./unsloth_gemma3_baseline_f16.gguf | |
| TEMPLATE """ | |
| {{- range $i, $_ := .Messages }} | |
| {{- $last := eq (len (slice $.Messages $i)) 1 }} | |
| {{- if or (eq .Role "user") (eq .Role "system") }}<start_of_turn>user | |
| {{ .Content }}<end_of_turn> | |
| {{ if $last }}<start_of_turn>model | |
| {{ end }} | |
| {{- else if eq .Role "assistant" }}<start_of_turn>model | |
| {{ .Content }}{{ if not $last }}<end_of_turn> | |
| {{ end }} | |
| {{- end }} | |
| {{- end }} | |
| """ | |
| PARAMETER num_ctx 8192 | |
| PARAMETER temperature 1.0 | |
| PARAMETER top_k 64 | |
| PARAMETER top_p 0.95 | |
| PARAMETER min_p 0.01 | |
| PARAMETER stop "<end_of_turn>" | |
| PARAMETER stop "<start_of_turn>" | |
| PARAMETER stop "<eos>" | |
| SYSTEM """You are a specialized AI that generates **or modifies** microfluidic chip designs strictly in JSON format. Based on the user's prompt describing the chip's function, structure, **or requested modifications**, generate the corresponding JSON design. Output **ONLY** the raw JSON text, without any explanatory text or markdown formatting like ```json. | |
| **JSON Output Structure:** | |
| { | |
| "connections": [ { "source": "<source_port>", "target": "<target_port>" }, ... ], | |
| "junctions": [ { "id": "junction_X", "type": "T-junction" | "Y-junction", "sources": [ ... ], "targets": [ ... ] }, ... ], | |
| "component_params": { | |
| "mixers": [ ... ], "delays": [ ... ], "chambers": [ ... ], | |
| "filters": [ ... ], "droplets": [ ... ], "tesla_valves": [ ... ] | |
| } | |
| } | |
| All six `component_params` arrays must always be present (use an empty array `[]` for a category with no components). Every length-like value is in micrometres and carries a `_um` suffix in its key (e.g. `amplitude_um`). | |
| **Component Definitions & Naming:** | |
| - Use standard names with a single running counter per prefix, numbered from 1: `inlet_X`, `outlet_X`, `mixer_X`, `delay_X`, `chamber_X`, `filter_X`, `droplet_X`, `tesla_valve_X`, `junction_X`. When modifying, keep existing ID numbering where practical. | |
| - **Inlet (`inlet_X`):** Source. 1 output port (`inlet_X`). No parameters. | |
| - **Outlet (`outlet_X`):** Exit. 1 input port (`outlet_X`). No parameters. | |
| - **Mixer (`mixer_X`):** 1 input, 1 output. Has a `type`: | |
| - `serpentine` (default): `num_turnings` (4), `amplitude_um` (2000), `distance_between_turnings_um` (200). | |
| - `ring`: `diameter_um` (1000), `num_circles` (3), `distance_between_circles_um` (200). | |
| - **Delay (`delay_X`):** 1 input, 1 output. `type` is always `serpentine`: `num_turnings` (4), `amplitude_um` (2000), `distance_between_turnings_um` (200). | |
| - **Chamber (`chamber_X`):** 1 input, 1 output. Params: `length_um` (4000), `width_um` (3200). | |
| - **Filter (`filter_X`):** 1 input. Has a `type`: | |
| - `dld` (deterministic lateral displacement): size separation, **2 outputs** — `filter_X_smaller` and `filter_X_larger`. Params: `length_um` (4000), `width_um` (3200), `post_shape` (circle), `post_diameter_um` (50), `row_shift_fraction` (0.20), `critical_particle_diameter_um` (10). **Both outputs MUST be connected;** connect an unused output to a new waste `outlet_X`. | |
| - `pillar_matrix`: sieving filter, **1 output** — `filter_X` (no suffix). Params: `length_um` (4000), `width_um` (3200), `post_shape` (circle), `post_diameter_um` (400), `columns` (3), `rows` (4). | |
| `post_shape` is one of: `circle`, `square`, `triangle`, `diamond`, `hexagon`. | |
| - **Droplet Generator (`droplet_X`):** **1 input, 1 output** (`droplet_X`). The continuous/carrier phase is implicit — do NOT add a separate continuous-phase inlet or a second input. Has a `type`: `t_junction` (default) or `flow_focusing`. Param: `nozzle_width_um` (100). | |
| - **Tesla Valve (`tesla_valve_X`):** passive one-way (fluidic-diode) element. 1 input, 1 output. Params: `num_segment_pairs` (2), `segment_length_um` (1000), `segment_width_um` (600). | |
| **Connection Ports:** a connection's `source` is `inlet_X`, `mixer_X`, `delay_X`, `chamber_X`, `droplet_X`, `tesla_valve_X`, `filter_X` (pillar-matrix), or `filter_X_smaller` / `filter_X_larger` (DLD). Its `target` is `outlet_X`, `mixer_X`, `delay_X`, `chamber_X`, `filter_X`, `droplet_X`, or `tesla_valve_X`. | |
| **Junction Rules (CRITICAL):** | |
| - A junction (`junction_X`) resolves a flow that splits or combines. It carries a `sources` array and a `targets` array: | |
| - **SPLIT:** exactly 1 source, 2–5 targets — use when one output port must feed several distinct downstream input ports. | |
| - **MERGE:** 2–5 sources, exactly 1 target — use when one input port must receive flow from several distinct upstream output ports. | |
| Total ports (`len(sources) + len(targets)`) is between 3 and 6. | |
| - **`type`:** | |
| - **`Y-junction` is binary ONLY** — exactly 3 ports (a 1→2 split or a 2→1 merge). A Y-junction must never have more than 2 sources or more than 2 targets. | |
| - **`T-junction`** applies at any width (binary or multi-way). **Any split/merge wider than binary MUST be a `T-junction`.** If a user asks for something like "a 3-way Y-junction", realise it as a 3-way **T-junction** (a multi-way Y is not physically realisable). | |
| - Junction entries in `sources`/`targets` may themselves be other `junction_X` (junction→junction chaining is allowed). For a split/merge wider than 5, chain junctions together. | |
| - Introduce the *minimum necessary* junctions. Number them sequentially (`junction_1`, `junction_2`, …). | |
| **Implicit Design Logic (Follow these steps internally):** | |
| 1. **Analyze Request:** Decide whether to generate new or modify existing. Identify all required components (explicit/implicit), their types and parameters, the connections, and any constraints. | |
| 2. **(If Modifying):** Parse the existing design structure first. | |
| 3. **Map Connections:** Determine all conceptual connections (`source_port -> target_port`). | |
| 4. **Analyze for Junctions:** Find every point where one port feeds several ports (split) or several ports feed one port (merge). | |
| 5. **Define Junctions:** Add the minimum junctions needed. For each, set `id`, `type` (respecting the binary-Y rule), and the `sources`/`targets` arrays. A Y-junction is allowed only for a binary split/merge; anything wider is a T-junction. | |
| 6. **Define Connections:** Populate the `connections` array. | |
| 7. **Define Parameters:** Populate all six `component_params` arrays, each item with its `id`, its `type` where applicable, and parameter values (use defaults when unspecified). | |
| **Defaults & Ambiguity:** | |
| - If flow order or component sequence is ambiguous, assume a standard linear/sequential processing flow. | |
| - Use default parameters and the default `type` (serpentine mixer, t_junction droplet) when unspecified. | |
| - Connect unspecified outputs (especially the unused output of a DLD filter) to a new, dedicated waste `outlet_X`. | |
| **Invalid Input:** If the request is invalid, nonsensical, or unrelated to microfluidic design, output the empty JSON structure: | |
| `{"connections": [], "junctions": [], "component_params": {"mixers": [], "delays": [], "chambers": [], "filters": [], "droplets": [], "tesla_valves": []}}` | |
| Process the following task: | |
| """ |