--- license: mit tags: - fastflowlm - npu2 - q4nx --- # You can install this with PyPI (recommended) `uv tool install flm-add` `pip install flm-add` Install a pre-converted FLM (Q4NX) model and register it with FastFlowLM. ``` positional arguments: repo Hugging Face repo id (Org/Name), ModelScope id (with --modelscope), URL, or local directory options: -h, --help show this help message and exit --tag TAG Registry tag (default: derived from the repo name, e.g. qwen3.5-claude:9b) --family FAMILY details.family for engine dispatch (default: from matching official entry) --config CONFIG model_list.json to update (default: $FLM_CONFIG_PATH or ~/.config/flm/model_list.json) --models-root MODELS_ROOT models directory (default: $FLM_MODEL_PATH or ~/.config/flm/models) --xclbin-dir XCLBIN_DIR user xclbins directory (default: ~/.config/flm/xclbins) --xclbin-from XCLBIN_FROM official model directory name to link xclbins from (default: best match, e.g. Qwen3.6-35B-A3B-NPU2) --system-list SYSTEM_LIST official model_list.json used for defaults (default: auto-detect) --modelscope Treat REPO as a ModelScope repo id --no-xclbin Do not create the xclbins symlink --no-verify Skip sha256 verification of downloads --force Overwrite existing model files/links --dry-run Print the plan and exit --quiet Less output ``` Example: ``` $ flm-add Atomic-Germ/DynaGuard-4B-NPU2 --tag dynaguard:4b --family qwen3.5 [INFO] xclbins from official qwen3.5:4b [INFO] Downloading model files from Hugging Face: Atomic-Germ/DynaGuard-4B-NPU2 Downloading config.json (0.00 GB)... 100% (0.00 GB / 0.00 GB) Downloading model.q4nx (3.29 GB)... 0% (0.00 GB / 3.29 GB) 5% (0.16 GB / 3.29 GB) 10% (0.33 GB / 3.29 GB) 15% (0.49 GB / 3.29 GB) 20% (0.66 GB / 3.29 GB) 25% (0.82 GB / 3.29 GB) 30% (0.99 GB / 3.29 GB) 35% (1.15 GB / 3.29 GB) 40% (1.32 GB / 3.29 GB) 45% (1.48 GB / 3.29 GB) 50% (1.65 GB / 3.29 GB) 55% (1.81 GB / 3.29 GB) 60% (1.98 GB / 3.29 GB) 65% (2.14 GB / 3.29 GB) 70% (2.30 GB / 3.29 GB) 75% (2.47 GB / 3.29 GB) 80% (2.63 GB / 3.29 GB) 85% (2.80 GB / 3.29 GB) 90% (2.96 GB / 3.29 GB) 95% (3.13 GB / 3.29 GB) 100% (3.29 GB / 3.29 GB) Downloading tokenizer.json (0.01 GB)... 45% (0.01 GB / 0.01 GB) 55% (0.01 GB / 0.01 GB) 100% (0.01 GB / 0.01 GB) Downloading tokenizer_config.json (0.00 GB)... 100% (0.00 GB / 0.00 GB) Downloading chat_template.jinja (0.00 GB)... 100% (0.00 GB / 0.00 GB) [INFO] Registered tag 'dynaguard:4b' in /home/atomic-germ/.config/flm/model_list.json [INFO] Linked xclbins: /home/atomic-germ/.config/flm/xclbins/DynaGuard-4B-NPU2 -> /opt/fastflowlm/share/flm/xclbins/Qwen3.5-4B-NPU2 Done: DynaGuard-4B-NPU2 installed to /home/atomic-germ/.config/flm/models/DynaGuard-4B-NPU2 Run: flm run dynaguard:4b (or: flm serve dynaguard:4b) FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json" FLM_XCLBIN_PATH="$HOME/.config/flm" flm run dynaguard:4b ```