| license: apache-2.0 | |
| base_model: | |
| - google/umt5-xxl | |
| - Able2/umt5-xxl-encode-only | |
| umt5-xxl gguf model with encoder only, mainly used as text encoder for image or video generation models. Use with llama.cpp. Used in [HighDoping/Wan2.1](https://github.com/HighDoping/Wan2.1). | |
| Example command: | |
| ```bash | |
| llama-embedding -m umt5-xxl-encode-only-Q4_K_M.gguf -p "Penguin" --pooling none --embd-normalize -1 --no-warmup --batch-size 512 --ctx-size 512 --embd-output-format array | |
| ``` |