How to use from
llama.cpp
Install from brew
brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf trollek/SmolImagePromptHelper-135M-GGUF:
# Run inference directly in the terminal:
llama-cli -hf trollek/SmolImagePromptHelper-135M-GGUF:
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf trollek/SmolImagePromptHelper-135M-GGUF:
# Run inference directly in the terminal:
llama-cli -hf trollek/SmolImagePromptHelper-135M-GGUF:
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf trollek/SmolImagePromptHelper-135M-GGUF:
# Run inference directly in the terminal:
./llama-cli -hf trollek/SmolImagePromptHelper-135M-GGUF:
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf trollek/SmolImagePromptHelper-135M-GGUF:
# Run inference directly in the terminal:
./build/bin/llama-cli -hf trollek/SmolImagePromptHelper-135M-GGUF:
Use Docker
docker model run hf.co/trollek/SmolImagePromptHelper-135M-GGUF:
Quick Links

Smol Image Prompt Helper

Quants of SmolImagePromptHelper-135M

Model description

Lets say you have a node in ComfyUI to parse JSON and send the appropriate prompt to the text encoders. Tadaaa:

You are an AI assistant tasked with expanding and formatting image prompts. You are given an input that you will need to write image prompts for different text encoders.
Always respond with the following format:
{
    "clip_l": "<keywords from image analysis>",
    "clip_g": "<simple descriptions of the image>",
    "t5xxl": "<complex semanticly rich description of the image>",
    "negative": "<contrasting keywords for what is not in the image>"
}

Intended uses & limitations

Have a look at the dataset that I created (ImagePromptHelper-v02 (CC BY 4.0)) and you will see whaaaaat I've doooone.

Downloads last month
70
GGUF
Model size
0.1B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

3-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for trollek/SmolImagePromptHelper-135M-GGUF

Quantized
(1)
this model

Datasets used to train trollek/SmolImagePromptHelper-135M-GGUF