Works with image input!

#7
by GeoMaciolek - opened

At least decently well - this is probably old news for lots of people, but on a whim I tried the mmproj from mistralai/Mistral-Small-3.2-24B-Instruct-2506 (Specifically this bf16 from bartowski's GGUF) and applied it in llama.cpp, and it worked pretty decently! Just figured I'd mention it to anyone who might be curious to try it. (Especially given that at least at some point in its life, WeirdCompound had a textonly model in there, it seems?)

Sign up or log in to comment