File size: 684 Bytes
0e86f35 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 | # ==============================================================================
# 🌉 ChiasmBridge Universal Cross-Modal GGUF Modelfile
# Bridges 7B Vision GGUF (3584-dim) to 24B/72B Base Cognitive LLM (5120-dim)
# ==============================================================================
# 1. Target Base Cognitive Language Model (5,120-dim or 8,192-dim)
FROM ./kalos-24b.gguf
# 2. Source Vision/Audio Encoder Model (e.g., ./vision-7b.gguf or ./whisper-audio.gguf)
# Note: ChiasmBridge (libchiasm.so) bridges the source encoder to the base model above
# in CUDA VRAM at runtime, eliminating GGUF dimension mismatch crashes!
# 3. Context Window Size
PARAMETER num_ctx 16384
|