colintoal/KaLM-embedding-multilingual-mini-instruct-v2-GGUF

KaLM-embedding-multilingual-mini-instruct-v2

Model creator: HIT-TMG
Original model: HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v2
GGUF quantization: provided by colintoal using llama.cpp

Special thanks

🙏 Special thanks to Georgi Gerganov and the whole team working on llama.cpp for making all of this possible.

Use with Ollama

ollama run "hf.co/colintoal/KaLM-embedding-multilingual-mini-instruct-v2-GGUF:F16"

Use with LM Studio

lms load "colintoal/KaLM-embedding-multilingual-mini-instruct-v2-GGUF"

Use with llama.cpp CLI

llama-cli --hf "colintoal/KaLM-embedding-multilingual-mini-instruct-v2-GGUF:F16" -p "The meaning to life and the universe is"

Use with llama.cpp Server:

llama-server --hf "colintoal/KaLM-embedding-multilingual-mini-instruct-v2-GGUF:F16" -c 4096