Some Like It Small: Czech Semantic Embedding Models for Industry Applications
Paper • 2311.13921 • Published
How to use Veol-CZ/czech-semantic-embeddings with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Veol-CZ/czech-semantic-embeddings:F16 # Run inference directly in the terminal: llama cli -hf Veol-CZ/czech-semantic-embeddings:F16
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Veol-CZ/czech-semantic-embeddings:F16 # Run inference directly in the terminal: llama cli -hf Veol-CZ/czech-semantic-embeddings:F16
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Veol-CZ/czech-semantic-embeddings:F16 # Run inference directly in the terminal: ./llama-cli -hf Veol-CZ/czech-semantic-embeddings:F16
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Veol-CZ/czech-semantic-embeddings:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Veol-CZ/czech-semantic-embeddings:F16
docker model run hf.co/Veol-CZ/czech-semantic-embeddings:F16
How to use Veol-CZ/czech-semantic-embeddings with Ollama:
ollama run hf.co/Veol-CZ/czech-semantic-embeddings:F16
How to use Veol-CZ/czech-semantic-embeddings with Unsloth Studio:
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Veol-CZ/czech-semantic-embeddings to start chatting
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Veol-CZ/czech-semantic-embeddings to start chatting
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Veol-CZ/czech-semantic-embeddings to start chatting
How to use Veol-CZ/czech-semantic-embeddings with Docker Model Runner:
docker model run hf.co/Veol-CZ/czech-semantic-embeddings:F16
How to use Veol-CZ/czech-semantic-embeddings with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Veol-CZ/czech-semantic-embeddings:F16
lemonade run user.czech-semantic-embeddings-F16
lemonade list
GGUF conversions of Czech semantic embedding models from Seznam with non-commercial license terms.
Seznam__dist-mpnet-czeng-cs-en.f16.ggufSeznam__dist-mpnet-czeng-cs-en.q8_0.ggufSeznam__simcse-dist-mpnet-czeng-cs-en.f16.ggufSeznam__simcse-dist-mpnet-czeng-cs-en.q8_0.ggufIf you use this model, please cite the original Seznam paper:
@inproceedings{bednavr2024some,
title={Some Like It Small: Czech Semantic Embedding Models for Industry Applications},
author={Bedn{\'a}{\v{r}}, Ji{\v{r}}{\'\i} and N{\'a}plava, Jakub and Baran{\v{c}}{\'\i}kov{\'a}, Petra and Lisick{\`y}, Ond{\v{r}}ej},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={38},
number={21},
pages={22734--22742},
year={2024}
}
llama-server -m Seznam__dist-mpnet-czeng-cs-en.q8_0.gguf --embedding --pooling cls
SHA256 checksums are in checksums.txt.
This package contains converted checkpoints from upstream models. Respect original model license and terms:
dist-mpnet-czeng-cs-en: CC-BY-NC-SA-4.0simcse-dist-mpnet-czeng-cs-en: CC-BY-NC-SA-4.0Non-commercial use only. Attribution to Seznam and original model card is required.
8-bit
16-bit
docker model run hf.co/Veol-CZ/czech-semantic-embeddings:F16