ViralityLeo/vllm-translategemma-4b-it-FP8-Dynamic

This is a quantized variant of google/translategemma-4b-it with templating for vLLM.

Essentially a fuse between https://huggingface.co/kaitchup/translategemma-4b-it-FP8-Dynamic (model) and https://huggingface.co/Infomaniak-AI/vllm-translategemma-4b-it (prompt template & configs).

Chat Template

Format: <<<source>>>{source_lang}<<<target>>>{target_lang}<<<text>>>{text_to_translate}

If you need to provide a custom prompt input

Format: <<<custom>>>{text}