🤏 smolified-indic-chat-translator

Intelligence, Distilled.

This is a Domain Specific Language Model (DSLM) generated by the Smolify Foundry.

It has been synthetically distilled from SOTA reasoning engines into a high-efficiency architecture, optimized for deployment on edge hardware (CPU/NPU) or low-VRAM environments.

📦 Asset Details

• Origin: Smolify Foundry (Job ID: 6f1d306c)
• Architecture: DSLM-Micro (270M Parameter Class)
• Training Method: Proprietary Neural Distillation
• Optimization: 4-bit Quantized / FP16 Mixed
• Dataset: Link to Dataset

🚀 Usage (Inference)

This model is compatible with standard inference backends like vLLM.

# Example: Running your Sovereign Model
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "rishiraj/smolified-indic-chat-translator"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")

messages = [
    {'role': 'system', 'content': '''You are an expert linguistics AI specializing in informal Indian communication patterns and Romanized transliteration (writing local languages using English letters). You are given a WhatsApp-style message and your task is to identify its source language from the given list, and then provide its translations into all the other target languages, ensuring all outputs are in Roman script and maintain an informal tone.'''},
    {'role': 'user', 'content': '''yenna sollu? office ponnum but manasu illa'''}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize = False,
    add_generation_prompt = True,
).removeprefix('<bos>')

from transformers import TextStreamer
_ = model.generate(
    **tokenizer(text, return_tensors = "pt").to("cuda"),
    max_new_tokens = 1000,
    temperature = 1, top_p = 0.95, top_k = 64,
    streamer = TextStreamer(tokenizer, skip_prompt = True),
)

⚖️ License & Ownership

This model weights are a sovereign asset owned by rishiraj. Generated via Smolify.ai.