How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Noushad999/Polymath-1.5B-Bengali-Math")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Noushad999/Polymath-1.5B-Bengali-Math")
model = AutoModelForCausalLM.from_pretrained("Noushad999/Polymath-1.5B-Bengali-Math", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

πŸ‡§πŸ‡© Polymath-1.5B-Bengali-Math

This model is a merge of Qwen/Qwen2.5-1.5B and Qwen/Qwen2.5-1.5B-Instruct created using the SLERP method.

πŸ§ͺ Research Goal

To investigate the "Capacity Gap" in low-resource languages (like Bengali) when transferring mathematical reasoning capabilities without fine-tuning.

πŸ“Š Performance

  • English Math Logic: 60% Accuracy (Retained Logic) βœ…
  • Bengali Math Logic: 0% Accuracy (Capacity Constraint Revealed) ⚠️

πŸ› οΈ Method

Merged using MergeKit with the following config:

  • Method: SLERP
  • Precision: float16
  • Parameters: 1.5 Billion

Created for research and educational purposes.

Downloads last month
17
Safetensors
Model size
2B params
Tensor type
F16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Noushad999/Polymath-1.5B-Bengali-Math

Merge model
this model
Quantizations
1 model