Qwen2.5_CPT

This is a continued pretraining (CPT) + fine-tuned version of Qwen2.5-1.5B.

How to use

from transformers import AutoModelForCausalLM, AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("kovidritesh/Qwen2.5_CPT")
model = AutoModelForCausalLM.from_pretrained("kovidritesh/Qwen2.5_CPT")

text = "Explain fusion reaction."
inputs = tokenizer(text, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0]))