Technical question: Lineage of jinaai/jina-code-embeddings-1.5b

#2
by dqdw - opened

Dear [Developer/Team],

I've been using jinaai/jina-code-embeddings-1.5b recently, and I find it quite useful for my tasks.

Before building on top of it, I would like to understand its connection with Qwen/Qwen2.5-Coder-1.5B:

Direct Fine-tuning: Is it derived directly from Qwen/Qwen2.5-Coder-1.5B, or through other checkpoints?

Inheritance: Are the weights directly inherited from Qwen/Qwen2.5-Coder-1.5B?

This clarification would help me avoid compatibility issues.

I really appreciate your help.

Jina AI org

Hey @dqdw ,
Yes it's a direct fine-tuning of Qwen/Qwen2.5-Coder-1.5B and the weights are inherited from that checkpoint

Sign up or log in to comment