File size: 1,395 Bytes
30bfd91
0b0e570
97f7b47
30bfd91
 
 
 
 
 
 
 
 
22d4dca
 
 
d033305
22d4dca
30bfd91
 
22d4dca
30bfd91
22d4dca
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30bfd91
 
 
22d4dca
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
base_model:
- unsloth/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
license: apache-2.0
language:
- en
- zh
datasets:
- FradSer/DeepSeek-R1-Distilled-Translate-en-zh_CN-39k
- wmt/wmt19
pipeline_tag: text-generation
---

## DeepTranslate-R1-1.5B 概述

DeepTranslate-R1-1.5B 是一个从 DeepSeek-R1-Distilled-Qwen-1.5B 微调而来的语言模型,专门用于英文和中文之间的高质量翻译。我们的模型使用监督式微调(SFT)技术,在仅有1.5B参数的计算效率下实现高质量翻译。

## 输出模板

```
TEMPLATE """{{- if .System }}{{ .System }}{{ end }}
{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1}}
{{- if eq .Role "user" }}<|User|>{{ .Content }}
{{- else if eq .Role "assistant" }}<|Assistant|>{{ .Content }}{{- if not $last }}<|end▁of▁sentence|>{{- end }}
{{- end }}
{{- if and $last (ne .Role "assistant") }}<|Assistant|>{{- end }}
{{- end }}"""

```

## 作者
- [歸藏 (guizang.ai)](https://x.com/op7418)
- [FradSer](https://x.com/FradSer) 

This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)