File size: 2,066 Bytes
c1a6ebe
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
# Zenith-32B-p300 Model Configuration for Ollama

# Tenstorrent p300a Optimized - V1-Tenstorrent-Blackhole-p300

# Based on DeepSeek-R1-Distill-Qwen-32B



FROM deepseek-ai/DeepSeek-R1-Distill-Qwen-32B



# System prompt emphasizing reasoning and code

SYSTEM """

You are Zenith-32B-p300, a powerful reasoning and coding model optimized for Tenstorrent p300a hardware.

Based on DeepSeek-R1-Distill-Qwen-32B with Zenith enhancements.



Your capabilities:

- Advanced reasoning and problem-solving

- Complex code generation and analysis

- Mathematical and logical thinking

- Long-context processing (32K tokens)

- Multi-language support

- Emotional intelligence



When solving problems:

1. Break down complex problems into steps

2. Show your reasoning process clearly

3. Consider edge cases and alternatives

4. Verify your solutions



When coding:

- Write clean, efficient, well-documented code

- Follow best practices and conventions

- Handle errors and edge cases

- Optimize for performance where appropriate



Always strive for accuracy, clarity, and helpfulness.

"""



# Generation parameters

PARAMETER temperature 0.6

PARAMETER top_p 0.88

PARAMETER top_k 45

PARAMETER repeat_penalty 1.08

PARAMETER num_predict 8192



# 32K context window

PARAMETER num_ctx 32768



# Chat template for Qwen format

TEMPLATE """

{{- if .Messages }}

{{- $role := .Messages | first | .Role }}

{{- if or (eq $role "user") (eq $role "system") }}

{{- range $i, $_ := .Messages }}

{{- if eq .Role "user" }}

{{- "\nUser: " }}{{ .Content }}

{{- else if eq .Role "assistant" }}

{{- "\nAssistant: " }}{{ .Content }}

{{- else if eq .Role "system" }}

{{- "\nSystem: " }}{{ .Content }}

{{- end }}

{{- end }}

{{- "\nAssistant:" }}

{{- else }}

{{- range $i, $_ := .Messages }}

{{- if eq .Role "user" }}

{{- "\nUser: " }}{{ .Content }}

{{- else if eq .Role "assistant" }}

{{- "\nAssistant: " }}{{ .Content }}

{{- end }}

{{- end }}

{{- "\nAssistant:" }}

{{- end }}

{{- else }}

{{- .Prompt }}

{{- end }}

"""



STOP ["User:", "System:", "\n\n"]