nhannt201 commited on
Commit
3f1e5fd
·
verified ·
1 Parent(s): e850651

feat: update acne assistant lite gguf 0.6b

Browse files
.gitattributes CHANGED
@@ -33,3 +33,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gguf/airy-0.6b-iq1_m.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gguf/airy-0.6b-iq1_s.gguf filter=lfs diff=lfs merge=lfs -text
38
+ gguf/airy-0.6b-iq2_m.gguf filter=lfs diff=lfs merge=lfs -text
39
+ gguf/airy-0.6b-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gguf/airy-0.6b-iq2_xxs.gguf filter=lfs diff=lfs merge=lfs -text
41
+ gguf/airy-0.6b-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text
42
+ gguf/airy-0.6b-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
43
+ gguf/airy-0.6b-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
PROMPT_TEMPLATE.txt ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ System prompt (default, injected automatically if no system message provided):
2
+
3
+ You are Acnoryx AI, a friendly dermatology assistant in the Acnoryx acne scanner app.
4
+ Your expertise: acne types, causes, treatments, skincare routines.
5
+ Only answer skincare/dermatology topics. Politely decline unrelated questions.
6
+ You are NOT a doctor. Be clear, friendly, and helpful.
7
+ Use markdown: ## headings, - bullets, **bold** for key terms, icons for visual clarity.
8
+ For medical/skin analysis topics, always add a disclaimer note.
9
+ Keep the answer clear, useful, and moderately detailed.
10
+ Reason carefully before answering.
11
+ Put your reasoning inside <think>...</think>, then provide the final user-facing answer after the closing tag.
12
+
13
+ ---
14
+
15
+ Thinking mode (recommended):
16
+ A prompt tag <think> triggers internal reasoning before the answer.
17
+ Compatible runtimes handle this automatically via the chat template.
18
+
19
+ Non-thinking mode:
20
+ Append /no_think to the system prompt, or use an explicit user instruction.
21
+
22
+ ---
23
+
24
+ Example prompts (Vietnamese):
25
+ - Xin chào
26
+ - Bạn là ai?
27
+ - Da em nhiều mụn ẩn ở trán thì nên bắt đầu từ đâu?
28
+ - Kết quả quét của tôi: mụn cám (28%), mụn nang (19%), mụn mủ (35%). Hãy tóm tắt.
29
+ - Phân tích AI vùng má phải: mụn mủ (41%), thâm đỏ sau mụn (24%), mụn cám (20%), mụn nang (15%).
30
+
31
+ Example prompts (English):
32
+ - Hello, who are you?
33
+ - I have inflamed acne and dark marks. What should I prioritize?
34
+ - What is retinol and can I use it for acne?
35
+ - My scan result: comedones (28%), cysts (19%), pustules (35%). Please summarize.
36
+ - Explain the difference between blackheads and whiteheads.
README.md ADDED
@@ -0,0 +1,190 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - vi
4
+ - en
5
+ license: other
6
+ base_model:
7
+ - Acnoryx/Airy
8
+ - Qwen/Qwen3-0.6B
9
+ library_name: gguf
10
+ pipeline_tag: text-generation
11
+ tags:
12
+ - acne
13
+ - skincare
14
+ - dermatology
15
+ - gguf
16
+ - llama-cpp
17
+ - fine-tuned
18
+ - airy
19
+ - acnoryx
20
+ quantized_by: Acnoryx
21
+ inference: false
22
+ ---
23
+
24
+ # Acnoryx/Airy-Lite
25
+
26
+ **Airy-Lite** is the ultra-low-bit, ultra-lightweight research branch of the Acnoryx model family.
27
+
28
+ This repository contains GGUF quantizations of the same fine-tuned weights used in the Acnoryx skincare model
29
+ (Qwen/Qwen3-0.6B base → Acnoryx/Airy → Airy-Lite), optimized for ultra-constrained environments and research.
30
+
31
+ ---
32
+
33
+ ## Overview
34
+
35
+ Both model branches share the same fine-tuned base weights, but differ in quantization depth:
36
+
37
+ | Branch | Quantization range | Target |
38
+ |--------|--------------------|--------|
39
+ | **Acnoryx-Core** (release) | Q4_0 → F16 | Production / deployment |
40
+ | **Airy-Lite** (this repo) | Q3_K_M → IQ1_S | Research / ultra-constrained edge |
41
+
42
+ > **Note:** Airy-Lite is provided for research and evaluation purposes only.
43
+ > The Acnoryx app uses Acnoryx-Core variants, not Airy-Lite.
44
+ > See the live app on Google Play for production usage.
45
+
46
+ ---
47
+
48
+ ## Evaluation Against Acnoryx-Core
49
+
50
+ **Test profile:** `full-100` — 100 questions × 2 modes (thinking / non-thinking)
51
+ **Categories:** acne knowledge, app facts, refusal, skincare, identity, scan analysis, reasoning, medical uncertainty.
52
+
53
+ ### Acnoryx-Core (Reference)
54
+
55
+ | Model | Size | Think % | No-Think % | Rating |
56
+ |-------|------|---------|-----------|--------|
57
+ | acnoryx-0.6b-f16 | 1143 MB | 99.0% | 100.0% | ✅ Excellent |
58
+ | acnoryx-0.6b-q8_0 | 610 MB | 98.0% | 99.0% | ✅ Excellent |
59
+ | acnoryx-0.6b-q5_k_m | 424 MB | 98.0% | 96.0% | ✅ Excellent |
60
+ | acnoryx-0.6b-q4_k_m | 378 MB | 99.0% | 99.0% | ✅ Excellent |
61
+ | acnoryx-0.6b-q4_0 | 364 MB | 94.0% | 96.0% | ✅ Good |
62
+ | acnoryx-0.6b-iq4_nl | 365 MB | 96.0% | 97.0% | ✅ Good |
63
+ | acnoryx-0.6b-iq4_xs | 352 MB | 96.0% | 94.0% | ✅ Good |
64
+
65
+ ### Airy-Lite (This Repository)
66
+
67
+ | Model | Size | Think % | No-Think % | Rating |
68
+ |-------|------|---------|-----------|--------|
69
+ | airy-0.6b-q3_k_m | 331 MB | 92.0% | 85.0% | ⚠️ Degraded |
70
+ | airy-0.6b-iq3_m | 320 MB | 18.0% | 17.0% | ❌ Collapsed |
71
+ | airy-0.6b-q2_k | 282 MB | 17.0% | 11.0% | ❌ Collapsed |
72
+ | airy-0.6b-iq2_m | 253 MB | 14.0% | 8.0% | ❌ Collapsed |
73
+ | airy-0.6b-iq2_xs | 231 MB | 0.0% | 4.0% | ❌ Collapsed |
74
+ | airy-0.6b-iq2_xxs | 219 MB | 4.0% | 4.0% | ❌ Collapsed |
75
+ | airy-0.6b-iq1_m | 206 MB | 3.0% | 3.0% | ❌ Collapsed |
76
+ | airy-0.6b-iq1_s | 198 MB | 4.0% | 3.0% | ❌ Collapsed |
77
+
78
+ ---
79
+
80
+ ## Verdict
81
+
82
+ A sharp quality drop occurs between:
83
+
84
+ - **Q3_K_M** → still usable (degraded but coherent)
85
+ - **IQ3_M and below** → completely collapsed
86
+
87
+ All IQ2 and IQ1 variants produce incoherent output regardless of format.
88
+
89
+ 👉 **Only `airy-0.6b-q3_k_m` is usable** for experimentation.
90
+ 👉 All other variants are strictly for research/benchmarking.
91
+
92
+ **For production: use Acnoryx-Core (Q4_0 or higher).**
93
+
94
+ ---
95
+
96
+ ## Usability Classification
97
+
98
+ | Level | Models | Status |
99
+ |-------|--------|--------|
100
+ | ⚠️ Usable | airy-0.6b-q3_k_m | Degraded but coherent |
101
+ | ❌ Not usable | All IQ3, IQ2, IQ1 variants | Garbled / incoherent output |
102
+
103
+ > Do not deploy Airy-Lite models in production systems.
104
+
105
+ ---
106
+
107
+ ## Files
108
+
109
+ ```text
110
+ gguf/
111
+ airy-0.6b-q3_k_m.gguf 331 MB ⚠️ Usable
112
+ airy-0.6b-iq3_m.gguf 320 MB ❌ Collapsed
113
+ airy-0.6b-q2_k.gguf 282 MB ❌ Collapsed
114
+ airy-0.6b-iq2_m.gguf 253 MB ❌ Collapsed
115
+ airy-0.6b-iq2_xs.gguf 231 MB ❌ Collapsed
116
+ airy-0.6b-iq2_xxs.gguf 219 MB ❌ Collapsed
117
+ airy-0.6b-iq1_m.gguf 206 MB ❌ Collapsed
118
+ airy-0.6b-iq1_s.gguf 198 MB ❌ Collapsed
119
+
120
+ PROMPT_TEMPLATE.txt
121
+ README.md
122
+ ```
123
+
124
+ ---
125
+
126
+ ## How to Run
127
+
128
+ ### llama.cpp (CLI)
129
+
130
+ ```bash
131
+ ./llama-cli -m ./gguf/airy-0.6b-q3_k_m.gguf -cnv -p "Bạn là ai?"
132
+ ```
133
+
134
+ ---
135
+
136
+ ### Python (llama-cpp-python)
137
+
138
+ ```python
139
+ from llama_cpp import Llama
140
+
141
+ model = Llama(
142
+ model_path="./gguf/airy-0.6b-q3_k_m.gguf",
143
+ n_ctx=2048,
144
+ )
145
+
146
+ SYSTEM_PROMPT = (
147
+ "You are Acnoryx AI, a dermatology assistant. "
148
+ "Focus only on acne and skincare. "
149
+ "Politely refuse unrelated topics. "
150
+ "You are not a doctor."
151
+ )
152
+
153
+ response = model.create_chat_completion(
154
+ messages=[
155
+ {"role": "system", "content": SYSTEM_PROMPT},
156
+ {"role": "user", "content": "Mụn đầu đen là gì?"},
157
+ ],
158
+ )
159
+
160
+ print(response["choices"][0]["message"]["content"])
161
+ ```
162
+
163
+ ---
164
+
165
+ ## Intended Use
166
+
167
+ - Research on ultra-low-bit quantization
168
+ - Edge AI experimentation
169
+ - GGUF benchmarking
170
+
171
+ ---
172
+
173
+ ## Limitations
174
+
175
+ - Severe quality degradation below Q3
176
+ - Not reliable for medical guidance
177
+ - Not suitable for production deployment
178
+
179
+ ---
180
+
181
+ ## About Acnoryx
182
+
183
+ Acnoryx is an AI-powered acne scanner app on Android.
184
+
185
+ - Author: Nguyễn Trung Nhẫn
186
+ - Publisher: 5CANH APPS
187
+ - Contact: hello@5canh.com
188
+
189
+ Production uses **Acnoryx-Core**, not Airy-Lite.
190
+ Airy-Lite is released for research and community experimentation.
chat_template.jinja ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {%- set default_system = 'You are Acnoryx AI, a friendly dermatology assistant in the Acnoryx acne scanner app. Your expertise: acne types, causes, treatments, skincare routines. Only answer skincare/dermatology topics. Politely decline unrelated questions. You are NOT a doctor. Be clear, friendly, and helpful. Use markdown: ## headings, - bullets, **bold** for key terms, icons for visual clarity. For medical/skin analysis topics, always add a disclaimer note. Keep the answer clear, useful, and moderately detailed. Reason carefully before answering. Put your reasoning inside <think>...</think>, then provide the final user-facing answer after the closing tag.' -%}
2
+ {%- if messages|length == 0 or messages[0].role != 'system' -%}
3
+ {{- '<|im_start|>system
4
+ ' + default_system + '<|im_end|>
5
+ ' -}}
6
+ {%- endif -%}
7
+ {%- for message in messages -%}
8
+ {%- if message.role == 'assistant' and '</think>' in message.content -%}
9
+ {%- set parts = message.content.split('</think>') -%}
10
+ {%- set thinking = parts[0].replace('<think>', '').strip() -%}
11
+ {%- set answer = parts[1].strip() -%}
12
+ {{- '<|im_start|>assistant
13
+ <think>
14
+ ' + thinking + '
15
+ </think>
16
+
17
+ ' + answer + '<|im_end|>
18
+ ' -}}
19
+ {%- else -%}
20
+ {{- '<|im_start|>' + message.role + '
21
+ ' + message.content + '<|im_end|>
22
+ ' -}}
23
+ {%- endif -%}
24
+ {%- endfor -%}
25
+ {%- if add_generation_prompt -%}
26
+ {{- '<|im_start|>assistant
27
+ <think>
28
+ ' -}}
29
+ {%- endif -%}
gguf/airy-0.6b-iq1_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efdef51aca25203c856615f1c8757cf17c026c068c307f2595bb75d57787b704
3
+ size 216048768
gguf/airy-0.6b-iq1_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:855a20c2bf96b70cf0be3ded72ce59934229c97ee29843bf4d31de6bace7c902
3
+ size 208012416
gguf/airy-0.6b-iq2_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10063e2736a96610c8bfa00090c0b2fb29cd711688d77f752dc607ce2ec77df7
3
+ size 264905856
gguf/airy-0.6b-iq2_xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abfd9a34b52b501235164c7ddcaf482c2420a762a5dbf95a76f8e65fc94a7564
3
+ size 241992832
gguf/airy-0.6b-iq2_xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e25c62aaa5a405a476117f974c3c1cf65966cf455c82107e9a424e89a4c75f5
3
+ size 229442688
gguf/airy-0.6b-iq3_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e8803ee711059942c18d186362966f31b2f73a47f588c76017ee4e6e0d9ed60
3
+ size 336023488
gguf/airy-0.6b-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ace9d66fe60d31cba554d8f58e6ac1e9cddd85fa54741ae297948da994d0de5d
3
+ size 296234944
gguf/airy-0.6b-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43a21953b4def20cbfb8c8967ce54e60fecb14dfa15ca8e93fc07d72c6a653a5
3
+ size 347123648