guell00 commited on
Commit
9f36bb6
·
verified ·
1 Parent(s): 911ef88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +528 -294
README.md CHANGED
@@ -14,314 +14,354 @@ pipeline_tag: text-generation
14
  tags:
15
  - code
16
  - coding
 
 
 
17
  - gguf
18
  - unsloth
19
  - lora
 
20
  - html
 
21
  - javascript
22
  - threejs
 
23
  - python
24
  - multilingual
25
  ---
26
 
27
- # OBSIDIAN-9B-Coder
28
 
29
- **OBSIDIAN-9B-Coder** is a 9B coding model fine-tuned on the **Coder Max Multilingual** dataset.
30
 
31
- The model is specialized in generating **complete software implementations**, with a strong focus on modern frontend development, interactive browser applications, Three.js, HTML5 Canvas, JavaScript, HTML/CSS and general programming.
32
 
33
- > **Complete code. Long context. Interactive software.**
34
 
35
- ---
 
 
36
 
37
- ## Highlights
38
 
39
- * **9B parameter-class coding model**
40
- * **32K training context**
41
- * **Multilingual coding support**
42
- * **Three.js specialization**
43
- * **Complete HTML/CSS/JavaScript applications**
44
- * **Canvas and browser graphics**
45
- * **Python and algorithmic code**
46
- * **LoRA supervised fine-tuning**
47
- * **GGUF quantizations available**
48
- * **Fine-tuned with Unsloth**
 
 
 
 
 
 
49
 
50
  ---
51
 
52
- # Overview
53
 
54
- OBSIDIAN-9B-Coder was created to specialize a Qwen-based coding model toward **implementation-heavy programming tasks**.
55
 
56
- Instead of focusing primarily on explanations surrounding code, the fine-tuning corpus heavily emphasizes the generation of the actual implementation.
57
 
58
  The model is particularly suited for:
59
 
60
- * Complete single-file web applications
61
- * HTML5 and modern CSS
62
- * JavaScript ES6+
63
- * Three.js
64
- * HTML5 Canvas
65
- * Interactive browser applications
66
- * Games and graphical experiments
67
- * DOM manipulation
68
- * Animation loops
69
- * State management
70
- * Python
71
- * Algorithmic programming
72
- * Multilingual programming instructions
 
 
 
73
 
74
  ---
75
 
76
- # Core Philosophy
77
 
78
  ```text
79
  USER REQUEST
80
-
81
- OBSIDIAN-9B-Coder
82
-
 
 
 
 
83
  COMPLETE IMPLEMENTATION
84
-
85
- HTML / CSS / JavaScript / Three.js / Python
 
 
 
 
 
86
  ```
87
 
88
- The goal is simple:
89
 
90
- > **Less explanation. More implementation. Complete outputs.**
 
 
 
 
 
 
 
 
91
 
92
- OBSIDIAN is fine-tuned to preserve long application structure, including:
93
 
94
- * document layout;
95
- * event handlers;
96
- * state;
97
- * rendering loops;
98
- * interaction logic;
99
- * animation;
100
- * closing tags;
101
- * frontend lifecycle.
 
 
102
 
103
  ---
104
 
105
- # GGUF
106
 
107
- This model was fine-tuned and converted to **GGUF** format using **Unsloth**.
108
-
109
- The repository contains multiple quantizations so users can select the appropriate balance between model size, memory usage and output quality.
110
 
111
- ## Available Model Files
112
 
113
- | File | Quantization | Notes |
114
- | ------------------------------------- | ------------ | --------------------------------- |
115
- | `Qwopus3.5-9B-Coder.Q8_0.gguf` | Q8_0 | Highest-quality quantized version |
116
- | `Qwopus3.5-9B-Coder.Q6_K.gguf` | Q6_K | High quality with reduced size |
117
- | `Qwopus3.5-9B-Coder.Q5_K_M.gguf` | Q5_K_M | Strong quality/size balance |
118
- | `Qwopus3.5-9B-Coder.Q4_K_M.gguf` | Q4_K_M | Recommended balance for local use |
119
- | `Qwopus3.5-9B-Coder.Q3_K_M.gguf` | Q3_K_M | Lower memory requirement |
120
- | `Qwopus3.5-9B-Coder.BF16-mmproj.gguf` | BF16 mmproj | Multimodal projector artifact |
 
 
 
 
 
 
 
121
 
122
- ---
123
 
124
- # llama.cpp
125
 
126
- For compatible text-generation configurations:
127
 
128
- ```bash
129
- llama-cli -hf guell00/OBSIDIAN-9B-Coder --jinja
 
 
 
 
 
 
 
 
 
 
 
 
130
  ```
131
 
132
- For compatible multimodal configurations:
133
 
134
- ```bash
135
- llama-mtmd-cli -hf guell00/OBSIDIAN-9B-Coder --jinja
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
136
  ```
137
 
138
- Depending on your environment and the files selected automatically by `llama.cpp`, you may want to explicitly choose a GGUF quantization.
139
 
140
- ---
 
 
 
 
141
 
142
- # Quantization Guide
 
 
 
143
 
144
- ## Q8_0
145
 
146
- Best option when memory usage is less important and you want to preserve as much quality as practical in GGUF form.
 
 
147
 
148
- ## Q6_K
 
149
 
150
- High-quality quantization with lower memory requirements than Q8.
151
 
152
- ## Q5_K_M
153
 
154
- A strong balance between quality and size.
155
 
156
- Good choice for machines with moderate RAM/VRAM.
 
157
 
158
- ## Q4_K_M
 
 
159
 
160
- Recommended general-purpose quantization.
161
 
162
- It usually offers a useful balance between:
163
 
164
- * memory usage;
165
- * inference speed;
166
- * output quality.
167
 
168
- ## Q3_K_M
 
 
 
 
 
 
 
 
 
 
 
 
 
169
 
170
- Smaller memory footprint.
171
 
172
- Useful when hardware is constrained, at the cost of some model fidelity.
173
 
174
  ---
175
 
176
- # Training Dataset
177
-
178
- OBSIDIAN-9B-Coder was fine-tuned using:
179
 
180
- **Coder Max Multilingual**
181
 
182
- Repository:
183
 
184
  `guell00/Coder-max`
185
 
186
  Coder Max is a conversational supervised fine-tuning dataset focused heavily on code generation.
187
 
188
- The corpus was designed to contain **complete implementations instead of heavily truncated programming answers**.
189
 
190
  ## Dataset Characteristics
191
 
192
- | Characteristic | Description |
193
- | ----------------------- | ----------------------- |
194
- | Format | JSONL |
195
- | Structure | Conversational messages |
196
- | Training type | Supervised Fine-Tuning |
197
- | Languages | 10 |
198
- | Main content | Programming |
199
- | Code density | ~95%+ |
200
- | Frontend focus | Strong |
201
- | Three.js specialization | Strong |
202
- | Long code outputs | Preserved |
203
 
204
  ---
205
 
206
- # Dataset Scale
207
 
208
- Coder Max is distributed in incremental variants.
209
 
210
- | Variant | Physical Size | Records | Messages | Code Density |
211
- | ----------- | --------------: | ------: | -------: | -----------: |
212
- | `001MB` | 3,739,874 B | 109 | 220 | 99.08% |
213
- | `010MB` | 12,709,008 B | 969 | 2,012 | 96.18% |
214
- | `100MB` | 102,679,666 B | 9,790 | 20,396 | 95.84% |
215
- | `300MB` | 302,689,973 B | 29,233 | 60,916 | 95.83% |
216
- | `500MB` | 502,678,782 B | 48,676 | 101,442 | 95.82% |
217
- | `600MB` | 602,666,385 B | 58,466 | 121,848 | 95.82% |
218
- | `001GB` | 1,002,677,454 B | 97,499 | 203,200 | 95.82% |
219
- | `total_4GB` | 4,002,669,404 B | 390,302 | 813,452 | 95.81% |
220
 
221
  The larger variants contain the content represented by the smaller variants, allowing different training scales without requiring manual concatenation.
222
 
223
  ---
224
 
225
- # Specialization
226
 
227
- ## Three.js
228
 
229
- Three.js is one of the primary specialization targets of OBSIDIAN.
230
 
231
- Training examples include patterns involving:
232
 
233
- * scene creation;
234
- * perspective cameras;
235
- * lighting;
236
- * meshes;
237
- * materials;
238
- * geometry;
239
- * animation loops;
240
- * browser interaction;
241
- * keyboard input;
242
- * game mechanics;
243
- * 3D environments;
244
- * interactive simulations;
245
- * single-file applications.
246
 
247
- The goal is to teach the model to connect all required pieces of a Three.js application rather than merely output isolated API examples.
248
 
249
- ---
250
 
251
- ## Frontend Generation
252
 
253
- The model has strong exposure to complete frontend applications combining:
254
 
255
- ```text
256
- HTML
257
-
258
- ├── CSS
259
-
260
- └── JavaScript
261
-
262
- ├── DOM
263
- ├── State
264
- ├── Events
265
- ├── Canvas
266
- ├── Three.js
267
- └── Animation
268
- ```
269
 
270
- A typical training target may contain an entire application:
271
 
272
- ```html
273
- <!DOCTYPE html>
274
- <html>
275
- <head>
276
- <style>
277
- /* Complete interface */
278
- </style>
279
- </head>
280
 
281
- <body>
282
- <main>
283
- <!-- Complete application -->
284
- </main>
285
 
286
- <script>
287
- // State
288
- // Logic
289
- // Rendering
290
- // Interaction
291
- // Animation loop
292
- </script>
293
- </body>
294
- </html>
295
- ```
296
 
297
- ---
298
-
299
- # Multilingual Programming
 
300
 
301
- The training corpus contains programming instructions across 10 languages.
302
 
303
- | Language | Code |
304
- | --------- | ---- |
305
- | Português | `pt` |
306
- | English | `en` |
307
- | Español | `es` |
308
- | Français | `fr` |
309
- | Deutsch | `de` |
310
- | Italiano | `it` |
311
- | 日本語 | `ja` |
312
- | 简体中文 | `zh` |
313
- | Русский | `ru` |
314
- | Türkçe | `tr` |
315
-
316
- The objective is to make programming capability less dependent on the language used in the instruction.
317
 
318
  ---
319
 
320
- # Fine-Tuning
321
 
322
  OBSIDIAN-9B-Coder was produced using supervised fine-tuning with **LoRA**.
323
 
324
- The training setup used for the model included:
325
 
326
  ```text
327
  Training method LoRA
@@ -333,8 +373,6 @@ Context target 32,768
333
  Trainer Unsloth
334
  Optimizer AdamW BNB 8-bit
335
  Scheduler Cosine
336
- Batch size 1
337
- Gradient accumulation 1
338
  Response-only training Enabled
339
  ```
340
 
@@ -352,34 +390,111 @@ down_proj
352
 
353
  ---
354
 
355
- # Training Strategy
356
 
357
- The model was trained with a code-heavy SFT corpus designed around long-form completions.
358
 
359
  Important characteristics include:
360
 
361
- * long HTML responses;
362
- * complete application generation;
363
- * repeated high-value specialization examples;
364
- * multilingual prompt variants;
365
- * frontend-oriented training;
366
- * Three.js and Canvas exposure;
367
- * assistant-response-only loss.
 
 
368
 
369
- Intentional repetitions may exist in the source dataset as part of the specialization strategy.
370
 
371
- These repetitions are used to reinforce selected programming behaviors rather than representing accidental duplicate ingestion.
372
 
373
  ---
374
 
375
- # Example Prompts
376
 
377
- ## Three.js
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
378
 
379
  ```text
380
  Create a complete Three.js game inside a single HTML file.
381
 
382
  Include:
 
383
  - responsive rendering;
384
  - perspective camera;
385
  - dynamic lighting;
@@ -392,6 +507,27 @@ Include:
392
  Return the complete HTML file.
393
  ```
394
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
395
  ## Portuguese
396
 
397
  ```text
@@ -403,6 +539,8 @@ estado interno e interação com o usuário.
403
  Retorne o arquivo HTML completo.
404
  ```
405
 
 
 
406
  ## Canvas
407
 
408
  ```text
@@ -413,6 +551,8 @@ Include mouse interaction, animation, responsive resizing
413
  and performance-conscious rendering.
414
  ```
415
 
 
 
416
  ## Python
417
 
418
  ```text
@@ -423,171 +563,265 @@ Explain the algorithm briefly and return working code.
423
 
424
  ---
425
 
426
- # Recommended Generation
427
 
428
  Coding tasks generally benefit from conservative sampling.
429
 
430
- A reasonable starting point is:
431
 
432
  ```text
433
  temperature: 0.2
434
  top_p: 0.9
435
  ```
436
 
437
- For creative frontend generation:
438
 
439
  ```text
440
  temperature: 0.5 - 0.7
441
  top_p: 0.9 - 0.95
442
  ```
443
 
444
- These values are starting points rather than guarantees.
445
 
446
- Generation settings should be benchmarked for the target workload.
447
 
448
  ---
449
 
450
- # Intended Use
451
 
452
  OBSIDIAN-9B-Coder is intended for:
453
 
454
- * coding assistants;
455
- * frontend code generation;
456
- * HTML/CSS/JavaScript generation;
457
- * Three.js generation;
458
- * Canvas applications;
459
- * Python programming;
460
- * programming experiments;
461
- * multilingual coding assistants;
462
- * local coding models;
463
- * research into code-specialized fine-tuning.
 
 
464
 
465
  ---
466
 
467
- # Evaluation Recommendations
468
-
469
- For coding models such as OBSIDIAN, executable evaluation is strongly recommended.
470
-
471
- Useful evaluation categories include:
472
 
473
- * HTML completeness;
474
- * CSS validity;
475
- * JavaScript syntax;
476
- * Three.js initialization;
477
- * rendering-loop correctness;
478
- * DOM interaction;
479
- * Canvas rendering;
480
- * Python syntax;
481
- * algorithmic correctness;
482
- * long-response completion;
483
- * multilingual instruction following.
484
 
485
  A useful evaluation pipeline is:
486
 
487
  ```text
 
 
 
488
  GENERATE
489
-
 
490
  PARSE
491
-
 
492
  EXECUTE
493
-
 
494
  INSPECT
495
-
 
496
  TEST
497
  ```
498
 
499
- Execution matters more than text similarity when evaluating generated software.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
500
 
501
  ---
502
 
503
- # Limitations
504
 
505
  OBSIDIAN-9B-Coder is a generative model.
506
 
507
  Generated code can contain:
508
 
509
- * logical errors;
510
- * security vulnerabilities;
511
- * hallucinated APIs;
512
- * outdated library usage;
513
- * incomplete edge-case handling;
514
- * incorrect assumptions;
515
- * dependency incompatibilities.
516
 
517
  Generated applications should be inspected and tested before production deployment.
518
 
519
- The model's context capacity also does not guarantee perfect reasoning or perfect retention across every token in a long context.
520
 
521
  ---
522
 
523
- # Dataset Integrity
 
 
524
 
525
- Coder Max includes metadata intended to support corpus integrity and provenance tracking.
526
 
527
- Dataset preparation includes:
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
528
 
529
- * syntax-oriented filtering;
530
- * preservation of complete code;
531
- * credential and runtime artifact sanitization;
532
- * SHA-256 provenance metadata;
533
- * multilingual prompt labeling;
534
- * frontend classification metadata.
535
 
536
  ---
537
 
538
- # Base Model
 
 
539
 
540
- OBSIDIAN-9B-Coder is a **fine-tuned derivative model**.
541
 
542
- The underlying pretrained capabilities and architecture originate from the declared base model.
543
 
544
- OBSIDIAN should therefore not be interpreted as a foundation model trained from scratch.
545
 
546
- Users redistributing or deploying the model should review the licensing and usage requirements of the underlying model and training data.
 
 
547
 
548
  ---
549
 
550
- # Model Identity
551
 
552
- **Model:** OBSIDIAN-9B-Coder
553
 
554
- **Dataset:** Coder Max Multilingual
555
 
556
  **Author:** guell00
557
 
558
- **Training framework:** Unsloth
559
 
560
- **Format:** GGUF
561
 
562
- **Specialization:**
563
 
564
- `Three.js` `JavaScript` • `HTML` • `CSS` • `Canvas` • `Python` • `Multilingual`
 
 
 
 
 
 
 
565
 
566
  ---
567
 
568
- # Summary
569
 
570
- OBSIDIAN-9B-Coder is a 9B coding model specialized through supervised fine-tuning on a highly code-dense multilingual dataset.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
571
 
572
- Its main focus is:
573
 
574
- > **Generating complete software instead of fragmented examples.**
575
 
576
- Primary strengths include:
577
 
578
- * frontend code generation;
579
- * Three.js;
580
- * JavaScript;
581
- * complete HTML applications;
582
- * Canvas;
583
- * Python;
584
- * multilingual programming instructions;
585
- * long code outputs.
 
586
 
587
  ---
588
 
589
- ## OBSIDIAN-9B-Coder
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
590
 
591
- **Complete Code Long Context Interactive Software**
592
 
593
- `Three.js` `JavaScript` `HTML` `CSS` • `Canvas` • `Python` • `Multilingual`
 
14
  tags:
15
  - code
16
  - coding
17
+ - coder
18
+ - qwen
19
+ - qwen3.5
20
  - gguf
21
  - unsloth
22
  - lora
23
+ - sft
24
  - html
25
+ - css
26
  - javascript
27
  - threejs
28
+ - canvas
29
  - python
30
  - multilingual
31
  ---
32
 
33
+ # 💎 OBSIDIAN-9B-Coder
34
 
35
+ > **Complete Code · Long Context · Interactive Software**
36
 
37
+ **OBSIDIAN-9B-Coder** is a 9B-class coding model fine-tuned from **Jackrong/Qwopus3.5-9B-Coder** using the **Coder Max Multilingual** dataset.
38
 
39
+ The model is specialized in generating **complete software implementations**, with a strong focus on modern frontend development, interactive browser applications, Three.js, HTML5 Canvas, JavaScript, HTML/CSS, Python and general programming.
40
 
41
+ OBSIDIAN is designed around a simple objective:
42
+
43
+ > **Generate the implementation, not fragments of it.**
44
 
45
+ ---
46
 
47
+ ## Highlights
48
+
49
+ | Feature | OBSIDIAN-9B-Coder |
50
+ |---|---|
51
+ | Model Class | 9B |
52
+ | Training Context | 32K |
53
+ | Training Method | LoRA SFT |
54
+ | Training Framework | Unsloth |
55
+ | Languages | 10 |
56
+ | Primary Focus | Code Generation |
57
+ | Frontend | Strong specialization |
58
+ | Three.js | Strong specialization |
59
+ | Canvas | Strong specialization |
60
+ | JavaScript | Strong specialization |
61
+ | Python | Supported |
62
+ | Distribution | GGUF |
63
 
64
  ---
65
 
66
+ # 🧠 Overview
67
 
68
+ OBSIDIAN-9B-Coder was created to further specialize an already capable coding model toward **implementation-heavy programming tasks**.
69
 
70
+ Instead of focusing primarily on explanations surrounding code, the fine-tuning corpus heavily emphasizes generation of the actual implementation.
71
 
72
  The model is particularly suited for:
73
 
74
+ - Complete single-file web applications
75
+ - HTML5
76
+ - Modern CSS
77
+ - JavaScript ES6+
78
+ - Three.js
79
+ - HTML5 Canvas
80
+ - Interactive browser applications
81
+ - Browser games
82
+ - Graphical experiments
83
+ - DOM manipulation
84
+ - Animation loops
85
+ - State management
86
+ - Python
87
+ - Algorithms
88
+ - Multilingual programming instructions
89
+ - Long-form code generation
90
 
91
  ---
92
 
93
+ # 🔥 Core Philosophy
94
 
95
  ```text
96
  USER REQUEST
97
+
98
+
99
+ ┌──────────────────────┐
100
+ │ OBSIDIAN-9B-Coder │
101
+ └──────────────────────┘
102
+
103
+
104
  COMPLETE IMPLEMENTATION
105
+
106
+ ├── HTML
107
+ ├── CSS
108
+ ├── JavaScript
109
+ ├── Three.js
110
+ ├── Canvas
111
+ └── Python
112
  ```
113
 
114
+ The training strategy emphasizes:
115
 
116
+ ```text
117
+ Less boilerplate explanation
118
+ +
119
+ More actual implementation
120
+ +
121
+ Complete long-form outputs
122
+ =
123
+ OBSIDIAN
124
+ ```
125
 
126
+ OBSIDIAN is fine-tuned to preserve long application structures including:
127
 
128
+ - document layout;
129
+ - styles;
130
+ - application state;
131
+ - event handlers;
132
+ - rendering logic;
133
+ - animation loops;
134
+ - user interaction;
135
+ - game logic;
136
+ - DOM lifecycle;
137
+ - complete closing structures.
138
 
139
  ---
140
 
141
+ # 🎮 Three.js Specialization
142
 
143
+ Three.js is one of the primary specialization targets of OBSIDIAN.
 
 
144
 
145
+ Training examples contain patterns involving:
146
 
147
+ - Scene creation
148
+ - Perspective cameras
149
+ - Lighting
150
+ - Meshes
151
+ - Materials
152
+ - Geometry
153
+ - Animation loops
154
+ - Keyboard input
155
+ - Mouse interaction
156
+ - Game mechanics
157
+ - Collision logic
158
+ - 3D environments
159
+ - Interactive simulations
160
+ - Complete browser games
161
+ - Single-file Three.js applications
162
 
163
+ The objective is not simply to teach isolated Three.js API calls.
164
 
165
+ The model is trained to connect the different components required to produce an actual working application.
166
 
167
+ For example:
168
 
169
+ ```text
170
+ Scene
171
+
172
+ ├── Camera
173
+ ├── Renderer
174
+ ├── Lighting
175
+ ├── Objects
176
+
177
+ └── Materials
178
+
179
+ ├── Input
180
+ ├── State
181
+ ├── Game Logic
182
+ └── Animation Loop
183
  ```
184
 
185
+ ---
186
 
187
+ # 🌐 Frontend Generation
188
+
189
+ OBSIDIAN has strong exposure to complete frontend applications combining:
190
+
191
+ ```text
192
+ HTML
193
+
194
+ ├── CSS
195
+
196
+ └── JavaScript
197
+
198
+ ├── DOM
199
+ ├── State
200
+ ├── Events
201
+ ├── Canvas
202
+ ├── Three.js
203
+ ├── Rendering
204
+ └── Animation
205
  ```
206
 
207
+ A typical training target may contain an entire application:
208
 
209
+ ```html
210
+ <!DOCTYPE html>
211
+ <html>
212
+ <head>
213
+ <meta charset="UTF-8">
214
 
215
+ <style>
216
+ /* Complete interface */
217
+ </style>
218
+ </head>
219
 
220
+ <body>
221
 
222
+ <main>
223
+ <!-- Complete application -->
224
+ </main>
225
 
226
+ <script>
227
+ // Application state
228
 
229
+ // Event handling
230
 
231
+ // Rendering
232
 
233
+ // Interaction
234
 
235
+ // Animation loop
236
+ </script>
237
 
238
+ </body>
239
+ </html>
240
+ ```
241
 
242
+ The objective is to reduce common failure modes where coding models generate the beginning of an application but fail to correctly complete its architecture.
243
 
244
+ ---
245
 
246
+ # 🌍 Multilingual Programming
 
 
247
 
248
+ OBSIDIAN was fine-tuned with programming instructions across **10 languages**.
249
+
250
+ | Language | Code |
251
+ |---|---|
252
+ | Português | `pt` |
253
+ | English | `en` |
254
+ | Español | `es` |
255
+ | Français | `fr` |
256
+ | Deutsch | `de` |
257
+ | Italiano | `it` |
258
+ | 日本語 | `ja` |
259
+ | 简体中文 | `zh` |
260
+ | Русский | `ru` |
261
+ | Türkçe | `tr` |
262
 
263
+ The goal is to make coding capability less dependent on the natural language used in the instruction.
264
 
265
+ A developer can therefore ask for implementations using prompts in multiple languages while still requesting code in the same programming ecosystem.
266
 
267
  ---
268
 
269
+ # 🗃️ Training Dataset
 
 
270
 
271
+ OBSIDIAN-9B-Coder was fine-tuned using **Coder Max Multilingual**.
272
 
273
+ **Dataset:**
274
 
275
  `guell00/Coder-max`
276
 
277
  Coder Max is a conversational supervised fine-tuning dataset focused heavily on code generation.
278
 
279
+ The corpus was designed around **complete implementations rather than heavily truncated programming responses**.
280
 
281
  ## Dataset Characteristics
282
 
283
+ | Characteristic | Description |
284
+ |---|---|
285
+ | Format | JSONL |
286
+ | Structure | Conversational messages |
287
+ | Training Type | Supervised Fine-Tuning |
288
+ | Languages | 10 |
289
+ | Main Content | Programming |
290
+ | Code Density | ~95%+ |
291
+ | Frontend Focus | Strong |
292
+ | Three.js Specialization | Strong |
293
+ | Long Code Outputs | Preserved |
294
 
295
  ---
296
 
297
+ # 📊 Coder Max Scale
298
 
299
+ Coder Max is distributed in multiple incremental variants.
300
 
301
+ | Variant | Physical Size | Records | Messages | Code Density |
302
+ |---|---:|---:|---:|---:|
303
+ | `001MB` | 3,739,874 B | 109 | 220 | 99.08% |
304
+ | `010MB` | 12,709,008 B | 969 | 2,012 | 96.18% |
305
+ | `100MB` | 102,679,666 B | 9,790 | 20,396 | 95.84% |
306
+ | `300MB` | 302,689,973 B | 29,233 | 60,916 | 95.83% |
307
+ | `500MB` | 502,678,782 B | 48,676 | 101,442 | 95.82% |
308
+ | `600MB` | 602,666,385 B | 58,466 | 121,848 | 95.82% |
309
+ | `001GB` | 1,002,677,454 B | 97,499 | 203,200 | 95.82% |
310
+ | `total_4GB` | 4,002,669,404 B | 390,302 | 813,452 | 95.81% |
311
 
312
  The larger variants contain the content represented by the smaller variants, allowing different training scales without requiring manual concatenation.
313
 
314
  ---
315
 
316
+ # 🧹 Dataset Curation
317
 
318
+ Coder Max was built with a code-oriented preprocessing pipeline.
319
 
320
+ Important characteristics include:
321
 
322
+ ### Code Density
323
 
324
+ More than 95% of the larger corpus variants consist of code-oriented content.
 
 
 
 
 
 
 
 
 
 
 
 
325
 
326
+ ### Python Syntax Validation
327
 
328
+ Python blocks were structurally checked during preprocessing.
329
 
330
+ Invalid or corrupted samples could therefore be removed before training.
331
 
332
+ ### Complete Code Preservation
333
 
334
+ Long HTML, CSS and JavaScript applications are preserved rather than intentionally truncated.
 
 
 
 
 
 
 
 
 
 
 
 
 
335
 
336
+ This is especially important for teaching:
337
 
338
+ - closing tags;
339
+ - application state;
340
+ - complete functions;
341
+ - event listeners;
342
+ - rendering loops;
343
+ - lifecycle logic.
 
 
344
 
345
+ ### Data Sanitization
 
 
 
346
 
347
+ The preprocessing pipeline targets removal of artifacts such as:
 
 
 
 
 
 
 
 
 
348
 
349
+ - credentials;
350
+ - API keys;
351
+ - local IP addresses;
352
+ - runtime artifacts.
353
 
354
+ ### Provenance
355
 
356
+ Dataset records include SHA-256-based provenance metadata.
 
 
 
 
 
 
 
 
 
 
 
 
 
357
 
358
  ---
359
 
360
+ # 🧪 Fine-Tuning
361
 
362
  OBSIDIAN-9B-Coder was produced using supervised fine-tuning with **LoRA**.
363
 
364
+ Training configuration:
365
 
366
  ```text
367
  Training method LoRA
 
373
  Trainer Unsloth
374
  Optimizer AdamW BNB 8-bit
375
  Scheduler Cosine
 
 
376
  Response-only training Enabled
377
  ```
378
 
 
390
 
391
  ---
392
 
393
+ # 🧬 Training Strategy
394
 
395
+ The model was trained using a code-heavy SFT corpus designed around long-form completions.
396
 
397
  Important characteristics include:
398
 
399
+ - long HTML responses;
400
+ - complete application generation;
401
+ - high-value specialization examples;
402
+ - multilingual prompt variants;
403
+ - frontend-oriented training;
404
+ - Three.js exposure;
405
+ - Canvas exposure;
406
+ - JavaScript-heavy examples;
407
+ - assistant-response-only loss.
408
 
409
+ Some repetitions in the source dataset may be intentional.
410
 
411
+ Selected programming concepts and application patterns can be repeated to reinforce specific behaviors and specialization targets.
412
 
413
  ---
414
 
415
+ # 📦 GGUF
416
 
417
+ OBSIDIAN-9B-Coder is distributed in **GGUF** format for efficient local inference.
418
+
419
+ Available quantizations include:
420
+
421
+ | File | Quantization | Recommended Use |
422
+ |---|---|---|
423
+ | `Qwopus3.5-9B-Coder.Q8_0.gguf` | Q8_0 | Maximum practical GGUF fidelity |
424
+ | `Qwopus3.5-9B-Coder.Q6_K.gguf` | Q6_K | High quality |
425
+ | `Qwopus3.5-9B-Coder.Q5_K_M.gguf` | Q5_K_M | Quality / size balance |
426
+ | `Qwopus3.5-9B-Coder.Q4_K_M.gguf` | Q4_K_M | Recommended general use |
427
+ | `Qwopus3.5-9B-Coder.Q3_K_M.gguf` | Q3_K_M | Memory-constrained systems |
428
+ | `Qwopus3.5-9B-Coder.BF16-mmproj.gguf` | BF16 mmproj | Multimodal projector |
429
+
430
+ ---
431
+
432
+ # ⚖️ Quantization Guide
433
+
434
+ ```text
435
+ QUALITY
436
+
437
+
438
+ Q8_0 ████████████████████
439
+ Q6_K ██████████████████
440
+ Q5_K_M █████████████████
441
+ Q4_K_M ███████████████
442
+ Q3_K_M ████████████
443
+
444
+ └──────────────► LOWER MEMORY
445
+ ```
446
+
447
+ ## Q8_0
448
+
449
+ Use when preserving model fidelity is more important than memory consumption.
450
+
451
+ ## Q6_K
452
+
453
+ High-quality option with lower requirements than Q8_0.
454
+
455
+ ## Q5_K_M
456
+
457
+ Strong compromise between model fidelity and memory requirements.
458
+
459
+ ## Q4_K_M
460
+
461
+ Recommended starting point for most local deployments.
462
+
463
+ ## Q3_K_M
464
+
465
+ Designed for systems where memory consumption is the primary constraint.
466
+
467
+ For coding workloads, **Q4_K_M** and **Q5_K_M** are good starting points.
468
+
469
+ ---
470
+
471
+ # 🚀 llama.cpp
472
+
473
+ For compatible text inference:
474
+
475
+ ```bash
476
+ llama-cli -hf guell00/OBSIDIAN-9B-Coder --jinja
477
+ ```
478
+
479
+ For compatible multimodal inference:
480
+
481
+ ```bash
482
+ llama-mtmd-cli -hf guell00/OBSIDIAN-9B-Coder --jinja
483
+ ```
484
+
485
+ The exact command and available features depend on the installed `llama.cpp` version and selected GGUF files.
486
+
487
+ ---
488
+
489
+ # 💻 Example Prompts
490
+
491
+ ## Three.js Game
492
 
493
  ```text
494
  Create a complete Three.js game inside a single HTML file.
495
 
496
  Include:
497
+
498
  - responsive rendering;
499
  - perspective camera;
500
  - dynamic lighting;
 
507
  Return the complete HTML file.
508
  ```
509
 
510
+ ---
511
+
512
+ ## Frontend Application
513
+
514
+ ```text
515
+ Create a complete responsive web application using HTML,
516
+ CSS and vanilla JavaScript.
517
+
518
+ The application must include:
519
+
520
+ - modern interface;
521
+ - internal state;
522
+ - animations;
523
+ - user interaction;
524
+ - responsive design.
525
+
526
+ Return a single complete HTML file.
527
+ ```
528
+
529
+ ---
530
+
531
  ## Portuguese
532
 
533
  ```text
 
539
  Retorne o arquivo HTML completo.
540
  ```
541
 
542
+ ---
543
+
544
  ## Canvas
545
 
546
  ```text
 
551
  and performance-conscious rendering.
552
  ```
553
 
554
+ ---
555
+
556
  ## Python
557
 
558
  ```text
 
563
 
564
  ---
565
 
566
+ # 🎛️ Generation Settings
567
 
568
  Coding tasks generally benefit from conservative sampling.
569
 
570
+ A reasonable starting point:
571
 
572
  ```text
573
  temperature: 0.2
574
  top_p: 0.9
575
  ```
576
 
577
+ For more creative frontend generation:
578
 
579
  ```text
580
  temperature: 0.5 - 0.7
581
  top_p: 0.9 - 0.95
582
  ```
583
 
584
+ These values are starting points rather than guaranteed optimal settings.
585
 
586
+ Generation parameters should be benchmarked for the target workload.
587
 
588
  ---
589
 
590
+ # 🎯 Intended Use
591
 
592
  OBSIDIAN-9B-Coder is intended for:
593
 
594
+ - Coding assistants
595
+ - Frontend code generation
596
+ - HTML/CSS/JavaScript generation
597
+ - Three.js applications
598
+ - Browser games
599
+ - Canvas applications
600
+ - Interactive interfaces
601
+ - Python programming
602
+ - Programming experiments
603
+ - Multilingual coding assistants
604
+ - Local coding models
605
+ - Research into code-specialized fine-tuning
606
 
607
  ---
608
 
609
+ # 📏 Evaluation
 
 
 
 
610
 
611
+ Executable evaluation is strongly recommended for coding models.
 
 
 
 
 
 
 
 
 
 
612
 
613
  A useful evaluation pipeline is:
614
 
615
  ```text
616
+ PROMPT
617
+
618
+
619
  GENERATE
620
+
621
+
622
  PARSE
623
+
624
+
625
  EXECUTE
626
+
627
+
628
  INSPECT
629
+
630
+
631
  TEST
632
  ```
633
 
634
+ Useful evaluation categories include:
635
+
636
+ - HTML completeness
637
+ - CSS validity
638
+ - JavaScript syntax
639
+ - JavaScript runtime behavior
640
+ - Three.js initialization
641
+ - Rendering-loop correctness
642
+ - DOM interaction
643
+ - Canvas rendering
644
+ - Python syntax
645
+ - Algorithmic correctness
646
+ - Long-response completion
647
+ - Multilingual instruction following
648
+
649
+ For code-generation models, executable correctness is generally more informative than text similarity alone.
650
 
651
  ---
652
 
653
+ # ⚠️ Limitations
654
 
655
  OBSIDIAN-9B-Coder is a generative model.
656
 
657
  Generated code can contain:
658
 
659
+ - logical errors;
660
+ - security vulnerabilities;
661
+ - hallucinated APIs;
662
+ - outdated library usage;
663
+ - incomplete edge-case handling;
664
+ - incorrect assumptions;
665
+ - dependency incompatibilities.
666
 
667
  Generated applications should be inspected and tested before production deployment.
668
 
669
+ Long context capacity also does not guarantee perfect reasoning or perfect retention across every token of a long prompt.
670
 
671
  ---
672
 
673
+ # 🧬 Model Lineage
674
+
675
+ OBSIDIAN-9B-Coder was **not trained from scratch**.
676
 
677
+ Its lineage is:
678
 
679
+ ```text
680
+ Qwen3.5 family
681
+
682
+
683
+ Jackrong/Qwopus3.5-9B-Coder
684
+
685
+
686
+ Coder Max Multilingual
687
+
688
+
689
+ LoRA Supervised Fine-Tuning
690
+
691
+
692
+ OBSIDIAN-9B-Coder
693
+
694
+
695
+ GGUF Quantizations
696
+ ```
697
 
698
+ OBSIDIAN therefore inherits substantial pretrained and coding capabilities from its base model while adding specialization through Coder Max.
 
 
 
 
 
699
 
700
  ---
701
 
702
+ # 📚 Training Sources
703
+
704
+ ## Base Model
705
 
706
+ OBSIDIAN-9B-Coder was fine-tuned from:
707
 
708
+ **Jackrong/Qwopus3.5-9B-Coder**
709
 
710
+ Hugging Face:
711
 
712
+ https://huggingface.co/Jackrong/Qwopus3.5-9B-Coder
713
+
714
+ The Jackrong model is itself a coding-focused derivative of the Qwen3.5 model family and provides the underlying pretrained and coding capabilities used as the starting point for OBSIDIAN.
715
 
716
  ---
717
 
718
+ ## Fine-Tuning Dataset
719
 
720
+ The dataset used for the OBSIDIAN fine-tuning stage was:
721
 
722
+ **Coder Max Multilingual**
723
 
724
  **Author:** guell00
725
 
726
+ Hugging Face:
727
 
728
+ https://huggingface.co/datasets/guell00/Coder-max
729
 
730
+ Coder Max provides the additional specialization toward:
731
 
732
+ - complete code generation;
733
+ - HTML/CSS/JavaScript;
734
+ - Three.js;
735
+ - Canvas;
736
+ - Python;
737
+ - interactive applications;
738
+ - long-form implementations;
739
+ - multilingual programming instructions.
740
 
741
  ---
742
 
743
+ # 🏗️ Training Stack
744
 
745
+ ```text
746
+ Qwen3.5 Model Family
747
+
748
+
749
+ Jackrong/Qwopus3.5-9B-Coder
750
+
751
+ │ Base model
752
+
753
+ Coder Max Multilingual
754
+ guell00/Coder-max
755
+
756
+ │ Code-focused SFT data
757
+
758
+ LoRA + SFT
759
+ Unsloth
760
+
761
+
762
+ OBSIDIAN-9B-Coder
763
+
764
+
765
+ GGUF
766
+
767
+ ├── Q3_K_M
768
+ ├── Q4_K_M
769
+ ├── Q5_K_M
770
+ ├── Q6_K
771
+ └── Q8_0
772
+ ```
773
+
774
+ ---
775
+
776
+ # 🙏 Credits
777
+
778
+ OBSIDIAN-9B-Coder builds upon work from the open-source model ecosystem.
779
+
780
+ ### Qwen
781
+
782
+ For the underlying Qwen model family and architecture.
783
+
784
+ ### Jackrong
785
 
786
+ For **Qwopus3.5-9B-Coder**, used as the direct base model for this fine-tuning.
787
 
788
+ ### Unsloth
789
 
790
+ For the efficient fine-tuning and model conversion tooling used during training.
791
 
792
+ ### guell00
793
+
794
+ For:
795
+
796
+ - **Coder Max Multilingual**
797
+ - OBSIDIAN fine-tuning
798
+ - dataset preparation
799
+ - model specialization
800
+ - GGUF release
801
 
802
  ---
803
 
804
+ # 💎 OBSIDIAN-9B-Coder
805
+
806
+ ```text
807
+ Base
808
+ Jackrong/Qwopus3.5-9B-Coder
809
+
810
+ +
811
+
812
+ Dataset
813
+ guell00/Coder-max
814
+
815
+ +
816
+
817
+ Fine-Tuning
818
+ LoRA SFT / Unsloth
819
+
820
+ =
821
+
822
+ OBSIDIAN-9B-Coder
823
+ ```
824
 
825
+ **9B · 32K Training Context · Three.js · JavaScript · HTML · CSS · Canvas · Python · Multilingual**
826
 
827
+ > **OBSIDIAN-9B-Coder specialized for complete code generation.**