VertexAIco commited on
Commit
cf5d60a
·
verified ·
1 Parent(s): 8d4e466

Add model card

Browse files
Files changed (1) hide show
  1. README.md +91 -4
README.md CHANGED
@@ -1,9 +1,96 @@
1
  ---
2
- library_name: mlx
3
  license: apache-2.0
4
- license_link: https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507/blob/main/LICENSE
5
- pipeline_tag: text-generation
 
6
  tags:
7
  - mlx
8
- base_model: mlx-community/Qwen3-4B-Instruct-2507-4bit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model: mlx-community/Qwen3-4B-Instruct-2507-4bit
6
  tags:
7
  - mlx
8
+ - gguf
9
+ - creative-writing
10
+ - storytelling
11
+ - lora
12
+ - distillation
13
+ - conversational
14
+ - text-generation
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ <div align="center">
19
+ <img src="logo.png" alt="Prism Creative logo" width="220"/>
20
+
21
+ # Prism Creative 1 Mini
22
+
23
+ **A frontier creative-writing model, distilled from GLM 5.2 into Qwen3-4B**
24
+ </div>
25
+
26
  ---
27
+
28
+ ## Overview
29
+
30
+ Prism Creative 1 Mini is a compact creative-writing and storytelling model, fine-tuned via LoRA on **Qwen3-4B-Instruct** using a distilled dataset generated by **GLM 5.2**. It's built to write across genres, forms, and tones — short stories, character sketches, poetry, dialogue scenes, worldbuilding passages, flash fiction, and more — while staying immersive and avoiding the flat, generic "AI assistant" register.
31
+
32
+ Part of the **Prism** family of creative and roleplay models.
33
+
34
+ ## Training
35
+
36
+ - **Base model:** `mlx-community/Qwen3-4B-Instruct-2507-4bit`
37
+ - **Teacher model:** GLM 5.2 (via NVIDIA NIM)
38
+ - **Dataset:** 2,500 examples across 10 categories — short stories, character sketches, opening lines, dialogue scenes, worldbuilding, poetry, genre blends, POV exercises, flash fiction, and continuations
39
+ - **Method:** LoRA fine-tuning (rank 8, 16 layers), 6,500 iterations
40
+ - **Best validation loss:** 1.064
41
+
42
+ ### Data quality
43
+
44
+ The training data went through two hardening passes after an initial run surfaced two failure modes: a tendency to loop/repeat on very short fixed-length forms (like 100-word drabbles), and an over-reliance on a handful of "safe" cliché details (e.g. a clock reading a specific time) across otherwise-unrelated prompts. Both the generation prompt and an automated filter (rejecting outputs with excessive 4-gram repetition or flagged cliché phrases) were tightened before the final dataset was generated, and the existing data was re-filtered to match.
45
+
46
+ ## Evaluation
47
+
48
+ A held-out sanity check across flash fiction, worldbuilding, poetry, and dialogue produced coherent, well-formed, in-genre output with no leaked planning text and no repetition loops. Example (flash fiction, mystery noir, 100-word constraint):
49
+
50
+ > *Rain slicked the city like oil. I found her in the alley behind the pawn shop, fingers curled around a rusted key. "You knew," she whispered, eyes hollow...*
51
+
52
+ ## Formats available
53
+
54
+ This repo includes both:
55
+
56
+ | Format | File | Notes |
57
+ |---|---|---|
58
+ | **MLX** (4-bit) | `model.safetensors` + config | For Apple Silicon via `mlx-lm` |
59
+ | **GGUF** (Q4_K_M) | `prism_creative_1_mini_Q4_K_M.gguf` | For `llama.cpp` and compatible runtimes (LM Studio, Ollama, etc.) |
60
+
61
+ ### Usage — MLX
62
+
63
+ ```python
64
+ from mlx_lm import load, generate
65
+
66
+ model, tokenizer = load("VertexAIco/prism-creative-1-mini")
67
+
68
+ prompt = "Write a short story opening about a lighthouse keeper who receives a letter from someone who shouldn't exist."
69
+ messages = [{"role": "user", "content": prompt}]
70
+ text = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
71
+
72
+ response = generate(model, tokenizer, prompt=text, max_tokens=400)
73
+ print(response)
74
+ ```
75
+
76
+ ### Usage — GGUF (llama.cpp)
77
+
78
+ ```bash
79
+ llama-cli -hf VertexAIco/prism-creative-1-mini -m prism_creative_1_mini_Q4_K_M.gguf -p "Write a short story opening about a lighthouse keeper who receives a letter from someone who shouldn't exist."
80
+ ```
81
+
82
+ ## System prompt
83
+
84
+ For best results, use the system prompt the model was trained with:
85
+
86
+ ```
87
+ You are a skilled creative writer capable of working across genres, forms, and tones. Follow the given writing prompt precisely -- respect any length, format, and style constraints exactly. Write only the requested creative piece: no preamble, no meta-commentary about your approach, no "Here's a story about..." framing. Begin directly with the piece itself.
88
+ ```
89
+
90
+ ## Limitations
91
+
92
+ This is a 4B-parameter model fine-tuned via LoRA on a moderately sized (2,500-example) dataset — it's capable but not infallible. It can still occasionally repeat itself on very constrained short forms, and like any distilled model it inherits some of its teacher's stylistic tendencies. Treat outputs as a strong first draft, not a final one.
93
+
94
+ ## License
95
+
96
+ Apache 2.0, inherited from the Qwen3 base model.