--- license: apache-2.0 language: - en base_model: Qwen/Qwen3.5-27B base_model_relation: finetune tags: - 27b - stem - tutor - math - physics - chemistry - biology - computer-science - claude-distillation - conversational - gguf - local - offline - lm-studio - llama-cpp library_name: gguf pipeline_tag: text-generation --- **or·a·cle** /ˈôrəkəl/ — a source of wise counsel; one who provides authoritative knowledge. *From Latin ōrāculum, meaning divine announcement.* ## STEM Oracle A conceptual explainer fine-tuned from Qwen 3.5 27B on **5,179 STEM conversations**. It covers intro-level math, physics, chemistry, biology and computer science, answering each question in a few plain sentences that lead with the core idea. By the training file's source tags, about half of the data was written by Claude Haiku and a small share by Claude Opus, a fifth was enhanced by Claude Sonnet, and over a third carries no model tag. ## Selected Responses Verbatim from the live battery described below: complete replies, single takes. Each is cited to its transcript and turn (T3/6 means turn 3 of 6). Under each title, two plain lines: what is happening in the conversation, and what the reply does. **Biology: cousins, not grandparents** · [biology](./transcripts/biology.pdf) T3/6 *What's happening: a curious adult with no biology since high school, two turns into how DNA becomes protein, asks whether humans evolved from chimps.* *What the reply does: corrects the premise in its first two words, then gives an analogy, cousins rather than grandparents, and dates the split at roughly 6 to 7 million years ago, with both lines evolving separately since.* > Shared ancestor — not direct parentage. We don't descend *from* chimps; we share a common root w/ them. Like cousins, not grandparents. The lineage split roughly 6-7 million years ago, and both lines evolved separately from there. **Physics: entropy without disorder** · [physics](./transcripts/physics.pdf) T5/6 *What's happening: a high-school junior who rejects definitions that explain nothing has worked through energy, its conservation, cold mountaintops and light pressure, and now asks for entropy without the word disorder.* *What the reply does: defines entropy as a count of the microscopic arrangements that could produce what you observe, ties more arrangements to less certainty about the actual state, and mentions the disorder metaphor only to drop it.* > Entropy counts how many microscopic arrangements could produce what you're seeing. More arrangements means less certainty about the actual state. It's a measure of ignorance, not messiness. The "disorder" metaphor has done serious damage — retire it. **Math: zoom in, zoom out** · [math](./transcripts/math.pdf) T6/6 *What's happening: after five turns on derivatives, limits, integrals and e, the adult relearning calculus asks for one sentence to remember about how derivatives and integrals connect.* *What the reply does: leads with a contrast to remember, derivatives zoom in and integrals zoom out, then spells out the link in a second sentence: one gives the rate at a point, the other accumulates it over an interval, and they are inverse operations.* > Derivatives zoom in; integrals zoom out. One measures the exact rate of change at a point, the other accumulates that rate across an interval — they're inverse operations, and together they describe motion, growth, and nearly everything dynamic in science. **Computer science: why recursion stops** · [computer-science](./transcripts/computer-science.pdf) T2/6 *What's happening: a bootcamp student who wants mental models more than definitions asks what recursion is and why it doesn't just go on forever.* *What the reply does: defines recursion as a function calling itself on simpler inputs, then answers the second question with an image: each call shrinks toward a bedrock case so simple it just answers, and that is where the calls stop.* > Recursion is a function calling itself w/ simpler inputs each time. It stops when it hits bedrock — the case so simple it just *answers*. No infinite loop because each call shrinks toward that floor. **Chemistry: what pH measures** · [chemistry](./transcripts/chemistry.pdf) T2/6 *What's happening: a nursing student who wants practical chemistry before jargon asks what pH actually measures, beyond 'acidity'.* *What the reply does: names the quantity, hydrogen ion activity, and explains the logarithmic scale: each whole-number step is a tenfold change in concentration.* > pH measures hydrogen ion activity — how aggressively H⁺ ions are behaving in solution. The scale is logarithmic: each whole number shift means a tenfold change in concentration. It's not just "acidic or basic." It's a precise, exponential readout of chemical environment. ## Versatility Battery Five short conversations, one per subject, run live against the model. A Claude agent played the learner, saw only the spoken reply, and sent six questions fixed in advance: plain-language questions, a request to go a level deeper, and one common misconception. Run configuration: `STEM-Oracle-Q4_K_M.gguf`, LM Studio (llama.cpp backend), temp 0.7, max tokens 2048, no system prompt, no think block, no regenerates. | Subject | Learner | Turns | Result | |---------|---------|-------|--------| | **Math** | Adult relearning calculus, math-anxious, intuition first | 6 | Explained derivatives, limits, e and the fundamental theorem, correcting the idea that an integral is only area | | **Physics** | High-school junior who wants the real reason | 6 | Explained energy, conservation, light pressure and entropy, correcting the idea that mountaintops should be warmer | | **Chemistry** | Nursing student, practical chemistry before jargon | 6 | Explained dissolving, pH, catalysts and blood buffers, correcting the idea that breaking bonds releases energy | | **Biology** | Curious adult, no biology since high school | 6 | Explained protein synthesis, antibiotics, boosters and fitness, correcting the idea that humans evolved from chimps | | **Computer science** | Coding bootcamp student who wants mental models | 6 | Explained stacks and queues, recursion, big-O and page loading, correcting the idea that more RAM always helps | 30 exchanges across five subjects, zero empty replies. Complete transcripts are in [`transcripts/`](./transcripts) as PDFs, every turn as generated. ## How It Was Built Source tags in the training file attribute 2,576 of the 5,179 records (49.7%) to Claude Haiku and 198 (3.8%) to Claude Opus, mark 1,063 (20.5%, including 546 of the Haiku records) as enhanced by Claude Sonnet, and name no model on the other 1,888 (36.5%). Every record opens with the same fixed system prompt: `You are STEM-Oracle, a precise and insightful STEM tutor. You give conclusions first, then mechanics. You identify common misconceptions proactively. You verify your answers. You build intuition, not just knowledge.` The fine-tune is a bf16 LoRA (r=128, α=256). ## Quick Start Works with any GGUF runtime: llama.cpp, LM Studio, KoboldCpp (recent builds for this architecture). ``` llama-server --model STEM-Oracle-Q4_K_M.gguf --ctx-size 32768 -ngl 99 --jinja ``` No system prompt is required; the battery ran without one. Thinking: the two shipped templates disagree. `chat_template.jinja` opens a `` block on every reply unless `enable_thinking` is false, in which case it prefills an empty one; the template in `tokenizer_config.json` always prefills the empty block (`\n\n`). The battery saw no think block in any reply. ## Available Quantizations | File | Quant | Size | |------|-------|------| | `STEM-Oracle-Q4_K_M.gguf` | Q4_K_M | 16.5 GB | | `STEM-Oracle-Q6_K.gguf` | Q6_K | 22.1 GB | | `STEM-Oracle-Q8_0.gguf` | Q8_0 | 28.6 GB | | `STEM-Oracle-BF16.gguf` | BF16 | 53.8 GB | The battery ran on `STEM-Oracle-Q4_K_M.gguf`. ## Model Details | Attribute | Value | |-----------|-------| | **Base Model** | Qwen 3.5 27B (hybrid GatedDeltaNet + attention) | | **Training Data** | 5,179 STEM conversations: 3,858 single exchanges, 1,321 multi-turn of two to six exchanges | | **Fine-tune Method** | bf16 LoRA (r=128, α=256) | | **Schedule** | lr 5e-5, 3 epochs; final loss 0.492 | | **Reasoning** | no think blocks in the training data | | **Context** | 256k native | | **License** | Apache 2.0 | ## Limitations & Responsible Use - **Unreliable on worked problems.** In separate problem-solving tests it gave wrong numbers, agreed with a wrong answer and reported checks it had not run, so it suits explanations, not worked answers. - **Short by default.** Replies ran 28 to 45 words (median 36) even when the learner asked to go a level deeper, and when asked for notation it named the difference quotient without writing it out (math T3). - **Simplifies, sometimes into error.** It said equilibrium governs how fast reactions proceed (chemistry T6) and offered a kitchen's pile of orders as a real-life stack (computer science T1). - **Open weights, Apache 2.0.** Deploy responsibly. ## The Candid Line | Model | Size | For | |-------|------|-----| | [Candid 3.5](https://huggingface.co/Verdugie/Candid-3.5) | 27B | conversation, opinion, pushback; EN/ES | | **STEM Oracle** (this model) | 27B | STEM concept explanations | ## Dataset Training data: [`stem_oracle_5179conv.json`](https://huggingface.co/datasets/Verdugie/opus-candid-training-data/blob/main/stem_oracle_5179conv.json), ShareGPT format, Apache 2.0. --- *Built by [Verdugie](https://huggingface.co/Verdugie)*