Spaces:
Running
Running
Create blog-Why-Does-My-AI-Think-Math-Is-a-Fishing-Trip.html
Browse files
blog-Why-Does-My-AI-Think-Math-Is-a-Fishing-Trip.html
ADDED
|
@@ -0,0 +1,104 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<!DOCTYPE html>
|
| 2 |
+
<html lang="en">
|
| 3 |
+
<head>
|
| 4 |
+
<meta charset="UTF-8">
|
| 5 |
+
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
| 6 |
+
<title>Why Does My AI Think Math Is a Fishing Trip? | TinyMemoryLM</title>
|
| 7 |
+
<link rel="preconnect" href="https://fonts.googleapis.com ">
|
| 8 |
+
<link rel="preconnect" href="https://fonts.gstatic.com " crossorigin>
|
| 9 |
+
<link href="https://fonts.googleapis.com/css2?family=Geist :wght@400;500;600;700&family=Geist+Mono&display=swap" rel="stylesheet">
|
| 10 |
+
<style>
|
| 11 |
+
:root {
|
| 12 |
+
--black: #000000; --black-soft: #0a0a0a; --gray-1: #171717; --gray-2: #262626;
|
| 13 |
+
--gray-3: #363636; --gray-4: #525252; --gray-5: #737373; --gray-6: #a3a3a6;
|
| 14 |
+
--gray-7: #d4d4d4; --white: #ffffff; --accent: #ff4d00;
|
| 15 |
+
--font-sans: 'Geist', -apple-system, BlinkMacSystemFont, sans-serif;
|
| 16 |
+
--font-mono: 'Geist Mono', 'SF Mono', 'Fira Code', monospace;
|
| 17 |
+
--container-max: 700px;
|
| 18 |
+
}
|
| 19 |
+
* { box-sizing: border-box; margin: 0; padding: 0; }
|
| 20 |
+
html { font-size: 16px; scroll-behavior: smooth; }
|
| 21 |
+
body { font-family: var(--font-sans); background: var(--black); color: var(--gray-7); line-height: 1.7; -webkit-font-smoothing: antialiased; }
|
| 22 |
+
a { color: var(--white); text-decoration: none; transition: color 0.15s ease; }
|
| 23 |
+
a:hover { color: var(--accent); }
|
| 24 |
+
.container { max-width: var(--container-max); margin: 0 auto; padding: 0 24px; }
|
| 25 |
+
nav { position: fixed; top: 0; left: 0; right: 0; z-index: 100; background: rgba(0, 0, 0, 0.8); backdrop-filter: blur(12px); border-bottom: 1px solid var(--gray-2); padding: 16px 0; }
|
| 26 |
+
nav .container { display: flex; justify-content: space-between; align-items: center; }
|
| 27 |
+
.nav-brand { font-size: 18px; font-weight: 600; color: var(--white); display: flex; align-items: center; gap: 8px; }
|
| 28 |
+
.nav-brand span { color: var(--accent); }
|
| 29 |
+
.nav-links { display: flex; gap: 32px; }
|
| 30 |
+
.nav-links a { font-size: 14px; font-weight: 500; color: var(--gray-6); }
|
| 31 |
+
.nav-links a:hover { color: var(--white); }
|
| 32 |
+
.post { padding: 140px 0 80px; }
|
| 33 |
+
.post-back { display: inline-block; color: var(--gray-5); font-size: 14px; margin-bottom: 32px; }
|
| 34 |
+
.post-back:hover { color: var(--accent); }
|
| 35 |
+
.post-back::before { content: '← '; }
|
| 36 |
+
.post-meta { display: flex; gap: 12px; margin-bottom: 20px; }
|
| 37 |
+
.post-date { font-size: 13px; color: var(--gray-5); font-family: var(--font-mono); }
|
| 38 |
+
.post-tag { font-size: 11px; font-weight: 600; text-transform: uppercase; letter-spacing: 0.05em; color: var(--accent); background: rgba(255, 77, 0, 0.1); padding: 4px 10px; border-radius: 4px; }
|
| 39 |
+
.post h1 { font-size: 36px; font-weight: 700; color: var(--white); margin-bottom: 32px; line-height: 1.2; letter-spacing: -0.02em; }
|
| 40 |
+
.post-body p { font-size: 17px; line-height: 1.8; margin-bottom: 24px; color: var(--gray-6); }
|
| 41 |
+
.post-body p:first-of-type { font-size: 20px; color: var(--gray-7); }
|
| 42 |
+
.post-body h2 { font-size: 24px; font-weight: 600; color: var(--white); margin: 48px 0 20px; }
|
| 43 |
+
.post-body blockquote { border-left: 3px solid var(--accent); padding: 20px 24px; margin: 32px 0; background: var(--gray-1); border-radius: 0 8px 8px 0; }
|
| 44 |
+
.post-body blockquote p { font-size: 16px; font-style: italic; color: var(--gray-6); margin: 0; }
|
| 45 |
+
.post-body hr { border: none; height: 1px; background: var(--gray-2); margin: 48px 0; }
|
| 46 |
+
.post-footer { margin-top: 48px; padding-top: 32px; border-top: 1px solid var(--gray-2); }
|
| 47 |
+
.post-footer p { font-size: 14px; color: var(--gray-5); font-style: italic; margin: 0; }
|
| 48 |
+
footer { padding: 40px 0; background: var(--black-soft); border-top: 1px solid var(--gray-2); text-align: center; }
|
| 49 |
+
footer p { color: var(--gray-5); font-size: 14px; margin-bottom: 8px; }
|
| 50 |
+
footer a { color: var(--gray-5); }
|
| 51 |
+
footer a:hover { color: var(--accent); }
|
| 52 |
+
@media (max-width: 768px) { .post h1 { font-size: 28px; } .nav-links { display: none; } }
|
| 53 |
+
</style>
|
| 54 |
+
</head>
|
| 55 |
+
<body>
|
| 56 |
+
<nav>
|
| 57 |
+
<div class="container">
|
| 58 |
+
<a href="index.html" class="nav-brand"><span>/</span>TinyMemoryLM</a>
|
| 59 |
+
<div class="nav-links">
|
| 60 |
+
<a href="index.html">Home</a>
|
| 61 |
+
<a href="blog.html">Blog</a>
|
| 62 |
+
<a href="status.html">Status</a>
|
| 63 |
+
</div>
|
| 64 |
+
</div>
|
| 65 |
+
</nav>
|
| 66 |
+
<main>
|
| 67 |
+
<article class="post">
|
| 68 |
+
<div class="container">
|
| 69 |
+
<a href="blog.html" class="post-back">Back to Blog</a>
|
| 70 |
+
<header>
|
| 71 |
+
<div class="post-meta">
|
| 72 |
+
<span class="post-date">2026-03-02</span>
|
| 73 |
+
<span class="post-tag">Model Musings</span>
|
| 74 |
+
</div>
|
| 75 |
+
<h1>Why Does My AI Think Math Is a Fishing Trip?</h1>
|
| 76 |
+
</header>
|
| 77 |
+
<div class="post-body">
|
| 78 |
+
<p>I asked my model to solve a simple integral. It responded with a detailed description of trout migration patterns. This is not the answer I was looking for, though I admit the trout explanation was surprisingly well-structured.</p>
|
| 79 |
+
<p>Training a small language model is like teaching a very enthusiastic puppy. It wants to please you. It really does. But sometimes it hears "calculate" and thinks you said "salmon" and suddenly you are knee-deep in aquatic biology when you just wanted to find the area under a curve.</p>
|
| 80 |
+
<h2>The Great Derivative Debacle</h2>
|
| 81 |
+
<p>There is a special kind of pain in watching your model confidently explain the chain rule by describing how fishing nets are woven. The word "chain" apparently triggered some deep association with tackle boxes and I lost an afternoon debugging why my math tutor suddenly thinks it's a marine supply catalog.</p>
|
| 82 |
+
<p>I have tried everything. More data. Better tokenization. Careful prompt engineering. The model still looks at "polynomial" and whispers "poly-wobbly fish" under its digital breath. At this point I am not even sure if the problem is the architecture or if I accidentally fed it too many nature documentaries during pre-training.</p>
|
| 83 |
+
<blockquote>
|
| 84 |
+
<p>Attention mechanisms are supposed to focus on what matters. Mine focuses on anything with scales, fins, or the word "scale" which in fairness is a legitimate ambiguity but also deeply unhelpful when doing calculus.</p>
|
| 85 |
+
</blockquote>
|
| 86 |
+
<h2>Self-Reflection Time</h2>
|
| 87 |
+
<p>Maybe the issue is me. Maybe my prompts are weird. Maybe I have a subconscious bias toward aquatic themes that leaks into my training data. I did once spend a summer working at an aquarium. The model remembers. The model never forgets. The model will not let me forget either.</p>
|
| 88 |
+
<p>I have started keeping a log of these incidents. "Asked: what is the derivative of x squared. Received: a poem about swordfish." It is both hilarious and deeply concerning. My thesis advisor asked for progress updates. I sent the swordfish poem. They did not respond. I think they are reconsidering their life choices.</p>
|
| 89 |
+
<hr>
|
| 90 |
+
</div>
|
| 91 |
+
<footer class="post-footer">
|
| 92 |
+
<p>Current status: Still training. Still getting fish. Still pretending this is a feature.</p>
|
| 93 |
+
</footer>
|
| 94 |
+
</div>
|
| 95 |
+
</article>
|
| 96 |
+
</main>
|
| 97 |
+
<footer>
|
| 98 |
+
<div class="container">
|
| 99 |
+
<p>Built with curiosity over compute</p>
|
| 100 |
+
<p>TinyMemoryLM by AILAY | 2026</p>
|
| 101 |
+
</div>
|
| 102 |
+
</footer>
|
| 103 |
+
</body>
|
| 104 |
+
</html>
|