Update README.md
Browse files
README.md
CHANGED
|
@@ -36,4 +36,43 @@ inputs = tokenizer(prompt, return_tensors="pt")
|
|
| 36 |
outputs = model.generate(**inputs, max_new_tokens=50)
|
| 37 |
|
| 38 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 39 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
outputs = model.generate(**inputs, max_new_tokens=50)
|
| 37 |
|
| 38 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 39 |
+
```
|
| 40 |
+
## Comparision
|
| 41 |
+
### First Question
|
| 42 |
+
We both give the same question: "I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?"
|
| 43 |
+
[SmolLM2 Math](https://huggingface.co/MihaiPopa-1/SmolLM2-135M-Math) gave:
|
| 44 |
+
```
|
| 45 |
+
Question: I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?
|
| 46 |
+
Answer: The second part of the equation is 96 / 24 = 4.
|
| 47 |
+
#### 4
|
| 48 |
+
The answer is: 4
|
| 49 |
+
```
|
| 50 |
+
It correctly gave a answer.
|
| 51 |
+
[SmolLM2 Base](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) gave:
|
| 52 |
+
```
|
| 53 |
+
Question: I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?
|
| 54 |
+
Answer:
|
| 55 |
+
```
|
| 56 |
+
It produced NOTHING!
|
| 57 |
+
### Second Question
|
| 58 |
+
Also, Gemini 2.5 Flash thought another question: "If 5 apples cost $2.50, how much does 1 apple cost?"
|
| 59 |
+
|
| 60 |
+
So we put this question in both models:
|
| 61 |
+
[SmolLM2 Math](https://huggingface.co/MihaiPopa-1/SmolLM2-135M-Math) gave:
|
| 62 |
+
```
|
| 63 |
+
Question: If 5 apples cost $2.50, how much does 1 apple cost?
|
| 64 |
+
Answer: 1 apple = 100 apples
|
| 65 |
+
2 apples = 100 * 2 = 200 apples
|
| 66 |
+
1 apple = 100 * 2 = 200 apples
|
| 67 |
+
#### 200
|
| 68 |
+
The answer is: 200
|
| 69 |
+
```
|
| 70 |
+
Wrong answer.
|
| 71 |
+
[SmolLM2 Base](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) gave:
|
| 72 |
+
```
|
| 73 |
+
Question: If 5 apples cost $2.50, how much does 1 apple cost?
|
| 74 |
+
Answer: 1 apple = $0.10
|
| 75 |
+
|
| 76 |
+
Reasoning: The answer is $0.10.
|
| 77 |
+
```
|
| 78 |
+
Wrong answer too.
|