MihaiPopa-1 commited on
Commit
23dee79
·
verified ·
1 Parent(s): 9bb1d67

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -1
README.md CHANGED
@@ -36,4 +36,43 @@ inputs = tokenizer(prompt, return_tensors="pt")
36
  outputs = model.generate(**inputs, max_new_tokens=50)
37
 
38
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
39
- ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
  outputs = model.generate(**inputs, max_new_tokens=50)
37
 
38
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
39
+ ```
40
+ ## Comparision
41
+ ### First Question
42
+ We both give the same question: "I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?"
43
+ [SmolLM2 Math](https://huggingface.co/MihaiPopa-1/SmolLM2-135M-Math) gave:
44
+ ```
45
+ Question: I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?
46
+ Answer: The second part of the equation is 96 / 24 = 4.
47
+ #### 4
48
+ The answer is: 4
49
+ ```
50
+ It correctly gave a answer.
51
+ [SmolLM2 Base](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) gave:
52
+ ```
53
+ Question: I have a number, 96. If the result is 24 and we divide it, what's the second part of the equation?
54
+ Answer:
55
+ ```
56
+ It produced NOTHING!
57
+ ### Second Question
58
+ Also, Gemini 2.5 Flash thought another question: "If 5 apples cost $2.50, how much does 1 apple cost?"
59
+
60
+ So we put this question in both models:
61
+ [SmolLM2 Math](https://huggingface.co/MihaiPopa-1/SmolLM2-135M-Math) gave:
62
+ ```
63
+ Question: If 5 apples cost $2.50, how much does 1 apple cost?
64
+ Answer: 1 apple = 100 apples
65
+ 2 apples = 100 * 2 = 200 apples
66
+ 1 apple = 100 * 2 = 200 apples
67
+ #### 200
68
+ The answer is: 200
69
+ ```
70
+ Wrong answer.
71
+ [SmolLM2 Base](https://huggingface.co/HuggingFaceTB/SmolLM2-135M-Instruct) gave:
72
+ ```
73
+ Question: If 5 apples cost $2.50, how much does 1 apple cost?
74
+ Answer: 1 apple = $0.10
75
+
76
+ Reasoning: The answer is $0.10.
77
+ ```
78
+ Wrong answer too.