Update GreaterThan_Detector_NN_ReadMe.md
Browse files
GreaterThan_Detector_NN_ReadMe.md
CHANGED
|
@@ -1,16 +1,19 @@
|
|
| 1 |
# GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
| 2 |
|
| 3 |
-
Here is a GreaterThan_Detector_NN_ReadMe.md
|
| 4 |
-
It reports the results, presents the core challenge, and provides the dataset generator
|
|
|
|
| 5 |
|
| 6 |
GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
| 7 |
|
| 8 |
-
This repository, part of the Neural_Nets_Doing_Simple_Tasks collection, explores a fundamental question:
|
|
|
|
| 9 |
The specific task is to compare two numbers presented in a natural language format and identify the greater or lesser one.
|
| 10 |
|
| 11 |
The Objective
|
| 12 |
|
| 13 |
-
The goal is to create a model that can reliably process a text-based prompt, parse two numbers, understand the question
|
|
|
|
| 14 |
|
| 15 |
The input-output format is a single, continuous text sequence. For example:
|
| 16 |
|
|
@@ -21,7 +24,6 @@ Generated code
|
|
| 21 |
|
| 22 |
Expected Completion:
|
| 23 |
|
| 24 |
-
Generated code
|
| 25 |
10.00!
|
| 26 |
|
| 27 |
This makes the full, correct sequence:
|
|
@@ -29,9 +31,11 @@ This makes the full, correct sequence:
|
|
| 29 |
|
| 30 |
The Dataset
|
| 31 |
|
| 32 |
-
The training data is synthetically generated. This ensures an endless supply of examples but also presents a challenge:
|
|
|
|
| 33 |
|
| 34 |
-
You can generate your own dataset using the Python function below. This is the exact generator used for our baseline model,
|
|
|
|
| 35 |
|
| 36 |
Dataset Generator Code
|
| 37 |
|
|
@@ -99,7 +103,8 @@ Prompt Model's Completion Result
|
|
| 99 |
|
| 100 |
Analysis & The Challenge
|
| 101 |
|
| 102 |
-
The baseline model demonstrates a classic problem in machine learning: it has learned to be a good pattern matcher
|
|
|
|
| 103 |
|
| 104 |
The failures are illuminating:
|
| 105 |
|
|
|
|
| 1 |
# GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
| 2 |
|
| 3 |
+
Here is a GreaterThan_Detector_NN_ReadMe.md challenge defintion file.
|
| 4 |
+
It reports the results, presents the core challenge, and provides the dataset generator,
|
| 5 |
+
inviting the community to tackle the same problem.
|
| 6 |
|
| 7 |
GreaterThan_Detector_NN: A Challenge in Numerical Reasoning
|
| 8 |
|
| 9 |
+
This repository, part of the Neural_Nets_Doing_Simple_Tasks collection, explores a fundamental question:
|
| 10 |
+
can a general-purpose neural network learn a task that is trivial for humans but requires symbolic reasoning?
|
| 11 |
The specific task is to compare two numbers presented in a natural language format and identify the greater or lesser one.
|
| 12 |
|
| 13 |
The Objective
|
| 14 |
|
| 15 |
+
The goal is to create a model that can reliably process a text-based prompt, parse two numbers, understand the question
|
| 16 |
+
("Which is Greater?" or "Which is Lesser?"), and generate the correct numerical answer.
|
| 17 |
|
| 18 |
The input-output format is a single, continuous text sequence. For example:
|
| 19 |
|
|
|
|
| 24 |
|
| 25 |
Expected Completion:
|
| 26 |
|
|
|
|
| 27 |
10.00!
|
| 28 |
|
| 29 |
This makes the full, correct sequence:
|
|
|
|
| 31 |
|
| 32 |
The Dataset
|
| 33 |
|
| 34 |
+
The training data is synthetically generated. This ensures an endless supply of examples but also presents a challenge:
|
| 35 |
+
is the generated data diverse enough to teach true reasoning, or does it just encourage brittle pattern matching?
|
| 36 |
|
| 37 |
+
You can generate your own dataset using the Python function below. This is the exact generator used for our baseline model,
|
| 38 |
+
ensuring a level playing field.
|
| 39 |
|
| 40 |
Dataset Generator Code
|
| 41 |
|
|
|
|
| 103 |
|
| 104 |
Analysis & The Challenge
|
| 105 |
|
| 106 |
+
The baseline model demonstrates a classic problem in machine learning: it has learned to be a good pattern matcher
|
| 107 |
+
but has not acquired a robust, generalizable algorithm for numerical comparison.
|
| 108 |
|
| 109 |
The failures are illuminating:
|
| 110 |
|