ApplePiesFromScratch
/

tiny-agi-propagation-logic

propagation-logic

mechanism-first

abstract-reasoning

derivation-traces

boundary-conditions

Model card Files Files and versions

ApplePiesFromScratch commited on Apr 2

Commit

8a5a2de

·

verified ·

1 Parent(s): 0babacb

Update README.md

Files changed (1) hide show

README.md +6 -5

README.md CHANGED Viewed

@@ -53,11 +53,12 @@ on novel carriers?
 See: `ApplePiesFromScratch/dta-benchmark`
-| Model | DTA-Overall | DTA-Closure | DTA-FixedPts | DTA-Cycle |
-|-------|-------------|-------------|--------------|-----------|
-| MechanismBase (10M) | 62.5% | 80.0% | 70.0% | 60.0% |
-| Random baseline | 25% | 50% | 25% | 25% |
-| Engine (oracle) | 100% | 100% | 100% | 100% |
 ## Usage

 See: `ApplePiesFromScratch/dta-benchmark`
+| Model | DTA-Overall | DTA-Closure | DTA-FixedPts | DTA-Involution | DTA-Cycle |
+|-------|-------------|-------------|--------------|----------------|-----------|
+| MechanismBase (10M) | 62.5% | 80.0% | 70.0% | 70.0% | 60.0% |
+| Random baseline | 25% | 50% | 25% | 50% | 25% |
+| Engine (oracle) | 100% | 100% | 100% | 100% | 100% |
 ## Usage