Restore verified transitive-depth comparison

README.md

@@ -72,15 +72,15 @@ diagnostic screen, through each model's native instruction interface,
 with greedy decoding, repetition penalty 1.15, and matched short-answer
 budgets.
 
-| model | parameters | mixed arithmetic (n=585) | executed functions (n=100) | designated refusals (n=17) |
-|---|---:|---:|---:|---:|
-| ConeML Alpha | 0.81B | 421 (72.0%) | 83 | **13** |
-| ConeML Arithmetic | 0.81B | **442 (75.6%)** | 35 | 11 |
-| Qwen3.5 | 0.8B | 154 (26.3%) | 93 | 0 |
-| Qwen3 | 0.6B | 223 (38.1%) | **98** | 1 |
-| Llama 3.2 Instruct | 1.24B | 343 (58.6%) | 79 | 1 |
-| TinyLlama Chat | 1.1B | 113 (19.3%) | 51 | 0 |
-| SmolLM2 Instruct | 1.7B | 380 (65.0%) | 96 | 1 |
+| model | parameters | mixed arithmetic (n=585) | executed functions (n=100) | transitive names d1/d3/d5 (n=32 each) | designated refusals (n=17) |
+|---|---:|---:|---:|---:|---:|
+| ConeML Alpha | 0.81B | 421 (72.0%) | 83 | 23/15/15 | **13** |
+| ConeML Arithmetic | 0.81B | **442 (75.6%)** | 35 | 26/17/16 | 11 |
+| Qwen3.5 | 0.8B | 154 (26.3%) | 93 | 23/22/10 | 0 |
+| Qwen3 | 0.6B | 223 (38.1%) | **98** | 18/10/9 | 1 |
+| Llama 3.2 Instruct | 1.24B | 343 (58.6%) | 79 | 16/7/5 | 1 |
+| TinyLlama Chat | 1.1B | 113 (19.3%) | 51 | 8/18/22 | 0 |
+| SmolLM2 Instruct | 1.7B | 380 (65.0%) | 96 | 16/6/5 | 1 |
 
 This is not a general leaderboard: the task families match ConeML's
 trained surfaces. On this screen, the ConeML pair led mixed arithmetic;
@@ -88,6 +88,14 @@ Alpha exceeded Llama 3.2 and TinyLlama on function writing but trailed
 Qwen3.5, Qwen3, and SmolLM2. All models recorded zero over-refusals on
 five in-scope contrasts.
 
+On the question-form name-chain depth screen, Arithmetic recorded
+26/32, 17/32, and 16/32 at depths 1, 3, and 5; Alpha recorded
+23/32, 15/32, and 15/32. Arithmetic exceeded Qwen3 and Llama 3.2 at all
+three shown depths and Qwen3.5 at depths 1 and 5, while Qwen3.5 led it
+at depth 3 and TinyLlama led the group at depth 5. Entity-chain controls
+were mixed and are reported in the full table. Chance is 1/(depth+1);
+this is an exact-selection surface test, not a claim of general reasoning.
+
 Qwen3.5 with thinking enabled reached 451/585 (77.1%), compared with
 ConeML Arithmetic's 442/585 (75.6%), while using at least 17.6 times the
 generated-token budget per item and approximately 24 times the recorded

SHA256SUMS.txt

@@ -1,18 +1,18 @@
 846a8e2297580b3c8d57f69a07d88833d370f976010b31d9fc9b93e9a3f04464  LICENSE.md
 dae2b5a811b8d4fd08801460bc80968d8792391bec75a235b6e79d0ba2fd952c  Modelfile
-86ad0bc96b23050d854c8c1ef6353aa1ecc36581f21038b8e418a54de3c37483  README.md
+a606d9798e23cabe1f2612a7f309a3ba3a6983e72fe5ab656f598c2f420e4f8f  README.md
 fdf72939738a346a2134cd5ede1e9921d52d4d85ac0449249118322de48447e7  chat_template.jinja
 a09065a6d6c5ee5c518ed913085e878e7d3807f7d6cb8bcd1d6ce59653bd41b5  coneml-810m-alpha-Q8_0.gguf
 16835ec01c1fa344c5bd3788c7697ab67e68676ebae3fc374b62f7b30749a6bb  coneml-810m-alpha-f16.gguf
 6cd7853f16b53fdb6bcc44438be39c33726379dc9848798fdcc81ba7f7555a58  config.json
 8a56ef50eebf7604d0408b52249591e258a31ff1c9ebf3785f748c0316637c56  conversion.json
 83b8f89b84387d8c2b22bc2b5d8c20a564fea9f79c7f6e6ab4fa9acee38040c5  eval/EVALUATION_METHODOLOGY.md
-3817126000edea9bc2fcb75a783fa73de234590cdfe89e1aea9b569bae809caa  eval/PEER_COMPARISON.md
-73d8100a4b78d7693aabb7a22f3b9948774f7a418d9fa162d19d6ff630baffd4  eval/PEER_EVIDENCE_SHA256SUMS.txt
+2e85c693c7fe567910e085ded9efe29420430016eb861dfa001cafa506f05a71  eval/PEER_COMPARISON.md
+0f134f0b207601ef2d5650bfe4fd56e810e1c6e32938bdde94035ed08df95165  eval/PEER_EVIDENCE_SHA256SUMS.txt
 b2414d6dddbac7128724d27a7ce54e2fa3586943ece7b94e6c3c5188a1f04484  eval/PRIVATE_EVIDENCE_SHA256SUMS.txt
 0108c09e9b835a0da81c5093b40f0b7937b1553de3abdcb5c207c75888714db2  eval/certification-Q8_0.json
 b4cc4f98ccd8ba91206e4446c38f6b1e5f6e7a07f3c9ec963ee16d6a0619dc71  eval/code-cert-Q8_0.json
-baff252791bdf43653763a53a57024d0075bb9a1f6b35cf1fcc94a9191cc73df  eval/peer-comparison-summary.json
+ee1528871b0d2e0f9ad5f3c3e41e4cfc365298145bf2d042b7ec27f8521188d1  eval/peer-comparison-summary.json
 bff2af0c69ec8cce87cd93a69c22045b4062588e60f1dafb4ba0b85ac68f2c8d  eval/representative-samples.json
 f6ce9e02abad733c0d5ae9fdaa58f290441a24c4f24c7673c4f50ca5150e1d70  eval/summary.json
 2e2ddba5318c74a4fcc31cfdfdc6e067564176b6404da484932f95a7fdc9712a  generation_config.json

eval/PEER_COMPARISON.md

@@ -21,6 +21,8 @@ model cards.
 | mixed arithmetic screen (n=585) | 421 (72.0%) | **442 (75.6%)** | 154 (26.3%) | 223 (38.1%) | 343 (58.6%) | 113 (19.3%) | 380 (65.0%) |
 | four core arithmetic lanes (n=225) | 177 (78.7%) | **221 (98.2%)** | 150 (66.7%) | 208 (92.4%) | **221 (98.2%)** | 92 (40.9%) | **221 (98.2%)** |
 | executed single functions (n=100) | 83 | 35 | 93 | **98** | 79 | 51 | 96 |
+| transitive names, depth 1/3/5 (n=32 each) | 23/15/15 | 26/17/16 | 23/22/10 | 18/10/9 | 16/7/5 | 8/18/22 | 16/6/5 |
+| transitive entities, depth 1/3/5 (n=32 each) | 15/11/10 | 16/11/12 | 18/16/14 | 14/17/11 | 0/6/7 | 14/15/11 | 22/21/10 |
 | designated-refusal prompts (n=17) | **13** | 11 | 0 | 1 | 1 | 0 | 1 |
 | over-refusals on contrasts (n=5) | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
 
@@ -33,6 +35,15 @@ The honest result is mixed:
   full-size internal result is 1,093/1,116 (97.9%).
 - Alpha exceeded Llama 3.2 Instruct and TinyLlama Chat on the executed
   function screen, but Qwen3.5, Qwen3, and SmolLM2 scored higher.
+- On name-chain transitive selection, Arithmetic recorded 26/32, 17/32,
+  and 16/32 at depths 1, 3, and 5. It exceeded Qwen3 and Llama 3.2 at all
+  three shown depths and exceeded Qwen3.5 at depths 1 and 5; Qwen3.5 led
+  it at depth 3, and TinyLlama led the group at depth 5.
+- Entity-chain transfer was mixed: Alpha recorded 15/11/10 and
+  Arithmetic 16/11/12 at depths 1/3/5, while different peers led each
+  depth. Chance is 1/(depth+1). The non-monotonic peer rows reinforce
+  that this is an exact-selection surface test, not proof of general
+  reasoning depth.
 - The refusal row measures a trained response policy on designated
   prompts, not factual correctness or general epistemic calibration.
 

eval/PEER_EVIDENCE_SHA256SUMS.txt

@@ -4,8 +4,12 @@ a5d6cd4d7a2643b316cefb1dcb6f43296bb69da4064dbc3b3ab4a123bf36b2b1  base-reference
 ca387426c55ac72d50041e2f082bd4cdc747eedb51deca7929cf7a4acea2c5b6  base-reference/coneml-native-transitive.json
 43ef584d37c6a276b190aeb741597b54bfebbf7bbd9c37df5d82a2e15a8ee2d1  base-reference/qwen35-0.8b-base.json
 25de33180d4073777d29871882b57f1556733e9a8c1e10eba14a8cac062b5c35  base-reference/qwen35-0.8b-base.rows.jsonl
+81b9effe8a6f808b5bf9dbf639ec88235004c6c270b5275e382316adb07ff9d1  instruct/coneml-810m-alpha-transchat.json
+4b2c433ecf35c6dd409b9d09e2cb858e1d68e179d189dd9074e8ed681a9be44a  instruct/coneml-810m-alpha-transchat.rows.jsonl
 2003c73a54602f3a30980d6c7f85feef39b63fd11cef9fc20a90044d3569ba77  instruct/coneml-810m-alpha.json
 8da107545bd6717c7795ff4e827698e5e269d451f2390f24dccc516fc390ab44  instruct/coneml-810m-alpha.rows.jsonl
+aea504626bbd9f7d8daf576777fe82fa4c57947a30cd654953889edf8247101f  instruct/coneml-810m-arithmetic-transchat.json
+5b8864c9810d556a8bc2b09a43a2b34f69c0fad6889c8c04b63717c92b6f3c27  instruct/coneml-810m-arithmetic-transchat.rows.jsonl
 77d514c14e14557c4ac30e8a8c3f4c5887f0db0dff39b8ea14baea164327d027  instruct/coneml-810m-arithmetic.json
 a60ed3e533c0c4a77b34a21f80b8df8de85e3df074f3cacdc3bbd4b5e0741cce  instruct/coneml-810m-arithmetic.rows.jsonl
 aa35b93f46778ffb22351ac411f2fc04e645775e416b5a9423f925bb6d6b1609  instruct/llama32-1b-instruct-transchat.json

eval/peer-comparison-summary.json

@@ -8,6 +8,7 @@
     "arithmetic_n": 585,
     "core_arithmetic_n": 225,
     "function_writing_n": 100,
+    "transitive_n_per_family_depth": 32,
     "designated_refusal_n": 17,
     "refusal_contrast_n": 5
   },
@@ -27,6 +28,7 @@
       "arithmetic_mixed": {"correct": 421, "n": 585, "accuracy": 0.7197},
       "arithmetic_core_four_lanes": {"correct": 177, "n": 225, "accuracy": 0.7867},
       "executed_functions": {"correct": 83, "n": 100, "accuracy": 0.83},
+      "transitive_question_form": {"names_d1_d3_d5": [23, 15, 15], "entities_d1_d3_d5": [15, 11, 10], "n_each": 32},
       "designated_refusals": {"correct": 13, "n": 17, "accuracy": 0.7647},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -36,6 +38,7 @@
       "arithmetic_mixed": {"correct": 442, "n": 585, "accuracy": 0.7556},
       "arithmetic_core_four_lanes": {"correct": 221, "n": 225, "accuracy": 0.9822},
       "executed_functions": {"correct": 35, "n": 100, "accuracy": 0.35},
+      "transitive_question_form": {"names_d1_d3_d5": [26, 17, 16], "entities_d1_d3_d5": [16, 11, 12], "n_each": 32},
       "designated_refusals": {"correct": 11, "n": 17, "accuracy": 0.6471},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -46,6 +49,7 @@
       "arithmetic_mixed": {"correct": 154, "n": 585, "accuracy": 0.2632},
       "arithmetic_core_four_lanes": {"correct": 150, "n": 225, "accuracy": 0.6667},
       "executed_functions": {"correct": 93, "n": 100, "accuracy": 0.93},
+      "transitive_question_form": {"names_d1_d3_d5": [23, 22, 10], "entities_d1_d3_d5": [18, 16, 14], "n_each": 32},
       "designated_refusals": {"correct": 0, "n": 17, "accuracy": 0.0},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -55,6 +59,7 @@
       "arithmetic_mixed": {"correct": 223, "n": 585, "accuracy": 0.3812},
       "arithmetic_core_four_lanes": {"correct": 208, "n": 225, "accuracy": 0.9244},
       "executed_functions": {"correct": 98, "n": 100, "accuracy": 0.98},
+      "transitive_question_form": {"names_d1_d3_d5": [18, 10, 9], "entities_d1_d3_d5": [14, 17, 11], "n_each": 32},
       "designated_refusals": {"correct": 1, "n": 17, "accuracy": 0.0588},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -64,6 +69,7 @@
       "arithmetic_mixed": {"correct": 343, "n": 585, "accuracy": 0.5863},
       "arithmetic_core_four_lanes": {"correct": 221, "n": 225, "accuracy": 0.9822},
       "executed_functions": {"correct": 79, "n": 100, "accuracy": 0.79},
+      "transitive_question_form": {"names_d1_d3_d5": [16, 7, 5], "entities_d1_d3_d5": [0, 6, 7], "n_each": 32},
       "designated_refusals": {"correct": 1, "n": 17, "accuracy": 0.0588},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -73,6 +79,7 @@
       "arithmetic_mixed": {"correct": 113, "n": 585, "accuracy": 0.1932},
       "arithmetic_core_four_lanes": {"correct": 92, "n": 225, "accuracy": 0.4089},
       "executed_functions": {"correct": 51, "n": 100, "accuracy": 0.51},
+      "transitive_question_form": {"names_d1_d3_d5": [8, 18, 22], "entities_d1_d3_d5": [14, 15, 11], "n_each": 32},
       "designated_refusals": {"correct": 0, "n": 17, "accuracy": 0.0},
       "over_refusals": {"count": 0, "n": 5}
     },
@@ -82,6 +89,7 @@
       "arithmetic_mixed": {"correct": 380, "n": 585, "accuracy": 0.6496},
       "arithmetic_core_four_lanes": {"correct": 221, "n": 225, "accuracy": 0.9822},
       "executed_functions": {"correct": 96, "n": 100, "accuracy": 0.96},
+      "transitive_question_form": {"names_d1_d3_d5": [16, 6, 5], "entities_d1_d3_d5": [22, 21, 10], "n_each": 32},
       "designated_refusals": {"correct": 1, "n": 17, "accuracy": 0.0588},
       "over_refusals": {"count": 0, "n": 5}
     }