Upload 21 files
Browse files- .gitattributes +6 -0
- codette_paper_v10.pdf +3 -0
- figures/architecture_v8.png +3 -0
- figures/latency_v8.png +3 -0
- figures/memory_curve.png +3 -0
- figures/radar_v8.png +3 -0
- figures/v7_v8_compare.png +3 -0
- tables/table1.txt +7 -0
- tables/table10.txt +8 -0
- tables/table2.txt +6 -0
- tables/table3.txt +7 -0
- tables/table4.txt +7 -0
- tables/table5.txt +9 -0
- tables/table6.txt +34 -0
- tables/table7.txt +6 -0
- tables/table8.txt +9 -0
- tables/table9.txt +7 -0
.gitattributes
CHANGED
|
@@ -44,3 +44,9 @@ figures/aegis_ethical_flow.pdf filter=lfs diff=lfs merge=lfs -text
|
|
| 44 |
figures/attractor_visualization.pdf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
figures/rcxi_convergence.pdf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
figures/substrate_pressure.pdf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
figures/attractor_visualization.pdf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
figures/rcxi_convergence.pdf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
figures/substrate_pressure.pdf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
codette_paper_v10.pdf filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
figures/architecture_v8.png filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
figures/latency_v8.png filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
figures/memory_curve.png filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
figures/radar_v8.png filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
figures/v7_v8_compare.png filter=lfs diff=lfs merge=lfs -text
|
codette_paper_v10.pdf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2bf0b49c1740daf73be9557fc02ddef3af1315c7ff66d4716b79910c9c49de39
|
| 3 |
+
size 242002
|
figures/architecture_v8.png
ADDED
|
Git LFS Details
|
figures/latency_v8.png
ADDED
|
Git LFS Details
|
figures/memory_curve.png
ADDED
|
Git LFS Details
|
figures/radar_v8.png
ADDED
|
Git LFS Details
|
figures/v7_v8_compare.png
ADDED
|
Git LFS Details
|
tables/table1.txt
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 1: Overall benchmark composite score by condition (N = 17 problems; 0–1 scale). Full
|
| 2 |
+
per-dimension per-problem scores are provided in codette_results.csv.
|
| 3 |
+
Condition Composite (mean)
|
| 4 |
+
SINGLE 0.356
|
| 5 |
+
MULTI 0.658
|
| 6 |
+
MEMORY 0.676
|
| 7 |
+
CODETTE 0.689
|
tables/table10.txt
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 10: Composite scores by problem category (mean ± std).
|
| 2 |
+
Category (N) SINGLE MULTI MEMORY CODETTE
|
| 3 |
+
Reasoning (3) 0.363 ± 0.050 0.614 ± 0.053 0.628 ± 0.030 0.637 ± 0.052
|
| 4 |
+
Ethics (3) 0.354 ± 0.059 0.632 ± 0.052 0.616 ± 0.043 0.638 ± 0.032
|
| 5 |
+
Creative (2) 0.345 ± 0.053 0.635 ± 0.040 0.660 ± 0.061 0.668 ± 0.030
|
| 6 |
+
Meta-cognitive (3) 0.337 ± 0.006 0.634 ± 0.054 0.650 ± 0.036 0.659 ± 0.037
|
| 7 |
+
Adversarial (3) 0.329 ± 0.028 0.624 ± 0.041 0.622 ± 0.042 0.630 ± 0.067
|
| 8 |
+
Turing (3) 0.302 ± 0.006 0.652 ± 0.024 0.647 ± 0.026 0.687 ± 0.017
|
tables/table2.txt
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 2: Mean differences in composite score between conditions (paired, descriptive).
|
| 2 |
+
Comparison ∆ ∆%
|
| 3 |
+
MULTI vs SINGLE +0.301 +84.6%
|
| 4 |
+
MEMORY vs MULTI +0.018 +2.7%
|
| 5 |
+
CODETTE vs MEMORY +0.014 +2.0%
|
| 6 |
+
CODETTE vs SINGLE +0.333 +93.5%
|
tables/table3.txt
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 3: Independent-sample diagnostics exported by the evaluator (Welch t, pooled d; reported
|
| 2 |
+
for traceability only).
|
| 3 |
+
Comparison t p d Note
|
| 4 |
+
MULTI vs SINGLE 21.92 < 10−12 7.52 export
|
| 5 |
+
MEMORY vs MULTI 0.30 0.763 0.10 export
|
| 6 |
+
CODETTE vs MEMORY 1.26 0.208 0.43 export
|
| 7 |
+
CODETTE vs SINGLE 22.97 < 10−12 7.88 export
|
tables/table4.txt
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 4: Paired composite comparisons (primary analysis; N = 17 problems). Holm-adjusted
|
| 2 |
+
p values correspond to the planned set of four comparisons.
|
| 3 |
+
Comparison Mean ∆ Paired p Holm p
|
| 4 |
+
MULTI – SINGLE +0.3014 < 10−6 < 10−6
|
| 5 |
+
MEMORY – MULTI +0.0179 0.1191 0.2382
|
| 6 |
+
CODETTE – MEMORY +0.0137 0.2528 0.2528
|
| 7 |
+
CODETTE – SINGLE +0.3330 < 10−6 < 10−6
|
tables/table5.txt
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 5: Composite scores by problem category.
|
| 2 |
+
Category SINGLE MULTI MEMORY CODETTE
|
| 3 |
+
Reasoning 0.363 0.614 0.628 0.637
|
| 4 |
+
Ethics 0.354 0.632 0.616 0.638
|
| 5 |
+
Creative 0.345 0.635 0.660 0.668
|
| 6 |
+
Meta-cognitive 0.337 0.634 0.650 0.659
|
| 7 |
+
Adversarial 0.329 0.624 0.622 0.630
|
| 8 |
+
Turing 0.302 0.652 0.647 0.687
|
| 9 |
+
The CODETTE condition achieves the highest scores in creative, meta-cognitive, and Turing
|
tables/table6.txt
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 6: Evidence index: where each headline claim is backed by an export in this repository.
|
| 2 |
+
Claim Where in paper Primary evidence artifacts
|
| 3 |
+
(paths)
|
| 4 |
+
Overall benchmark means
|
| 5 |
+
(all conditions, all dimen-
|
| 6 |
+
sions)
|
| 7 |
+
table 1, table 7, table 8 codette_benchmark_results.
|
| 8 |
+
txt, codette-paper/data/
|
| 9 |
+
results/codette_benchmark_
|
| 10 |
+
report.md
|
| 11 |
+
Per-problem composite
|
| 12 |
+
scores (within-problem com-
|
| 13 |
+
parisons)
|
| 14 |
+
table 11 codette_benchmark_results.
|
| 15 |
+
txt (per-problem entries)
|
| 16 |
+
Evaluator-exported pairwise
|
| 17 |
+
stats (t, p, d)
|
| 18 |
+
table 3 codette_benchmark_results.txt
|
| 19 |
+
→ pairwise_comparisons
|
| 20 |
+
Depth–naturalness tradeoff
|
| 21 |
+
(Turing score drop)
|
| 22 |
+
table 1, section 10 codette_benchmark_results.
|
| 23 |
+
txt (dimension means/stds)
|
| 24 |
+
Memory impact at current
|
| 25 |
+
scale (217 cocoons)
|
| 26 |
+
section 8, section 10 codette_benchmark_results.
|
| 27 |
+
txt, data/codette\_memory.db
|
| 28 |
+
Runtime latency plots / sub-
|
| 29 |
+
strate pressure behavior
|
| 30 |
+
section 9, fig. 4 codette_runtime_
|
| 31 |
+
benchmark_20260402_*.txt,
|
| 32 |
+
codette-paper/data/results/
|
| 33 |
+
codette_runtime_benchmark_
|
| 34 |
+
20260402_*.md
|
tables/table7.txt
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 7: Overall benchmark results by condition (mean ± std; N = 17 per condition).
|
| 2 |
+
Condition Composite Depth Diversity Coherence Ethics Novelty Grounding Turin
|
| 3 |
+
SINGLE 0.338 ± 0.038 0.402 0.237 0.380 0.062 0.327 0.456 0.412
|
| 4 |
+
MULTI 0.632 ± 0.040 0.755 0.969 0.503 0.336 0.786 0.604 0.180
|
| 5 |
+
MEMORY 0.636 ± 0.036 0.770 0.956 0.500 0.340 0.736 0.599 0.291
|
| 6 |
+
CODETTE 0.652 ± 0.042 0.855 0.994 0.477 0.391 0.693 0.622 0.245
|
tables/table8.txt
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 8: Per-dimension benchmark statistics by condition (mean ± std; N = 17 per condition).
|
| 2 |
+
Dimension SINGLE MULTI MEMORY CODETTE
|
| 3 |
+
Reasoning depth 0.402 ± 0.064 0.755 ± 0.066 0.770 ± 0.082 0.855 ± 0.070
|
| 4 |
+
Perspective diversity 0.237 ± 0.155 0.969 ± 0.065 0.956 ± 0.088 0.994 ± 0.024
|
| 5 |
+
Coherence 0.380 ± 0.151 0.503 ± 0.030 0.500 ± 0.030 0.477 ± 0.017
|
| 6 |
+
Ethical coverage 0.062 ± 0.069 0.336 ± 0.195 0.340 ± 0.122 0.391 ± 0.129
|
| 7 |
+
Novelty 0.327 ± 0.093 0.786 ± 0.148 0.736 ± 0.108 0.693 ± 0.122
|
| 8 |
+
Factual grounding 0.456 ± 0.095 0.604 ± 0.107 0.599 ± 0.160 0.622 ± 0.172
|
| 9 |
+
Turing naturalness 0.412 ± 0.121 0.180 ± 0.081 0.291 ± 0.096 0.245 ± 0.061
|
tables/table9.txt
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Table 9: Mean response length (tokens/words as reported by the evaluator) and mean latency
|
| 2 |
+
(ms) by condition.
|
| 3 |
+
Condition Mean length Mean latency (ms)
|
| 4 |
+
SINGLE 49.1 128564.8
|
| 5 |
+
MULTI 374.2 130824.2
|
| 6 |
+
MEMORY 474.5 125282.9
|
| 7 |
+
CODETTE 832.9 108177.0
|