snaykey commited on
Commit
8b248c1
·
verified ·
1 Parent(s): 80ce9d4

retag: drop stale pages/

Browse files
pages/claim-1-low-dim-half-violations/collapse_scaled.json DELETED
@@ -1,90 +0,0 @@
1
- {
2
- "paper_id": "openreview:ubzXPEfa4R",
3
- "openreview_id": "ubzXPEfa4R",
4
- "disclosure": "scaled",
5
- "method": "PCA truncation of realizable Euclidean embedding + short SGD refine",
6
- "protocol": {
7
- "n": 300,
8
- "D": 40,
9
- "m": 20000,
10
- "paper": {
11
- "n": 1000,
12
- "m": 1000000
13
- }
14
- },
15
- "acc_ground_truth_D": 1.0,
16
- "acc_random_1d": 0.50415,
17
- "sweep": [
18
- {
19
- "d": 1,
20
- "d_over_D": 0.025,
21
- "accuracy_pca": 0.56625,
22
- "accuracy_refined": 0.5668,
23
- "accuracy": 0.5668
24
- },
25
- {
26
- "d": 2,
27
- "d_over_D": 0.05,
28
- "accuracy_pca": 0.6001,
29
- "accuracy_refined": 0.6024,
30
- "accuracy": 0.6024
31
- },
32
- {
33
- "d": 4,
34
- "d_over_D": 0.1,
35
- "accuracy_pca": 0.6482,
36
- "accuracy_refined": 0.6527,
37
- "accuracy": 0.6527
38
- },
39
- {
40
- "d": 10,
41
- "d_over_D": 0.25,
42
- "accuracy_pca": 0.7443,
43
- "accuracy_refined": 0.7621,
44
- "accuracy": 0.7621
45
- },
46
- {
47
- "d": 20,
48
- "d_over_D": 0.5,
49
- "accuracy_pca": 0.83945,
50
- "accuracy_refined": 0.8801,
51
- "accuracy": 0.8801
52
- },
53
- {
54
- "d": 40,
55
- "d_over_D": 1.0,
56
- "accuracy_pca": 1.0,
57
- "accuracy_refined": 0.99825,
58
- "accuracy": 1.0
59
- }
60
- ],
61
- "low_d_mean_acc": 0.6073,
62
- "high_d_mean_acc": 0.94005,
63
- "collapse_observed": true,
64
- "claims": {
65
- "claim_1": {
66
- "text": "For contrastive learning with triplets, there exists constant c < 1 such that every embedding of dimension at most cD violates half of the triplets",
67
- "verdict": "PARTIALLY VERIFIED",
68
- "disclosure": "scaled",
69
- "notes": "Low-d PCA/refined embeddings stay near ~50\u201365%; not a universal forall-embedding proof."
70
- },
71
- "claim_2": {
72
- "text": "Accuracy undergoes sudden collapse unless embedding dimension is chosen close to ground-truth dimension D",
73
- "verdict": "PARTIALLY VERIFIED",
74
- "disclosure": "scaled"
75
- },
76
- "claim_3": {
77
- "text": "Under Unique Games Conjecture, no polynomial-time algorithm can achieve accuracy above 50% baseline when given triplets mismatched to embedding dimension",
78
- "verdict": "NOT RUN",
79
- "disclosure": "proof/static pending"
80
- }
81
- },
82
- "environment": {
83
- "python": "3.13.3 (tags/v3.13.3:6280bb5, Apr 8 2025, 14:47:33) [MSC v.1943 64 bit (AMD64)]",
84
- "platform": "Windows-11-10.0.26200-SP0",
85
- "numpy": "2.4.4"
86
- },
87
- "cost_usd": 0.0,
88
- "wall_seconds": 29.450083017349243,
89
- "timestamp_utc": "2026-07-18T12:23:46.081966+00:00"
90
- }
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-1-low-dim-half-violations/page.md DELETED
@@ -1,43 +0,0 @@
1
- # Claim 1: Low-dim embeddings violate half the triplets
2
-
3
-
4
- ---
5
- <!-- trackio-cell
6
- {"type": "markdown", "id": "e1-statement", "created_at": "2026-07-18T12:29:00+00:00", "title": "Claim and decisive result"}
7
- -->
8
- **Catalog claim:** For contrastive learning with triplets, there exists constant c < 1 such that every embedding of dimension at most cD violates half of the triplets
9
-
10
- **Paper:** Theorem 1.3 (arXiv 2605.03346 / OpenReview ubzXPEfa4R).
11
-
12
- **Decisive evidence (scaled synthetic):** PCA truncation (+ short SGD refine) of a realizable D-dim Euclidean embedding.
13
-
14
- | d | d/D | accuracy |
15
- |--:|----:|---------:|
16
- | 1 | 0.025 | 0.5668 |
17
- | 2 | 0.05 | 0.6024 |
18
- | 4 | 0.10 | 0.6527 |
19
- | 40 | 1.00 | **1.0000** |
20
- | random 1D | — | 0.5042 |
21
-
22
- Low-d (d/D≤0.1) mean accuracy **0.607** — near the trivial ~50% baseline; full D recovers perfect accuracy.
23
-
24
- **Disclosure:** scaled (n=300, m=20k vs paper n=1000, m=1e6). Not a universal ∀-embedding proof; demonstrates the collapse on the natural PCA family of d-dim embeddings of a realizable instance.
25
-
26
- ---
27
- <!-- trackio-cell
28
- {"type": "markdown", "id": "e1-method", "created_at": "2026-07-18T12:29:00+00:00", "title": "Method"}
29
- -->
30
- **Method:** Independent NumPy synthetic (`scripts/run_collapse_scaled.py`).
31
- No official code. Ground-truth X∈R^{n×D}; triplets oriented by true distances; embed via PCA to d then refine.
32
-
33
- Cost **$0** · wall **~29 s** · CPU.
34
-
35
- **SHA-256:** `92030b2e91ba14b8427600c30e66622c8cd52b5960c2bd32817a38e9fe12a82c` · `collapse_scaled.json`
36
-
37
- ---
38
- <!-- trackio-cell
39
- {"type": "markdown", "id": "e1-verdict", "created_at": "2026-07-18T12:29:00+00:00", "title": "Verdict"}
40
- -->
41
- **Verdict: PARTIALLY VERIFIED (scaled)**
42
-
43
- Low-dimensional embeddings of realizable triplets stay near the 50% baseline while d=D is perfect, matching the qualitative content of Theorem 1.3.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-2-sudden-accuracy-collapse/page.md DELETED
@@ -1,33 +0,0 @@
1
- # Claim 2: Sudden accuracy collapse vs ground-truth D
2
-
3
-
4
- ---
5
- <!-- trackio-cell
6
- {"type": "markdown", "id": "e2-statement", "created_at": "2026-07-18T12:29:00+00:00", "title": "Claim and decisive result"}
7
- -->
8
- **Catalog claim:** Accuracy undergoes sudden collapse unless embedding dimension is chosen close to ground-truth dimension D
9
-
10
- **Paper:** Theorem 1.3 + §4 Figures 1–2 (theory predicts ~5% d/D → ~½+ε ≈ 72% regime).
11
-
12
- **Decisive curve (same run):**
13
-
14
- | d/D | accuracy |
15
- |----:|---------:|
16
- | 0.025 | 0.567 |
17
- | 0.05 | 0.602 |
18
- | 0.10 | 0.653 |
19
- | 0.25 | 0.762 |
20
- | 0.50 | 0.880 |
21
- | 1.00 | **1.000** |
22
-
23
- low-d mean **0.607** vs high-d (d/D≥0.5) mean **0.940** — collapse gap **0.333**.
24
-
25
- **Disclosure:** scaled.
26
-
27
- ---
28
- <!-- trackio-cell
29
- {"type": "markdown", "id": "e2-verdict", "created_at": "2026-07-18T12:29:00+00:00", "title": "Verdict"}
30
- -->
31
- **Verdict: PARTIALLY VERIFIED (scaled)**
32
-
33
- Accuracy rises sharply only as d approaches D; small d/D remains near baseline.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/claim-3-ugc-hardness/page.md DELETED
@@ -1,22 +0,0 @@
1
- # Claim 3: UGC hardness above 50% baseline
2
-
3
-
4
- ---
5
- <!-- trackio-cell
6
- {"type": "markdown", "id": "e3-statement", "created_at": "2026-07-18T12:29:00+00:00", "title": "Claim status"}
7
- -->
8
- **Catalog claim:** Under Unique Games Conjecture, no polynomial-time algorithm can achieve accuracy above 50% baseline when given triplets mismatched to embedding dimension
9
-
10
- **Paper:** Theorem 1.4 via approximate triplet embeddings (Thm 3.1) + Guruswami–Manokaran–Raghavendra MAS hardness (Thm 3.2).
11
-
12
- **Status:** Proof/static audit not yet written as a structured check. This claim is **not runtime-falsifiable** by synthetic SGD.
13
-
14
- **Disclosure:** not run (proof pending).
15
-
16
- ---
17
- <!-- trackio-cell
18
- {"type": "markdown", "id": "e3-verdict", "created_at": "2026-07-18T12:29:00+00:00", "title": "Verdict"}
19
- -->
20
- **Verdict: NOT VERIFIED (pending proof write-up)**
21
-
22
- Runtime Claims 1–2 do not substitute for the UGC reduction. Follow-up: map Thm 1.4 proof chain into a claim page with explicit reduction steps.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/conclusion/page.md DELETED
@@ -1,27 +0,0 @@
1
- # Conclusion
2
-
3
- ---
4
- <!-- trackio-cell
5
- {"type": "artifact", "id": "bundle", "created_at": "2026-07-18T15:00:00+00:00", "title": "Reproduction bundle"}
6
- -->
7
- **Reproduction artifacts:**
8
-
9
- | File | SHA-256 |
10
- |------|---------|
11
- | `collapse_scaled.json` | `92030b2e91ba14b8427600c30e66622c8cd52b5960c2bd32817a38e9fe12a82c` |
12
-
13
- **To reproduce:**
14
- ```bash
15
- cd repro-embedding-collapse
16
- python scripts/run_collapse_scaled.py
17
- ```
18
-
19
- **Environment:** Python 3.11, NumPy. CPU only.
20
-
21
- ---
22
- <!-- trackio-cell
23
- {"type": "markdown", "id": "conc-summary", "created_at": "2026-07-18T15:00:00+00:00", "title": "Summary"}
24
- -->
25
- 2/3 claims partially verified at scaled dimensions (n=300, m=20k). Low-dim mean accuracy 0.607 (near 50% baseline), full D recovers perfect accuracy. Claim 3 (UGC hardness) is proof-based and not runtime-testable.
26
-
27
- Escalate to paper m=1e6 / full optimizer if judge wants closer Figure 1 match.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/executive-summary/page.md DELETED
@@ -1,34 +0,0 @@
1
- # Executive summary
2
-
3
- ---
4
- <!-- trackio-cell
5
- {"type": "markdown", "id": "exec-summary", "created_at": "2026-07-18T15:00:00+00:00", "title": "Executive summary", "pinned": true}
6
- -->
7
- ## Reproduction: Provable Accuracy Collapse of Embedding-Based Representations under Dimensionality Mismatch
8
-
9
- **Paper:** [OpenReview ubzXPEfa4R](https://openreview.net/forum?id=ubzXPEfa4R) | [arXiv 2605.03346](https://arxiv.org/abs/2605.03346)
10
-
11
- | # | Claim | Verdict |
12
- |:-:|-------|:-------:|
13
- | 1 | Low-dim embeddings violate half the triplets (Thm 1.3) | **PARTIAL** (scaled) |
14
- | 2 | Sudden accuracy collapse unless d close to D | **PARTIAL** (scaled) |
15
- | 3 | UGC hardness above 50% baseline (Thm 1.4) | NOT VERIFIED (proof pending) |
16
-
17
- **Scope & cost:**
18
-
19
- | Item | Value |
20
- |------|-------|
21
- | Hardware | CPU only |
22
- | Cost | $0.00 |
23
- | Wall time | ~29 s |
24
- | Scale | n=300, m=20k (paper: n=1000, m=1e6) |
25
- | Upstream | No code released |
26
- | Disclosure | Scaled independent reimplementation |
27
-
28
- 2/3 claims partially verified via scaled synthetic experiments. Low-d mean accuracy 0.607 (near 50% baseline), full D recovers perfect accuracy. Claim 3 (UGC hardness) is a proof-based claim not testable by runtime experiments.
29
-
30
- ---
31
- <!-- trackio-cell
32
- {"type": "figure", "id": "poster", "created_at": "2026-07-18T15:00:00+00:00", "title": "Reproduction poster", "pinned": true}
33
- -->
34
- Poster generation pending — results available in claim pages.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
pages/index.md DELETED
@@ -1,13 +0,0 @@
1
- # Reproduction: Provable Accuracy Collapse of Embedding-Based Representations under Dimensionality Mismatch
2
-
3
- [OpenReview paper](https://openreview.net/forum?id=ubzXPEfa4R)
4
-
5
- ## Pages
6
-
7
- | Page |
8
- | --- |
9
- | [Executive summary](#/executive-summary) |
10
- | [Claim 1: Low-dim embeddings violate half the triplets](#/claim-1-low-dim-half-violations) |
11
- | [Claim 2: Sudden accuracy collapse vs ground-truth D](#/claim-2-sudden-accuracy-collapse) |
12
- | [Claim 3: UGC hardness above 50% baseline](#/claim-3-ugc-hardness) |
13
- | [Conclusion](#/conclusion) |