Avi-L commited on
Commit
36bf3e3
Β·
verified Β·
1 Parent(s): a9a3ba7

sweep v2 verdict: PASS (DSR 0.998, PBO 0.26) + era analysis

Browse files
Files changed (1) hide show
  1. README.md +33 -2
README.md CHANGED
@@ -7,7 +7,8 @@ tags: [ml-intern, crypto, finance, backtesting, evaluation]
7
  [![Built with ML Intern](https://huggingface.co/datasets/huggingface/badges/resolve/main/built-with-ml-intern-sm.svg)](https://hf.co/chat?mode=ml-intern)
8
 
9
  Institutional-grade evaluation harness for crypto quant trading strategies,
10
- plus a systematic strategy sweep. The companion dataset lives at
 
11
  [Avi-L/crypto-quant-eval-data](https://huggingface.co/datasets/Avi-L/crypto-quant-eval-data).
12
 
13
  ## What this eval measures
@@ -44,7 +45,37 @@ Strategies are functions `(bars, funding) -> positions`; add yours to
44
  structurally: a bar starting at `t` closes at `t+freq`, so signals use
45
  `shift_bars` (last closed bar at `t-1`); the engine and audit catch peeking.
46
 
47
- ## Strategy sweep verdict (2026-10-25, corrected cost model)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
48
 
49
  Run on real curated data: BTCUSDT 1h, 59,654 bars (2020-01 β†’ 2026-10),
50
  5,295 funding ticks, $1M initial capital, CPCV N=6/K=2, horizon=embargo=8h.
 
7
  [![Built with ML Intern](https://huggingface.co/datasets/huggingface/badges/resolve/main/built-with-ml-intern-sm.svg)](https://hf.co/chat?mode=ml-intern)
8
 
9
  Institutional-grade evaluation harness for crypto quant trading strategies,
10
+ plus systematic strategy sweeps (hourly single-asset and daily multi-asset).
11
+ The companion dataset lives at
12
  [Avi-L/crypto-quant-eval-data](https://huggingface.co/datasets/Avi-L/crypto-quant-eval-data).
13
 
14
  ## What this eval measures
 
45
  structurally: a bar starting at `t` closes at `t+freq`, so signals use
46
  `shift_bars` (last closed bar at `t-1`); the engine and audit catch peeking.
47
 
48
+ ## Strategy sweep v2 β€” daily multi-asset panel (2026-10-25): **PASS**
49
+
50
+ 66 configurations (panel TSMOM/Donchian Γ— 24+8, XS momentum Β± trend filter
51
+ Γ— 18, single-asset BTC/ETH long-only trend Γ— 16) through the full gates on
52
+ **daily data 2014-01 β†’ 2026-10, 4,526 days Γ— 8 majors** (coinmetrics VWAP
53
+ index, 5bps/2bps fees, per-asset ADV impact, 0.1095 APR funding drag).
54
+
55
+ **Winner: Donchian 20d long-only on ETH β€” the first config to clear every gate:**
56
+
57
+ | Gate | Value | Required | |
58
+ |---|---|---|---|
59
+ | Deflated Sharpe (66 trials) | **0.9981** | > 0.95 | βœ… |
60
+ | PBO (CSCV, 8 splits) | **0.257** | ≀ 0.5 | βœ… |
61
+ | Leakage audit (15 CPCV combos) | OK | no leakage | βœ… |
62
+ | OOS mean SR (CPCV, purge+embargo 5d) | **1.48** | β€” | 15/15 combos positive |
63
+ | Full-sample SR / MDD | 1.56 / βˆ’61% | β€” | skew +1.28, kurt 18 |
64
+
65
+ **Era analysis (mandatory honesty check):** the ETH winner's edge
66
+ concentrates pre-2022 (2023-26 era SR **0.50**). The **era-stable** picks are
67
+ BTC long-only trend: Donchian 200d (recent-era SR **0.92**, full 0.93),
68
+ TSMOM 50d (recent 0.89), Donchian 20d (recent 0.87) β€” lower full-sample SR
69
+ (~0.9) but no era decay. Engine fix found during this sweep: the portfolio
70
+ divisor previously granted implicit early-era leverage; corrected (unlisted
71
+ capital = cash), which *lowered* all panel numbers β€” the PASS survived the fix.
72
+
73
+ Read: long-only trend following on daily crypto is a statistically
74
+ significant, era-stable (BTC) edge after full institutional costs β€” with
75
+ βˆ’60/βˆ’80% drawdowns inherent to the unlevered profile and an edge magnitude
76
+ that decays as the market matures.
77
+
78
+ ## Strategy sweep v1 β€” hourly single-asset (2026-10-25): **FAIL**
79
 
80
  Run on real curated data: BTCUSDT 1h, 59,654 bars (2020-01 β†’ 2026-10),
81
  5,295 funding ticks, $1M initial capital, CPCV N=6/K=2, horizon=embargo=8h.