sweep v2 verdict: PASS (DSR 0.998, PBO 0.26) + era analysis
Browse files
README.md
CHANGED
|
@@ -7,7 +7,8 @@ tags: [ml-intern, crypto, finance, backtesting, evaluation]
|
|
| 7 |
[](https://hf.co/chat?mode=ml-intern)
|
| 8 |
|
| 9 |
Institutional-grade evaluation harness for crypto quant trading strategies,
|
| 10 |
-
plus
|
|
|
|
| 11 |
[Avi-L/crypto-quant-eval-data](https://huggingface.co/datasets/Avi-L/crypto-quant-eval-data).
|
| 12 |
|
| 13 |
## What this eval measures
|
|
@@ -44,7 +45,37 @@ Strategies are functions `(bars, funding) -> positions`; add yours to
|
|
| 44 |
structurally: a bar starting at `t` closes at `t+freq`, so signals use
|
| 45 |
`shift_bars` (last closed bar at `t-1`); the engine and audit catch peeking.
|
| 46 |
|
| 47 |
-
## Strategy sweep
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
Run on real curated data: BTCUSDT 1h, 59,654 bars (2020-01 β 2026-10),
|
| 50 |
5,295 funding ticks, $1M initial capital, CPCV N=6/K=2, horizon=embargo=8h.
|
|
|
|
| 7 |
[](https://hf.co/chat?mode=ml-intern)
|
| 8 |
|
| 9 |
Institutional-grade evaluation harness for crypto quant trading strategies,
|
| 10 |
+
plus systematic strategy sweeps (hourly single-asset and daily multi-asset).
|
| 11 |
+
The companion dataset lives at
|
| 12 |
[Avi-L/crypto-quant-eval-data](https://huggingface.co/datasets/Avi-L/crypto-quant-eval-data).
|
| 13 |
|
| 14 |
## What this eval measures
|
|
|
|
| 45 |
structurally: a bar starting at `t` closes at `t+freq`, so signals use
|
| 46 |
`shift_bars` (last closed bar at `t-1`); the engine and audit catch peeking.
|
| 47 |
|
| 48 |
+
## Strategy sweep v2 β daily multi-asset panel (2026-10-25): **PASS**
|
| 49 |
+
|
| 50 |
+
66 configurations (panel TSMOM/Donchian Γ 24+8, XS momentum Β± trend filter
|
| 51 |
+
Γ 18, single-asset BTC/ETH long-only trend Γ 16) through the full gates on
|
| 52 |
+
**daily data 2014-01 β 2026-10, 4,526 days Γ 8 majors** (coinmetrics VWAP
|
| 53 |
+
index, 5bps/2bps fees, per-asset ADV impact, 0.1095 APR funding drag).
|
| 54 |
+
|
| 55 |
+
**Winner: Donchian 20d long-only on ETH β the first config to clear every gate:**
|
| 56 |
+
|
| 57 |
+
| Gate | Value | Required | |
|
| 58 |
+
|---|---|---|---|
|
| 59 |
+
| Deflated Sharpe (66 trials) | **0.9981** | > 0.95 | β
|
|
| 60 |
+
| PBO (CSCV, 8 splits) | **0.257** | β€ 0.5 | β
|
|
| 61 |
+
| Leakage audit (15 CPCV combos) | OK | no leakage | β
|
|
| 62 |
+
| OOS mean SR (CPCV, purge+embargo 5d) | **1.48** | β | 15/15 combos positive |
|
| 63 |
+
| Full-sample SR / MDD | 1.56 / β61% | β | skew +1.28, kurt 18 |
|
| 64 |
+
|
| 65 |
+
**Era analysis (mandatory honesty check):** the ETH winner's edge
|
| 66 |
+
concentrates pre-2022 (2023-26 era SR **0.50**). The **era-stable** picks are
|
| 67 |
+
BTC long-only trend: Donchian 200d (recent-era SR **0.92**, full 0.93),
|
| 68 |
+
TSMOM 50d (recent 0.89), Donchian 20d (recent 0.87) β lower full-sample SR
|
| 69 |
+
(~0.9) but no era decay. Engine fix found during this sweep: the portfolio
|
| 70 |
+
divisor previously granted implicit early-era leverage; corrected (unlisted
|
| 71 |
+
capital = cash), which *lowered* all panel numbers β the PASS survived the fix.
|
| 72 |
+
|
| 73 |
+
Read: long-only trend following on daily crypto is a statistically
|
| 74 |
+
significant, era-stable (BTC) edge after full institutional costs β with
|
| 75 |
+
β60/β80% drawdowns inherent to the unlevered profile and an edge magnitude
|
| 76 |
+
that decays as the market matures.
|
| 77 |
+
|
| 78 |
+
## Strategy sweep v1 β hourly single-asset (2026-10-25): **FAIL**
|
| 79 |
|
| 80 |
Run on real curated data: BTCUSDT 1h, 59,654 bars (2020-01 β 2026-10),
|
| 81 |
5,295 funding ticks, $1M initial capital, CPCV N=6/K=2, horizon=embargo=8h.
|