3.13 GB
11,407 files
Updated 8 days ago
Ctrl+K
| Name | Size | Uploaded | Xet hash |
|---|---|---|---|
| analysis | 69 items | ||
| attribution | 8 items | ||
| audit | 7 items | ||
| bootstrap | 4 items | ||
| corrections | 2 items | ||
| diagnostics | 4 items | ||
| docs | 1 items | ||
| enrichment | 4 items | ||
| figure1 | 3 items | ||
| git-hooks | 1 items | ||
| handoff | 1 items | ||
| manifests | 7 items | ||
| modal | 38 items | ||
| monitoring | 1 items | ||
| query_data | 9 items | ||
| r2_sunset | 9 items | ||
| sampling | 4 items | ||
| slurm | 195 items | ||
| transform | 3 items | ||
| unlearning | 9 items | ||
| upload | 2 items | ||
| validation | 11 items | ||
| visualization | 10 items | ||
| README.md | 999 Bytes xet | 5929a103 | |
| bootstrap_local_deps.sh | 5.33 kB xet | 3351878b | |
| build_corpus_explorer.py | 28.5 kB xet | 72f73781 | |
| download_soc95_manifest.py | 5.27 kB xet | 1a398457 | |
| ekfac.sh | 8.56 kB xet | 87e7c1ec | |
| generate_6t_figures.py | 7.73 kB xet | 4b96770a | |
| upload_manifest_to_hf.py | 5.51 kB xet | 621c8041 |
Script Layout
I keep scripts/ grouped by purpose instead of leaving unrelated entrypoints at the root.
scripts/bootstrap/: local environment setup and credential wrappersscripts/docs/: document and PDF extraction helpersscripts/enrichment/: enrichment workers and related debug or upload helpersscripts/manifests/: manifest generation and pre-splitting utilitiesscripts/query_data/: query-dataset conversion, download, scoring, and upload toolsscripts/sampling/: stratified sampling extraction and bin-splitting helpersscripts/transform/: general data reshaping and file-format conversion utilitiesscripts/validation/: reporting, coverage checks, and validation entrypointsscripts/modal/: Modal execution pathsscripts/slurm/: Slurm launchers and cluster wrappersscripts/analysis/: existing analysis-oriented helpers retained in place for now
When adding a new script, prefer the most specific folder above instead of the scripts/ root.
- Total size
- 3.13 GB
- Files
- 11,407
- Last updated
- Jul 1
- Pre-warmed CDN
- US EU US EU
