Buckets:
| # name | MemoryMax | command — every job here is resumable/idempotent; the watchdog relaunches any that is | |
| # not running and has not exited 0 (logs/NAME.exit). Ship loops never exit by design. | |
| crawl-chain | 900M | code/crawl_chain.sh | |
| # (finished; relaunch with --once if pass-1 leftovers are re-crawled) ship-pass1 | 500M | .venv/bin/python code/ship_delta.py data/raw/github_delta pass1_sourcegraph | |
| # (finished; chain ships late leftovers itself) ship-pass2 | 500M | .venv/bin/python code/ship_delta.py data/raw/github_delta_p2 pass2_new | |
| # (finished) ship-backfill | 800M | .venv/bin/python code/ship_delta.py data/raw/github_backfill backfill_gitskills | |
| gitskills | 900M | .venv/bin/python code/build_gitskills.py all | |
| clawhub-build | 600M | .venv/bin/python code/build_clawhub.py | |
| clawhub-api | 400M | .venv/bin/python code/clawhub_api.py data/raw/clawhub_api | |
| clawhub-api-build | 600M | .venv/bin/python code/build_clawhub_api.py | |
| topics | 150M | .venv/bin/python code/github_topic_seeds.py | |
| finish-chain | 900M | code/finish_chain.sh | |
| fill-repo-cap | 700M | .venv/bin/python code/fill_repo_cap.py | |
| canon | 1500M | .venv/bin/python code/canon_build.py all | |
| minhash | 1200M | .venv/bin/python code/minhash_cluster.py all | |
| # locator | 600M | .venv/bin/python code/build_locator.py | |
| # canon-repack | 1000M | .venv/bin/python code/canon_repack.py | |
Xet Storage Details
- Size:
- 1.42 kB
- Xet hash:
- 7304dda0dbf9fae38b3b697cda6eb3143b99bb0bdbb25d60f2ba8196631e609f
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.