STATUS.md

SkillsStorage — live status

Updated 2026-10-13 08:03 IST (02:33 UTC; auto-generated by code/status.py)

Machine: RAM used 1024/3814 MB (available 2790), swap 389/4095 MB, disk free 27G of 38G, load 0.15

Services

job	state	restarts	RAM MB (anon)	last log line
crawl-chain	✅ finished	0	-	chain done
gitskills	✅ finished	0	-	done
clawhub-build	✅ finished	0	-	uploaded
clawhub-api	✅ finished	0	-	done
clawhub-api-build	✅ finished	0	-	uploaded
topics	✅ finished	0	-	done
finish-chain	✅ finished	0	-	finish chain done
fill-repo-cap	✅ finished	0	-	fill done
canon	✅ finished	0	-	upload done
minhash	✅ finished	0	-	upload: 13s

Progress

• GitSkills → processed: 31/31 skill parts (1,877,981 skills), 45/45 bundle-file parts
• GitHub pass1_sourcegraph: 8,386/8,386 repos done; shipped 46 shards = 76,584 skills, 483,021 bundle files
• GitHub pass2_new: 29,296/29,296 repos done; shipped 158 shards = 216,617 skills, 1,153,726 bundle files
• GitHub backfill_gitskills: 136,218/136,218 repos done; shipped 1561 shards = 2,213,890 skills, 13,640,675 bundle files
• ClawHub dump → processed: done (80,961 skills, 291,125 bundle files)
• ClawHub API: 81,083 listed; 0 delta bundles; converter done
• Topic search: 12/12 topics, 38,605 hits

Bucket hf://buckets/Mercity/SkillsStorage

prefix	GB
README.md	0.00
STATUS.md	0.00
processed/canonical	13.80
processed/clawhub	0.95
processed/github_delta	43.48
processed/gitskills	12.41
processed/index	0.10
raw/clawhub_api	0.21
raw/github_delta	44.87
raw/hf	27.79
raw/vendor	0.55
stats/canonical_summary.json	0.00
stats/dedup_count.json	0.00
stats/final_unique.json	0.00
stats/near_dup_summary.json	0.00
total	144.15

New error lines since previous status (0)

none

Memory guard actions (last 5; freezes low-priority jobs when RAM < 350 MB)

2026-10-02T14:08:58Z MemAvailable=340MB < 350: froze minhash
2026-10-02T14:09:10Z MemAvailable=346MB < 350: froze canon
2026-10-02T14:09:41Z MemAvailable=1097MB > 900: thawed minhash

Watchdog actions (last 8)

2026-10-01T23:04:45Z relaunching gitskills (exit=none)
started skills-gitskills (MemoryMax=900M)
2026-10-02T07:10:16Z boot.sh: guards + watchdog ensured
2026-10-02T13:43:37Z relaunching minhash (exit=1)
Failed to start transient service unit: Unit skills-minhash.service was already loaded or has a fragment file.