STATUS.md

# SkillsStorage — live status

Updated **2026-10-18 16:26 IST** (10:56 UTC; auto-generated by `code/status.py`)

Machine: RAM used 1033/3814 MB (available 2780), swap 386/4095 MB, disk free 28G of 38G, load 0.19

## Services

| job | state | restarts | RAM MB (anon) | last log line |
|---|---|---|---|---|
| crawl-chain | ✅ finished | 0 | - | `chain done` |
| gitskills | ✅ finished | 0 | - | `done` |
| clawhub-build | ✅ finished | 0 | - | `uploaded` |
| clawhub-api | ✅ finished | 0 | - | `done` |
| clawhub-api-build | ✅ finished | 0 | - | `uploaded` |
| topics | ✅ finished | 0 | - | `done` |
| finish-chain | ✅ finished | 0 | - | `finish chain done` |
| fill-repo-cap | ✅ finished | 0 | - | `fill done` |
| canon | ✅ finished | 0 | - | `upload done` |
| minhash | ✅ finished | 0 | - | `upload: 13s` |

## Progress

- **GitSkills → processed**: 31/31 skill parts (1,877,981 skills), 45/45 bundle-file parts
- **GitHub pass1_sourcegraph**: 8,386/8,386 repos done; shipped 46 shards = 76,584 skills, 483,021 bundle files
- **GitHub pass2_new**: 29,296/29,296 repos done; shipped 158 shards = 216,617 skills, 1,153,726 bundle files
- **GitHub backfill_gitskills**: 136,218/136,218 repos done; shipped 1561 shards = 2,213,890 skills, 13,640,675 bundle files
- **ClawHub dump → processed**: done (80,961 skills, 291,125 bundle files)
- **ClawHub API**: 81,083 listed; 0 delta bundles; converter done
- **Topic search**: 12/12 topics, 38,605 hits

## Bucket `hf://buckets/Mercity/SkillsStorage`

| prefix | GB |
|---|---|
| README.md | 0.00 |
| STATUS.md | 0.00 |
| processed/canonical | 13.80 |
| processed/clawhub | 0.95 |
| processed/github_delta | 43.48 |
| processed/gitskills | 12.41 |
| processed/index | 0.10 |
| raw/clawhub_api | 0.21 |
| raw/github_delta | 44.87 |
| raw/hf | 27.79 |
| raw/vendor | 0.55 |
| stats/canonical_summary.json | 0.00 |
| stats/dedup_count.json | 0.00 |
| stats/final_unique.json | 0.00 |
| stats/near_dup_summary.json | 0.00 |
| **total** | **144.15** |

## New error lines since previous status (0)

```
none
```

## Memory guard actions (last 5; freezes low-priority jobs when RAM < 350 MB)

```
2026-10-02T14:08:58Z MemAvailable=340MB < 350: froze minhash
2026-10-02T14:09:10Z MemAvailable=346MB < 350: froze canon
2026-10-02T14:09:41Z MemAvailable=1097MB > 900: thawed minhash
```

## Watchdog actions (last 8)

```
2026-10-01T23:04:45Z relaunching gitskills (exit=none)
started skills-gitskills (MemoryMax=900M)
2026-10-02T07:10:16Z boot.sh: guards + watchdog ensured
2026-10-02T13:43:37Z relaunching minhash (exit=1)
Failed to start transient service unit: Unit skills-minhash.service was already loaded or has a fragment file.
```