File size: 3,431 Bytes
fdc6474 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 | # GLM-5.2 AQLM convergence RUNLOG
(see /home/coder/git/glm52/PLAN.md for the runbook; append-only)
## 2026-07-06 phase 1 start
- Smoke: layer 40 on GPU4, optimized scoring (bf16 GEMM, CHUNK 32768).
- w13 warm-start weighted rel-err 0.0868 -> converging ~0.4%/iter.
## Phase 1 full run launched
- Smoke L40 PASS: w13 0.0889->0.0859, w2 0.0887->0.0732 (-17.5%).
- Converger: all 75 layers, 8 GPUs (resumable), ETA ~5h.
- REAP scorer (CPU, 12 workers) running in parallel -> /data/glm52-reap-scores.npz.
## 2026-07-06 21:05Z phase 2.0 staging (CPU/network only, no GPU)
### Task A - calibration corpus v3
- /data/glm52-calib-v3/ : 16 uint32 .npy shards, 15,010,095 tokens total.
Shards 0-14 = 1,000,000 tok each; shard 15 = 10,095 tok. No empty shard.
- Composition (on target): code 40.0% (6,000,054), agentic/tool-calling
25.0% (3,756,155), instruction chat 15.0% (2,250,536), medical 10.0%
(1,503,133), prose 10.0% (1,500,217).
- Sources: reused tools/collect_expert_stats_v2.py generators (raw vLLM code,
bash corpus, agentic tool-calling via GLM chat template, coding chat, MedQA
textbook continuation, medical/general Q&A) + HF streaming downloads:
m-a-p/CodeFeedback-Filtered-Instruction + jtatman/python-code-dataset-500k
(code), tatsu-lab/alpaca (instruction), databricks/databricks-dolly-15k
(prose). All ungated, streaming=True, no auth.
- MedQA note: /tmp was wiped so /tmp/medqa was re-extracted from
cogbuji/medqa_corpus_en textbooks_en_jsonl.zip (18 textbook jsonl files).
- Held-out exclusions honored: heldout.txt never read; skipped last 25 vLLM
docs/*.md (sorted), last 3 MedQA jsonl (sorted), and vLLM python at seed-42
shuffle indices >=400 (used code_files[:400] only). Deterministic seed 42.
- Verify: tokenizer round-trip on a 300-token sample re-encodes exactly (True).
- Builder: tools/build_calib_v3.py.
### Task B - BF16 teacher streamer
- tools/bf16_stream.py : class Bf16Teacher.get_expert(layer,expert,proj)->bf16,
HTTP range reads of zai-org/GLM-5.2 (BF16, 282 shards, 1.5TB). Index +
per-shard headers cached under /data/bf16-cache/{index.json,headers/};
LRU blob cache /data/bf16-cache/blobs (400GB cap, mtime eviction). Retry
w/ exponential backoff. Range pattern reused from gguf_remote/make_hot_manifest.
- VERIFY (CPU): cosine(BF16, NVFP4-dequant teacher) on 10 random (layer,expert,
proj) triples, NVFP4 from /tmp/glm52-hot-dl2 via aqlm_converge dequant helpers.
All > 0.98: [0.99670,0.99639,0.99560,0.99573,0.99560,0.99543,0.99588,0.99557,
0.99636,0.99714]; min 0.99543, mean 0.99604. PASS.
### Task C - bench_small
- tools/sanity/bench_small.py : 20 HumanEval (openai/human-eval jsonl.gz from
GitHub, greedy, 512 tok, subprocess sandbox 5s timeout, pass@1) + 50 GSM8K
(openai/gsm8k main test, streaming, 3-shot, final-number exact match).
--self-test validates imports+downloads with no server. self-test PASS:
HumanEval 20 loaded, sandbox verifies canonical solution, GSM8K 3-shot+50
test stream + answer extraction OK. Not run against a server (none up).
## 2026-07-07 REAP re-tier GATES PASS (1M final)
- Slimmed stage-1 (190 lowest-REAP-score demotions on L21-39, 59 newly
encoded), rebuilt 291.6 GB. SC-1/2 PASS.
- SC-7: KV 1,052,672 tok; needle BLUEBERRY42; worst GPU 97,724 <= 97,887.
- SC-6 ppl: 2.7714 (ship) -> 2.7646 (conv) -> 2.7459 (REAP slim).
- Final recipe: util 0.5146 emul (0.959 real), --num-gpu-blocks-override 16448.
|