GautamKishore commited on
Commit
db5fa1a
Β·
verified Β·
1 Parent(s): dd399b4

Upload walkthrough.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. walkthrough.md +14 -5
walkthrough.md CHANGED
@@ -194,7 +194,7 @@ python -c "import torch, numpy, safetensors, yaml; print('ok')"
194
  - **Eval results (1000 samples, base tier, 5.6ms)**:
195
  - coarse 100%, modality 100%, subtype **98.4%**, code_lang **53.9%**, text_lang **100%**, file_mime 100%, risk mAP 100%
196
  - code_lang improved **+9.9%** (43.96% β†’ 53.85%) via real GitHub code samples
197
- - **ONNX export**: All 4 tiers re-exported from best.pt (~207-209 KB on disk with external data, opset 18).
198
  - **HF Model**: `huggingface.co/eulogik/pico-type` β€” ONNX models at root level + checkpoints/ directory, model card, paper scaffold.
199
  - **HF Space**: `huggingface.co/spaces/eulogik/pico-type` β€” Gradio app **label lists fixed** (Jun 18 2026). Root cause: `gradio_app.py` had different label ordering than `labels.py` (text_lang had `"ar","hi"` instead of `"id","ms"`; file_mime was completely different set). Also fixed `np.bool_`β†’`bool` for NumPy 2.x compat (Space runs Python 3.13).
200
  - **PyPI**: `pico-type` v0.1.3 published at https://pypi.org/project/pico-type/0.1.3/.
@@ -341,10 +341,19 @@ python -c "import torch, numpy, safetensors, yaml; print('ok')"
341
  - **INT8**: ONNX shape inference fails β€” `[ShapeInferenceError] Inferred shape (192) vs (12)`. Multi-head architecture (shared 192-dim pooled vector β†’ 7 linear layers with different output dims) confuses shape inference.
342
  - **FP16**: `onnxconverter_common.float16` succeeds but produces type mismatch errors in ONNX Runtime. Could not resolve with `op_block_list`.
343
 
344
- ### Fresh training from scratch (in progress)
345
- - Started training from scratch with diverse generator + real GitHub data (30% ratio) + high coarse weight (8.0)
346
- - 4000 steps, batch_size=16, 15 samples/lang from 62 languages
347
- - Located at: `checkpoints/fresh/train.log`
 
 
 
 
 
 
 
 
 
348
 
349
  ---
350
 
 
194
  - **Eval results (1000 samples, base tier, 5.6ms)**:
195
  - coarse 100%, modality 100%, subtype **98.4%**, code_lang **53.9%**, text_lang **100%**, file_mime 100%, risk mAP 100%
196
  - code_lang improved **+9.9%** (43.96% β†’ 53.85%) via real GitHub code samples
197
+ - **ONNX export**: All 4 tiers re-exported from best.pt (~9 MB each, self-contained single file, opset 18, `external_data=False`).
198
  - **HF Model**: `huggingface.co/eulogik/pico-type` β€” ONNX models at root level + checkpoints/ directory, model card, paper scaffold.
199
  - **HF Space**: `huggingface.co/spaces/eulogik/pico-type` β€” Gradio app **label lists fixed** (Jun 18 2026). Root cause: `gradio_app.py` had different label ordering than `labels.py` (text_lang had `"ar","hi"` instead of `"id","ms"`; file_mime was completely different set). Also fixed `np.bool_`β†’`bool` for NumPy 2.x compat (Space runs Python 3.13).
200
  - **PyPI**: `pico-type` v0.1.3 published at https://pypi.org/project/pico-type/0.1.3/.
 
341
  - **INT8**: ONNX shape inference fails β€” `[ShapeInferenceError] Inferred shape (192) vs (12)`. Multi-head architecture (shared 192-dim pooled vector β†’ 7 linear layers with different output dims) confuses shape inference.
342
  - **FP16**: `onnxconverter_common.float16` succeeds but produces type mismatch errors in ONNX Runtime. Could not resolve with `op_block_list`.
343
 
344
+ ### Fresh training from scratch experiment (Jun 18, discarded)
345
+ - Tried training from scratch with diverse generator + 647 real GitHub samples (30% ratio) + high coarse weight (8.0)
346
+ - 4000 steps, batch_size=16, best eval loss 2.42
347
+ - **Result**: Worse than fine-tuned model β€” real-world accuracy only 28.6% vs 52.4% from fine-tuned best.pt
348
+ - **Lesson**: Training from scratch with high coarse weight over-prioritizes coarse classification at expense of code_lang/text_lang. Fine-tuning from a good synthetic checkpoint with gradual head-weight adjustments works better.
349
+ - **Status**: Discarded. Production model remains `checkpoints/best.pt` (52.4% real-world accuracy).
350
+
351
+ ### v0.1.6: Docs, model card, HF fixes (Jun 18)
352
+ - Uploaded `walkthrough.md`, `docs/PLAN.md`, `MODEL_CARD.md` to HF model repo (fixes broken links on HF model page)
353
+ - Updated README.md with badges (PyPI, CI, DOI), eulogik branding, real-world accuracy metrics
354
+ - Updated MODEL_CARD.md with full training/architecture details, citation, eulogik branding
355
+ - Updated paper/main.tex with real-world eval, diverse generator details, higher coarse weight
356
+ - Created HF org card content for eulogik organization page (paste at huggingface.co/eulogik)
357
 
358
  ---
359