Mossez-100M-Coder-Instruct / DATASET_ATTRIBUTION.md
mossez-systems's picture
Publish Mossez-100M-Coder-Instruct
8dc5e05 verified
|
Raw
History Blame Contribute Delete
1.21 kB

Dataset attribution

The Coder-Instruct v1 SFT corpus is deterministic project-authored material licensed under Apache-2.0. It imports no external instruction dataset, private data, chat exports, Telegram data, or chain-of-thought material.

Composition

  • Train: 2,640 examples, 323,960 rendered tokens, 88 source groups.
  • Validation: 330 examples, 40,504 rendered tokens, 11 source groups.
  • Test: 330 examples, 40,518 rendered tokens, 11 source groups.
  • Maximum rendered sequence: 149 tokens; model limit: 1,024.
  • Eleven balanced task types: short function, completion, explanation, bug fix, refactor, unit test, traceback, JSON/YAML conversion, SQL, PowerShell, and FIM repair.
  • Source groups are disjoint across train, validation, and test.

Gates

License/provenance, secret, email-like PII, exact deduplication, cross-split source-group leakage, chain-of-thought exclusion, and chat-marker collision gates passed. Bounded local validators passed for Python AST/fragments, JSON, YAML, SQL, safe PowerShell, and concise text.

This conservative, template-heavy corpus validates the SFT pipeline and balanced held-out evaluation. It does not establish broad coding-assistant competence.