DATASET_ATTRIBUTION.md

# Dataset attribution

Continued pretraining used pinned snapshots of 60 permissively licensed public
repositories. Raw source repositories are not redistributed in this model repo.
The local build retained repository, commit, path, SPDX license label, split,
and content hash per record.

Safety processing removed secret-like material, one benchmark-leakage record,
and exact/normalized/near duplicates across splits. Evaluation records won any
cross-split duplicate conflict. The packed corpus contains 39,999,488 training,
2,178,048 validation, and 2,561,024 test tokens.

## Frozen sources

| Split | Repository | Commit | License |
|---|---|---|---|
| train | [pallets_flask](https://github.com/pallets/flask) | [`6a2f545bfd8e`](https://github.com/pallets/flask/commit/6a2f545bfd8ed31e19066a299296917e034aca58) | BSD-3-Clause |
| train | [pytest_dev_pytest](https://github.com/pytest-dev/pytest) | [`28e86a6c2ae0`](https://github.com/pytest-dev/pytest/commit/28e86a6c2ae0173831e4925a4af89b02a2936d09) | MIT |
| train | [pydantic_pydantic](https://github.com/pydantic/pydantic) | [`9eb0444f71bb`](https://github.com/pydantic/pydantic/commit/9eb0444f71bb3e03da428758fd81d3d21c4060b4) | MIT |
| train | [serde_rs_json](https://github.com/serde-rs/json) | [`afdf6fc67247`](https://github.com/serde-rs/json/commit/afdf6fc67247dd7fa4fcde1381e6ecc6bcc7a30e) | MIT OR Apache-2.0 |
| train | [burntsushi_ripgrep](https://github.com/BurntSushi/ripgrep) | [`3fce3b5bb023`](https://github.com/BurntSushi/ripgrep/commit/3fce3b5bb0236da2df6d99672afb8a719642eca7) | MIT OR Unlicense |
| train | [expressjs_express](https://github.com/expressjs/express) | [`a3714473feb3`](https://github.com/expressjs/express/commit/a3714473feb3d2908add734d340e7755fd85e0a3) | MIT |
| train | [golang_example](https://github.com/golang/example) | [`7f05d217867b`](https://github.com/golang/example/commit/7f05d217867b2af52b0a28c6d1c91df97e1b5b39) | BSD-3-Clause |
| train | [nlohmann_json](https://github.com/nlohmann/json) | [`21af527e7564`](https://github.com/nlohmann/json/commit/21af527e756435701f23e01aa8ea8dab6e050c90) | MIT |
| train | [yaml_pyyaml](https://github.com/yaml/pyyaml) | [`34a9bf82357f`](https://github.com/yaml/pyyaml/commit/34a9bf82357f4952d8f194a5a31f1c39743652d0) | MIT |
| train | [sindresorhus_type_fest](https://github.com/sindresorhus/type-fest) | [`548e7dfdbc8a`](https://github.com/sindresorhus/type-fest/commit/548e7dfdbc8a70767cd278c0ec8512aef6e16b56) | MIT |
| train | [sqlfluff_sqlfluff](https://github.com/sqlfluff/sqlfluff) | [`012dca6abe53`](https://github.com/sqlfluff/sqlfluff/commit/012dca6abe53d26f190211fd7e0f4584d5604e13) | MIT |
| train | [psf_requests](https://github.com/psf/requests) | [`1f6589ec3a1e`](https://github.com/psf/requests/commit/1f6589ec3a1ee910f9a65cc3ceac60b26677bc0e) | Apache-2.0 |
| train | [encode_httpx](https://github.com/encode/httpx) | [`b5addb64f016`](https://github.com/encode/httpx/commit/b5addb64f0161ff6bfe94c124ef76f6a1fba5254) | BSD-3-Clause |
| train | [fastapi_fastapi](https://github.com/fastapi/fastapi) | [`c8d33d39705d`](https://github.com/fastapi/fastapi/commit/c8d33d39705dd0cc3ad8084fc0969420b7ed74f7) | MIT |
| train | [python_attrs](https://github.com/python-attrs/attrs) | [`c1dc5dcba16e`](https://github.com/python-attrs/attrs/commit/c1dc5dcba16ed827aa6dcad896b41a3afedb4e32) | MIT |
| train | [tokio_rs_tokio](https://github.com/tokio-rs/tokio) | [`ecd621dd2c1a`](https://github.com/tokio-rs/tokio/commit/ecd621dd2c1a5205a84f579225e1454b62af211c) | MIT |
| train | [serde_rs_serde](https://github.com/serde-rs/serde) | [`747814f7d5fb`](https://github.com/serde-rs/serde/commit/747814f7d5fbab872df3b02f070c165b91bde062) | MIT OR Apache-2.0 |
| train | [clap_rs_clap](https://github.com/clap-rs/clap) | [`4a622b4340d5`](https://github.com/clap-rs/clap/commit/4a622b4340d5e1fffff60c0ecefdc6882f738159) | MIT OR Apache-2.0 |
| train | [rayon_rs_rayon](https://github.com/rayon-rs/rayon) | [`1f9bb2538e50`](https://github.com/rayon-rs/rayon/commit/1f9bb2538e50f1e6d1bc2e3d06a361ba2af0b632) | MIT OR Apache-2.0 |
| train | [gin_gonic_gin](https://github.com/gin-gonic/gin) | [`34dac209ffb6`](https://github.com/gin-gonic/gin/commit/34dac209ffb6ef85cc78c5d217bbb7ad001d68fd) | MIT |
| train | [spf13_cobra](https://github.com/spf13/cobra) | [`adbc8813901b`](https://github.com/spf13/cobra/commit/adbc8813901bba65827259daa8e22ff94ec1f30e) | Apache-2.0 |
| train | [stretchr_testify](https://github.com/stretchr/testify) | [`001eb7946baf`](https://github.com/stretchr/testify/commit/001eb7946baf451879253643e4ce4b38eaa0d4a7) | MIT |
| train | [mvdan_sh](https://github.com/mvdan/sh) | [`58a8c02277ed`](https://github.com/mvdan/sh/commit/58a8c02277edfc80a09579651c7034c980cf217e) | BSD-3-Clause |
| train | [colinhacks_zod](https://github.com/colinhacks/zod) | [`912f0f51b0ce`](https://github.com/colinhacks/zod/commit/912f0f51b0ced654d0069741e7160834dca742ee) | MIT |
| train | [axios_axios](https://github.com/axios/axios) | [`f5e83e49ee32`](https://github.com/axios/axios/commit/f5e83e49ee32b1004db82dad2b14d1e273a99e07) | MIT |
| train | [reduxjs_redux](https://github.com/reduxjs/redux) | [`3084fc33bb23`](https://github.com/reduxjs/redux/commit/3084fc33bb23ab4cab4796172eafe342da4e73d9) | MIT |
| train | [eslint_eslint](https://github.com/eslint/eslint) | [`f878d212e962`](https://github.com/eslint/eslint/commit/f878d212e9622da9513bcd60d2aedb2e8bb4fc8b) | MIT |
| train | [fmtlib_fmt](https://github.com/fmtlib/fmt) | [`60ccad511fd6`](https://github.com/fmtlib/fmt/commit/60ccad511fd680cb91d8b60a315759f71c67bef9) | MIT |
| train | [gabime_spdlog](https://github.com/gabime/spdlog) | [`f5f173a1a57d`](https://github.com/gabime/spdlog/commit/f5f173a1a57d0e2e0115f2ed71ee7ea316516853) | MIT |
| train | [cliutils_cli11](https://github.com/CLIUtils/CLI11) | [`aa4bfa0e5a56`](https://github.com/CLIUtils/CLI11/commit/aa4bfa0e5a56995017f060b7e03cffcd36ed265f) | BSD-3-Clause |
| train | [tobymao_sqlglot](https://github.com/tobymao/sqlglot) | [`5258f24934a0`](https://github.com/tobymao/sqlglot/commit/5258f24934a0f68cb42c6698db6e4992eedeb1c9) | MIT |
| train | [golang_tools](https://github.com/golang/tools) | [`bf54bcd2f14a`](https://github.com/golang/tools/commit/bf54bcd2f14a330f0dcffa4cf631235de771bde2) | BSD-3-Clause |
| train | [urfave_cli](https://github.com/urfave/cli) | [`c6f4cf7e9223`](https://github.com/urfave/cli/commit/c6f4cf7e9223793478cfcde9b8f135cc8f86e78f) | MIT |
| train | [nestjs_nest](https://github.com/nestjs/nest) | [`c3bc75c97381`](https://github.com/nestjs/nest/commit/c3bc75c973813969aa676793e20a7cba12a9daf5) | MIT |
| train | [prettier_prettier](https://github.com/prettier/prettier) | [`5643935c97ed`](https://github.com/prettier/prettier/commit/5643935c97ed78218cf571a41782bc0a7184ebb0) | MIT |
| train | [google_googletest](https://github.com/google/googletest) | [`d89aac5f0dd4`](https://github.com/google/googletest/commit/d89aac5f0dd4021198d903d39de16f896726de21) | BSD-3-Clause |
| train | [abseil_abseil_cpp](https://github.com/abseil/abseil-cpp) | [`d6fb29b653b0`](https://github.com/abseil/abseil-cpp/commit/d6fb29b653b0d34827777f2519a28ce7e5c37066) | Apache-2.0 |
| train | [libuv_libuv](https://github.com/libuv/libuv) | [`a6d06ba716b6`](https://github.com/libuv/libuv/commit/a6d06ba716b6facdf00e29306aa5013d51e070d4) | MIT |
| train | [nvm_sh_nvm](https://github.com/nvm-sh/nvm) | [`65ded65d46c1`](https://github.com/nvm-sh/nvm/commit/65ded65d46c16481dbbe8e93f8ba9e6b35f20740) | MIT |
| train | [dbt_labs_dbt_core](https://github.com/dbt-labs/dbt-core) | [`7d8193f9405c`](https://github.com/dbt-labs/dbt-core/commit/7d8193f9405c742de83c6c0630e9e3e848c1224d) | Apache-2.0 |
| train | [dbt_labs_jaffle_shop](https://github.com/dbt-labs/jaffle_shop) | [`fd7bfacae4f4`](https://github.com/dbt-labs/jaffle_shop/commit/fd7bfacae4f497ff044a6a0275268676bf1b64c3) | Apache-2.0 |
| train | [kubernetes_examples](https://github.com/kubernetes/examples) | [`d6b8cd27eacb`](https://github.com/kubernetes/examples/commit/d6b8cd27eacb51e651a1aa6f7c190a28713eff6e) | Apache-2.0 |
| train | [json_schema_test_suite](https://github.com/json-schema-org/JSON-Schema-Test-Suite) | [`15fe552d6cf7`](https://github.com/json-schema-org/JSON-Schema-Test-Suite/commit/15fe552d6cf76e29cc8165306fb6a72503fd360b) | MIT |
| train | [oai_openapi_specification](https://github.com/OAI/OpenAPI-Specification) | [`87ff4b606e46`](https://github.com/OAI/OpenAPI-Specification/commit/87ff4b606e4697340c9c5f3b5bff09eccb81a10c) | Apache-2.0 |
| train | [postgres_postgres](https://github.com/postgres/postgres) | [`b59783502224`](https://github.com/postgres/postgres/commit/b59783502224c0ae721974a5d9b6fb915cbd37e1) | PostgreSQL |
| validation | [pallets_click](https://github.com/pallets/click) | [`00e592cea702`](https://github.com/pallets/click/commit/00e592cea702e0b2caa0dee42489fdb1c22cd845) | BSD-3-Clause |
| validation | [pallets_jinja](https://github.com/pallets/jinja) | [`5ef70112a1ff`](https://github.com/pallets/jinja/commit/5ef70112a1ff19c05324ff889dd30405b1002044) | BSD-3-Clause |
| validation | [vitest_dev_vitest](https://github.com/vitest-dev/vitest) | [`c67d296f42f9`](https://github.com/vitest-dev/vitest/commit/c67d296f42f93ec888ff148e821877194969cea9) | MIT |
| validation | [sharkdp_fd](https://github.com/sharkdp/fd) | [`0f1f9676dcf7`](https://github.com/sharkdp/fd/commit/0f1f9676dcf7bc5af814469a74a0d878449cde80) | MIT OR Apache-2.0 |
| validation | [go_chi_chi](https://github.com/go-chi/chi) | [`8b258c7bb28f`](https://github.com/go-chi/chi/commit/8b258c7bb28f97a5f2a856ff7ef962578fec9215) | MIT |
| validation | [catchorg_catch2](https://github.com/catchorg/Catch2) | [`4cde12851773`](https://github.com/catchorg/Catch2/commit/4cde12851773b32fc5a0171f262e4281c8e28b01) | BSL-1.0 |
| validation | [bats_core_bats_core](https://github.com/bats-core/bats-core) | [`ae4b94d7cc35`](https://github.com/bats-core/bats-core/commit/ae4b94d7cc35f62468297791aa4ab8c3af7377ba) | MIT |
| test | [toml_lang_toml](https://github.com/toml-lang/toml) | [`b69253c93d3d`](https://github.com/toml-lang/toml/commit/b69253c93d3dec7ee7627c96159c2d3c753ed794) | MIT |
| test | [curl_curl](https://github.com/curl/curl) | [`b24346fe31ad`](https://github.com/curl/curl/commit/b24346fe31ad45a91de7d9be0698c8b2c0954d3d) | curl |
| test | [tiangolo_sqlmodel](https://github.com/fastapi/sqlmodel) | [`f299d20c2503`](https://github.com/fastapi/sqlmodel/commit/f299d20c2503b58ab3a80a809081e0f1ce37d64c) | MIT |
| test | [microsoft_tslib](https://github.com/microsoft/tslib) | [`12bd8a74b320`](https://github.com/microsoft/tslib/commit/12bd8a74b320e3acfaba36b0ecb0e14964a9165b) | 0BSD |
| test | [rust_lang_rustlings](https://github.com/rust-lang/rustlings) | [`3b7ca447f100`](https://github.com/rust-lang/rustlings/commit/3b7ca447f100b6542713532e64ea7e758aeaa6b0) | MIT |
| test | [junegunn_fzf](https://github.com/junegunn/fzf) | [`715d26fa3949`](https://github.com/junegunn/fzf/commit/715d26fa3949c9a0f1e41fcbda5440f3ac338e51) | MIT |
| test | [jqlang_jq](https://github.com/jqlang/jq) | [`603db3f57741`](https://github.com/jqlang/jq/commit/603db3f57741d217ba651e61086b550a72148b83) | MIT |
| test | [yaml_libyaml](https://github.com/yaml/libyaml) | [`893682bb98d5`](https://github.com/yaml/libyaml/commit/893682bb98d5ed663a3e314c46dceaf9b1c8802f) | MIT |

All source licenses remain the responsibility of their respective copyright
holders. The model release itself is provided under Apache-2.0.