| # Notices |
|
|
| The model weights are released under the Apache License 2.0 (`LICENSE`). The `sporelabs-scrub` code is MIT |
| (`LICENSE-CODE`). |
|
|
| ## Base model |
|
|
| Ettin encoder, `jhu-clsp/ettin-encoder-17m`, by Johns Hopkins University, Center for Language and Speech Processing, |
| released under the MIT licence. The weights here are a fine-tuned derivative. |
|
|
| ``` |
| MIT License |
| |
| Copyright (c) 2025 Johns Hopkins University Center for Language and Speech Processing |
| |
| Permission is hereby granted, free of charge, to any person obtaining a copy |
| of this software and associated documentation files (the "Software"), to deal |
| in the Software without restriction, including without limitation the rights |
| to use, copy, modify, merge, publish, distribute, sublicense, and/or sell |
| copies of the Software, and to permit persons to whom the Software is |
| furnished to do so, subject to the following conditions: |
| |
| The above copyright notice and this permission notice shall be included in all |
| copies or substantial portions of the Software. |
| |
| THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR |
| IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, |
| FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE |
| AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER |
| LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, |
| OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE |
| SOFTWARE. |
| ``` |
|
|
| ## Training data credits |
|
|
| - NVIDIA Nemotron-PII (`nvidia/Nemotron-PII`), CC BY 4.0. |
| - Gretel PII masking EN v1 (`gretelai/gretel-pii-masking-en-v1`), Apache-2.0. |
| - WildChat-1M (`allenai/WildChat-1M`), Allen Institute for AI, ODC-BY 1.0. Zhao et al., "WildChat: 1M ChatGPT |
| Interaction Logs in the Wild", ICLR 2024. User turns only. |
| - SMS Spam Collection (Almeida and Hidalgo), UCI Machine Learning Repository, CC BY 4.0, https://doi.org/10.24432/C5CC84 |
| - MASSIVE 1.1 (FitzGerald et al., Amazon), CC BY 4.0. |
| - OpenAssistant Conversations, oasst2 (`OpenAssistant/oasst2`), Apache-2.0. |
| - Keycloak message templates (https://github.com/keycloak/keycloak), Apache-2.0. |
| - GitHub source files under MIT, Apache-2.0, BSD, ISC, CC0 and Unlicense licences, via `codeparrot/github-code-clean`. |
|
|
| Personal details in the public text were replaced with generated values before training. The weights hold no |
| training text. |
|
|
