Update README.md
Browse files
README.md
CHANGED
|
@@ -62,7 +62,7 @@ image.save("flux-klein-small-decoder.png")
|
|
| 62 |
|
| 63 |
|
| 64 |
---
|
| 65 |
-
Limitations
|
| 66 |
|
| 67 |
- This model is not intended or able to provide factual information.
|
| 68 |
- While the model can output text, text rendered may be inaccurate or subject to distortion.
|
|
@@ -70,39 +70,24 @@ Limitations
|
|
| 70 |
- The model may fail to generate output that matches the prompts.
|
| 71 |
- Prompt following is heavily influenced by the prompting style.
|
| 72 |
|
| 73 |
-
Out-of-Scope Use
|
| 74 |
|
| 75 |
-
|
| 76 |
-
|
| 77 |
-
- In any way that violates applicable law.
|
| 78 |
-
- For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
|
| 79 |
-
- To generate or disseminate deceptive, fraudulent, misleading or otherwise harmful content.
|
| 80 |
-
- To generate or disseminate personal identifiable information that can be used to harm an individual.
|
| 81 |
-
- To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
|
| 82 |
-
- To create non-consensual intimate imagery or illegal pornographic content.
|
| 83 |
-
- For fully automated decision making or high risk applications that adversely impact an individual's legal rights or otherwise create or modify a binding, enforceable obligation.
|
| 84 |
-
|
| 85 |
-
Nothing contained in this Model Card should be interpreted as or deemed a restriction or modification to the license the model is released under.
|
| 86 |
|
| 87 |
---
|
| 88 |
-
Responsible AI Development
|
| 89 |
|
| 90 |
-
Black Forest Labs is committed to
|
|
|
|
| 91 |
|
| 92 |
-
|
| 93 |
-
2. Post-training mitigation. Subsequently, we undertook multiple rounds of targeted fine-tuning to provide additional mitigation against potential abuse, including both text-to-image (T2I) and image-to-image (I2I) attacks. By inhibiting certain behaviors and suppressing certain concepts in the trained model, these techniques can help to prevent a user generating synthetic CSAM or NCII from a text prompt, or transforming an uploaded image into synthetic CSAM or NCII.
|
| 94 |
-
3. Ongoing evaluation. Throughout this process, we conducted multiple internal and external third-party evaluations of model checkpoints to identify further opportunities for mitigation. External third-party evaluations focused on eliciting CSAM and NCII through adversarial testing with (i) text-only prompts, (ii) a single uploaded reference image with text prompts, and (iii) multiple uploaded reference images with text prompts. Based on this feedback, we conducted further safety fine-tuning to produce our open-weight FLUX.2 [klein] models.
|
| 95 |
-
4. Release decision. After safety fine-tuning and prior to release, we conducted a final third-party evaluation of the proposed release checkpoints, focused on T2I and I2I generation of synthetic CSAM and NCII, including a comparison with other open-weight T2I and I2I models. The final FLUX.2 [klein] checkpoints demonstrated high resilience against violative inputs in complex generation and editing tasks, and demonstrated higher resilience than leading open-weight models across these risk categories. Based on these findings, we approved the release of the open-weight FLUX.2 [klein] 4B models under an Apache 2.0 license and the release of the FLUX.2 [klein] 9B models under a non-commercial license to support third-party research and development.
|
| 96 |
-
5. Inference filters. The repository for the FLUX.2 [klein] models includes filters for NSFW and protected content in inputs and outputs. Filters or manual review must be used with the FLUX.2 [klein] 9B models under the terms of the FLUX Non-Commercial License, and we encourage deployers to implement these mitigations when using the FLUX.2 [klein] 4B models. Where we implement these features on our own hosted services, we may apply multiple filters to intercept text prompts, uploaded images, and output images. We utilize both in-house and third-party filters to mitigate against harmful outputs, such as CSAM and NCII outputs, including filters provided by https://thehive.ai/ and https://www.microsoft.com/.
|
| 97 |
-
6. Content provenance. Content provenance features can help users and platforms better identify, label, and interpret AI-generated content online. The inference code for FLUX.2 [klein] implements an example of pixel-layer watermarking. Additionally, this repository includes links to the https://c2pa.org/ standard for metadata. The API for FLUX.2 [klein] applies cryptographically-signed C2PA metadata to downloaded output content to indicate that images were produced with our model.
|
| 98 |
-
7. Policies. Acceptable use of our models and access to our API are governed by policies set out in applicable documentation, including FLUX Non-Commercial License (for our non-commercial open-weight users); Developer Terms of Service, Self-Hosted Commercial License Terms, and Usage Policy (for our commercial open-weight model users); and Developer Terms of Service, FLUX API Service Terms, and Usage Policy (for our API users). These prohibit the generation of unlawful content or the use of generated content for unlawful, defamatory, or abusive purposes.
|
| 99 |
-
8. Safety. Black Forest Labs takes model safety seriously. We provide a dedicated email address (safety@blackforestlabs.ai) to solicit feedback from the community. We maintain a reporting relationship with organizations such as the https://www.iwf.org.uk/ and the https://www.missingkids.org/, and welcome ongoing engagement with authorities, developers, and researchers to share intelligence about emerging risks and develop effective mitigations.
|
| 100 |
|
| 101 |
---
|
| 102 |
-
|
|
|
|
| 103 |
|
| 104 |
This model is licensed under the https://www.apache.org/licenses/LICENSE-2.0.
|
| 105 |
|
| 106 |
-
Trademarks & IP
|
| 107 |
|
| 108 |
This project may contain trademarks or logos for projects, products, or services. Use of Black Forest Labs and FLUX trademarks or logos in modified versions of this project must not cause confusion or imply sponsorship or endorsement. Any use of third-party trademarks, intellectual property or logos are subject to those third-party's policies.
|
|
|
|
| 62 |
|
| 63 |
|
| 64 |
---
|
| 65 |
+
# Limitations
|
| 66 |
|
| 67 |
- This model is not intended or able to provide factual information.
|
| 68 |
- While the model can output text, text rendered may be inaccurate or subject to distortion.
|
|
|
|
| 70 |
- The model may fail to generate output that matches the prompts.
|
| 71 |
- Prompt following is heavily influenced by the prompting style.
|
| 72 |
|
| 73 |
+
# Out-of-Scope Use
|
| 74 |
|
| 75 |
+
This model and its derivatives may not be used outside the scope of the license, including for unlawful, fraudulent, defamatory, abusive, or otherwise violative purposes as further explained in our Usage Policies.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
|
| 77 |
---
|
| 78 |
+
# Responsible AI Development
|
| 79 |
|
| 80 |
+
Black Forest Labs is committed to responsible model development and deployment. Prior to releasing FLUX.2 [klein] 9B-KV, we evaluated and mitigated a number of risks, including child sexual abuse material (CSAM) and nonconsensual intimate imagery (NCII). For detailed information about our mitigations, evaluation processes, content provenance features, and policies, please see our post: [Capable, Open, and Safe: Combating AI
|
| 81 |
+
Misuse](https://bfl.ai/blog/capable-open-and-safe-combating-ai-misuse).
|
| 82 |
|
| 83 |
+
To report safety concerns, contact safety@blackforestlabs.ai.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
|
| 85 |
---
|
| 86 |
+
|
| 87 |
+
# License
|
| 88 |
|
| 89 |
This model is licensed under the https://www.apache.org/licenses/LICENSE-2.0.
|
| 90 |
|
| 91 |
+
# Trademarks & IP
|
| 92 |
|
| 93 |
This project may contain trademarks or logos for projects, products, or services. Use of Black Forest Labs and FLUX trademarks or logos in modified versions of this project must not cause confusion or imply sponsorship or endorsement. Any use of third-party trademarks, intellectual property or logos are subject to those third-party's policies.
|