Image Segmentation
Transformers
PyTorch
ONNX
Safetensors
Transformers.js
remove background
background
background-removal
Pytorch
vision
legal liability
custom_code
Instructions to use aoiandroid/RMBG-2-Matting with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aoiandroid/RMBG-2-Matting with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-segmentation", model="aoiandroid/RMBG-2-Matting", trust_remote_code=True)# Load model directly from transformers import AutoModelForImageSegmentation model = AutoModelForImageSegmentation.from_pretrained("aoiandroid/RMBG-2-Matting", trust_remote_code=True, dtype="auto") - Transformers.js
How to use aoiandroid/RMBG-2-Matting with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('image-segmentation', 'aoiandroid/RMBG-2-Matting'); - Notebooks
- Google Colab
- Kaggle
| license: other | |
| license_name: bria-rmbg-2.0 | |
| license_link: https://creativecommons.org/licenses/by-nc/4.0/deed.en | |
| pipeline_tag: image-segmentation | |
| tags: | |
| - remove background | |
| - background | |
| - background-removal | |
| - Pytorch | |
| - vision | |
| - legal liability | |
| - transformers | |
| - transformers.js | |
| extra_gated_description: >- | |
| Bria AI Model weights are open source for non commercial use only, per the | |
| provided [license](https://creativecommons.org/licenses/by-nc/4.0/deed.en). | |
| extra_gated_heading: Fill in this form to immediatly access the model for non commercial use | |
| extra_gated_fields: | |
| Name: text | |
| Email: text | |
| Company/Org name: text | |
| Company Website URL: text | |
| Discord user: text | |
| I agree to BRIA’s Privacy policy, Terms & conditions, and acknowledge Non commercial use to be Personal use / Academy / Non profit (direct or indirect): checkbox | |
| # BRIA Background Removal v2.0 Model Card | |
| RMBG v2.0 is our new state-of-the-art background removal model significantly improves RMBG v1.4. The model is designed to effectively separate foreground from background in a range of | |
| categories and image types. This model has been trained on a carefully selected dataset, which includes: | |
| general stock images, e-commerce, gaming, and advertising content, making it suitable for commercial use cases powering enterprise content creation at scale. | |
| The accuracy, efficiency, and versatility currently rival leading source-available models. | |
| It is ideal where content safety, legally licensed datasets, and bias mitigation are paramount. | |
| Developed by BRIA AI, RMBG v2.0 is available as a source-available model for non-commercial use. | |
| ### Get Access | |
| Bria RMBG2.0 is availabe everywhere you build, either as source-code and weights, ComfyUI nodes or API endpoints. | |
| - **Purchase:** for commercial license simply click [Here](https://go.bria.ai/3D5EGp0). | |
| - **API Endpoint**: [Bria.ai](https://platform.bria.ai/console/api/image-editing), [fal.ai](https://fal.ai/models/fal-ai/bria/background/remove) | |
| - **ComfyUI**: [Use it in workflows](https://github.com/Bria-AI/ComfyUI-BRIA-API) | |
| For more information, please visit our [website](https://bria.ai/). | |
| Join our [Discord community](https://discord.gg/Nxe9YW9zHS) for more information, tutorials, tools, and to connect with other users! | |
| [CLICK HERE FOR A DEMO](https://huggingface.co/spaces/briaai/BRIA-RMBG-2.0) | |
|  | |
| ## Model Details | |
| ##### | |
| ### Model Description | |
| - **Developed by:** [BRIA AI](https://bria.ai/) | |
| - **Model type:** Background Removal | |
| - **License:** [Creative Commons Attribution–Non-Commercial (CC BY-NC 4.0)](https://creativecommons.org/licenses/by-nc/4.0/deed.en) | |
| - The model is released under a CC BY-NC 4.0 license for non-commercial use. | |
| - Commercial use is subject to a commercial agreement with BRIA. Available [here](https://share-eu1.hsforms.com/2sj9FVZTGSFmFRibDLhr_ZAf4e04?utm_campaign=RMBG%202.0&utm_source=Hugging%20face&utm_medium=hyperlink&utm_content=RMBG%20Hugging%20Face%20purchase%20form) | |
| **Purchase:** to purchase a commercial license simply click [Here](https://go.bria.ai/3D5EGp0). | |
| - **Model Description:** BRIA RMBG-2.0 is a dichotomous image segmentation model trained exclusively on a professional-grade dataset. | |
| - **BRIA:** Resources for more information: [BRIA AI](https://bria.ai/) | |
| ## Training data | |
| Bria-RMBG model was trained with over 15,000 high-quality, high-resolution, manually labeled (pixel-wise accuracy), fully licensed images. | |
| Our benchmark included balanced gender, balanced ethnicity, and people with different types of disabilities. | |
| For clarity, we provide our data distribution according to different categories, demonstrating our model’s versatility. | |
| ### Distribution of images: | |
| | Category | Distribution | | |
| | -----------------------------------| -----------------------------------:| | |
| | Objects only | 45.11% | | |
| | People with objects/animals | 25.24% | | |
| | People only | 17.35% | | |
| | people/objects/animals with text | 8.52% | | |
| | Text only | 2.52% | | |
| | Animals only | 1.89% | | |
| | Category | Distribution | | |
| | -----------------------------------| -----------------------------------------:| | |
| | Photorealistic | 87.70% | | |
| | Non-Photorealistic | 12.30% | | |
| | Category | Distribution | | |
| | -----------------------------------| -----------------------------------:| | |
| | Non Solid Background | 52.05% | | |
| | Solid Background | 47.95% | |
| | Category | Distribution | | |
| | -----------------------------------| -----------------------------------:| | |
| | Single main foreground object | 51.42% | | |
| | Multiple objects in the foreground | 48.58% | | |
| ## Qualitative Evaluation | |
| Open source models comparison | |
|  | |
|  | |
| ### Architecture | |
| RMBG-2.0 is developed on the [BiRefNet](https://github.com/ZhengPeng7/BiRefNet) architecture enhanced with our proprietary dataset and training scheme. This training data significantly improves the model’s accuracy and effectiveness for background-removal task.<br> | |
| If you use this model in your research, please cite: | |
| ``` | |
| @article{BiRefNet, | |
| title={Bilateral Reference for High-Resolution Dichotomous Image Segmentation}, | |
| author={Zheng, Peng and Gao, Dehong and Fan, Deng-Ping and Liu, Li and Laaksonen, Jorma and Ouyang, Wanli and Sebe, Nicu}, | |
| journal={CAAI Artificial Intelligence Research}, | |
| year={2024} | |
| } | |
| ``` | |
| #### Requirements | |
| ```bash | |
| torch | |
| torchvision | |
| pillow | |
| kornia | |
| transformers | |
| ``` | |
| ### Usage | |
| <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. --> | |
| ```python | |
| from PIL import Image | |
| import matplotlib.pyplot as plt | |
| import torch | |
| from torchvision import transforms | |
| from transformers import AutoModelForImageSegmentation | |
| model = AutoModelForImageSegmentation.from_pretrained('briaai/RMBG-2.0', trust_remote_code=True) | |
| torch.set_float32_matmul_precision(['high', 'highest'][0]) | |
| model.to('cuda') | |
| model.eval() | |
| # Data settings | |
| image_size = (1024, 1024) | |
| transform_image = transforms.Compose([ | |
| transforms.Resize(image_size), | |
| transforms.ToTensor(), | |
| transforms.Normalize([0.485, 0.456, 0.406], [0.229, 0.224, 0.225]) | |
| ]) | |
| image = Image.open(input_image_path) | |
| input_images = transform_image(image).unsqueeze(0).to('cuda') | |
| # Prediction | |
| with torch.no_grad(): | |
| preds = model(input_images)[-1].sigmoid().cpu() | |
| pred = preds[0].squeeze() | |
| pred_pil = transforms.ToPILImage()(pred) | |
| mask = pred_pil.resize(image.size) | |
| image.putalpha(mask) | |
| image.save("no_bg_image.png") | |
| ``` | |