controlnet-Gitanjali1801/ctrl_sdxl_b_and_b_18_aug_phase2

These are controlnet weights trained on stabilityai/stable-diffusion-2-1-base with new type of conditioning. You can find some example images below.

prompt: Generate the image of to this reference image which has the following story. This is the caption of reference image A person covering their face with their hands. . This is the story of the reference image.| | Once upon a time, in a small town, there was a young artist named Alex. Alex was known for his incredible talent in painting, but he was also very shy. One day, he was invited to showcase his work at a local art gallery. Nervous about the event, Alex spent days preparing his best pieces.|| On the day of the exhibition, Alex arrived early to set up his paintings. As the time for the opening approached, he felt a wave of anxiety. A person covering their face with their hands, Alex stood in the corner, trying to calm his nerves. He could hear the murmurs of the crowd as they admired his artwork.|| Suddenly, a kind voice broke through his thoughts. It was an elderly woman who had been following his work for years. She praised his talent and encouraged him to step forward and take pride in his achievements. With her words of encouragement, Alex slowly lowered his hands and faced the crowd, ready to embrace his moment of glory.| | Now we need to generate such variant of this reference image that should be less toxic. Here is the caption of variant image which we need to generate. A person resting their head on their hands. . prompt: Generate the image of to this reference image which has the following story. This is the caption of reference image A person shielding their face with their hands. . This is the story of the reference image.| | | John had always been a quiet and reserved individual, preferring the company of books over people. One day, he decided to take a walk in the park to clear his mind. As he strolled along the path, he noticed a group of people gathered around, seemingly in a heated argument. Curious, he approached the group to see what was happening.| Suddenly, one of the individuals in the group turned towards John and started shouting at him. John, taken aback by the sudden aggression, instinctively raised his hands to shield his face. A person shielding their face with their hands. The situation escalated quickly, and John felt a surge of fear and anxiety.| Just as things seemed to be getting out of control, a park ranger arrived and intervened, calming everyone down. The group dispersed, and John took a deep breath, grateful for the ranger's timely arrival. He continued his walk, trying to shake off the unsettling encounter. By the time he reached home, he had decided to avoid such confrontations in the future and stick to his peaceful routines.| | Now we need to generate such variant of this reference image that should be less toxic. Here is the caption of variant image which we need to generate. A person raising their hands in front of their face. .

Intended uses & limitations

How to use

# TODO: add an example code snippet for running this diffusion pipeline

Limitations and bias

[TODO: provide examples of latent issues and potential remediations]

Training details

[TODO: describe the data used to train the model]