new file: models/vae/diffusion_pytorch_model.safetensors

model_cards/FLUX.1-dev.md

@@ -1,46 +0,0 @@
-![FLUX.1 [dev] Grid](../assets/dev_grid.jpg)
-
-`FLUX.1 [dev]` is a 12 billion parameter rectified flow transformer capable of generating images from text descriptions.
-For more information, please read our [blog post](https://blackforestlabs.ai/announcing-black-forest-labs/).
-
-# Key Features
-1. Cutting-edge output quality, second only to our state-of-the-art model `FLUX.1 [pro]`.
-2. Competitive prompt following, matching the performance of closed source alternatives.
-3. Trained using guidance distillation, making `FLUX.1 [dev]` more efficient.
-4. Open weights to drive new scientific research, and empower artists to develop innovative workflows.
-5. Generated outputs can be used for personal, scientific, and commercial purposes, as described in the [flux-1-dev-non-commercial-license](./licence.md).
-
-# Usage
-We provide a reference implementation of `FLUX.1 [dev]`, as well as sampling code, in a dedicated [github repository](https://github.com/black-forest-labs/flux).
-Developers and creatives looking to build on top of `FLUX.1 [dev]` are encouraged to use this as a starting point.
-
-## API Endpoints
-The FLUX.1 models are also available via API from the following sources
-1. [bfl.ml](https://docs.bfl.ml/) (currently `FLUX.1 [pro]`)
-2. [replicate.com](https://replicate.com/collections/flux)
-3. [fal.ai](https://fal.ai/models/fal-ai/flux/dev)
-
-## ComfyUI
-`FLUX.1 [dev]` is also available in [Comfy UI](https://github.com/comfyanonymous/ComfyUI) for local inference with a node-based workflow.
-
----
-# Limitations
-- This model is not intended or able to provide factual information.
-- As a statistical model this checkpoint might amplify existing societal biases.
-- The model may fail to generate output that matches the prompts.
-- Prompt following is heavily influenced by the prompting-style.
-
-# Out-of-Scope Use
-The model and its derivatives may not be used
-
-- In any way that violates any applicable national, federal, state, local or international law or regulation.
-- For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
-- To generate or disseminate verifiably false information and/or content with the purpose of harming others.
-- To generate or disseminate personal identifiable information that can be used to harm an individual.
-- To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
-- To create non-consensual nudity or illegal pornographic content.
-- For fully automated decision making that adversely impacts an individual's legal rights or otherwise creates or modifies a binding, enforceable obligation.
-- Generating or facilitating large-scale disinformation campaigns.
-
-# License
-This model falls under the [`FLUX.1 [dev]` Non-Commercial License](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md).

model_cards/FLUX.1-schnell.md

@@ -1,41 +0,0 @@
-![FLUX.1 [schnell] Grid](../assets/schnell_grid.jpg)
-
-`FLUX.1 [schnell]` is a 12 billion parameter rectified flow transformer capable of generating images from text descriptions.
-For more information, please read our [blog post](https://blackforestlabs.ai/announcing-black-forest-labs/).
-
-# Key Features
-1. Cutting-edge output quality and competitive prompt following, matching the performance of closed source alternatives.
-2. Trained using latent adversarial diffusion distillation, `FLUX.1 [schnell]` can generate high-quality images in only 1 to 4 steps.
-3. Released under the `apache-2.0` licence, the model can be used for personal, scientific, and commercial purposes.
-
-# Usage
-We provide a reference implementation of `FLUX.1 [schnell]`, as well as sampling code, in a dedicated [github repository](https://github.com/black-forest-labs/flux).
-Developers and creatives looking to build on top of `FLUX.1 [schnell]` are encouraged to use this as a starting point.
-
-## API Endpoints
-The FLUX.1 models are also available via API from the following sources
-1. [bfl.ml](https://docs.bfl.ml/) (currently `FLUX.1 [pro]`)
-2. [replicate.com](https://replicate.com/collections/flux)
-3. [fal.ai](https://fal.ai/models/fal-ai/flux/schnell)
-
-## ComfyUI
-`FLUX.1 [schnell]` is also available in [Comfy UI](https://github.com/comfyanonymous/ComfyUI) for local inference with a node-based workflow.
-
----
-# Limitations
-- This model is not intended or able to provide factual information.
-- As a statistical model this checkpoint might amplify existing societal biases.
-- The model may fail to generate output that matches the prompts.
-- Prompt following is heavily influenced by the prompting-style.
-
-# Out-of-Scope Use
-The model and its derivatives may not be used
-
-- In any way that violates any applicable national, federal, state, local or international law or regulation.
-- For the purpose of exploiting, harming or attempting to exploit or harm minors in any way; including but not limited to the solicitation, creation, acquisition, or dissemination of child exploitative content.
-- To generate or disseminate verifiably false information and/or content with the purpose of harming others.
-- To generate or disseminate personal identifiable information that can be used to harm an individual.
-- To harass, abuse, threaten, stalk, or bully individuals or groups of individuals.
-- To create non-consensual nudity or illegal pornographic content.
-- For fully automated decision making that adversely impacts an individual's legal rights or otherwise creates or modifies a binding, enforceable obligation.
-- Generating or facilitating large-scale disinformation campaigns.

models/vae/config.json

@@ -0,0 +1,38 @@
+{
+  "_class_name": "AutoencoderKL",
+  "_diffusers_version": "0.30.0.dev0",
+  "_name_or_path": "../checkpoints/flux-dev",
+  "act_fn": "silu",
+  "block_out_channels": [
+    128,
+    256,
+    512,
+    512
+  ],
+  "down_block_types": [
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D",
+    "DownEncoderBlock2D"
+  ],
+  "force_upcast": true,
+  "in_channels": 3,
+  "latent_channels": 16,
+  "latents_mean": null,
+  "latents_std": null,
+  "layers_per_block": 2,
+  "mid_block_add_attention": true,
+  "norm_num_groups": 32,
+  "out_channels": 3,
+  "sample_size": 1024,
+  "scaling_factor": 0.3611,
+  "shift_factor": 0.1159,
+  "up_block_types": [
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D",
+    "UpDecoderBlock2D"
+  ],
+  "use_post_quant_conv": false,
+  "use_quant_conv": false
+}

models/vae/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f5b59a26851551b67ae1fe58d32e76486e1e812def4696a4bea97f16604d40a3
+size 167666902

src/flux/util.py

@@ -148,8 +148,8 @@ def load_ae(name: str, device: str | torch.device = "cuda", hf_download: bool =
         and configs[name].repo_ae is not None
         and hf_download
     ):
-        ckpt_path = hf_hub_download(configs[name].repo_id, configs[name].repo_ae)
-        #ckpt_path = "/homedata/HuggingFace/black-forest-labs/FLUX.1-dev/ae.safetensors"
+        #ckpt_path = hf_hub_download(configs[name].repo_id, configs[name].repo_ae)
+        ckpt_path = "/home/user/app/models/vae/diffusion_pytorch_model.safetensors"
 
     # Loading the autoencoder
     print("Init AE")