modified: src/flux/modules/conditioner.py

Files changed (10) hide show

src/flux/__pycache__/__init__.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/__init__.cpython-310.pyc and b/src/flux/__pycache__/__init__.cpython-310.pyc differ

src/flux/__pycache__/_version.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/_version.cpython-310.pyc and b/src/flux/__pycache__/_version.cpython-310.pyc differ

src/flux/__pycache__/math.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/math.cpython-310.pyc and b/src/flux/__pycache__/math.cpython-310.pyc differ

src/flux/__pycache__/model.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/model.cpython-310.pyc and b/src/flux/__pycache__/model.cpython-310.pyc differ

src/flux/__pycache__/sampling.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/sampling.cpython-310.pyc and b/src/flux/__pycache__/sampling.cpython-310.pyc differ

src/flux/__pycache__/util.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/__pycache__/util.cpython-310.pyc and b/src/flux/__pycache__/util.cpython-310.pyc differ

src/flux/modules/__pycache__/autoencoder.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/autoencoder.cpython-310.pyc and b/src/flux/modules/__pycache__/autoencoder.cpython-310.pyc differ

src/flux/modules/__pycache__/conditioner.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/conditioner.cpython-310.pyc and b/src/flux/modules/__pycache__/conditioner.cpython-310.pyc differ

src/flux/modules/__pycache__/layers.cpython-310.pyc CHANGED Viewed

Binary files a/src/flux/modules/__pycache__/layers.cpython-310.pyc and b/src/flux/modules/__pycache__/layers.cpython-310.pyc differ

src/flux/modules/conditioner.py CHANGED Viewed

@@ -31,9 +31,14 @@ class HFEmbedder(nn.Module):
             return_tensors="pt",
         )
         input_ids = batch_encoding["input_ids"]
         print(f"input_ids shape: {input_ids.shape}, max_length: {self.max_length}")  # Debug
-        assert input_ids.shape[1] == 77, f"Sequence length {input_ids.shape[1]} exceeds max_length 77"
         outputs = self.hf_module(
             input_ids=input_ids.to(self.hf_module.device),

             return_tensors="pt",
         )
+        if self.is_clip:
+            flag = 'clip'
+        else:
+            flag = 't5'
+        print('foward {flag}')
         input_ids = batch_encoding["input_ids"]
         print(f"input_ids shape: {input_ids.shape}, max_length: {self.max_length}")  # Debug
+        assert input_ids.shape[1] == self.max_length, f"Sequence length {input_ids.shape[1]} does not match max_length {self.max_length}"
         outputs = self.hf_module(
             input_ids=input_ids.to(self.hf_module.device),