Instructions to use hf-internal-testing/tiny-kandinsky-s2v-modular-pipe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use hf-internal-testing/tiny-kandinsky-s2v-modular-pipe with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("hf-internal-testing/tiny-kandinsky-s2v-modular-pipe", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Download transformer/config.json from hf-internal-testing/tiny-kandinsky-s2v-modular-pipe: direct link, hf CLI and curl.
- Browser
- Download file 731 Bytes
-
https://huggingface.co/hf-internal-testing/tiny-kandinsky-s2v-modular-pipe/resolve/main/transformer/config.json
- Command line
-
hf download hf://hf-internal-testing/tiny-kandinsky-s2v-modular-pipe/transformer/config.json
-
curl -L -o config.json https://huggingface.co/hf-internal-testing/tiny-kandinsky-s2v-modular-pipe/resolve/main/transformer/config.json
731 Bytes
| { | |
| "_class_name": "KandinskyS2VTransformer3DModel", | |
| "_diffusers_version": "0.40.0", | |
| "audio_inject_layers": [ | |
| 0 | |
| ], | |
| "axes_dims": [ | |
| 4, | |
| 6, | |
| 6 | |
| ], | |
| "enable_framepack": true, | |
| "ff_dim": 64, | |
| "frame_buckets": [ | |
| 1, | |
| 2, | |
| 4 | |
| ], | |
| "in_audio_dim": 16, | |
| "in_text_dim": 16, | |
| "in_text_dim2": 16, | |
| "in_visual_dim": 4, | |
| "index_rope_ref_image": 40, | |
| "model_dim": 32, | |
| "num_audio_blocks": 1, | |
| "num_text_blocks": 1, | |
| "num_visual_blocks": 2, | |
| "out_visual_dim": 4, | |
| "patch_proj1x_coef": [ | |
| 1, | |
| 1, | |
| 1 | |
| ], | |
| "patch_proj2x_coef": [ | |
| 2, | |
| 2, | |
| 2 | |
| ], | |
| "patch_proj4x_coef": [ | |
| 4, | |
| 4, | |
| 4 | |
| ], | |
| "patch_size": [ | |
| 1, | |
| 2, | |
| 2 | |
| ], | |
| "text_rope_max_pos": 128, | |
| "time_dim": 16 | |
| } | |