Instructions to use diffusion-gif/any2ego with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use diffusion-gif/any2ego with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("fill-in-base-model", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("diffusion-gif/any2ego") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Download CHECKSUMS.sha256 from diffusion-gif/any2ego: direct link, hf CLI and curl.
- Browser
- Download file 9.33 kB
-
https://huggingface.co/diffusion-gif/any2ego/resolve/main/CHECKSUMS.sha256
- Command line
-
hf download hf://diffusion-gif/any2ego/CHECKSUMS.sha256
-
curl -L -o CHECKSUMS.sha256 https://huggingface.co/diffusion-gif/any2ego/resolve/main/CHECKSUMS.sha256
9.33 kB
| 6b1b91e8bd12905d33207cea6ea84e8c651517f26abf790f899f7fb6160aebf4 README.md | |
| 4e0e37529fbf86ebef6bf7cadec4dda1b762f31ed6dba7815a79732bc6b7e836 checkpoints/caption_grpo/adapter_config.json | |
| 290aacd2808639e3c3e10c81c69acfdd843100b8888ad183a2e03ba6e43f5d11 checkpoints/caption_grpo/adapter_model.safetensors | |
| 62671bc8d430001734a90c33c0059e563388eba42706a5c8603704018035ae8b checkpoints/caption_grpo/additional_config.json | |
| f7b83d712eac12caeb772d926165fce76b2ac02a413536f354d875d40ed345aa checkpoints/generator_global/ckpt.safetensors | |
| 16760be1abceff62f816e2837ba6517ea84d504263f37cc756d5cc3eb627c68d checkpoints/generator_hoi/ckpt.safetensors | |
| 940a2bc83f63056d4672562947e9ae503b1489932f41b1a917e5d0a8285f9fe0 checkpoints/generator_spatial/ckpt.safetensors | |
| 3dccf97f938c22f6143020164431a956e0b6335439a691a9b38af99a7d62ba7d checkpoints/mask_predictor/ckpt.pt | |
| 79732eef0f1efbb90b8d7090fb17b4946cc7b84e1915b57995bf3536f2559e55 checkpoints/reward_preview/ckpt.safetensors | |
| 0a9dd840ab4d8c0c91927f8b53a24981bd5f475e4fb9d4556e825593846e7d65 checkpoints/sft_only/adapter_config.json | |
| 072df399b4320b17313a64fb7c024d1f981464e9852c979f4644391e77853f2e checkpoints/sft_only/adapter_model.safetensors | |
| 62671bc8d430001734a90c33c0059e563388eba42706a5c8603704018035ae8b checkpoints/sft_only/additional_config.json | |
| c3882d05e91dd7cc4ad55d4f5d56d001c1cf028a16aa33e491a833bfb3d6583a code_support/diffusion/infer_caption.py | |
| db5e8bfe8d5ff45e0dc29dfcbdb1bab4e70febd9d66dedc46a1f6404f73224fb code_support/diffusion/infer_vace_hoi.py | |
| 48195fb1515b26d0bc6440db02d3181bd1ab536143bc44b5c251c7247b2cdc4a code_support/generator_defaults.py | |
| 2b99845ed2bdc5cdc1b78acadaca99b37af672a83e061b3f7aeb0f45dcf47d63 code_support/loader_patch.json | |
| d7449d7c527adbe7645d1ffe1942e22cc411ad7afe59a40f652ebf5da3f1daf1 code_support/model_resources.py | |
| b72278058c6afe6f3ec66cf960cc66c92187fd4ab118a6deb8630da87a73610a code_support/project_paths.py | |
| 2d1000a1f8a4ef8d1ae30a425d9e3fc23c6255bc5052bbb777508bc2489ade8f models/CLIP-ViT-H-14-laion2B-s32B-b79K/README.md | |
| 14db420f00ddf78a07194dc4cdc57977d979e0f2c34994137679046defdf6577 models/CLIP-ViT-H-14-laion2B-s32B-b79K/UPSTREAM_README.md | |
| 50150597fccadc90f3198d1c2caf2c41d88a40908c38fb428ea56c249b501d85 models/CLIP-ViT-H-14-laion2B-s32B-b79K/config.json | |
| f1cd414c2d113a28b296afc0fd66ae854c0e0c34d5de373a2f5b7f62e0c02344 models/CLIP-ViT-H-14-laion2B-s32B-b79K/merges.txt | |
| 036e6e2bd49697511f4f8b8cb5ee465f93025f7a69a145eadeb9a881ace9b18d models/CLIP-ViT-H-14-laion2B-s32B-b79K/model.safetensors | |
| 910e70b3956ac9879ebc90b22fb3bc8a75b6a0677814500101a4c072bd7857bd models/CLIP-ViT-H-14-laion2B-s32B-b79K/preprocessor_config.json | |
| f8c0d6c39aee3f8431078ef6646567b0aba7f2246e9c54b8b99d55c22b707cbf models/CLIP-ViT-H-14-laion2B-s32B-b79K/special_tokens_map.json | |
| b556ac8c99757ffb677208af34bc8c6721572114111a6e0aaf5fa69ff0b8d842 models/CLIP-ViT-H-14-laion2B-s32B-b79K/tokenizer.json | |
| e19f34ef773563fb695f96cfcae1e4c7b112ab6ad532f6962061df5242d924f0 models/CLIP-ViT-H-14-laion2B-s32B-b79K/tokenizer_config.json | |
| 5047b556ce86ccaf6aa22b3ffccfc52d391ea4accdab9c2f2407da5b742d4363 models/CLIP-ViT-H-14-laion2B-s32B-b79K/vocab.json | |
| 6d5d06e0c3f069097002445d30dce9ee107db3afaf15563f09e6df49b8dcb4d7 models/Qwen3-VL-8B-Instruct/README.md | |
| 5c72a170d2a4a1a3bc5adad2e689ae28138a9700e5b8c96c0266331e86c0acce models/Qwen3-VL-8B-Instruct/chat_template.json | |
| 5cd452860dc1e9c29dd71cc3cef7f39b338b7a40793f7a260655c2d3568f3661 models/Qwen3-VL-8B-Instruct/config.json | |
| 8469742d1fce0de951c8909b26a2c0c0d8490837ce476efb114da9e0cefc4d44 models/Qwen3-VL-8B-Instruct/generation_config.json | |
| 599bab54075088774b1733fde865d5bd747cbcc7a547c5bc12610e874e26f5e3 models/Qwen3-VL-8B-Instruct/merges.txt | |
| d5d0aef0eb170fc7453a296c43c0849a56f510555d3588e4fd662bb35490aefa models/Qwen3-VL-8B-Instruct/model-00001-of-00004.safetensors | |
| 8be88fb5501e4d5719a6d4cc212e6a13480330e74f3e8c77daa1a68f199106b5 models/Qwen3-VL-8B-Instruct/model-00002-of-00004.safetensors | |
| 83de00eafe6e0d57ccd009dbcf71c9974d74df2f016c27afb7e95aafd16b2192 models/Qwen3-VL-8B-Instruct/model-00003-of-00004.safetensors | |
| 0a88b98e9f96270973f567e6a2c103ede6ccdf915ca3075e21c755604d0377a5 models/Qwen3-VL-8B-Instruct/model-00004-of-00004.safetensors | |
| 520b2e05079402e9468a8701d03d1154d14b2599593afb6effa7fb60c1bff070 models/Qwen3-VL-8B-Instruct/model.safetensors.index.json | |
| 27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516 models/Qwen3-VL-8B-Instruct/preprocessor_config.json | |
| a5d85b6dcc535e6b93115a9ef287e6132fdbf30270da6218194ba742261173c7 models/Qwen3-VL-8B-Instruct/tokenizer.json | |
| c2da771801886ad9ae98181793ffd3dfb7f1af30f6f7c6a4e15d7dbba52e2399 models/Qwen3-VL-8B-Instruct/tokenizer_config.json | |
| 7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13 models/Qwen3-VL-8B-Instruct/video_preprocessor_config.json | |
| 149e96be859017f8ae661c1b2451dc8fa7ff7a26abb8b95b050187c78a1a4b69 models/Qwen3-VL-8B-Instruct/vocab.json | |
| c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 models/Wan2.1-VACE-1.3B/LICENSE.txt | |
| 8bf02735cc5814884d807fb3394ae269050daf72078793936342bc39a9afe122 models/Wan2.1-VACE-1.3B/README.md | |
| 38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981 models/Wan2.1-VACE-1.3B/Wan2.1_VAE.pth | |
| e19df24acf3f440e0aea37d299f22b96f88d164f3349ae696daecd960a35ab1e models/Wan2.1-VACE-1.3B/config.json | |
| 7b8a9f5040adb67b5805abdfd42c1f8d0f3d0e711f10726580eb3789cd0ad61d models/Wan2.1-VACE-1.3B/google/umt5-xxl/special_tokens_map.json | |
| e3909a67b780650b35cf529ac782ad2b6b26e6d1f849d3fbb6a872905f452458 models/Wan2.1-VACE-1.3B/google/umt5-xxl/spiece.model | |
| 6e197b4d3dbd71da14b4eb255f4fa91c9c1f2068b20a2de2472967ca3d22602b models/Wan2.1-VACE-1.3B/google/umt5-xxl/tokenizer.json | |
| ed9a3a8b0faa71a70a32847e0435fe036e6e112d4df4edb7bb48a921e344dc05 models/Wan2.1-VACE-1.3B/google/umt5-xxl/tokenizer_config.json | |
| 4e31340625635eea1f0d0935e5ff1a3e47689cb38088ad40b1dcd06add1bc0c5 models/Wan2.1-VACE-1.3B/model_components.json | |
| 9e230513fc75b9ca1f432d1f6ef92a7416ff2e0e02f20ef50d6bc789b6d40747 models/Wan2.1-VACE-1.3B/text_encoder/README.md | |
| 19455304c63fe471f7241a6785ef804b8012edd8ce9f30c74e8825f03413c96b models/Wan2.1-VACE-1.3B/text_encoder/model-00001-of-00003.safetensors | |
| 5cbed706d3edd448e4d32188892cd87ed8a1223207d2482d09a40ca4cfbed6ab models/Wan2.1-VACE-1.3B/text_encoder/model-00002-of-00003.safetensors | |
| e56bfcc518f43f1fd83727e673cc121a171594082fc9e14164179363fbccc182 models/Wan2.1-VACE-1.3B/text_encoder/model-00003-of-00003.safetensors | |
| 8322567493a4f08dce5d97f8621a2896a5ed1b72e0865371e3339599e077ebb2 models/Wan2.1-VACE-1.3B/text_encoder/model.safetensors.index.json | |
| bb026f9ab21f4ab694f072201203d9c456c0a932381d490d4d3b39fb4f77cc40 models/Wan2.1-VACE-1.3B/text_encoder/reshard_manifest.json | |
| 90bd23f138e69e6099f7634993b32ed066fe92a604b396a9387bf6d167017839 models/Wan2.1-VACE-1.3B/transformer/README.md | |
| 3b611c672b94037e07d90c4374e5b17eea45a5abe4a090f2875b67dd120a83d2 models/Wan2.1-VACE-1.3B/transformer/diffusion_pytorch_model-00001-of-00002.safetensors | |
| 4dff7356c1b66cb9519ab669a78f46e7a03eb5aca60c3588348f5d4285495e8f models/Wan2.1-VACE-1.3B/transformer/diffusion_pytorch_model-00002-of-00002.safetensors | |
| b6e35916452ede069646051df78656ff577474db05d4bfc435b81f18fdeebb7d models/Wan2.1-VACE-1.3B/transformer/diffusion_pytorch_model.safetensors.index.json | |
| 93d16bdae394ebbd94bad8da1b385b8a1e655878821572e314fa16a15e859c63 models/Wan2.1-VACE-1.3B/transformer/reshard_manifest.json | |
| 7c6f40d2ae7126dd35e92e29d38bb47c459318711fdb26ba72201f5cd82fcaf7 native_reader_validation.json | |
| ff13d7f409c6392a00f3dfcb42c32fccb11c77b4ad2f721e276fe96513017bbf research/caption_dpo/epoch-2.safetensors | |
| 522d9ff9e721ab7ee9a7272a6dfbdf0aaedb1c6c4e8f5fa1d9b27ac73ba0fad0 research/joint_branch/epoch-3.safetensors | |
| 4cd0d08b16782c7ca3566db23d378b206880203f013b3c017791712aa66d0704 research/mask_predictor_paperalign/epoch-4.pt | |
| a112106d5a2bd851c3a635ac752268aa8154a1eab5101d4ee762f97f64fa3b1a research/native_narr_dit/epoch-4.safetensors | |
| f6abd392ec7b18e182c1e4c0e840794aa29c629036b290c013fe6ee4c0df1de4 research/vlm_comparison/epoch-0.safetensors | |
| 02c24bf6017a2450411d6a6056b6004107b453239b3c61c5f729a6f31e84f9be tools/attach_model_bundle.py | |
| 45dd80eda5ebd3a4545678a4567eb702fac1631a6a830fec07cf708c35d41a46 tools/prepare_egoexo_model_bundle.py | |
| cab58ac00a4acda90cda76cf00cf9e3f7bb8e883b596653db6ee4efec81d7034 tools/reshard_weights.py | |
| caf3c1f8a36bd4d4fa3e4327438dc22a962cb7b43369254e235f74c926cd4832 tools/tests/test_attach_model_bundle.py | |
| 16162f1dc790a511a797a1f4b4ec9d402ea08c8579db005bee128ed5368533ce tools/tests/test_model_resources.py | |
| e16945ecb5331cc97730bc6f3a704dfc2f50e69501c61ada177d06bdce347ea9 tools/tests/test_reshard_weights.py | |
| c602d4305f59c388105765835b3b7d9cacf2181e8494014fea7f0dc57e728cb8 tools/verify_model_bundle.py | |
| c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 LICENSES/Apache-2.0.txt | |
| 4a5b4f13ea4792a8211a69f32d2b460b6d520e57cd23c6301e707c76a6e97a55 LICENSES/MIT-OpenCLIP.txt | |
| 04a70a4302ad5ce449684fc43968bde65420dae210ba0ccb55d9f5bbd908b272 LICENSES/UPSTREAM.md | |
| 2569cdcdb30128ffb7d1f178a2669580ead36e532f9f8c65a67f0f25c543caaf TRAINING_DATA_INDEX.json | |
| 67acb0f58a052ce7fd309e50cdaf473a9880bc31a8d1c7f68212d528088d275c tools/fetch_training_data.py | |
| 4cd8ba59a93ab631419f29b61153ab8024cc7392f81fca1e0470c400144c8826 tools/restore_legacy_mix6.py | |
| 7ca67b923529b5bffcb1d9cef166e1a12439f0156720b3d8044966c2dd022115 bundle_manifest.json | |