Instructions to use Orange-3DV-Team/Gimbal360 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Orange-3DV-Team/Gimbal360 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-Fill-dev", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("Orange-3DV-Team/Gimbal360") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
Gimbal360
Single-image 360° panorama generation from an arbitrary perspective photograph.
Code: https://github.com/Orange-3DV-Team/Gimbal360
Model Weights
| File | Size | Description |
|---|---|---|
autolevel.pth |
107 MB | Geometry estimation model combining a pretrained SegNeXt-B backbone with a trained flow decoder and rigid filter. Estimates camera FOV, pitch, and roll from a single perspective image. |
pytorch_lora_weights.safetensors |
171 MB | Fine-tuned panorama-generation LoRA weights for FLUX.1-Fill-dev. |
Usage
The inference script downloads both weights automatically from this repository:
git clone https://github.com/Orange-3DV-Team/Gimbal360.git
cd Gimbal360
pip install -r requirements.txt
python inference.py \
--image example/example.png \
--prompt "a frozen, abandoned train car in a post-apocalyptic wasteland." \
--resolution 960
Weights can also be fetched manually:
hf download Orange-3DV-Team/Gimbal360
Pipeline
- AutoLevel (
autolevel.pth) estimates the camera parameters (FOV / pitch / roll) of the input photo. - The photo is projected onto an equirectangular canvas as conditioning, with an inpaint mask for the unknown regions.
- FLUX.1-Fill-dev + LoRA (
pytorch_lora_weights.safetensors) inpaints the full 360° panorama.
License
The LoRA weights are a derivative of FLUX.1-Fill-dev and are released under the FLUX.1-dev Non-Commercial License.
- Downloads last month
- -
Model tree for Orange-3DV-Team/Gimbal360
Base model
black-forest-labs/FLUX.1-Fill-dev