metadata
pipeline_tag: image-to-image
library_name: diffusers
license: mit
F-ViTA: Foundation Model Guided Visible to Thermal Translation
This repository contains the model described in the paper F-ViTA: Foundation Model Guided Visible to Thermal Translation.
F-ViTA leverages foundation models (SAM and Grounded DINO) to guide the visible-to-thermal image translation process using an InstructPix2Pix diffusion model. This approach improves translation accuracy and generalizes well to out-of-distribution scenarios.
Code: https://github.com/jay-jnp/F-ViTA
Pre-trained checkpoints are available for several datasets: