Diffusion based Interior Customisation for VR Home Tours

Explore VR interior customization using diffusion models. See how users can style apartments with Controlnets and LoRAs, maintaining layout while changing aesthetics. Live demos showcase practical applications.

Overview

This project uses a Flux1.dev diffusion model to customise the look of an apartment in a VR Home Tour. The user can pick a style of their choice (Modern, Minimalist, Boho, etc) and the apartment will be styled to match the user’s preferences while maintaining the same structure and dimensions. The approach uses Controlnets and LoRAs to create conditioning based on the original apartment layout and then styles the image based on a prompt.

Tech stack