SDXL 360 Diffusion
General
SDXL 360 Diffusion is a 3.5 billion parameter model designed to generate 360 degree spherical images from text descriptions.
The model was trained from the SD-XL 1.0-base model on an extremely diverse dataset composed of tens of thousands of equirectangular images, depicting landscapes, interiors, humans, animals, and objects. All images were resized to 2048x1024 before training.
Given the right prompt, the model should be capable of producing almost anything you want.
Usage
The trigger phrase is "equirectangular 360 view", "360 panorama", or some variation of those words in your prompt.
When rendering images, it's recommended that you choose a 2:1 aspect ratio, such as 1024x512, 1536x768, or 2048x1024. Afterwards, you can use an upscaler of your choosing to make the resolution high enough for sky-boxes, backgrounds, VR, VR therapy, and 3D worlds.
Additional Tools
HTML 360 Viewer
To make the viewing and sharing of 360 images & video easier, I built a web browser based HTML 360 viewer that runs locally on your device.
• You can try it out here on Github Pages: https://progamergov.github.io/html-360-viewer/
• Github code: https://github.com/ProGamerGov/html-360-viewer
• You can append '?url=' followed by a link to your image in order to automatically load it into the 360 viewer, making sharing your 360 creations extremely easy.
• Example: https://progamergov.github.io/html-360-viewer/?url=https://upload.wikimedia.org/wikipedia/commons/7/76/Dauderi.jpg
Recommended ComfyUI Nodes
If you are a user of ComfyUI, then these sets of nodes can be useful for working with 360 images & videos.
• ComfyUI_preview360panorama
• For viewing 360s inside of ComfyUI (may be slower than my web browser viewer).
• Link: https://github.com/ProGamerGov/ComfyUI_preview360panorama
• ComfyUI_pytorch360convert
• For editing 360s, applying circular Conv2d padding, and masking potential artifacts.
• Link: https://github.com/ProGamerGov/ComfyUI_pytorch360convert
F