SD3 now supports ControlNet on Comfy UI! via /r/comfyui

SD3 now supports ControlNet on Comfy UI!

Hi everyone, ControlNet for SD3 is available on Comfy UI! Please read the instructions below:

1- In order to use the native 'ControlNetApplySD3' node, you need to have the latest Comfy UI, so update your Comfy UI.

2- Right now, there are 3 known ControlNet models, created by Instant-X team: Canny, Pose and Tile. This example is for Canny, but you can use the others as well.

Canny:  https://huggingface.co/InstantX/SD3-Controlnet-Canny/blob/main/diffusion_pytorch_model.safetensors

Pose:  https://huggingface.co/InstantX/SD3-Controlnet-Pose/blob/main/diffusion_pytorch_model.safetensors

Tile:  https://huggingface.co/InstantX/SD3-Controlnet-Tile/blob/main/diffusion_pytorch_model.safetensors

Example workflow: https://openart.ai/workflows/sg2IeIOwngVOqZ6Rc5is

Thanks to the ComfyOrg & Instant-X teams!

(Please let me know if anything is missing or inaccurate)

P.s: you might need to adjust your 'strength' and 'threshold' parameters for getting the best results.

Submitted June 28, 2024 at 06:24AM by sktksm
via reddit https://www.reddit.com/r/comfyui/comments/1dqidz2/sd3_now_supports_controlnet_on_comfy_ui/?utm_source=ifttt