--- license: mit tags: - comfyui - stable-diffusion-xl - controlnet - ipadapter - clip-vision - vae - upscale - inpaint --- # ComfyUI Model Collection (SDXL) A curated collection of models for **ComfyUI** workflows, focused on SDXL-based image generation. Includes ControlNet, IPAdapter, CLIP Vision, VAE, inpainting, upscaling, and detection models. --- ## 📁 Repository Structure ``` ├── clip_vision/ # CLIP Vision encoders for IPAdapter ├── controlnet/SDXL/ # ControlNet models for SDXL ├── inpaint/ # Inpainting models ├── ipadapter/SDXL/ # IPAdapter models for SDXL ├── sams/ # SAM (Segment Anything) models ├── ultralytics/ │ ├── bbox/ # Bounding box detection models (YOLO) │ └── segm/ # Segmentation models (YOLO) ├── upscale_models/ # Image upscaling models └── vae/SDXL/ # VAE models for SDXL ``` --- ## 🧩 Models Included ### CLIP Vision | File | Description | |------|-------------| | `clip-vision_vit-h.safetensors` | ViT-H CLIP Vision encoder | | `CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors` | BigG CLIP Vision (large) | | `CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors` | ViT-H CLIP Vision (laion2B) | | `clip_vision_g.safetensors` | CLIP Vision G encoder | ### ControlNet (SDXL) | File | Description | |------|-------------| | `controlnet-union-sdxl-1.0-promax.safetensors` | Union ControlNet (multi-purpose) | | `control-lora-canny-rank256.safetensors` | Canny edge detection | | `control-lora-depth-rank256.safetensors` | Depth map | | `noob-sdxl-controlnet-*.fp16.safetensors` | NoobAI SDXL ControlNet series (canny, depth, lineart, normal, scribble, softedge, tile) | | `noobaiXLControlnet_openposeModel.safetensors` | OpenPose | | `IllustriousXL_openpose.safetensors` | OpenPose (IllustriousXL) | | `OpenPoseXL2.safetensors` | OpenPose XL v2 | | `AnytestV4.safetensors` | Anytest v4 base model | | `fabricatedXL_v70.safetensors` | FabricatedXL v7.0 | | `waiIllustriousSDXL_v160.safetensors` | Wai IllustriousSDXL v1.6 | | `noobaiInpainting_v10.safetensors` | NoobAI Inpainting | ### IPAdapter (SDXL) | File | Description | |------|-------------| | `ip-adapter-plus_sdxl_vit-h.safetensors` | IPAdapter Plus | | `ip-adapter-faceid-plusv2_sdxl.bin` | FaceID Plus v2 | | `ip-adapter-faceid-portrait_sdxl.bin` | FaceID Portrait | | `ip-adapter-faceid-portrait_sdxl_unnorm.bin` | FaceID Portrait (unnormalized) | | `ip-adapter-faceid_sdxl.bin` | FaceID base | | `noobIPAMARK1_mark1.safetensors` | NoobAI IPAdapter Mark1 | ### Inpaint | File | Description | |------|-------------| | `inpaint_v26.fooocus.patch` | Fooocus inpaint patch v2.6 | | `fooocus_inpaint_head.pth` | Fooocus inpaint head | | `MAT_Places512_G_fp16.safetensors` | MAT inpainting model | ### SAM (Segment Anything) | File | Description | |------|-------------| | `sam_vit_b_01ec64.pth` | SAM ViT-B | ### Ultralytics — BBox Detection | File | Description | |------|-------------| | `face_yolov8m.pt` | Face detection (YOLOv8m) | | `face_yolov9c.pt` | Face detection (YOLOv9c) | | `hand_yolov9c.pt` | Hand detection (YOLOv9c) | | `femaleBodyDetection_yolo26.pt` | Body detection | | `Eyeful_v2-Paired.pt` | Eye detection | ### Ultralytics — Segmentation | File | Description | |------|-------------| | `face_yolov8m-seg_60.pt` | Face segmentation | | `person_yolov8m-seg.pt` | Person segmentation | | `femaleBodyDetection_typea.pt` | Body segmentation | | `yolo11m-seg.pt` | General segmentation (YOLO11m) | ### Upscale Models | File | Description | |------|-------------| | `4x_foolhardy_Remacri.pth` | 4x upscale (Remacri) | | `4x-AnimeSharp.pth` | 4x anime upscale | | `4x_NMKD-Superscale-SP_178000_G.pth` | 4x NMKD Superscale | | `2x_APISR_RRDB_GAN_generator.pth` | 2x APISR upscale | | `4x_APISR_GRL_GAN_generator.pth` | 4x APISR GRL upscale | | `OmniSR_X2/X3/X4_DIV2K.safetensors` | OmniSR upscale (2x/3x/4x) | ### VAE (SDXL) | File | Description | |------|-------------| | `sdxl_vae.safetensors` | Standard SDXL VAE | | `illustriousXLV10_v10.safetensors` | IllustriousXL VAE | --- ## 🚀 How to Use with ComfyUI Place models in the corresponding ComfyUI folders: ``` ComfyUI/models/ ├── clip_vision/ ← clip_vision/* ├── controlnet/ ← controlnet/SDXL/* ├── inpaint/ ← inpaint/* ├── ipadapter/ ← ipadapter/SDXL/* ├── sams/ ← sams/* ├── ultralytics/ ← ultralytics/bbox/* and ultralytics/segm/* ├── upscale_models/ ← upscale_models/* └── vae/ ← vae/SDXL/* ``` Or download with `huggingface-cli`: ```bash huggingface-cli download danaidesign/comfyui --local-dir ./ComfyUI/models ```