Devserhii's picture
Document RealVisXL provenance, conversion, and runtime settings
3c6fc64 verified
|
Raw
History Blame Contribute Delete
2.98 kB
---
license: openrail++
base_model: SG161222/RealVisXL_V5.0_Lightning
library_name: coreml
tags:
- coreml
- stable-diffusion-xl
- text-to-image
- image-to-image
- ios
- localmuse
---
# RealVisXL V5.0 Lightning — 6-bit split Core ML
Self-contained, compiled SDXL package prepared for on-device use by the LocalMuse iOS app. The repository stays private until the artifact manifest and anonymous downloads are verified.
## Provenance
- Source UNet: [`SG161222/RealVisXL_V5.0_Lightning`](https://huggingface.co/SG161222/RealVisXL_V5.0_Lightning)
- Pinned source revision: `f4454158cedaab9f0688c199561d6c92525f3a85`
- Source fp16 UNet LFS SHA-256: `1143cd2aaf65d24af34b5699d090aed724f6c0978c2ec5a5f56821ccb36260ce`
- License: CreativeML Open RAIL++-M (`LICENSE.md`), inherited from the source model and SDXL base.
The RealVisXL UNet was converted from the pinned source above. The text encoders, VAE encoder/decoder, tokenizer vocabulary, and merges are standard SDXL components reused byte-for-byte from [`LocalMuseAI/coreml-dreamshaper-xl-lightning-6bit`](https://huggingface.co/LocalMuseAI/coreml-dreamshaper-xl-lightning-6bit) revision `736408cecf59b3b81a8b2a900cdd5dbf94c34c2a`. Only the UNet contains RealVisXL-specific weights.
## Conversion
- Apple converter: [`apple/ml-stable-diffusion`](https://github.com/apple/ml-stable-diffusion) revision `e12202c1f6405b83918b58a5d097cd61e3e1f702`
- PyTorch `2.4.0`
- coremltools `8.0`
- Diffusers `0.30.2`
- Transformers `4.44.2`
- huggingface_hub `0.24.6`
- NumPy `1.23.5`
- Resolution: fixed `1024 × 1024` (`128 × 128` latent)
- Classifier-free-guidance batch: `2`
- Attention implementation: `SPLIT_EINSUM`
- UNet storage: mixed Float16 and 6-bit palettized weights
- Minimum Core ML deployment target: iOS 17
- UNet split into two independently compiled chunks below 1 GiB each
The source model's fp16 UNet was loaded directly without downloading unrelated full-precision weights, converted through Apple's Stable Diffusion implementation, palettized before chunking, bisected with coremltools, and compiled with `xcrun coremlc`.
## Runtime settings
The source model card recommends 5 inference steps, CFG 1–2, and a DPM++ SDE Karras scheduler. LocalMuse uses:
- Steps: `5`
- CFG: `1.5`
- Scheduler: second-order DPM-Solver++ multistep
- Timestep spacing: Karras
- Batch size: `1` image (the UNet internally uses batch 2 for CFG)
- UNet: Neural Engine preferred
- VAE: GPU preferred
- Minimum device memory exposed by the app: 8 GiB
## Verification
Both chunks compile successfully with Xcode `coremlc`. Their named input/output feature sets and tensor shapes match the SDXL split-UNet contract already used by LocalMuse. The model is distributed as direct authenticated files; the app pins every URL to a repository commit and verifies the exact SHA-256 and byte count before installation.
Real-device image quality and thermal behavior should still be validated before shipping a production App Store build.