Flux2-dev-controlnet-lora-weights / test_single_gpu_20260415_165338.log
JasonXF's picture
Add files using upload-large-folder tool
eb730e7 verified
Raw
History Blame Contribute Delete
2.51 kB
Run dir : output/_smoke_test_1gpu
Log file: output/_smoke_test_1gpu/train.log
GPU: NVIDIA GeForce RTX 5090 | VRAM: 31.4 GiB | PyTorch: 2.11.0+cu130
Final Configuration:
Paths:
transformer_path weights/flux2_dev_fp8mixed.safetensors
vae_path weights/flux2-vae.safetensors
controlnet_path weights/FLUX.2-dev-Fun-Controlnet-Union-2602.safetensors
dataset_dir dataset
color_map_path configs/color_map.json
output_dir output/_smoke_test_1gpu
text_encoder_path weights/mistral_3_small_flux2_fp8.safetensors
precomputed_embeddings output/text_embeddings_global.pt
Model:
image_size 1024
num_classes 6
control_in_dim 3072
fusion_dim 768
num_fusion_blocks 3
num_heads 12
num_fourier_bands 32
boundary_threshold 0.1
Training:
num_epochs 1
batch_size 4
learning_rate 0.0003
weight_decay 0.01
max_grad_norm 1.0
grad_accum_steps 4
guidance_scale 3.5
num_workers 0
Text Encoder:
text_seq_len 512
text_dim 15360
Logging:
log_interval 1
save_every_n_epochs 5
val_every_n_epochs 1
WandB:
wandb_entity
wandb_project _smoke_test_1gpu
Resume:
resume_from (not set)
[MEM @ pre-flight] RAM: 10.7/188.5 GiB (5.7%) | VRAM: 0.0/31.4 GiB (0.0%)
============================================================
[1/8] Text Embeddings
============================================================
Composed prompt (575 chars):
Aerial top-down satellite view of American urban area, Google Earth style, 8k resolution, photorealistic satellite imagery, natural daylight, buildings: detaile...
=== Precomputing Global Text Embedding ===
Prompt: Aerial top-down satellite view of American urban area, Google Earth style, 8k resolution, photorealistic satellite image...
Loading safetensors: weights/mistral_3_small_flux2_fp8.safetensors
Building tokenizer from embedded tekken_model ...
Detected: 30 layers, hidden=5120, heads=32, kv_heads=8, ffn=32768, vocab=131072
Initialising MistralModel (30 layers)...