Spaces:
Sleeping
Sleeping
Commit History
-
fix: correct DATASETS dict, genimage->download_genimage_subset
0dadee8
-
fix: append missing DATASETS dict and __main__ block (truncation bug)
06a9c4f
-
fix: append missing DATASETS dict and __main__ block (truncation bug)
ccacb07 -
fix: rewrite diffusiondb/genimage downloaders to use working sources
diffusiondb: switched from load_dataset (broken loading script) to direct HTTP zip download of part-000001..005.zip files (~5000 full-res SD images) genimage: replaced with Defactify MS-COCOAI dataset (Parquet, no loading script) -- SD3/SD2.1/SDXL/DALL-E3/MidJourney at matched resolutions040db50 -
fix: restore missing DATASETS dict and __main__ block in download_ai.py
4fe90b6 -
fix: remove trust_remote_code, use Parquet configs for DiffusionDB/GenImage
datasets>=2.x dropped support for loading scripts. DiffusionDB now uses large_random_1k Parquet config. GenImage tries two repo names with graceful fallback. Both functions skip images < 256px to avoid tiny thumbnails polluting the training data.cde260f
-
fix: use as_posix() for manifest paths to avoid Windows backslash bug
str(path.relative_to(ROOT)) produces backslashes on Windows which break path resolution on Linux (HuggingFace). Fixed all download scripts to use .as_posix() which always writes forward slashes. Also fixed train_embedding.py to use Path(row['path']) which handles both slash styles. Added fix_manifest_paths.py to repair existing manifests.ee6c080
-
fix: replace unicode box-drawing chars that crash Windows cp1252
retrain_all.py, download_ai.py, download_real.py all used Unicode box-drawing/icon characters (U+2500, U+2501, U+2717 etc) which crash on Windows terminals using cp1252 encoding. Replaced all with plain ASCII equivalents. Also added PYTHONUTF8=1 env var to child process env in retrain_all.py so any remaining unicode in subprocess output is handled correctly.011009f
-
fix(test+frontend+scripts): methods count, 25->26, logo, script cleanup
test_advanced_ensemble.py: Update methods_used assertion 7->8 (own_embedding was added) frontend/index.html: Fix all 3 remaining '25 signals' -> '26 signals' (lines 1040, 1154, 1187) Fix '7 methods' -> '8 methods' Logo fix: src='logo2.png' -> GitHub raw URL so it works on GitHub Pages (.gitattributes routes *.png through Xet storage so local path fails on GitHub Pages; raw.githubusercontent.com serves the actual file) scripts/extract_features.py: Critical: filter split=='train' not split=='val' (train/eval leakage fix) Remove unused json import scripts/download_real_images.py: remove unused annotations_url variable scripts/build_clip_database.py: fix 2 bare f-strings (emoji lines) scripts/datasets/download_ai.py: remove unused zipfile, shutil importsd2665f0
-
Merge branch 'main' into feature/platform-forensics
fd86c49 -
feat(platform): invariant tests + pyflakes cleanup
- platform_detector.py: JPEG quantization fingerprinting for WhatsApp/Instagram/ Discord/Telegram/Twitter-X/Facebook; PNG -> original fallback - analyze.py: POST /api/v1/analyze/platform endpoint - test_platform_detector.py: 9 tests - test_invariants.py: 14 property-based invariant tests - pyflakes: remove dead assignments and unused imports in service files6ecfe4f
-
fix: audit pass — unused imports, None crash guard, emojis, accuracy claims, broken f-strings
206dd1a
-
feat: add dataset download scripts for real and AI sources
- download_real.py: COCO, DIV2K, Unsplash (automated), RAISE (manual guide) - download_ai.py: CIFAKE, StyleGAN faces, DiffusionDB, GenImage via HuggingFace - index_manual.py: index any manually downloaded folder into manifest.csv - All scripts write directly to manifest.csv with correct labels and splits - Resume support on interrupted downloads42f3067