2025-07-16 10:36:41,644 - INFO - Starting Dimensionality Reduction Suite
2025-07-16 10:36:41,645 - INFO - Loading datasets for dimensionality reduction analysis
2025-07-16 10:36:41,647 - INFO - Iris dataset loaded: (150, 4) features, 3 classes
2025-07-16 10:36:41,656 - INFO - Digits dataset loaded: (1797, 64) features, 10 classes
2025-07-16 10:36:41,658 - INFO - Data standardization completed
2025-07-16 10:36:41,658 - INFO - === APPLYING PCA ===
2025-07-16 10:36:41,658 - INFO - Applying PCA to iris dataset
2025-07-16 10:36:41,661 - INFO - PCA completed for iris
2025-07-16 10:36:41,661 - INFO - Explained variance per component: [0.72962445 0.22850762]
2025-07-16 10:36:41,661 - INFO - Cumulative explained variance: [0.72962445 0.95813207]
2025-07-16 10:36:41,662 - INFO - Applying PCA to digits dataset
2025-07-16 10:36:41,670 - INFO - PCA completed for digits
2025-07-16 10:36:41,671 - INFO - Explained variance per component: [0.12033916 0.09561054]
2025-07-16 10:36:41,672 - INFO - Cumulative explained variance: [0.12033916 0.21594971]
2025-07-16 10:36:41,672 - INFO - === APPLYING t-SNE ===
2025-07-16 10:36:41,673 - INFO - Applying t-SNE to iris dataset with perplexity=30
2025-07-16 10:36:42,159 - INFO - t-SNE completed for iris
2025-07-16 10:36:42,159 - INFO - Final KL divergence: 0.14698290824890137
2025-07-16 10:36:42,159 - INFO - Applying t-SNE to digits dataset with perplexity=30
2025-07-16 10:36:43,689 - INFO - t-SNE completed for digits
2025-07-16 10:36:43,690 - INFO - Final KL divergence: 0.8376309275627136
2025-07-16 10:36:43,690 - INFO - === APPLYING UMAP ===
2025-07-16 10:36:43,691 - INFO - Applying UMAP to iris dataset with n_neighbors=15
2025-07-16 10:36:46,402 - INFO - UMAP completed for iris
2025-07-16 10:36:46,403 - INFO - Applying UMAP to digits dataset with n_neighbors=15
2025-07-16 10:36:48,356 - INFO - UMAP completed for digits
2025-07-16 10:36:48,356 - INFO - === APPLYING AUTOENCODER ===
2025-07-16 10:36:48,356 - INFO - Training autoencoder for iris dataset
2025-07-16 10:36:48,357 - INFO - Input dimension: 4, Encoding dimension: 2
2025-07-16 10:36:49,110 - INFO - Epoch 20/50, Loss: 0.314444
2025-07-16 10:36:49,122 - INFO - Epoch 40/50, Loss: 0.169524
2025-07-16 10:36:49,140 - INFO - Autoencoder training completed for iris
2025-07-16 10:36:49,140 - INFO - Final reconstruction loss: 0.081181
2025-07-16 10:36:49,143 - INFO - Training autoencoder for digits dataset
2025-07-16 10:36:49,144 - INFO - Input dimension: 64, Encoding dimension: 10
2025-07-16 10:36:49,215 - INFO - Epoch 20/100, Loss: 0.856640
2025-07-16 10:36:49,266 - INFO - Epoch 40/100, Loss: 0.649845
2025-07-16 10:36:49,316 - INFO - Epoch 60/100, Loss: 0.515600
2025-07-16 10:36:49,363 - INFO - Epoch 80/100, Loss: 0.427001
2025-07-16 10:36:49,408 - INFO - Epoch 100/100, Loss: 0.348234
2025-07-16 10:36:49,409 - INFO - Autoencoder training completed for digits
2025-07-16 10:36:49,410 - INFO - Final reconstruction loss: 0.348234
2025-07-16 10:36:49,410 - INFO - === EVALUATING METHODS ===
2025-07-16 10:36:49,410 - INFO - Evaluating PCA performance on iris dataset
2025-07-16 10:36:49,511 - INFO - Original data accuracy: 0.8889
2025-07-16 10:36:49,511 - INFO - Reduced data accuracy: 0.8667
2025-07-16 10:36:49,512 - INFO - Accuracy retention: 97.50%
2025-07-16 10:36:49,512 - INFO - Evaluating TSNE performance on iris dataset
2025-07-16 10:36:49,604 - INFO - Original data accuracy: 0.8889
2025-07-16 10:36:49,604 - INFO - Reduced data accuracy: 0.9333
2025-07-16 10:36:49,604 - INFO - Accuracy retention: 105.00%
2025-07-16 10:36:49,605 - INFO - Evaluating UMAP performance on iris dataset
2025-07-16 10:36:49,697 - INFO - Original data accuracy: 0.8889
2025-07-16 10:36:49,698 - INFO - Reduced data accuracy: 0.9111
2025-07-16 10:36:49,698 - INFO - Accuracy retention: 102.50%
2025-07-16 10:36:49,698 - INFO - Evaluating PCA performance on digits dataset
2025-07-16 10:36:49,920 - INFO - Original data accuracy: 0.9685
2025-07-16 10:36:49,920 - INFO - Reduced data accuracy: 0.5074
2025-07-16 10:36:49,920 - INFO - Accuracy retention: 52.39%
2025-07-16 10:36:49,921 - INFO - Evaluating TSNE performance on digits dataset
2025-07-16 10:36:50,117 - INFO - Original data accuracy: 0.9685
2025-07-16 10:36:50,117 - INFO - Reduced data accuracy: 0.9722
2025-07-16 10:36:50,117 - INFO - Accuracy retention: 100.38%
2025-07-16 10:36:50,118 - INFO - Evaluating UMAP performance on digits dataset
2025-07-16 10:36:50,325 - INFO - Original data accuracy: 0.9685
2025-07-16 10:36:50,326 - INFO - Reduced data accuracy: 0.9611
2025-07-16 10:36:50,326 - INFO - Accuracy retention: 99.24%
2025-07-16 10:36:50,326 - INFO - Creating comprehensive visualizations
2025-07-16 10:36:51,350 - INFO - All visualizations saved to visualizations/ directory
2025-07-16 10:36:51,351 - INFO - Saving trained models
2025-07-16 10:36:51,360 - INFO - Saving results summary
2025-07-16 10:36:51,361 - INFO - === FINAL SUMMARY ===
2025-07-16 10:36:51,362 - INFO - Iris Dataset - PCA Explained Variance: [0.72962445 0.22850762]
2025-07-16 10:36:51,362 - INFO - Digits Dataset - PCA Explained Variance: [0.12033916 0.09561054]
2025-07-16 10:36:51,363 - INFO - 
IRIS Dataset Classification Performance:
2025-07-16 10:36:51,363 - INFO -   PCA: 97.50% accuracy retention
2025-07-16 10:36:51,363 - INFO -   TSNE: 105.00% accuracy retention
2025-07-16 10:36:51,363 - INFO -   UMAP: 102.50% accuracy retention
2025-07-16 10:36:51,363 - INFO - 
DIGITS Dataset Classification Performance:
2025-07-16 10:36:51,364 - INFO -   PCA: 52.39% accuracy retention
2025-07-16 10:36:51,364 - INFO -   TSNE: 100.38% accuracy retention
2025-07-16 10:36:51,364 - INFO -   UMAP: 99.24% accuracy retention
2025-07-16 10:36:51,365 - INFO - 
All models saved to models/ directory
2025-07-16 10:36:51,365 - INFO - All results saved to results/ directory
2025-07-16 10:36:51,365 - INFO - All visualizations saved to visualizations/ directory
2025-07-16 10:36:51,366 - INFO - Dimensionality Reduction Suite completed successfully!