Spaces:
Sleeping
Sleeping
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,15 +1,63 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# 👗 Atelier d'AI: A Neural Fashion Search Engine
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
|
| 4 |
-
An ode to the "fashion girlies" and the timeless elegance of Chanel, Dior, and LV. This engine uses **Deep Metric Learning** to understand style silhouettes beyond simple keywords.
|
| 5 |
|
| 6 |
-
##
|
| 7 |
-
|
| 8 |
-
- **Engine:** OpenCLIP + PyTorch
|
| 9 |
-
- **Vector DB:** FAISS (Facebook AI Similarity Search)
|
| 10 |
-
- **UI:** Streamlit in a Docker Container
|
| 11 |
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
2. The AI extracts a 768-dimensional "Style Vector".
|
| 15 |
-
3. FAISS performs a Nearest Neighbor search to find the most elegant match.
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: 👗 Atelier d'AI
|
| 3 |
+
emoji: ✨
|
| 4 |
+
colorFrom: yellow
|
| 5 |
+
colorTo: indigo
|
| 6 |
+
sdk: docker
|
| 7 |
+
pinned: true
|
| 8 |
+
tags:
|
| 9 |
+
- fashion
|
| 10 |
+
- computer-vision
|
| 11 |
+
- clip
|
| 12 |
+
- quiet-luxury
|
| 13 |
+
- vector-search
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
# 👗 Atelier d'AI: A Neural Fashion Search Engine
|
| 17 |
+
### *An Ode to High Fashion, Paris Runway, and the 'Quiet Luxury' Aesthetic*
|
| 18 |
+
|
| 19 |
+
**Atelier d'AI** is a sophisticated recommendation system designed for the "fashion girlies" who appreciate the timeless elegance of Dior, Chanel, and Louis Vuitton. Unlike traditional search engines that rely on keywords, this project utilizes **Deep Metric Learning** to understand the "DNA" of a garment—its silhouette, texture, and vibe.
|
| 20 |
+
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
## 🚀 The Technical Vision
|
| 24 |
+
To move from "Emily in Paris" kitsch to high-fashion sophistication, the system moves beyond simple color matching. It uses a **two-stage AI pipeline**:
|
| 25 |
+
|
| 26 |
+
1. **Semantic Encoding:** Leveraging **Marqo-FashionSigLIP**, a Vision Transformer (ViT) fine-tuned on luxury fashion datasets. It maps images and text into a shared 768-dimensional vector space.
|
| 27 |
+
2. **Vector Retrieval:** Utilizing **FAISS (Facebook AI Similarity Search)** for lightning-fast nearest neighbor retrieval.
|
| 28 |
+
|
| 29 |
+
[Image of a deep learning-based fashion recommendation system architecture including feature extraction and similarity matching]
|
| 30 |
+
|
| 31 |
+
---
|
| 32 |
+
|
| 33 |
+
## 🛠️ Tech Stack & Architecture
|
| 34 |
+
* **Neural Backbone:** `OpenCLIP` + `Marqo-FashionSigLIP` (Sigmoid Loss-Image Language Pre-training)
|
| 35 |
+
* **Vector Database:** `FAISS` (IndexFlatIP for Cosine Similarity)
|
| 36 |
+
* **Infrastructure:** `Docker` (ensuring environment parity for production)
|
| 37 |
+
* **Frontend:** `Streamlit` with a custom "Luxury Dark" CSS theme
|
| 38 |
+
|
| 39 |
+
---
|
| 40 |
+
|
| 41 |
+
## 💎 Features
|
| 42 |
+
* **Visual Inspiration Search:** Upload a Pinterest moodboard or a runway snap to find pieces with a similar "Quiet Luxury" silhouette.
|
| 43 |
+
* **Aesthetic Prompting:** Search using abstract high-fashion concepts like *"90s minimalist chic"* or *"Parisian street style"* using CLIP's zero-shot capabilities.
|
| 44 |
+
* **Metric-Driven Results:** Every recommendation includes a confidence score based on vector distance.
|
| 45 |
+
|
| 46 |
+
---
|
| 47 |
+
|
| 48 |
+
## 🧠 Technical Deep Dive: Why Vector Search?
|
| 49 |
+
Traditional search looks for "tags." Atelier d'AI looks for **relationships**.
|
| 50 |
+
|
| 51 |
+
By performing **L2 Normalization** on our 768-d embeddings, we ensure that similarity is measured by the *direction* of the style vector. This means the model understands that a "tweed texture" is a style signature, regardless of the photo's brightness or the garment's color.
|
| 52 |
+
|
| 53 |
+
$$\text{Cosine Similarity} = \frac{A \cdot B}{\|A\|\|B\|}$$
|
| 54 |
+
|
| 55 |
+
This mathematical approach allows for **Zero-Shot Retrieval**, where the model can find "Quiet Luxury" items even if it has never been explicitly told what that label means.
|
| 56 |
|
| 57 |
+
---
|
|
|
|
| 58 |
|
| 59 |
+
## 🤝 Contributing & License
|
| 60 |
+
Distributed under the **MIT License**. Created as a portfolio piece to demonstrate the intersection of **Computer Vision** and **Luxury Aesthetics**.
|
|
|
|
|
|
|
|
|
|
| 61 |
|
| 62 |
+
**Developed by Priyanshi Shah**
|
| 63 |
+
*Student at PDEU | Aspiring AI/ML Leader*
|
|
|
|
|
|