| --- |
| title: Modular Model Composition Explorer |
| emoji: 🧩 |
| colorFrom: indigo |
| colorTo: purple |
| sdk: gradio |
| sdk_version: 6.15.2 |
| app_file: app.py |
| pinned: false |
| short_description: Profile adapter compatibility and VRAM cost for models |
| --- |
| |
| # Modular Model Composition Explorer |
|
|
| This Hugging Face Space serves as a production-grade developer environment to profile multi-tenant adapter networks, calculate tensor shapes, and analyze VRAM efficiency for runtime model architectures. It allows engineers to simulate complex modular compositions without setting up heavy local hardware infrastructure. |
|
|
| ## Core Capabilities |
|
|
| - **Adapter Compatibility Checker**: Empirically verify structural alignment (hidden size, attention heads, target modules) between base models and PEFT adapters using real-time Hugging Face Hub metadata. |
| - **Multi-Tenant Router Simulator**: Profile runtime routing overhead and performance bottlenecks for dynamic adapter configurations (e.g., Token Gating, MoE). |
| - **VRAM & Resource Calculator**: Calculate precise infrastructure footprints, including KV Cache overhead and multi-tenant scaling factors across various quantization levels (FP16, INT8, INT4). |
|
|
| ## Technical Implementation |
| The application uses **Gradio** for the interactive interface, **huggingface_hub** for metadata retrieval, and **Plotly** for high-fidelity architectural visualizations. It focuses on structural and resource profiling, abstracting away the underlying tensor computations for rapid prototyping. |
