salihfurkaan's picture
Update README.md
fa9f9fd verified
|
Raw
History Blame Contribute Delete
1.5 kB

A newer version of the Gradio SDK is available: 6.20.0

Upgrade
metadata
title: Modular Model Composition Explorer
emoji: 🧩
colorFrom: indigo
colorTo: purple
sdk: gradio
sdk_version: 6.15.2
app_file: app.py
pinned: false
short_description: Profile adapter compatibility and VRAM cost for models

Modular Model Composition Explorer

This Hugging Face Space serves as a production-grade developer environment to profile multi-tenant adapter networks, calculate tensor shapes, and analyze VRAM efficiency for runtime model architectures. It allows engineers to simulate complex modular compositions without setting up heavy local hardware infrastructure.

Core Capabilities

  • Adapter Compatibility Checker: Empirically verify structural alignment (hidden size, attention heads, target modules) between base models and PEFT adapters using real-time Hugging Face Hub metadata.
  • Multi-Tenant Router Simulator: Profile runtime routing overhead and performance bottlenecks for dynamic adapter configurations (e.g., Token Gating, MoE).
  • VRAM & Resource Calculator: Calculate precise infrastructure footprints, including KV Cache overhead and multi-tenant scaling factors across various quantization levels (FP16, INT8, INT4).

Technical Implementation

The application uses Gradio for the interactive interface, huggingface_hub for metadata retrieval, and Plotly for high-fidelity architectural visualizations. It focuses on structural and resource profiling, abstracting away the underlying tensor computations for rapid prototyping.