| ---
|
| language: ["ko", "en", "ja", "zh", "es", "fr", "de", "pt", "it", "ru", "ar", "hi", "th", "vi", "id", "tr", "nl", "pl"]
|
| tags:
|
| - sentence-transformers
|
| - intent-classification
|
| - multilingual
|
| - layer-pruning
|
| - vocab-pruning
|
|
|
| library_name: sentence-transformers
|
| pipeline_tag: sentence-similarity
|
| license: apache-2.0
|
| ---
|
|
|
| # L4_compact
|
|
|
| Ultra-compact multilingual sentence encoder (~57.7MB) for intent classification.
|
| 4 layers [0,4,7,11] + 20K vocab
|
|
|
| ## Performance
|
|
|
| | Model | Size | MassiveIntent | MassiveScenario | Average |
|
| |-------|------|--------------|-----------------|---------|
|
| | Teacher (12L, full) | ~480MB | 55.52% | 61.01% | 58.27% |
|
| | L6_bottom (38K vocab) | 98MB | 54.70% | 59.39% | 57.05% |
|
| | **L4_compact** | **57.7MB** | **49.2%** | **52.69%** | **50.95%** |
|
|
|
| ## Model Details
|
|
|
| | Property | Value |
|
| |----------|-------|
|
| | Teacher | paraphrase-multilingual-MiniLM-L12-v2 |
|
| | Vocab | ~20,000 (frequency-based pruning, 97.4% coverage) |
|
| | Size | 57.7MB |
|
| | Distilled | No |
|
|
|
| ## Quick Start
|
|
|
|
|
|
|
| |
