| --- |
| language: |
| - en |
| license: apache-2.0 |
| tags: |
| - multimodal |
| - embedding |
| - matryoshka |
| - trimodal |
| - image-text-audio |
| - retrieval |
| - cross-modal |
| - edge |
| - rag |
| library_name: safetensors |
| pipeline_tag: feature-extraction |
| datasets: |
| - custom |
| --- |
| |
| # AIT-86M — Audio, Image, Text Embeddings (Depth-2) |
|
|
| **AIT-86M** maps image, audio, and text into a shared 1280-dim embedding space for cross-modal retrieval with a single vector index. All three modalities share one space with full Matryoshka truncation support down to 128 dims. |
|
|
| Built for edge deployment, with a single combined safetensors artifact. |
|
|
| Successor to [TE-75M](https://huggingface.co/augmem/TE-75M). |
|
|
| > Also available in [GGUF format](https://huggingface.co/augmem/AIT-86M-GGUF) for quantized edge deployment. |
|
|
| ## Why This Matters |
|
|
| The notable result for this family is preserving the shared semantic retrieval path while adding anchor-style decision behavior in downstream variants. In practice, the hard part is usually keeping the retrieval backbone flat while adding new decision surfaces on top of it. |
|
|
| ## File layout |
|
|
| ```text |
| AIT-86M.safetensors |
| ``` |
|
|
| ## Notes |
|
|
| - shared trimodal embedding space |
| - Matryoshka truncation: `1280 / 768 / 512 / 256 / 128` |
| - intended for retrieval and embedding use, not generation |
|
|
| ## Historical Local Gate Baseline |
|
|
| The exact local gate baseline that was previously attached under the `TE-86M` release directory is restored here for continuity in the `AIT-86M` artifact line. |
|
|
| Attached JSON: |
|
|
| - `teacher_dual_mn20whisper_exact_gate_baseline_20260424T155324Z.json` |
|
|
| Seeded split-excluded baseline at `1280d`: |
|
|
| | Slice | Metric | |
| |---|---:| |
| | Speech holdout A->T R@1 | 0.5652 | |
| | Speech holdout T->A R@1 | 0.5992 | |
| | Speech holdout avg R@1 | 0.5822 | |
| | WavCaps FSD A->T R@1 | 0.1078 | |
| | WavCaps FSD T->A R@1 | 0.1030 | |
| | WavCaps FSD avg R@1 | 0.1054 | |
| | SALT A->I R@1 | 0.1692 | |
| | SALT I->A R@1 | 0.1261 | |
|
|
| Scope note: |
|
|
| - These are the canonical local gate numbers used for bounded continuation and recovery experiments in this model family. |
| - They are not a claim of broad public benchmark superiority. |
| - They are restored here because the prior card revision dropped the attached evaluation summary. |
|
|
| ## Evaluation Scope |
|
|
| Published evaluations for this model family include targeted retrieval and anchor-style discrimination tasks. Those targeted evaluations are useful, but they are not a substitute for a published adversarial or out-of-distribution benchmark. Downstream runtime validation remains application-specific. |
|
|
| ## Files |
|
|
| | File | Purpose | |
| |---|---| |
| | `AIT-86M.safetensors` | Base trimodal checkpoint | |
| | `teacher_dual_mn20whisper_exact_gate_baseline_20260424T155324Z.json` | Restored canonical local gate baseline summary | |
|
|
| ## License |
|
|
| Apache 2.0 |
|
|
