README.md

metadata

language: en
license: apache-2.0
tags:
  - aqea
  - compression
  - embeddings
  - similarity-search
  - vector-database
datasets:
  - mteb/stsbenchmark-sts
base_model: openai/text-embedding-3-small

AQEA: aqea-text-embedding-3-small-29x

OpenAI text-embedding-3-small compressed 29x while preserving 90.6% similarity ranking

📊 Performance

Metric	Value
Compression Ratio	29.5x
Spearman ρ	90.6%
Source Dimension	1536D
Compressed Dimension	52D
Storage Savings	96.6%

🚀 Usage

from aqea import AQEACompressor

# Load pre-trained compressor
compressor = AQEACompressor.from_pretrained("nextxag/aqea-text-embedding-3-small-29x")

# Compress embeddings
embeddings = model.encode(texts)  # 1536D
compressed = compressor.compress(embeddings)  # 52D

# Decompress for retrieval
reconstructed = compressor.decompress(compressed)  # 1536D

📁 Files

• weights.aqwt - Binary weights (AQEA native format)
• config.json - Model configuration

🔬 How It Works

AQEA (Adaptive Quantized Embedding Architecture) uses learned linear projections with Pre-Quantify rotation to compress embeddings while maximally preserving pairwise similarity rankings (measured by Spearman correlation).

📚 Citation

@software{aqea2024,
  title = {AQEA: Adaptive Quantized Embedding Architecture},
  author = {AQEA Team},
  year = {2024},
  url = {https://huggingface.co/nextxag}
}

📄 License

Apache 2.0