File size: 1,135 Bytes
b44799d 1e3674a b44799d a1c0982 b44799d a1c0982 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
title: 🧠 intfloat/e5-small Embedding API Server
emoji: 🧩
colorFrom: blue
colorTo: purple
sdk: docker
app_file: app.py
pinned: false
---
# 🧠 Local Embedding API Server (Multilingual)
A lightweight embedding generation server using FastAPI + SentenceTransformer, supporting Chinese, English, Malay and more — powered by `BAAI/bge-m3`.
## 🚀 Features
- `/embed`: generate embedding for a single string
- `/embed/batch`: generate embedding for multiple strings
- Support for GPU acceleration (CUDA) via Docker
- Docker-ready deployment
## 🔧 Requirements
- Docker (with NVIDIA container runtime)
- Optional: Python 3.10+ for local dev
## ⚙️ Run with Docker (GPU)
```bash
docker build -t embed-server .
docker run --gpus all --env-file .env -p 8000:8000 embed-server
```
## 📦 API Usage
### `POST /embed`
```json
{
"input": "Saya suka makan nasi lemak"
}
```
### `POST /embed/batch`
```json
{
"inputs": ["I like cats", "我喜欢猫", "Saya suka kucing"]
}
```
## 📤 Response
```json
{
"embedding": [...],
"dim": 1024,
"model": "altaidevorg/BGE-M3-Distill-8L"
}
```
## ✍️ License
MIT
|