Spaces:

edusocial
/

e5-small-embedding-server

Running

App Files Files Community

e5-small-embedding-server / README.md

edusocial

Update README.md

1e3674a verified 11 months ago

preview code

Raw

History Blame Contribute Delete

1.14 kB

metadata

title: 🧠 intfloat/e5-small Embedding API Server
emoji: 🧩
colorFrom: blue
colorTo: purple
sdk: docker
app_file: app.py
pinned: false

🧠 Local Embedding API Server (Multilingual)

A lightweight embedding generation server using FastAPI + SentenceTransformer, supporting Chinese, English, Malay and more — powered by BAAI/bge-m3.

🚀 Features

/embed: generate embedding for a single string
/embed/batch: generate embedding for multiple strings
Support for GPU acceleration (CUDA) via Docker
Docker-ready deployment

🔧 Requirements

Docker (with NVIDIA container runtime)
Optional: Python 3.10+ for local dev

⚙️ Run with Docker (GPU)

docker build -t embed-server .
docker run --gpus all --env-file .env -p 8000:8000 embed-server

📦 API Usage

`POST /embed`

{
  "input": "Saya suka makan nasi lemak"
}

`POST /embed/batch`

{
  "inputs": ["I like cats", "我喜欢猫", "Saya suka kucing"]
}

📤 Response

{
  "embedding": [...],
  "dim": 1024,
  "model": "altaidevorg/BGE-M3-Distill-8L"
}

✍️ License

MIT