Update infinity section
#22
by
michaelfeil
- opened
README.md
CHANGED
|
@@ -416,6 +416,13 @@ async def main():
|
|
| 416 |
asyncio.run(main())
|
| 417 |
```
|
| 418 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 419 |
## Evaluation
|
| 420 |
|
| 421 |
`baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
|
|
|
|
| 416 |
asyncio.run(main())
|
| 417 |
```
|
| 418 |
|
| 419 |
+
For a docker based deployment:
|
| 420 |
+
```bash
|
| 421 |
+
docker run --gpus all -v $PWD/data:/app/.cache -e HF_TOKEN=$HF_TOKEN -p "7997":"7997" \
|
| 422 |
+
michaelf34/infinity:0.0.68 \
|
| 423 |
+
v2 --model-id BAAI/bge-reranker-base --revision "main" --dtype float16 --batch-size 32 --engine torch --port 7997
|
| 424 |
+
```
|
| 425 |
+
|
| 426 |
## Evaluation
|
| 427 |
|
| 428 |
`baai-general-embedding` models achieve **state-of-the-art performance on both MTEB and C-MTEB leaderboard!**
|