README.md

---
title: Fades Api
emoji: 🏆
colorFrom: green
colorTo: yellow
sdk: docker
pinned: false
license: cc-by-nc-2.0
short_description: API for fades LLM
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

## Build
```
docker build -t fades-api .
```

## Start
```
docker run --rm -it -p 7860:7860 -v "${PWD}\data:/data" fades-api
```

## Switch to another version of the model

Quantized model : 4Go, ideal for CPU
```python
from huggingface_hub import hf_hub_download

REPO_ID = "maxime-antoine-dev/maxime-antoine-dev/fades-mistral-v02-gguf
REPO_TYPE = "model"

# v1
p1 = hf_hub_download(repo_id=REPO_ID, filename=HF_FILENAME, revision="v1")
print("v1 path:", p1)

# v2
p2 = hf_hub_download(repo_id=REPO_ID, filename=HF_FILENAME, revision="v2")
print("v2 path:", p2)
```



Full Model 13Go : ideal for GPU
```python
from huggingface_hub import hf_hub_download

REPO_ID = "maxime-antoine-dev/maxime-antoine-dev/fades
REPO_TYPE = "model"

# v1
p1 = hf_hub_download(repo_id=REPO_ID, filename=HF_FILENAME, revision="v1")
print("v1 path:", p1)

# v2
p2 = hf_hub_download(repo_id=REPO_ID, filename=HF_FILENAME, revision="v2")
print("v2 path:", p2)
```