Hugging Face's logo

Spaces:
solnone
/
mixtral-46.7b-fastapi
Sleeping

App Files Community
solnone commited on
Commit
8ea0c8a
·
verified ·
1 Parent(s): 473963a

Update main.py

Browse files
Files changed (1) hide show
  1. main.py +3 -1
main.py CHANGED
@@ -6,7 +6,9 @@ import uvicorn
6
 
7
  app = FastAPI()
8
 
9
- client = InferenceClient("mistralai/Mixtral-8x7B-Instruct-v0.1")
 
 
10
 
11
  class Item(BaseModel):
12
  prompt: str
 
6
 
7
  app = FastAPI()
8
 
9
+ MODEL = os.getenv('MODEL')
10
+ # client = InferenceClient("mistralai/Mixtral-8x7B-Instruct-v0.1")
11
+ client = InferenceClient(MODEL)
12
 
13
  class Item(BaseModel):
14
  prompt: str