Spaces:

Viktor-Hirenko
/

rag-python-rag

Sleeping

viktor-hirenko commited on Jan 7

Commit

ea6f355

1 Parent(s): 26520e9

fix: use microsoft/Phi-3-mini-4k-instruct - officially supported free model

Files changed (1) hide show

config.py CHANGED Viewed

@@ -37,8 +37,8 @@ CHROMA_COLLECTION_NAME = "document_embeddings"
 CHROMA_DISTANCE_METRIC = "cosine"
 # LLM Configuration - Hugging Face Inference API
-# Using a reliable FREE model that works with HF Inference API
-HF_MODEL = "google/flan-t5-base"  # Small, fast, 100% free, reliable
 HF_TOKEN = os.getenv("HF_TOKEN", "")
 # Retrieval Configuration

 CHROMA_DISTANCE_METRIC = "cosine"
 # LLM Configuration - Hugging Face Inference API
+# Using Microsoft Phi-3 - officially supported on free tier
+HF_MODEL = "microsoft/Phi-3-mini-4k-instruct"  # Officially supported, free, reliable
 HF_TOKEN = os.getenv("HF_TOKEN", "")
 # Retrieval Configuration