MIGRATION_NOTICE.md

🔄 IMPORTANT: HuggingFace API Migration Notice

Critical Update - November 2025

HuggingFace is migrating from their old Inference API endpoint to a new Inference Providers API.

⚠️ UPDATE: The new endpoint format is still being tested. For now, we recommend using OpenAI or Anthropic for production use.

---

⚠️ What Changed

Old Endpoint (DEPRECATED - Returns 404):

https://api-inference.huggingface.co/models/{model}

New Endpoint (REQUIRED as of Nov 1, 2025):

https://router.huggingface.co/hf-inference/models/{model}

---

✅ This Version is Updated

Good news: If you're using this version of ConversAI, the update is already applied!

The code has been updated to use the new Inference Providers API automatically.

---

🔍 How to Verify

Run the test script:

python test_hf_backend.py

Look for this line:

✓ Using new Inference Providers API endpoint

Or check manually:

python check_env.py

---

📦 What You Need to Do

If You Deployed BEFORE November 2025:

Option 1: Update the Code (Recommended)

1. Pull the latest version of llm_backend.py
2. Restart your application
3. Test with python test_hf_backend.py

Option 2: Manual Update

Edit llm_backend.py around line 80:

# Find this line:
return f"https://api-inference.huggingface.co/models/{self.model}"

# Replace with:
return f"https://router.huggingface.co/hf-inference/models/{self.model}"

If You're Deploying NEW:

No action needed! The latest code already uses the new endpoint.

---

🐛 Symptoms of Old Endpoint

If you're still using the old endpoint, you'll see:

❌ Error generating survey: Survey generation failed:
LLM generation failed: 404 Client Error: Not Found for url:
https://api-inference.huggingface.co/models/mistralai/Mixtral-8x7B-Instruct-v0.1

Solution: Update to the new endpoint as described above.

---

📚 More Information

Official HuggingFace Announcement:

• Migration deadline: November 1, 2025
• Old endpoint returns 404 errors after deadline
• New API docs: https://huggingface.co/docs/inference-providers

Benefits of New API:

• Access to more models
• Better performance and reliability
• Unified API across all inference services
• Future-proof for new features

---

❓ FAQ

Q: Do I need a new API token? A: No, your existing HF_TOKEN or HUGGINGFACE_API_KEY works with the new endpoint.

Q: Will this affect my deployed HuggingFace Space? A: Yes, if it was deployed before this update. Simply update the code and restart.

Q: Do I need to change any configuration? A: No, just update the code. All configuration remains the same.

Q: What if I use OpenAI or Anthropic? A: This change only affects HuggingFace users. Other providers are unaffected.

Q: Will my old surveys/data still work? A: Yes, this is only an API endpoint change. All data formats remain compatible.

Q: How do I know if I'm affected? A: If you see 404 errors when using HuggingFace provider, you need to update.

---

✅ Verification Checklist

After updating, verify everything works:

• Updated llm_backend.py to use new endpoint
• Ran python test_hf_backend.py - shows new endpoint
• Tested survey generation - works without 404 errors
• Tested translation - works correctly
• Tested analysis - works correctly
• No 404 errors in logs
• Application runs normally

---

🆘 Need Help?

If you're still getting 404 errors after updating:

1. Verify the update:

   grep "router.huggingface.co" llm_backend.py
   

   Should return a match. If not, update wasn't applied.

2. Check you're using HuggingFace:

   python check_env.py
   

   Look for which provider is being used.

3. Test the connection:

   python test_hf_backend.py
   

   Should show "✓ Using new Inference Providers API endpoint"

4. Clear any caches:

   • Restart your application
   • On HF Spaces: Factory reboot the Space

5. Still stuck?

   • Check TROUBLESHOOTING.md
   • Verify your HF_TOKEN is still valid
   • Try with a different model

---

📋 Migration Timeline

Date	Event
January 2025	Old endpoint deprecated, warnings sent
November 1, 2025	Old endpoint returns 404 errors
Today	This version updated to new endpoint

---

🚀 Bottom Line

If you're using this version: ✅ You're all set! The update is already applied.

If you deployed before: 🔄 Update your code to the latest version.

If you see 404 errors: ⚠️ Follow the update instructions above.

---

Updated: November 2025 Status: Migration Complete ✅ Action Required: Update existing deployments to latest code

For more details, see CHANGELOG.md