Spaces:
Runtime error
Runtime error
Adding openAI like provider
What is an openAI like provider
It is an api that is like the openAI one. They are used as llm providers.
Adding providers - docker and local deployment - file method
- Set up the app as you normally would
- Open
openai-compatible.config.tsin an IDE - Uncomment the example and remove the word example
- Modify the api url and other data to match your provider - to add more just copy and paste it and edit it, also add your secret key
- Run
pnpm openai-compatiable:parseto update env when you change schema
Adding providers - vercel or anywhere else - ui based method
- Go to this website and set up your models and providers
- Press generate JSON and copy it
- Put in this into your env as the
OPENAI_COMPATIBLE_DATAvariable
Editing
Copy the contents of the env into the import section at the top, then regenerate and update your env