Spaces:
Sleeping
Sleeping
Adding openAI like provider
What is an openAI like provider
It is an api that is like the openAI one. They are used as llm providers.
Adding providers - docker and local deployment - file method
- Set up the app as you normally would
- Open
openai-compatible.config.tsin an IDE - Uncomment the example and remove the word example
- Modify the api url and other data to match your provider - to add more just copy and paste it and edit it, also add your secret key
- Run
pnpm openai-compatiable:parseto update env when you change schema
Adding providers - vercel or anywhere else - ui based method
- Go to this website and set up your models and providers
- Press generate JSON and copy it
- Put in this into your env as the
OPENAI_COMPATIBLE_DATAvariable
Editing
Copy the contents of the env into the import section at the top, then regenerate and update your env