Spaces:
Paused
Paused
Commit History
-
feat: allow storing env variable in DB (#1802)
Unverified signature* feat(config): wip, make config controllable from DB, public side for now * fix: build * feat(config): add config manager env var toggle * wip: make backend config use config manager * fix: typechecks * fix: circular import * refactor: init hook sveltekit * fix: disable config manager during tests * refactor: use enum for semaphore, move delete from auto after 60s to separate `deleteAt` field * feat: config manager checks for updates on requests * fix: config script exit * fix: remove top-level awaits * fix: script await * feat: filter config keys based on public environment variables for more security * fix: change import to type for public environment variables48059af
-
feat(chart): use inference proxy (#1688)
Unverified signature* feat(chart): use inference proxy * fix: also use `HF_API_ROOT` for embedding endpointscf63293
-
chores(deps): update Transformers to latest version and remove chat templates for all models (#1414)
Unverified signature* chores(deps): update Transformers to latest version and remove chat templates for mistral models * feat(models): remove chatPromptTemplate everywherea0ed974
-
Fix error logging (#1228)
Unverified signatureLogging was switched to Pino. For error logging, Pino wants the object first, and then the string message. For example see this thread: https://github.com/pinojs/pino/issues/6737dd92b8
-
Web Search: Playwright, spatial parsing, markdown (#1094)
Liam Dyer +2: Aaditya Sahay, Aaditya SahayUnverified signature* feat: playwright, spatial parsing, markdown for web search Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> * feat: choose multiple clusters if necessary (#2) * chore: resolve linting failures * feat: improve paring performance and error messages * feat: combine embeddable chunks together on cpu * feat: reduce parsed pages from 10 to 8 * feat: disable javascript in playwright by default * feat: embedding and parsing error messages * feat: move isURL, fix type errors, misc * feat: misc cleanup * feat: change serializedHtmlElement to interface * fix: isUrl filename * fix: add playwright dependencies to docker * feat: add playwright browsers to docker image * feat: enable javascript by default * feat: remove error message from console on failed page --------- Co-authored-by: Aaditya Sahay <aadityasahay1@gmail.com> Co-authored-by: Aaditya Sahay <56438732+Aaditya-Sahay@users.noreply.github.com>2c00ea8
-
Fix OpenAI Embeddings Auth Issue (#1077)
Unverified signature* Update embeddingEndpoints.ts Adds the `Api-Key` Parameter instead of `Authorization` since OpenAI depends on API Key * Add `defaultHeaders` to openAI embeddings endpoint and revert auth header --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>77340d8
-
Move vars to dynamic, add metrics (#1085)
Unverified signature* Add healthcheck route * Add prom client with basic metrics * wip: serve metrics on a different port * exclude server from tsconfig * latest * refacto(all): use class & singleton * refacto(all): use class & singleton * refacto(all): add request logs * Make all the env vars dynamic (#1092) * Add truncate to task model (#1090) * retry text area height (#1091) * Make all the env vars dynamic * only check for db at runtime * remove secret from build step * improve dockerfile * Wrap db in singleton * add .env.local to dockerignore * changes to dockerfile * lint * aborted generations * move collections build check * Use a single dockerfile * lint * fixes * lint * don't return db during building * remove dev --------- Co-authored-by: Victor Muštar <victor.mustar@gmail.com> * refacto(all): update default metrics port * fix recursion error * add version check * revert vite preview * Move request logs to debug level and add an env var to filter by log level in d…a8a9533
-
Use pino for logs (#1086)
Unverified signature* Use pino for logs * Use logger for info * Add errorId to the logs486ffa7
-
Use TEI space in prod (#1051)
Unverified signature8cb1f84
-
Always dispose of pipeline for embeddings after use (#1048)
Unverified signature622c26c -
Dispose of embeddings pipeline occasionally to clear memory (#1047)
Unverified signaturee5a85ec
-
return empty if error on hfapi endpoint (#1038)
Unverified signature9911143 -
Use inference API for embeddings in huggingchat prod (#1037)
Unverified signature* Let the user use HF_TOKEN as auth bearer token in TEI endpoint * Use inference API for embeddings in huggingchat prodcc2dafe
-
Use jinja template for chat formatting (#730) (#744)
Unverified signature* Use jinja template for chat formatting * Add support for transformers js chat template * update to latest transformers version * Make sure to `add_generation_prompt` * unindent144112e
-
Add openai embeddings (#915)
Martok88 +1: nsarrazinUnverified signature* Add OpenAI embedding compatibility * Use OPENAI_API_KEY by default * lint * Add default OpenAI URL replace `authorization` by `apiKey` * Add a note in readme --------- Co-authored-by: Nathan Sarrazin <sarrazin.nathan@gmail.com>8c28b44
-
Mv embeddingEndpoints.ts (#688)
MishigUnverified signature* Mv embeddingEndpoints.ts * relative importd89c536
-
Add embedding models configurable, from both transformers.js and TEI (#646)
Unverified signature* Add embedding models configurable, from both Xenova and TEI * fix lint and format * Fix bug in sentenceSimilarity * Batches for TEI using /info route * Fix web search disapear when finish searching * Fix lint and format * Add more options for better embedding model usage * Fixing CR issues * Fix websearch disapear in later PR * Fix lint * Fix more minor code CR * Valiadate embeddingModelName field in model config * Add embeddingModel into shared conversation * Fix lint and format * Add default embedding model, and more readme explanation * Fix minor embedding model readme detailed * Update settings.json * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Update README.md Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Apply suggestions from code review Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> * Resolved more issues * lint * Fix more issues * Fix format * fix small typo * lint * fix defaul…b17a5c8
