juliaturc commited on
Commit
02a7f76
·
1 Parent(s): 7cec107

Better defaults for remote.yaml

Browse files

- Use `text-embedding-3-small` instead of ADA for embeddings; as shown in our retrieval benchmark, the improvement in quality is very significant.
- Use `gpt-4o` instead of `gpt4`. According to OpenAI, it's cheaper and better.

Files changed (1) hide show
  1. sage/configs/remote.yaml +3 -3
sage/configs/remote.yaml CHANGED
@@ -1,6 +1,6 @@
1
  # Embeddings
2
  embedding-provider: openai
3
- embedding-model: text-embedding-ada-002
4
  tokens-per-chunk: 800
5
  chunks-per-batch: 2000
6
 
@@ -11,7 +11,7 @@ hybrid-retrieval: true
11
 
12
  # LLM
13
  llm-provider: openai
14
- llm-model: gpt-4
15
 
16
  # Reranking
17
- reranker-provider: nvidia
 
1
  # Embeddings
2
  embedding-provider: openai
3
+ embedding-model: text-embedding-3-small
4
  tokens-per-chunk: 800
5
  chunks-per-batch: 2000
6
 
 
11
 
12
  # LLM
13
  llm-provider: openai
14
+ llm-model: gpt-4o
15
 
16
  # Reranking
17
+ reranker-provider: nvidia