ikuyamada commited on
Commit
312b494
·
verified ·
1 Parent(s): 4ec7d0a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -21,7 +21,7 @@ model_index:
21
 
22
  A key limitation of large language models (LLMs) is their inability to capture less-frequent or up-to-date entity knowledge, often leading to factual inaccuracies and hallucinations. Retrieval-augmented generation (RAG), which incorporates external knowledge through retrieval, is a common approach to mitigate this issue.
23
 
24
- Although RAG typically relies on embedding-based retrieval, the embedding models themselves are also based on language models and therefore struggle with queries involving less-frequent entities, often failing to retrieve the crucial knowledge needed to overcome this limitation.
25
 
26
  **Knowledgeable Embedding** enhances performance on such queries by injecting real-world entity knowledge into embeddings, making them more *knowledgeable*.
27
 
 
21
 
22
  A key limitation of large language models (LLMs) is their inability to capture less-frequent or up-to-date entity knowledge, often leading to factual inaccuracies and hallucinations. Retrieval-augmented generation (RAG), which incorporates external knowledge through retrieval, is a common approach to mitigate this issue.
23
 
24
+ Although RAG typically relies on embedding-based retrieval, the embedding models themselves are also based on language models and therefore struggle with queries involving less-frequent entities ([Sciavolino et al., 2021](https://arxiv.org/abs/2109.08535)), often failing to retrieve the crucial knowledge needed to overcome this limitation.
25
 
26
  **Knowledgeable Embedding** enhances performance on such queries by injecting real-world entity knowledge into embeddings, making them more *knowledgeable*.
27