Update README.md
Browse files
README.md
CHANGED
|
@@ -12,15 +12,19 @@ model_index:
|
|
| 12 |
- name: kpr-bert-base-uncased
|
| 13 |
results:
|
| 14 |
---
|
| 15 |
-
|
|
|
|
| 16 |
|
| 17 |
## Introduction
|
| 18 |
|
|
|
|
|
|
|
| 19 |
A key limitation of large language models (LLMs) is their inability to capture less-frequent or up-to-date entity knowledge, often leading to factual inaccuracies and hallucinations. Retrieval-augmented generation (RAG), which incorporates external knowledge through retrieval, is a common approach to mitigate this issue.
|
| 20 |
|
| 21 |
Although RAG typically relies on embedding-based retrieval, the embedding models themselves are also based on language models and therefore struggle with queries involving less-frequent entities, often failing to retrieve the crucial knowledge needed to overcome this limitation.
|
| 22 |
|
| 23 |
-
**Knowledgeable
|
|
|
|
| 24 |
**The entity knowledge is pluggable and can be dynamically updated with ease.**
|
| 25 |
|
| 26 |
For more details, refer to [our GitHub repository](https://github.com/knowledgeable-embedding/knowledgeable-embedding).
|
|
|
|
| 12 |
- name: kpr-bert-base-uncased
|
| 13 |
results:
|
| 14 |
---
|
| 15 |
+
|
| 16 |
+
# Knowledgeable Embedding: kpr-bert-base-uncased
|
| 17 |
|
| 18 |
## Introduction
|
| 19 |
|
| 20 |
+
**Injecting dynamically updatable entity knowledge into embeddings to enhance RAG**
|
| 21 |
+
|
| 22 |
A key limitation of large language models (LLMs) is their inability to capture less-frequent or up-to-date entity knowledge, often leading to factual inaccuracies and hallucinations. Retrieval-augmented generation (RAG), which incorporates external knowledge through retrieval, is a common approach to mitigate this issue.
|
| 23 |
|
| 24 |
Although RAG typically relies on embedding-based retrieval, the embedding models themselves are also based on language models and therefore struggle with queries involving less-frequent entities, often failing to retrieve the crucial knowledge needed to overcome this limitation.
|
| 25 |
|
| 26 |
+
**Knowledgeable Embedding** enhances the performance with such queries by injecting real-world entity knowledge into embeddings, making them more *knowledgeable*.
|
| 27 |
+
|
| 28 |
**The entity knowledge is pluggable and can be dynamically updated with ease.**
|
| 29 |
|
| 30 |
For more details, refer to [our GitHub repository](https://github.com/knowledgeable-embedding/knowledgeable-embedding).
|