Instructions to use vectara/hallucination_evaluation_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vectara/hallucination_evaluation_model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="vectara/hallucination_evaluation_model", trust_remote_code=True)# Load model directly from transformers import AutoModelForSequenceClassification model = AutoModelForSequenceClassification.from_pretrained("vectara/hallucination_evaluation_model", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
embed gui demo url using iframe
Browse files
README.md
CHANGED
|
@@ -11,6 +11,7 @@ pipline_tag: text-classficiation
|
|
| 11 |
|
| 12 |
[**Click here try out HHEM-2.1-Open from your browser** ](https://huggingface.co/spaces/vectara/hhem-2.1-open-demo?logs=build)
|
| 13 |
|
|
|
|
| 14 |
|
| 15 |
With a performance superior than GPT-3.5-Turbo and GPT-4 but a footprint of less than 600MB RAM,
|
| 16 |
HHEM-2.1-Open is the lastest open source version of Vectara's HHEM series models for detecting hallucinations in LLMs. They are particularly useful in the context of building retrieval-augmented-generation (RAG) applications where a set of facts is summarized by an LLM, and HHEM can be used to measure the extent to which this summary is factually consistent with the facts.
|
|
|
|
| 11 |
|
| 12 |
[**Click here try out HHEM-2.1-Open from your browser** ](https://huggingface.co/spaces/vectara/hhem-2.1-open-demo?logs=build)
|
| 13 |
|
| 14 |
+
<iframe src="https://vectara-hhem-2-1-open-demo.hf.space/" title="Demo for HHEM-2.1-Open"></iframe>
|
| 15 |
|
| 16 |
With a performance superior than GPT-3.5-Turbo and GPT-4 but a footprint of less than 600MB RAM,
|
| 17 |
HHEM-2.1-Open is the lastest open source version of Vectara's HHEM series models for detecting hallucinations in LLMs. They are particularly useful in the context of building retrieval-augmented-generation (RAG) applications where a set of facts is summarized by an LLM, and HHEM can be used to measure the extent to which this summary is factually consistent with the facts.
|