Instructions to use vectara/hallucination_evaluation_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use vectara/hallucination_evaluation_model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="vectara/hallucination_evaluation_model", trust_remote_code=True)# Load model directly from transformers import AutoModelForSequenceClassification model = AutoModelForSequenceClassification.from_pretrained("vectara/hallucination_evaluation_model", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Is RAGTruth part of the fine tuning dataset?
#16
by lqw110 - opened
I know this model has good performance on RAGTruth as benchmarking dataset. Just want to confirm that RAGTruth is not part of any training of fine tuning process. Thanks!
Hi Iris, thanks for your interest in HHEM. RAGTruth has a training set and a test set. The training set was used in the finetuning process.
forrest-vectara changed discussion status to closed