Instructions to use nuriasane/llm-hallucination-detector with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use nuriasane/llm-hallucination-detector with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("nuriasane/llm-hallucination-detector") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Scikit-learn
How to use nuriasane/llm-hallucination-detector with Scikit-learn:
from huggingface_hub import hf_hub_download import joblib model = joblib.load( hf_hub_download("nuriasane/llm-hallucination-detector", "sklearn_model.joblib") ) # only load pickle files from sources you trust # read more about it here https://skops.readthedocs.io/en/stable/persistence.html - Notebooks
- Google Colab
- Kaggle
LLM Hallucination Detector
A logistic regression classifier trained on sentence embeddings to detect hallucinations in LLM-generated responses.
Classes
- factual - the answer is correct
- partial - the answer contains some errors
- hallucination - the answer is fabricated or incorrect
Usage
The model takes a (question, answer) pair, embeds both with sentence-transformers/all-MiniLM-L6-v2, concatenates the vectors, and predicts the class.