Instructions to use jakeflavin/minicheck-roberta-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use jakeflavin/minicheck-roberta-large with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download jakeflavin/minicheck-roberta-large --local-dir minicheck-roberta-large
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
MiniCheck-RoBERTa-Large (safetensors, fp16)
This is lytang/MiniCheck-RoBERTa-Large, converted to safetensors for Chirp, an on-device Mac app. Chirp uses it to check that each point in a summary is supported by the text it came from.
What changed from the original
- The weights were converted from
pytorch_model.bintomodel.safetensorsin float16. The values are unchanged apart from the float16 rounding. config.jsonnames its two labels:0isunsupportedand1isentailment.- The tokenizer files from the original repo are included.
Nothing was retrained or fine-tuned.
Use
Input: a document chunk and a claim, as a RoBERTa sentence pair. The model gives a probability that the claim is supported (label entailment).
Credit and licence
The original model is by Liyan Tang, Philippe Laban and Greg Durrett, released under the MIT licence. It is described in:
Liyan Tang, Philippe Laban, Greg Durrett. MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents. EMNLP 2024. arXiv:2404.10774
This conversion is also released under the MIT licence.
- Downloads last month
- -
Quantized
Model tree for jakeflavin/minicheck-roberta-large
Base model
lytang/MiniCheck-RoBERTa-Large