Token Classification
Transformers
Safetensors
English
modernbert
token classification
hallucination detection
Instructions to use KRLabsOrg/lettucedect-base-modernbert-en-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KRLabsOrg/lettucedect-base-modernbert-en-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="KRLabsOrg/lettucedect-base-modernbert-en-v1")# Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("KRLabsOrg/lettucedect-base-modernbert-en-v1") model = AutoModelForTokenClassification.from_pretrained("KRLabsOrg/lettucedect-base-modernbert-en-v1", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
Remove 'reference_compile' from config.json
Browse filesHello!
## Pull Request overview
* Remove 'reference_compile' from config.json
## Details
This is a bit of an issue on the `transformers` side - the `reference_compile` should be adaptively set on the user's environment, rather than being set based on the model config.
- Tom Aarsen
- config.json +0 -1
config.json
CHANGED
|
@@ -36,7 +36,6 @@
|
|
| 36 |
"num_hidden_layers": 22,
|
| 37 |
"pad_token_id": 50283,
|
| 38 |
"position_embedding_type": "absolute",
|
| 39 |
-
"reference_compile": true,
|
| 40 |
"repad_logits_with_grad": false,
|
| 41 |
"sep_token_id": 50282,
|
| 42 |
"sparse_pred_ignore_index": -100,
|
|
|
|
| 36 |
"num_hidden_layers": 22,
|
| 37 |
"pad_token_id": 50283,
|
| 38 |
"position_embedding_type": "absolute",
|
|
|
|
| 39 |
"repad_logits_with_grad": false,
|
| 40 |
"sep_token_id": 50282,
|
| 41 |
"sparse_pred_ignore_index": -100,
|