Visual Question Answering
Transformers
Safetensors
baby_medgemma
feature-extraction
medical
chest-x-ray
vision-language-model
interpretability
mechanistic-interpretability
research
custom_code
Instructions to use saillab/FlipLens with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use saillab/FlipLens with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "visual-question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("visual-question-answering", model="saillab/FlipLens", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("saillab/FlipLens", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Correct shuffled-grounding AUC to 0.502 (was 0.506)
Browse files
README.md
CHANGED
|
@@ -76,7 +76,7 @@ below chance)**, most likely a label-definition mismatch, and should not be trus
|
|
| 76 |
|
| 77 |
Accuracy alone cannot tell a seeing model from a blind one here: a blind model, a
|
| 78 |
model given a *shuffled* grounding token, and a genuinely seeing model all score
|
| 79 |
-
~0.50 accuracy while their AUCs are 0.500 / 0.
|
| 80 |
|
| 81 |
### The discarded margin is a single-pass flip detector
|
| 82 |
|
|
|
|
| 76 |
|
| 77 |
Accuracy alone cannot tell a seeing model from a blind one here: a blind model, a
|
| 78 |
model given a *shuffled* grounding token, and a genuinely seeing model all score
|
| 79 |
+
~0.50 accuracy while their AUCs are 0.500 / 0.502 / 0.604. Report AUC.
|
| 80 |
|
| 81 |
### The discarded margin is a single-pass flip detector
|
| 82 |
|