gexinh's picture
Update vlmprobe to 1.0.1 with SAE methods, guides, and technical report
31246a6 verified
|
Raw History Blame Contribute Delete
2.31 kB

Runnable method tutorials

These scripts contain the same complete workflows shown in the method guides: load a model, prepare raw inputs, configure a probe, compute results, inspect tensors and draw built-in plots. They do not load archived probe measurements.

From the repository root:

python -m pip install -e ".[transformers,visualization]"
python examples/tutorials/lens_logit.py

VLM_PROBING_DEVICE selects a device and VLM_PROBING_OUTPUT selects an output directory. VLM_PROBING_MODEL optionally supplies a compatible local checkpoint; otherwise each script uses its stated public model. Keep overrides within the script's supported model family. Image examples expose their input URL/path and prompt directly; some also accept VLM_PROBING_IMAGE.

GPT-2 is the text default, SmolVLM-500M the VLM default, and Google ViT-B/16 the vision-classifier default. First use downloads weights. Dense Attention Lens fitting can use several gigabytes of memory and checkpoints even for GPT-2; exact Jacobians and integrated attribution require repeated backwards/forwards. Read the method's cost and calibration notes before starting those scripts.

For a guided sequence and inline outputs, use the live notebooks. Raw sample provenance and image rights are documented there. Short training splits demonstrate the protocol; use independent representative data before interpreting a fitted decoder.