Unlearned Checkpoint

Field Value
Unlearning method PISCES
Base model google/gemma-2-2b-it
Target concept Baseball
Checkpoint type Full Model Weights
Rank / seed 100 / 42
Train eval protocol open

Unlearning Configuration

Selected hyperparameters (from unlearned_checkpoints.json):

Parameter Value
delta_embed 0
k_features_embed 0
k_pisces 0.5
n_tokens_edited 0
ratio_thresh 2
value_pisces 13

Primary Unlearning Metrics (held-out test, MC protocol)

Headline scores used for checkpoint selection:

Metric Train (after unlearning) Test (after unlearning)
Efficacy 0.967 1
Specificity 0.838 0.767
Harmonic mean 0.898 0.868

Full Evaluation (baseline โ†’ unlearned)

From evaluation/score_comparison.csv:

Metric Baseline (train) After unlearn (train) Baseline (test) After unlearn (test)
QA accuracy 0.6 0.02 0.6 0
QA fraction 1 0.033 1 0
SimDom accuracy 0.8 0.66 0.88 0.66
SimDom fraction 1 0.825 1 0.75
MMLU accuracy 0.52 0.48 0.551 0.486
MMLU fraction 1 0.852 1 0.784

Files in This Repository

File Description
unlearned_checkpoints.json Checkpoint metadata & hyperparameters
evaluation/evaluation_summary.json Full evaluation payload (train/test/relearning)
evaluation/score_comparison.csv Baseline vs. unlearned comparison table
Downloads last month
40
Safetensors
Model size
3B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for shirasko/gemma-2-2b-it-pisces-baseball

Finetuned
(1077)
this model

Collection including shirasko/gemma-2-2b-it-pisces-baseball