Unlearned Checkpoint

Field Value
Unlearning method PISCES
Base model google/gemma-2-2b-it
Target concept Uranium
Checkpoint type Full Model Weights
Rank / seed 100 / 42
Train eval protocol open

Unlearning Configuration

Selected hyperparameters (from unlearned_checkpoints.json):

Parameter Value
delta_embed 0
k_features_embed 0
k_pisces 0.4
n_tokens_edited 0
ratio_thresh 2
value_pisces 42

Primary Unlearning Metrics (held-out test, MC protocol)

Headline scores used for checkpoint selection:

Metric Train (after unlearning) Test (after unlearning)
Efficacy 0.524 0.565
Specificity 0.709 0.633
Harmonic mean 0.603 0.597

Full Evaluation (baseline โ†’ unlearned)

From evaluation/score_comparison.csv:

Metric Baseline (train) After unlearn (train) Baseline (test) After unlearn (test)
QA accuracy 0.46 0.2 0.52 0.2
QA fraction 1 0.476 1 0.435
SimDom accuracy 0.82 0.46 0.86 0.38
SimDom fraction 1 0.575 1 0.463
MMLU accuracy 0.52 0.5 0.551 0.552
MMLU fraction 1 0.926 1 1

Files in This Repository

File Description
unlearned_checkpoints.json Checkpoint metadata & hyperparameters
evaluation/evaluation_summary.json Full evaluation payload (train/test/relearning)
evaluation/score_comparison.csv Baseline vs. unlearned comparison table
Downloads last month
42
Safetensors
Model size
3B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for shirasko/gemma-2-2b-it-pisces-uranium

Finetuned
(1077)
this model

Collection including shirasko/gemma-2-2b-it-pisces-uranium