vital-ar/physics-solver-e4-adversarial-v2
Viewer β’ Updated β’ 919 β’ 91
How to use vital-ar/adversarial-physics-solver-e4-adversarial-v2-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("CohereLabs/tiny-aya-global")
model = PeftModel.from_pretrained(base_model, "vital-ar/adversarial-physics-solver-e4-adversarial-v2-lora")Part of Adversarial Physics SolverβVerifier (Track 1: Data-Scarce University Physics). Multi-turn hint-conditioned Solver (CohereLabs/tiny-aya-global, Model A) designed to solve Turn-0 physics problems and revise derivations when given self-contained [[CHALLENGE]] directives from the E4b Verifier without repeating mistakes. Extends E3 Turn-0 derivations with harvested valid tiny-aya-global attempts, aya-expanse-8b Alternative Solution 2s, and Turn-1/Turn-2 corrective hint trajectories.
vital-ar/physics-solver-e4-adversarial-v2 (826 training examples; strict < 0.80 MiniLM separation vs. Clean held-out splits)622, Turn 1 (1 hint): 77, Turn 2 (2 hints): 127 | Sources: literature_curated: 788, physgym_seed: 7, synthetic_seed_subtopic: 31ELECTROMAGNETISM 149, MECHANICS 447, MODERN_PHYSICS 94, OPTICS 38, RELATIVITY 62, THERMODYNAMICS 36. Data filtering/generation used CohereForAI/aya-expanse-8b exclusively; training & failure harvesting used CohereLabs/tiny-aya-global exclusively.1.0e-4, 5 epochs), expanded held-out 60-problem splits, normalized E1, added v2 deduplicated exports.AlignTune aligntune==0.1.32): Base CohereLabs/tiny-aya-global (3.35B FP16), LoRA r=16 / alpha=32, LR 0.0001, epochs 3.0/5, steps 156, final train loss 0.84, selected checkpoint checkpoint-156, completion_only_loss=true, seed=42.cosine < 0.80 Splits)
| Clean Split | Overall Acc | Textbook Acc | Sentinel % | Degenerate % | AuditKIT SHA-256 |
|---|---|---|---|---|---|
validation (n=44) |
0.00% (0/44) | 0.00% (0/6) | 100.00% | 0.00% | 2352f4f544f971ec |
test (n=49) |
2.04% (1/49) | 8.33% (1/12) | 97.96% | 2.04% | 1d57b2cf51e61b6a |
YimengChen/PhysGym (38 problems) stays 0/38 across all runs (see main repo for root-cause analysis and Table 1 pre-filter comparison).AlignTune Raw Prompt Format)
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_id = "CohereLabs/tiny-aya-global"
adapter_id = "vital-ar/adversarial-physics-solver-e4-adversarial-v2-lora"
tok = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(base_id, torch_dtype=torch.float16, device_map="auto")
model = PeftModel.from_pretrained(base, adapter_id).eval()
prompt = (
"Solve the following physics problem step by step (in at most 10 logical steps). "
"State the governing physical equations, perform algebraic substitutions clearly, include "
"SI units, and end with the final answer on a new line prefixed with ANSWER:.\n\n"
"PROBLEM:\nA 2 kg block starts from rest on a 5 m frictionless ramp. Find its speed "
"at the bottom.\n\n"
)
inputs = tok(prompt, return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=1024, do_sample=False)
print(tok.decode(out[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
@vital-ar | Repo: GitHub | Collections: Models (15) Β· Datasets & Traces