--- base_model: Qwen/Qwen3-4B-Base library_name: peft license: apache-2.0 pipeline_tag: text-generation tags: - lora - peft - qwen3 - code - livecodebench - diagnostic-only --- # CN11 FIELD_OCI100 LoRA (Qwen3-4B-Base) **DIAGNOSTIC_ONLY / NOT_WINNER / OPERATIONAL_SCREENING_ONLY** This is a **PEFT LoRA adapter only** (not merged full weights) for [`Qwen/Qwen3-4B-Base`](https://huggingface.co/Qwen/Qwen3-4B-Base) revision `906bfd4b4dc7f14ee4320094d8b41684abff8539`. User shorthand **CI100** maps to the local CN11 arm **`FIELD_OCI100`**. There is no literal `CI100` / `CN11_CI100` adapter in the local experiment tree. ## Identity | Field | Value | | --- | --- | | Local arm | `FIELD_OCI100` | | Route | `fieldfix_targeted` (`run_20260815T072135Z`) | | Train seed | `43` | | Train status | `COMPLETE` (attempt 3) | | Update mode | `token_balanced_64` (U=64) | | Dose | 500,000 non-padding unique clean supervised target tokens | | Recipe | Nemotron CP-v2 final-code **400K** + OCI fieldfix_v2 **100K** | | Rows | 1,832 (1,298 CP-v2 + 534 OCI fieldfix); reasoning tokens = 0 | | Cutoff | 2048 | | LoRA | r=64, alpha=128, dropout=0.0, target-only CE, AdamW 1e-5, cosine+warmup | | Local adapter | `.../training/FIELD_OCI100/seed_43/attempt3/adapter` | | `adapter_manifest_sha256` | `927727c4434afcca19179a7fdcf8266bfbd79e848e062190bc27e6734ea47f40` | ## Public full-LCB diagnostic (1055 tasks, seeds 5227 / 5233 / 5303) Source: local `PUBLIC_DIAGNOSTIC_AGGREGATE.json` for the fieldfix targeted route. **Not** a hidden-dev confirmation and **not** a winner gate. | Entity | 3-seed mean pass@1 | | --- | --- | | `FIELD_OCI100` | **24.83%** | | `BASE` | 24.39% | | `FIELD_FC500_CONTROL` | 23.76% | Paired task-cluster bootstrap (10,000 replicates): - vs BASE: **+0.44pp**, 95% CI **[-0.92, +1.77] pp — crosses zero** - vs FC500 control: **+1.07pp**, 95% CI **[+0.16, +1.99] pp — excludes zero** Per-seed pass@1: 5227=25.21%, 5233=24.74%, 5303=24.55%. ## Load with PEFT ```python from transformers import AutoModelForCausalLM, AutoTokenizer from peft import PeftModel base_id = "Qwen/Qwen3-4B-Base" base_rev = "906bfd4b4dc7f14ee4320094d8b41684abff8539" adapter_id = "modrill/CN11-FIELD_OCI100" tokenizer = AutoTokenizer.from_pretrained(base_id, revision=base_rev, trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained( base_id, revision=base_rev, torch_dtype="bfloat16", device_map="auto", trust_remote_code=True, ) model = PeftModel.from_pretrained(model, adapter_id) model.eval() ``` Do **not** treat this as a merged standalone model. The published `adapter_config.json` rewrites the training-time local `base_model_name_or_path` to `Qwen/Qwen3-4B-Base`; weights (`adapter_model.safetensors`) are byte-identical to the COMPLETE local adapter. ## What this is not - Not a winner / not confirmation / not holdout - Not D2 / mix / THINK - Not a full-weight merge - Positive signal vs FC500 is a **final-code mix** result, not a long-CoT / think contract