opt-125m-mic

Slim model weights, executable usage and framework expectations in one repository.

Contract

OPT causal language modeling

Runnable usage and the framework expectations directory are linked above.

Slim model

Slim fixture: opt-125m-mic

A 1.0M-parameter fixture for the OPT MIC, covering facebook/opt-125m. It is a test artifact, not a usable model, tagged test-artifact to keep it out of candidate-model search.

  • Fixture key 5a07dd710c26. It covers every checkpoint whose processor files are byte-identical and whose config matches after shrinking.
  • Same architecture, smaller config: OPTForCausalLM, shrunk by the generic rule in sweep.py (num_hidden_layers 2).
  • Processor files copied byte for byte from facebook/opt-125m: LICENSE.md, generation_config.json, merges.txt, special_tokens_map.json, tokenizer_config.json, vocab.json.
  • Random weights (seed 17). They passed the input-sensitivity gate: every perturbation of the contract's inputs moved the logits by at least 0.001 (weakest: input_ids:roll_batch, 0.00429), so no training was needed.
  • Same tensor names as the real checkpoint. The real checkpoint has every parameter, and so does the fixture.
  • Saved in float16, the dtype facebook/opt-125m loads in by default.
  • Finite in float32, bfloat16, and float16 (forward, loss, gradients).

Built by build_fixtures.py; build.json records the pinned sources, gate results, and file hashes. This repository includes the slim weights, usage and framework expectations; rebuild the other files with python example/build_fixtures.py --fixture opt-125m-mic.

Downloads last month
231
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for huggingface-mic/opt-125m-mic

Finetuned
(102)
this model