gemma-2-2b-it-mic

Slim model weights, executable usage and framework expectations in one repository.

Contract

Gemma 2 causal LM

Runnable usage and the framework expectations directory are linked above.

Slim model

Slim fixture: gemma-2-2b-it-mic

A 16.5M-parameter fixture for the Gemma2 MIC, covering google/gemma-2-2b-it. It is a test artifact, not a usable model, tagged test-artifact to keep it out of candidate-model search.

  • Fixture key 6757a5dfa94e. It covers every checkpoint whose processor files are byte-identical and whose config matches after shrinking.
  • Same architecture, smaller config: Gemma2ForCausalLM, shrunk by the generic rule in sweep.py (num_hidden_layers 2).
  • Processor files copied byte for byte from google/gemma-2-2b-it: generation_config.json, special_tokens_map.json, tokenizer.json, tokenizer.model, tokenizer_config.json.
  • Random weights (seed 0). They passed the input-sensitivity gate: every perturbation of the contract's inputs moved the logits by at least 0.001 (weakest: input_ids:roll_batch, 0.401), so no training was needed.
  • Same tensor names as the real checkpoint. The real checkpoint has every parameter, and so does the fixture.
  • Saved in bfloat16, the dtype google/gemma-2-2b-it loads in by default.
  • Finite in float32, bfloat16, and float16 (forward, loss, gradients).

Built by build_fixtures.py; build.json records the pinned sources, gate results, and file hashes. This repository includes the slim weights, usage and framework expectations; rebuild the other files with python example/build_fixtures.py --fixture gemma-2-2b-it-mic.

Downloads last month
298
Safetensors
Model size
16.5M params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for huggingface-mic/gemma-2-2b-it-mic

Finetuned
(1115)
this model