albert-base-v2-mic

Slim model weights, executable usage and framework expectations in one repository.

Contract

ALBERT fill-mask

Runnable usage and the framework expectations directory are linked above.

Slim model

Slim fixture: albert-base-v2-mic

A 11.3M-parameter fixture for the ALBERT MIC, covering albert/albert-base-v2. It is a test artifact, not a usable model, tagged test-artifact to keep it out of candidate-model search.

  • Fixture key b903f3096f56. It covers every checkpoint whose processor files are byte-identical and whose config matches after shrinking.
  • The checkpoint's own config, not shrunk: AlbertForMaskedLM at 11.3M parameters is at or under the 20M below which a source is kept whole.
  • Processor files copied byte for byte from albert/albert-base-v2: spiece.model, tokenizer.json, tokenizer_config.json.
  • The checkpoint's own trained weights, unchanged: at 11.3M parameters it is no bigger than a slim fixture. They passed the input-sensitivity gate (weakest: input_ids:roll_batch, 40).
  • Same tensor names as the real checkpoint. The real checkpoint has every parameter, and so does the fixture.
  • Saved in float32, the dtype albert/albert-base-v2 loads in by default.
  • Finite in float32, bfloat16, and float16 (forward, loss, gradients).

Built by build_fixtures.py; build.json records the pinned sources, gate results, and file hashes. This repository includes the slim weights, usage and framework expectations; rebuild the other files with python example/build_fixtures.py --fixture albert-base-v2-mic.

Downloads last month
305
Safetensors
Model size
11.3M params
Tensor type
F32
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for huggingface-mic/albert-base-v2-mic

Finetuned
(250)
this model

Space using huggingface-mic/albert-base-v2-mic 1