Add Whisper weight collection card

README.md

@@ -0,0 +1,88 @@
+---
+license: apache-2.0
+language:
+- multilingual
+pipeline_tag: automatic-speech-recognition
+tags:
+- audio
+- automatic-speech-recognition
+- whisper
+- safetensors
+---
+
+# Whisper inference weights
+
+Inference-oriented conversions of OpenAI Whisper checkpoints. The model architecture and learned parameters come from [OpenAI Whisper](https://github.com/openai/whisper) and the corresponding [`openai/whisper-*`](https://huggingface.co/models?search=openai%2Fwhisper) repositories.
+
+This repository uses branches to keep each model at the conventional root path `model.safetensors`:
+
+| Revision | Source | Parameters | Languages |
+|---|---|---:|---|
+| [`tiny`](https://huggingface.co/vpermilp/whisper/tree/tiny) | [`openai/whisper-tiny`](https://huggingface.co/openai/whisper-tiny) | 39M | Multilingual |
+| [`small`](https://huggingface.co/vpermilp/whisper/tree/small) | [`openai/whisper-small`](https://huggingface.co/openai/whisper-small) | 244M | Multilingual |
+| [`medium`](https://huggingface.co/vpermilp/whisper/tree/medium) | [`openai/whisper-medium`](https://huggingface.co/openai/whisper-medium) | 769M | Multilingual |
+| [`large-v3`](https://huggingface.co/vpermilp/whisper/tree/large-v3) | [`openai/whisper-large-v3`](https://huggingface.co/openai/whisper-large-v3) | 1.55B | Multilingual |
+
+Always select a revision. The `main` branch is an index and does not contain weights.
+
+## Transformation
+
+The conversion is deterministic and does not train or otherwise alter the model:
+
+- Linear, convolution, embedding, and other compute weights are stored as IEEE FP16.
+- Positional embeddings and LayerNorm affine parameters remain FP32, matching Whisper's mixed-precision inference behavior.
+- Hugging Face Transformers parameter paths are normalized to the concise OpenAI Whisper layout, for example `model.decoder.layers.0.self_attn.q_proj.weight` becomes `decoder.blocks.0.attn.query.weight`.
+- Tied token embeddings are stored once in FP16 and used for both token lookup and vocabulary projection.
+- Non-floating tensors are preserved without conversion.
+- Tokenizer, generation, preprocessing, and architecture configuration files are copied from each source revision.
+
+The mixed storage cuts checkpoint size and prevents runtimes from repeatedly converting a large FP32 vocabulary matrix during autoregressive decoding. FP16 conversion introduces the expected rounding relative to the source FP32 checkpoints.
+
+Because parameter names are normalized, these weights are **not a drop-in `transformers` checkpoint**. Consumers must understand the OpenAI-style paths. [Svod](https://github.com/npatsakula/svod) can load this layout directly.
+
+## Loading
+
+With Svod, pass the branch as the Hub revision and use dimensions matching that branch:
+
+```rust
+let model = Whisper::from_hub(
+    "vpermilp/whisper",
+    "medium",
+    ModelDimensions::for_size(WhisperSize::Medium),
+)?;
+```
+
+For generic safetensors consumers:
+
+```python
+from huggingface_hub import hf_hub_download
+
+path = hf_hub_download(
+    "vpermilp/whisper",
+    "model.safetensors",
+    revision="medium",
+)
+```
+
+## Model
+
+Whisper is a Transformer encoder-decoder model for multilingual speech recognition and speech translation to English. It was trained by OpenAI on 680,000 hours of weakly supervised audio data. See the paper [Robust Speech Recognition via Large-Scale Weak Supervision](https://arxiv.org/abs/2212.04356), the [original repository](https://github.com/openai/whisper), and each source model card for architecture details, evaluation results, intended uses, training data, and complete limitations.
+
+## Limitations
+
+These converted weights retain the source models' behavior and limitations. Whisper can hallucinate text not present in the audio, generate repetitions, perform unevenly across languages and accents, and make consequential transcription errors. Evaluate the selected model on the target language, domain, acoustic conditions, and hardware before deployment. Do not use transcription or inferred attributes for high-risk decisions, and do not transcribe people without an appropriate legal basis or consent.
+
+No independent benchmark suite is claimed for these conversions. Results reported by OpenAI apply to the source checkpoints and evaluation procedures; FP16 rounding can produce small output differences.
+
+## License and attribution
+
+The source checkpoints are distributed under the Apache License 2.0. This repository preserves that license and attributes OpenAI and the Whisper authors. Model-card content is adapted in part from the OpenAI/Hugging Face Whisper cards.
+
+```bibtex
+@article{radford2022robust,
+  title={Robust Speech Recognition via Large-Scale Weak Supervision},
+  author={Radford, Alec and Kim, Jong Wook and Xu, Tao and Brockman, Greg and McLeavey, Christine and Sutskever, Ilya},
+  journal={arXiv preprint arXiv:2212.04356},
+  year={2022}
+}
+```