Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,39 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
metrics:
|
| 5 |
+
- wer
|
| 6 |
+
pipeline_tag: automatic-speech-recognition
|
| 7 |
+
---
|
| 8 |
+
# Model Card: LEVI Whisper Medium Fine-Tuned Model
|
| 9 |
+
|
| 10 |
+
## Model Information
|
| 11 |
+
- **Model Name:** levicu/LEVI_whisper_medium
|
| 12 |
+
- **Description:** This model is a fine-tuned version of the OpenAI Whisper Medium model, tailored for speech recognition tasks using the LEVI v2 dataset, which consists of classroom audiovisual recording data.
|
| 13 |
+
- **Model Architecture:** openai/whisper-medium
|
| 14 |
+
- **Dataset:** LEVI v2 (classroom audiovisual recording data)
|
| 15 |
+
|
| 16 |
+
## Training Details
|
| 17 |
+
- **Training Procedure:**
|
| 18 |
+
- LoRA Parameter Efficient Fine-tuning technique with the following parameters:
|
| 19 |
+
- r=32
|
| 20 |
+
- lora_alpha=64
|
| 21 |
+
- target_modules=["q_proj", "v_proj"]
|
| 22 |
+
- lora_dropout=0.05
|
| 23 |
+
- bias="none"
|
| 24 |
+
- INT8 quantization
|
| 25 |
+
- Trained for 6 epochs with a learning rate of 1e-4 and warmup steps of 100 without gradient accumulation.
|
| 26 |
+
- **Evaluation Metrics:** Word Error Rate (WER)
|
| 27 |
+
|
| 28 |
+
## Usage
|
| 29 |
+
- **Usage:** The model can be used for speech recognition tasks. Inputs should be audio files, and the model outputs transcriptions.
|
| 30 |
+
|
| 31 |
+
## Limitations and Ethical Considerations
|
| 32 |
+
- **Limitations:** None provided.
|
| 33 |
+
- **Ethical Considerations:** Consider the ethical implications of using this model, particularly in scenarios involving sensitive or private information.
|
| 34 |
+
|
| 35 |
+
## License
|
| 36 |
+
- **License:** Not specified.
|
| 37 |
+
|
| 38 |
+
## Contact Information
|
| 39 |
+
- **Contact:** For questions, feedback, or support regarding the model, please contact roso8920@colorado.edu or nich7312@colorado.edu.
|