Itbanque/ScreenTalk_JA2ZH
Updated โข 7
How to use Itbanque/whisper-ja-zh-base with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="Itbanque/whisper-ja-zh-base") # Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("Itbanque/whisper-ja-zh-base")
model = AutoModelForSpeechSeq2Seq.from_pretrained("Itbanque/whisper-ja-zh-base")This project fine-tunes the Whisper base model to perform Japanese audio to Chinese text translation. It uses the Hugging Face Transformers library and a custom dataset aligned for speech translation.
Achieved a BLEU score of ~0.72 on the held-out test set, indicating high translation quality.
Maintained by IT Banque | https://www.itbanque.com