YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

zuhri025/lm_weights_small_tts_prepared

Base model : zuhri025/lm_weights_scratch_small_v2 @ checkpoint-33000

Extended with TTS vocabulary:

  • <|audio_0|> โ€ฆ <|audio_12801|> โ€” audio codebook (12,802 tokens, IDs 50011โ€“62812)
  • Boundary: <|start_of_audio|>, <|end_of_audio|>, <|audio|>
  • Text gates: <|start_of_text|>, <|end_of_text|>
  • Conditioning: <|male|>, <|female|>, <|other|>, <|accent_us|>, <|accent_uk|>, <|unconditional|>

Total vocab: 62,813

Embedding init

  • Special/structural tokens โ†’ mean of original embeddings + ฯƒ=0.02 noise
  • Audio code tokens โ†’ ฯƒ=0.02 random normal (independent codebook)
  • All original embeddings unchanged.

Prepared for fine-tuning on zuhri025/Urdu-Munch-Processed-s.

Downloads last month
107
Safetensors
Model size
77.8M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support