File size: 899 Bytes
b7c4f2c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
This model is licensed under the Fish Audio Research License, Copyright © 39 AI, INC. All Rights Reserved.

This repository is a Derivative Work, under the Fish Audio Research License,
of fishaudio/s2-pro (https://huggingface.co/fishaudio/s2-pro).

Changes made:
- A LoRA adapter (r=32, alpha=16) on the attention and mlp modules of both the
  slow and fast transformers.
- 26 atomic input-only tokens for Hebrew IPA symbols, each with its own
  trainable embedding, added to the tokenizer (155,774 -> 155,800 tokens) and
  trained alongside the LoRA weights. The output vocabulary is unchanged.
- A fix to an embedding-scale mismatch between the training and inference
  paths in fish_speech/models/text2semantic/llama.py (upstream of this
  adapter's own training), which applies to any S2-Pro fine-tune.

The full license text is at:
https://github.com/maxmelichov/fish-speech/blob/main/LICENSE