TADA! Tuning Audio Diffusion Models through Activation Steering
Paper โข 2602.11910 โข Published โข 2
mood (ACE-Step)
Steering vectors for the mood concept on ACE-Step, computed via contrastive activation addition (CAA).
TADA! Tuning Audio Diffusion Models through Activation Steering โ https://huggingface.co/papers/2602.11910
from src.steering import SteerableACEModel, CAASteeringController
model = SteerableACEModel(device="cuda")
model.pipeline.load()
ctrl = CAASteeringController.from_pretrained("lukasz-staniszewski/ace-step-rfm-mood", alpha=20.0)
with model.steer(ctrl):
audio = model.generate(
prompt="instrumental music", lyrics="[inst]",
audio_duration=10.0, infer_step=30, manual_seed=0,
)
{
"method": "rfm",
"concept": "mood",
"lyrics": "[inst]",
"num_cfg_passes": 2,
"save_all_cfg_passes": true,
"audio_duration": 30.0,
"num_inference_steps": 30,
"seed": 10,
"device": "cuda",
"save_dir": "steering_vectors/rfm",
"guidance_scale_text": 0.0,
"guidance_scale_lyric": 0.0,
"guidance_scale": 5.0,
"guidance_interval": 1.0,
"guidance_interval_decay": 0.0,
"rfm_iters": 30,
"n_components": 12,
"hyperparam_samples": 100,
"val_frac": 0.2
}