flax-lora-distilbert-base-uncased / adapter_config.json
KRadim's picture
LoRA adapter for Flax DistilBERT (NNX implementation)
1d56598 verified
{
"lora_rank": 16,
"lora_alpha": 32,
"target_modules": [
"q_lin",
"v_lin"
],
"base_model_name": "distilbert-base-uncased",
"task_type": "sequence_classification"
}