| | --- |
| | language: |
| | - en |
| | base_model: |
| | - microsoft/Phi-4-mini-instruct |
| | pipeline_tag: text-generation |
| | tags: |
| | - professional |
| | - linkedin |
| | --- |
| | |
| | * Parameter-efficient, instruction-fine-tuned phi-4-mini model. |
| | * Uses LoRA for fine-tuning. |
| | * Trained on LinkedIn posts from various themes. |
| |
|
| | * Training details: |
| | <ul> |
| | <li>Training size: 2643</li> |
| | <li>Quantization: 8-bit</li> |
| | <li>Optimizer: AdamW</li> |
| | <li>Learning Rate: 1e-4</li> |
| | <li>Epochs: 1</li> |
| | <li>Train Batch size: 1</li> |
| | <li>Eval Batch size: 4</li> |
| | <li>Gradient accumulation steps: 8</li> |
| | <li>Sequence length: 412</li> |
| | </ul> |
| | |
| | * LoRA configs: |
| | <ul> |
| | <li>Rank: 16</li> |
| | <li>Alpha: 16</li> |
| | <li>Dropout: 0.05</li> |
| | </ul> |
| |
|
