File size: 849 Bytes
832bafc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 | ---
license: apache-2.0
base_model: ineso22/affine-vscode
tags:
- lora
- peft
- qwen
- causal-lm
---
# out_affine
This model is a fine-tuned version of [ineso22/affine-vscode](https://huggingface.co/ineso22/affine-vscode) using LoRA (Low-Rank Adaptation).
## Model Details
- **Base Model**: ineso22/affine-vscode
- **Training Method**: LoRA (Low-Rank Adaptation)
- **LoRA Rank**: 16
- **LoRA Alpha**: 32
- **LoRA Dropout**: 0.05
- **Quantization**: 4-bit QLoRA
- **Precision**: bfloat16
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model = AutoModelForCausalLM.from_pretrained(
"out_affine/merged_model",
torch_dtype=torch.bfloat16,
trust_remote_code=True,
device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("out_affine/merged_model")
# Your inference code here
```
|