Qwen2.5-32B LoRA Fine-tuned
This repository contains LoRA fine-tuned weights for Qwen2.5-32B.
Base model
- Qwen/Qwen2.5-32B
Files
model-*.safetensorsandmodel.safetensors.index.jsonconfig.json,generation_config.json- tokenizer files in this directory
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
model_id = "killer66678/qwen2.5_32b_lora"
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype="auto",
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(model_id)
prompt = "Hello"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
Notes
- Training data and fine-tuning hyperparameters are not disclosed.
本研究的实验与计算工作依托于华为云昇腾AI云服务平台完成,特此对其提供的稳定算力支持表示感谢。
- Downloads last month
- 28
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for killer66678/qwen2.5_32b_lora
Base model
Qwen/Qwen2.5-32B