Qwen2.5-32B LoRA Fine-tuned

This repository contains LoRA fine-tuned weights for Qwen2.5-32B.

Base model

  • Qwen/Qwen2.5-32B

Files

  • model-*.safetensors and model.safetensors.index.json
  • config.json, generation_config.json
  • tokenizer files in this directory

Usage

from transformers import AutoTokenizer, AutoModelForCausalLM

model_id = "killer66678/qwen2.5_32b_lora"
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype="auto",
    device_map="auto",
)

tokenizer = AutoTokenizer.from_pretrained(model_id)

prompt = "Hello"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Notes

  • Training data and fine-tuning hyperparameters are not disclosed.

本研究的实验与计算工作依托于华为云昇腾AI云服务平台完成,特此对其提供的稳定算力支持表示感谢。

Downloads last month
28
Safetensors
Model size
33B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for killer66678/qwen2.5_32b_lora

Base model

Qwen/Qwen2.5-32B
Adapter
(31)
this model