--- library_name: transformers pipeline_tag: text-generation tags: - mymodel - causal-lm --- # MyModel-sft MyModel 稠密文本模型(sft-4k),参数量 259M,训练 step 4,968,tokens 0.17B。 ## 使用 ```python from transformers import AutoModelForCausalLM, AutoTokenizer repo_id = "HappyBulingling/MyModel-sft" tokenizer = AutoTokenizer.from_pretrained(repo_id) model = AutoModelForCausalLM.from_pretrained(repo_id, trust_remote_code=True) messages = [{"role": "user", "content": "你好"}] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, return_tensors="pt", enable_thinking=True ) outputs = model.generate( inputs, max_new_tokens=256, do_sample=True, temperature=0.8, top_p=0.9 ) print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True)) ```