SNOWTEAM
/

medico-mistral

Text Generation

text-generation-inference

Model card Files Files and versions

Boyue27 commited on Jul 12, 2024

Commit

c15a5cd

·

verified ·

1 Parent(s): 30cddce

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -45,7 +45,7 @@ model = AutoModelForCausalLM.from_pretrained(
     max_memory=max_memory_mapping,
     torch_dtype=torch.float16,
 )
-tokenizer = AutoTokenizer.from_pretrained("mistralai/Mixtral-8x7B-Instruct-v0.1")
 input_text = ""
 input_ids = tokenizer(input_text, return_tensors="pt").input_ids
 output_ids = model.generate(input_ids=input_ids.cuda(),

     max_memory=max_memory_mapping,
     torch_dtype=torch.float16,
 )
+tokenizer = AutoTokenizer.from_pretrained("SNOWTEAM/medico-mistral")
 input_text = ""
 input_ids = tokenizer(input_text, return_tensors="pt").input_ids
 output_ids = model.generate(input_ids=input_ids.cuda(),