TwT-6
/

cr-model

Text Generation

Eval Results (legacy)

text-generation-inference

Model card Files Files and versions

TwT-6 commited on May 8, 2024

Commit

b9fa8ea

·

verified ·

1 Parent(s): 88679c6

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -14,11 +14,11 @@ import torch
 model = AutoModelForCausalLM.from_pretrained(
-    'TwT-6/open_llm_leaderboard_demo',
     attn_implementation="flash_attention_2",
     trust_remote_code=True, torch_dtype=torch.bfloat16, device_map="auto").eval()
-tokenizer = AutoTokenizer.from_pretrained('TwT-6/open_llm_leaderboard_demo', trust_remote_code=True)
 inputs = '你好'

 model = AutoModelForCausalLM.from_pretrained(
+    'TwT-6/cr-model',
     attn_implementation="flash_attention_2",
     trust_remote_code=True, torch_dtype=torch.bfloat16, device_map="auto").eval()
+tokenizer = AutoTokenizer.from_pretrained('TwT-6/cr-model', trust_remote_code=True)
 inputs = '你好'