Mxode
/

Pythia-70m-C-Language-KnowledgeExtract

Text Generation

knowledge extraction

text-generation-inference

Model card Files Files and versions

Mxode commited on Oct 5, 2023

Commit

71fb641

·

1 Parent(s): a4d4ad6

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -60,7 +60,8 @@ tokens = model.generate(
     pad_token_id=tokenizer.eos_token_id,
     max_new_tokens=32,
 )
-response = tokenizer.decode(tokens[0]).split('```')[-1].split('<')[0]	# deduplicate inputs
 ```

     pad_token_id=tokenizer.eos_token_id,
     max_new_tokens=32,
 )
+# deduplicate inputs
+response = tokenizer.decode(tokens[0]).split('```')[-1].split('<')[0]
 ```