Owaner/fineweb-falcon

Direct Use

import transformers as tfm 

model = tfm.AutoModelForCausalLM.from_pretrained("Owaner/fineweb-falcon")
tokenizer = tfm.PreTrainedTokenizerFast.from_pretrained("Owaner/falcon_tokenizer")

example = "When habitually indulge in "
tokenized_input = tokenizer(example, return_tensors="pt", return_token_type_ids=False)
output = model.generate(
    inputs=tokenized_input["input_ids"],
    attention_mask=tokenized_input["attention_mask"],
    do_sample = True,
    max_length=100,
    temperature=0.7,
    top_k=50,
    top_p=0.95,
    num_return_sequences=5
)
output_text = tokenizer.batch_decode(output, skip_special_tokens=True)

for i, o in enumerate(output_text):
    print(f"Output {i+1}: {o}") 

• Hardware Type: Single Nvidia A80 memory 80
• Hours used: 2 hours
• Cloud Provider: DataCrunch
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]