HMC83/synthetic_foi_requests
Viewer • Updated • 51.3k • 9
How to use HMC83/request_writer_sbp_2 with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("HMC83/skunkbadger-phoenix")
model = PeftModel.from_pretrained(base_model, "HMC83/request_writer_sbp_2")How to use HMC83/request_writer_sbp_2 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("HMC83/request_writer_sbp_2", dtype="auto")Tiny 22M param model based on GPT2
This model expects a prompt following the Alpaca instruction format. The user's query should be placed after ### Instruction:.
You are an expert at writing formal Freedom of Information requests to UK public authorities. Write clear, specific, professional requests that comply with FOI requirements and use accessible language. ### Instruction:
Generate a formal Freedom of Information request to {authority_name} using these keywords: {keywords}
### Response:
{authority_name} with the name of the public body.{keywords} with a comma-separated list of relevant keywords.Base model
HMC83/skunkbadger-phoenix