Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking
Paper • 2403.09629 • Published • 79
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="pharaouk/qstar", trust_remote_code=True)# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("pharaouk/qstar", trust_remote_code=True, dtype="auto")YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quiet-STaR (https://arxiv.org/abs/2403.09629)
# Gated model: Login with a HF token with gated access permission hf auth login