CLAUDE.md

Project Overview

This repo contains code generating text using GEMMA 4 via the transformers library

Inflections

The goal of this work is to use GEMMA 4 to generate 5 beams in response to a prompt. Each beam is parsed and can be displayed along with it's total 'score.' Each beam can also be displayed with a score-per-token.

What needs work

• create a second version of the inflections.py file with all class methods as separate functions. they should each return needed variables needed to call the next function,
• modify the app.py so that the input elemnet takes the prompt and the output displays the first beam, with any token with score < 0.6 is highlighted in red.

Tech Stack

• Language: Python
• packages:
  • transformers
  • torch

Project Structure

llm_inflections/
  inflections.py           # inflection class
  app.py                   # gradio gui
  

Other information

• assume any API keys can be obtained as environment variables.