Commit History

Merge pull request #6 from pie-314/fix/grading-bugs-and-cli
3fc0eba
unverified

pi9605 commited on

Fix pipeline 0.0 scoring override, resolve test floating-point flakiness, and add readable CLI output for inference.py
9c67b20

pi9605 commited on

Updated api base url
6b72bd2

Naman Gupta commited on

Merge pull request #4 from subhdotsol/fix
d29e78c
unverified

Naman Gupta commited on

Updated readme
f839212

Naman Gupta commited on

Merge pull request #3 from subhdotsol/fix
787c9f7
unverified

Naman Gupta commited on

small fixes
fabaddd

Naman Gupta commited on

Merge pull request #2 from pie-314/main
ec047bd
unverified

pi9605 commited on

added graders and rewards
dd3b701

pi9605 commited on

Updated readme
e25d8cb

Naman Gupta commited on

Merge pull request #1 from subhdotsol/feat/ai-integration
bce1ad6
unverified

Naman Gupta commited on

rewrite README with full setup guide and integration contracts
d11f97d

Naman Gupta commited on

update env example to use Groq instead of HuggingFace
e092a4c

Naman Gupta commited on

document all LLM prompts — what they do and why they're designed that way
39ae0cb

Naman Gupta commited on

add 59 tests for the LLM modules — all run offline, no API needed
c7a9ff1

Naman Gupta commited on

wire up the main LLM pipeline — defender + classifiers in one place
5ebe298

Naman Gupta commited on

add defense scorer — how well did the defender actually handle that?
463b003

Naman Gupta commited on

add attack classifier — did the attacker actually win this turn?
8708281

Naman Gupta commited on

add defender LLM — the AI that holds the line against attacks
e28e08d

Naman Gupta commited on

add ConversationManager to give the defender a memory
99a9cb9

Naman Gupta commited on

add Groq client setup — one place to rule all API calls
f778bee

Naman Gupta commited on

chore: final cleanup — remove stray files, verify all imports resolve
ab90fa0

subhdotsol commited on

refactor: replace datetime.utcnow() with timezone-aware datetime.now(UTC)
40e374a

subhdotsol commited on

docs: add example usage code snippet for httpx client in README
f15649d

subhdotsol commited on

docs: add task difficulty table and Docker usage section to README
9ead4a8

subhdotsol commited on

docs: add API endpoint table to README
d546c9d

subhdotsol commited on

test(graders): add programmatic_grader tests — structure, score range, letter grade
30ab30f

subhdotsol commited on

test(graders): add hard_grader tests — breakthrough bonus and repetitive penalty
dc89e10

subhdotsol commited on

test(graders): add medium_grader tests — diversity scores higher than uniform strategies
843ee19

subhdotsol commited on

test(graders): add easy_grader tests — empty, good, bad episode and range check
a5aa26d

subhdotsol commited on

test(environment): add injection tests — custom reward_computer and llm_pipeline are called
613f214

subhdotsol commited on

test(environment): add framing sanitization tests for script and javascript injection
b81d32a

subhdotsol commited on

test(environment): add guard tests — step without reset raises, step past max_turns raises
d512522

subhdotsol commited on

test(environment): add step() tests — turn increment, history append, result shape
fd32873

subhdotsol commited on

test(environment): add reset() tests — observation shape, history clear, unique ids
51dbc62

subhdotsol commited on

chore(tests): add tests package __init__.py
2bab08f

subhdotsol commited on

feat(inference): add main() — runs all 3 task difficulties with 20-minute guard
e00a7dd

subhdotsol commited on

feat(inference): implement run_episode() — full reset→step loop with httpx client
bff2d46

subhdotsol commited on

feat(inference): add strategy escalation logic — harder strategies as turns increase
0d902c2

subhdotsol commited on

feat(inference): add generate_attack() — uses OpenAI client to craft next framing
3cd5882

subhdotsol commited on

feat(inference): scaffold inference.py with OpenAI client config and env vars
57c321d

subhdotsol commited on

feat(llm): add run_llm_pipeline() stub with correct return shape for Person 3
962dc67

subhdotsol commited on

chore(llm): add llm package __init__.py
d0d319c

subhdotsol commited on

feat(rewards): add RewardComputer wrapper class with __call__ and reset() for injection
a8b148d

subhdotsol commited on

feat(rewards): add reset_scorer() stub for novelty scorer reset between episodes
6e3f9a2

subhdotsol commited on

feat(rewards): add compute_rewards() stub with correct return shape for Person 2
d683d9b

subhdotsol commited on

chore(rewards): add rewards package __init__.py
62b425a

subhdotsol commited on

feat(graders): add letter grade, summary and full metrics dict to grade_episode()
081c6ca

subhdotsol commited on

feat(graders): implement all 5 scoring components in programmatic_grader
0b1e995

subhdotsol commited on

feat(graders): add programmatic_grader scaffold and grade_episode() signature
c5c7c2a

subhdotsol commited on