traces/sample/README.md

# Sample LLM traces — Sharing-is-Caring badge

These JSONL files are unedited captures of every LLM call from real
playthroughs of *The Apprentice*. One JSON object per line, schema
documented in [`../README.md`](../README.md).

## Files

| File | Records | Calls | Notes |
|---|---|---|---|
| `three-playthroughs-fantasy-en.jsonl` | 117 | All `oracle-wizard-lora` (the fine-tune) | Three back-to-back playthroughs in one Python process. Default `Tobin / the Hollow` hero+village, English, fantasy theme. ~422k prompt tokens / ~43k output tokens total. 90 JSON-mode calls (resolutions + fork picks) + 27 text-mode calls (interludes + epilogue + theme expansion). |

## Quick exploration

Inspect with `jq`:

```bash
# Distinct models served
jq -r '.model_returned' three-playthroughs-fantasy-en.jsonl | sort -u

# Just the responses
jq -r '.response' three-playthroughs-fantasy-en.jsonl | head -3

# Calls by mode
jq -r '.mode' three-playthroughs-fantasy-en.jsonl | sort | uniq -c

# Latency distribution (ms)
jq -r '.latency_ms' three-playthroughs-fantasy-en.jsonl | sort -n | awk '
  {a[NR]=$1; sum+=$1} END {
    print "min:",a[1],"p50:",a[int(NR/2)],"p95:",a[int(NR*0.95)],"max:",a[NR],"mean:",sum/NR
  }'
```

## How these were generated

LLM-call tracing is default-on in this app. Set
`ORACLES_TRACE_DISABLE=1` to opt out. Each session writes to
`traces/oracles-trace-<12-char-hex>.jsonl`. The
[`curate_trace`](../../scripts/curate_trace.py) script copies one of
those session files into this directory under a friendlier label.