Commit History

ci: add HF Space keep-alive and uptime-monitor workflows; docs
44b7781

X2-0 commited on

server: serve showcase HTML at / so HF Space embed mirrors *.hf.space/showcase (move root JSON to /info)
caad989

r1cksync commited on

docs: update demo video link to https://youtu.be/aBnQ33q9MMw across README, BLOG, and showcase header
43e6a55

r1cksync commited on

blog: inline ENV_DEEP/ENV_SHALLOW/TASKS_SHALLOW into BLOG.md (deep first); voice: tour deep regime in scene04
c5cb009

r1cksync commited on

showcase: add Deep regime section (Rounds 1+2) with 11-archetype table, per-checkpoint Round 1 numbers, v2/v3/v4 critic swap deltas, and per-task v2->v4 improvement table
4baed7b

r1cksync commited on

docs: add TASKS_SHALLOW.md - row-by-row index of all 381 procedural scenarios
850a8df

r1cksync commited on

docs: add env reference for deep (11-task) and shallow (381-task) regimes; expand BLOG appendix
c161c7b

r1cksync commited on

blog+readme: document the two prior deep-training rounds (legacy SB3 + hybrid Ollama/Groq PPO on 11 tasks); cite training code; add 3-panel deep-training chart
aa4671b

r1cksync commited on

blog: replace mermaid fences with rendered PNGs (some viewers don't render mermaid); tighten legacy chart y-axis
d505de0

r1cksync commited on

blog: embed legacy + LLM training graphs and 3 mermaid pipeline DAGs
34b426f

r1cksync commited on

blog: add BLOG.md (story + novelties + training proofs); README: link YouTube + blog; voice: auto-recorder + scene06 fix
adc6367

r1cksync commited on

showcase(results): add evidence-of-learning section + scene04 voiceover walks legacy baseline vs PPO Kaggle, KL/loss convergence, per-category Δ
484e9cc

r1cksync commited on

showcase(slack): wrap long lines in code snippets so they don't overflow the card
5d2296e

r1cksync commited on

showcase: add Slack-noise novelty section + DAG; voiceover scene03 mentions coworker Slack; 4:58 total under 5min cap
aaf95f8

r1cksync commited on

fix(showcase): visible task grid + reward-sign explainer; fix(dashboard): rewards stretch glitch + dual legacy/ppo dashboards with sourced-file banners
1268301

r1cksync commited on

feat(showcase): /showcase page + precomputed bundle + READMEs + video script
898958e

r1cksync commited on

feat(train): show current task_id in heartbeat lines so round-robin coverage is visible at a glance
4d16e00

r1cksync commited on

fix(collector): persist task cursor across PPO updates - was resetting to 0 each update so only first IC_ROLLOUTS tasks were ever trained on; now round-robins full shard (3 rollouts x 60 updates = 180 visits over 127-task shard = full coverage); also log first/last 5 task ids at startup so coverage is visible
c1e7f70

r1cksync commited on

fix(train_lib): wrap unsloth for_training/for_inference in try/except — peft+unsloth compat bug deletes _flag_for_generation; falls back to model.train()/eval() (correct, slightly slower); add IC_DISABLE_UNSLOTH escape hatch
4eede85

r1cksync commited on

feat: hand-written 3 Kaggle ipynbs with unsloth install attempt; train_lib disables actor grad-checkpoint + filters Phi3 warning spam (2x faster + clean logs)
0fa8055

r1cksync commited on

fix: drop trust_remote_code so transformers uses native Phi-3/Qwen3 (custom modeling code is incompatible with t>=4.48 DynamicCache API)
423678c

r1cksync commited on

fix(kaggle): bump transformers to >=4.51 for Qwen3 (DeepSeek-R1-Qwen3-8B critic)
e30ba27

r1cksync commited on

fix(kaggle): chdir out of WORK before rmtree so re-run git clone succeeds
77494d7

r1cksync commited on

fix(kaggle): always wipe + re-clone repo so HF_TOKEN-optional fix is picked up
5cb38e8

r1cksync commited on

feat(train): make HF_TOKEN optional + continuous live ETA heartbeat during rollouts
a116aa4

r1cksync commited on

feat(kaggle): use user-pinned mount paths Phi-3.5-mini (actor) + DeepSeek-R1-0528-Qwen3-8B (critic); train_lib: trust_remote_code + adaptive LoRA target_modules for fused-qkv archs
1a1b258

r1cksync commited on

fix(kaggle): switch to Phi-3 (MIT, no access gate) since Llama license requests are disabled
a09e127

r1cksync commited on

fix(kaggle): use Kaggle Models (Llama-3.2-1B + Llama-3.1-8B) instead of HF download to avoid filling /kaggle/working
9647546

r1cksync commited on

fix(kaggle): download Qwen actor+critic from HF Hub instead of Kaggle Models
e683d0b

r1cksync commited on

feat(kaggle): 3 sharded training notebooks + local-critic mode + LoRA merge
01853a1

r1cksync commited on

feat(phases): realistic 3x12 configs for phase2/3 launchers
a3b4e38

r1cksync commited on

fix(hfjob): bitsandbytes 0.45.5 to avoid triton.ops removal
92cef9d

r1cksync commited on

fix(hfjob): pin transformers/peft/bnb stack — skip unsloth (gemma3n compile crash)
bd45d93

r1cksync commited on

fix(actor): fallback to plain HF transformers when unsloth fails to import
fc28e1a

r1cksync commited on

fix(hfjob): install unsloth_zoo + datasets/sentencepiece deps that unsloth needs
053e85b

r1cksync commited on

fix(hfjob): use python3 interpreter (HF transformers image has no python alias)
05befc7

r1cksync commited on

feat(train): warm-start adapter loading + IC_TASK_MODE (curated/all/hard) + phase2/phase3 launchers
2824f8c

r1cksync commited on

feat(train): live tqdm+ETA, per-update HF Hub checkpoint upload, HF Jobs entrypoint + launcher
ca4df62

r1cksync commited on

fix(colab): silence Qwen max_length FutureWarning, real 120-update training run, validated task IDs
8d39d55

r1cksync commited on

feat(phase8-10): saboteur+slack+replay, 381 scenarios, Colab Unsloth+Qwen72B critic, push helpers
94db88e

r1cksync commited on

Remove kube-sre-gym comparison from README
09669df
unverified

Sagnik commited on

fix(dashboard): hoist unicode literals out of f-string expression for py3.11
b97516e

r1cksync commited on

v4: Groq critic, real AWS writes, +17 reward signals, dashboard polish
ea0a2a4

r1cksync commited on

rename hybrid-ollama-bedrock -> ppo-v3-hybrid-ollama-bedrock so it sorts last and becomes dashboard default
dce8d90

r1cksync commited on

fix: replace f-string with backslash escapes that broke dashboard_pages import
5be0e41

r1cksync commited on

Hybrid Ollama+Bedrock actor-critic trainer + dashboard snapshot pipeline
064f2b7

r1cksync commited on

Real training data + full AWS multi-service infra
64bb5a5

r1cksync commited on

fix(hf): copy dashboard_pages.py into image + avoid Py3.11 f-string backslash
cb6c37f

r1cksync commited on

fix: include dashboard pages in HF image
354d7e8

r1cksync commited on

feat: actor-critic PPO trainer + multi-page analytics dashboard
bff3da2

r1cksync commited on