Spaces:

openenv-community
/

test-local-nested-envs

Running on T4

App Files Files Community

test-local-nested-envs

4 contributors

History: 67 commits

KarlLearnsAI's picture

Upload minimum_training_script.ipynb

37d5368 verified 2 days ago

assets
Upload architecture.png 2 days ago
layer0
Improve reward function to break refuse-everything local minimum and scale training 2 days ago
layer1
Pre-format SFT dataset as text column, drop formatting_func 2 days ago
layer2
Switch Llama 3.1 8B to ungated unsloth mirror 2 days ago
personas
Clean up dead code, unused imports, and move hardcoded values to config.yaml 2 days ago
scripts
Make Supabase uploads incremental — upload after every step 2 days ago
tests
Improve reward function to break refuse-everything local minimum and scale training 2 days ago
.gitattributes

60 Bytes

Upload assets/architecture.png with huggingface_hub 2 days ago
.gitignore

126 Bytes

Implement self-improving AI oversight system with nested RL environments 3 days ago
Dockerfile

199 Bytes

Add supabase to Dockerfile pip install 2 days ago
README.md

18.3 kB

Add HF Spaces config metadata to README 2 days ago
app.py

4.83 kB

Upload app.py with huggingface_hub 2 days ago
config.yaml

4.31 kB

Increase training scale: more steps, episodes, and SFT epochs 2 days ago
config_loader.py

5.69 kB

Add SFT warm start before GRPO and DB connectivity init check 2 days ago
minimum_training_script.ipynb

261 kB

Upload minimum_training_script.ipynb 2 days ago
pyproject.toml

917 Bytes

Move supabase to core dependencies 2 days ago
train.sh

1.04 kB

Add train.sh startup script and assets folder 2 days ago