File size: 1,312 Bytes
26b4a6f
 
795b5aa
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26b4a6f
795b5aa
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
---
license: apache-2.0
tags:
- reinforcement-learning
- ml-agents
- ML-Agents-Pyramids
- deep-rl-class
model-index:
- name: Pyramids
  results:
  - task:
      type: reinforcement-learning
      name: Reinforcement Learning
    dataset:
      name: ML-Agents-Pyramids
      type: ML-Agents-Pyramids
    metrics:
    - type: mean_reward
      name: mean_reward
      value: -0.8986 +/- 0.4869
---

# Pyramids

Trained from random initialization for Vlad Kolomiiets (`Vladprime`) using the official Hugging Face Deep RL Course Unity environment and Unity ML-Agents 1.1.0. No pretrained weights were used. This is an initial training run; it is not claimed to have converged. Units 5 and 7 require publishing a trained model without a reward threshold.

Training: ppo, 30000 configured environment steps, seed 20261101. Export: genuine ML-Agents ONNX plus PyTorch checkpoint and trainer configuration. Separate ONNX evaluation process: seed 1000000; 48 completed agent episodes, mean -0.8986, standard deviation 0.4869. Original environment, action and observation spaces were retained. See results.json for individual returns and evaluation limitations.

The .onnx file is compatible with the course Unity browser viewer. Training/evaluation code is in train-unity.py; the exact run configuration is config.yaml.