Phongsakon commited on
Commit
3f9a9db
·
verified ·
1 Parent(s): 71a32b2

Upload RL checkpoints (DQN/Rainbow/PPO/IQL/threshold × DK1/DK2 × R1–R6)

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
rl/README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # RL trading checkpoints
2
+
3
+ PyTorch state dicts for the RL trading agents benchmarked in *The Trader's
4
+ Trinity* — day-ahead discrete trading (buy/flat/sell) and Danfoss consumption
5
+ optimisation on DK1/DK2 across six expanding-window rounds (R1–R6).
6
+
7
+ ## Layout
8
+
9
+ ```
10
+ rl/
11
+ <agent>_<zone>_r<round>.pt # per-round agent weights
12
+ <agent>_<zone>.pt # final (latest round) convenience copy
13
+ dqn_consumption_<zone>_r<round>.pt # consumption-optimisation variant
14
+ threshold_<zone>.pt # baseline threshold policy state
15
+ ```
16
+
17
+ Agents: ``dqn``, ``rainbow``, ``ppo``, ``iql``, ``threshold``. Zones: ``dk1``,
18
+ ``dk2``. Rounds: ``r1``–``r6`` (expanding window, see the repo CLAUDE.md for the
19
+ train/val/test split per round).
20
+
21
+ ## Usage
22
+
23
+ ```python
24
+ from huggingface_hub import hf_hub_download
25
+ import torch
26
+
27
+ ckpt = hf_hub_download(
28
+ repo_id="Phongsakon/the-traders-trinity-checkpoints",
29
+ filename="rl/ppo_dk1_r6.pt",
30
+ )
31
+ state = torch.load(ckpt, map_location="cpu")
32
+ ```
33
+
34
+ Architecture constructors and environment wrappers live in
35
+ [phomarkon/the-traders-trinity](https://github.com/phomarkon/the-traders-trinity)
36
+ under ``research/rl/agents`` and ``research/rl/envs``.
rl/dqn_consumption_dk1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f978e4b399aff212cb2b317618164a740e30b601e577b0b7f3c711510855b24
3
+ size 432249
rl/dqn_consumption_dk1_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e30e2cd5585c91fcbcf64a35e5a22795e3556ab9564534f98b8cbbbd4db367e7
3
+ size 432485
rl/dqn_consumption_dk1_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69ee905308e436825580b85cfd9ae0c2ffc3bf288bd02e84ec3a16b29f83a683
3
+ size 432485
rl/dqn_consumption_dk1_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:874d7edfcfac06df6568793401d929f6460609c4bf2519ee2a6a62dea80478d4
3
+ size 432485
rl/dqn_consumption_dk1_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9170bc624c1f7c59aa6cf2c60e4bc2f6e584375fafa0859f480665b4f91e2ef8
3
+ size 432485
rl/dqn_consumption_dk1_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a06ecf556d9ff008d0f155cf8d41a96c9ab75538335edd4c447415e295848f34
3
+ size 432485
rl/dqn_consumption_dk1_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b24bbf767bbbc4ddabc12d26fbf27bbc56ab2180923a61afda8f323100a67aa3
3
+ size 432485
rl/dqn_consumption_dk2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcc2f61d2a707a5310e3a0eb9f696c196ce799d1b5e2a518e83d89738cedf40a
3
+ size 432249
rl/dqn_consumption_dk2_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f242607aa4598902e4e841199fd2e74c547db48e3f3f53dedc9cb1311cbe118a
3
+ size 432485
rl/dqn_consumption_dk2_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e42d3a641ad91f339def2e357f289e524a9cb7db9a6597e2507f85f5441b9e87
3
+ size 432485
rl/dqn_consumption_dk2_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c235da73a6a21eabd6b4352b48aac0172247acf08277123b6c3861ec97cfac4
3
+ size 432485
rl/dqn_consumption_dk2_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e08c5988279b6711117457dcb8773206b527685ff53875b4091cdfeb344ba3e6
3
+ size 432485
rl/dqn_consumption_dk2_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b6a7c3b8421712d5124b7d19fadd24040f7084f772db2fd7816ed814433155e
3
+ size 432485
rl/dqn_consumption_dk2_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:053446f24d548e469564c7da3526734aeb8ff760703073b3c5a16b1dcf0c0d34
3
+ size 432485
rl/dqn_dk1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b303ca02e9a8bfa2bc84390b04e22e825c0252c6e68510a62a704f9f75a7d49e
3
+ size 433353
rl/dqn_dk1_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:235888876f77efa9d6eb4ef56e51b6640a115a7ff3d399f76ddedde2c3afb412
3
+ size 433973
rl/dqn_dk1_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4062f197486fb53ac3452760b82f43f494e1cb07de7923cd0537a075fe56194d
3
+ size 433973
rl/dqn_dk1_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3d45898b44410f2cbe50a4868e1ef32927dfa9272ec1a23c1e1e9a03c1b4132
3
+ size 433973
rl/dqn_dk1_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43b09c9912730672c63b0a5de32370144a720e427a27b79e73e85e497fc71921
3
+ size 433973
rl/dqn_dk1_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64746503ab8d939be020211cb9dd68b618c8ca2572bcfc8ba63642601c8e1e55
3
+ size 433973
rl/dqn_dk1_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45711669d70af35e7e4e0f420d32ade2191a6542ffac3e9dd9b74032346ac452
3
+ size 433973
rl/dqn_dk2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2920ca156dadeae7a56f537b2cb205060a862ca9d7fc3233cffa62fa0b55abe7
3
+ size 433353
rl/dqn_dk2_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59ff765a5dcef1cf5c938735ca312f6d983d52011965b80e9cf099f665c2a7dd
3
+ size 433973
rl/dqn_dk2_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2fc095dfa2797a17124648580db7a8948b843c6e9200f8580a38a9f543a4ceb
3
+ size 433973
rl/dqn_dk2_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a917ae1616d48c02a2cba9b0ba7b7625ee2b562909172f51f2c1a12e5441690
3
+ size 433973
rl/dqn_dk2_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6db6c18f2e0665fa902727cfb5bdb31268a708e8cc875f9c6b49499548b70f8
3
+ size 433973
rl/dqn_dk2_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:647ef166d94a86983e1fb1b78a86e6b3fdefcb0d72698f3d52bf31755679a836
3
+ size 433973
rl/dqn_dk2_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d90709a773d800c7d9145309dd44fd53329ad4ff948c05ceaefd10ac0c4554b6
3
+ size 433973
rl/iql_dk1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af812ffc200c14e425cec270d49e985d68f443a782f639c4c9ac124859c02556
3
+ size 4829287
rl/iql_dk1_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2ccc371c9aef967fa6989ce95c500217dfa0f3632278d2e0d4b2e76fd0783cf
3
+ size 4830141
rl/iql_dk1_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e123855fbe1e54a1cbbe14c0af7c54a83f83a89ae7d1fb725fd86f4b2467c4a2
3
+ size 4830141
rl/iql_dk1_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:169034a406eb5b4d624ffe40c849bb96e0a40dfaf4370988ce1f0014b886fdff
3
+ size 4830141
rl/iql_dk1_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1374e73a65a3d31c3863d93b146f9bb4a2d64278db2d38e6914fcaa57c33435c
3
+ size 4830141
rl/iql_dk1_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5600e45c387dff8461ca80bd40afd3b90a822a240f52bf389e7eb5cbb241fef2
3
+ size 4830141
rl/iql_dk1_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:713b013db69993176b63c7b52afc0585eb0d476f7a5327e31d479f3387c7bc6e
3
+ size 4830141
rl/iql_dk2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e553d9ae9afe1912081a839b4dbe03c8440fec10ec76542e69e57db1ab7f5a3
3
+ size 4829287
rl/iql_dk2_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6d98bb4cab383d747c7eb4fa9399925a6c1cae7126c355bd4488ac21fabec66
3
+ size 4830141
rl/iql_dk2_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc2b63a43e96ba6a6032865698e7449b7d18d7ba81ea3783bf7cf9485c22fca0
3
+ size 4830141
rl/iql_dk2_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5592cb28cd59fa8db3cb5ba947d4b875c8974b05def2a138eb30c2a10b3daffe
3
+ size 4830141
rl/iql_dk2_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1294253480d2ee767023aa82f4ddfa40775b0c0c8a3d3381f8abc1d4b22bcaf9
3
+ size 4830141
rl/iql_dk2_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:81642e8b47c4f79f716a51179a251fe28af7ebea3ca783d2fc492c543c8e9aae
3
+ size 4830141
rl/iql_dk2_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04f7e592b452ce74b1d38d063ecb20b5592e8a0a2a052571cb10d64111e5ebb7
3
+ size 4830141
rl/ppo_dk1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:596c8f2a426b3c2d6a9dfca0addad67da8111f2f25aabedf068cc1848fa26db6
3
+ size 529707
rl/ppo_dk1_r1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee1199cbdc4287b3b831d920ed06312bbdb6208a9a115dccfc96b9188d9da31d
3
+ size 530357
rl/ppo_dk1_r2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfc8d6c5636aaf8e0f5a34f4985b728c6b88a0fa862d758da5704eecc5d8844e
3
+ size 530357
rl/ppo_dk1_r3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1d4009b00c6edef08bf83bdcff91e29e9335b2c722e9e0843a6b46bbff4f890
3
+ size 530357
rl/ppo_dk1_r4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c7c8178d37e98703f56a44c4329d30d1ae07e0cb2469849c918723d9acacb5d
3
+ size 530357
rl/ppo_dk1_r5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd16bfed2a184f56703258c02e4690265c665bda71d84ab9aa04fe4938e0a074
3
+ size 530357
rl/ppo_dk1_r6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:012895d6888958e2ff7ba19120a6d1cad63d41a395403e1310dd750d0fa7e4a9
3
+ size 530357