Spaces:
Runtime error
Runtime error
Update social links
#1
by pedroc - opened
README.md
CHANGED
|
@@ -70,20 +70,22 @@ Shout out to Brenda Chiang that made the songs.
|
|
| 70 |
|
| 71 |
[Youtube Playthrough](https://www.youtube.com/shorts/rsKrMIF9-rU)
|
| 72 |
|
|
|
|
| 73 |
### REQ-04 Social Media Posts
|
| 74 |
|
| 75 |
-
https://www.
|
| 76 |
|
| 77 |
-
https://www.linkedin.com/posts/
|
| 78 |
|
| 79 |
-
https://www.linkedin.com/posts/pedrolcarvalho_reinforcedlearning-datapipeline-ml-activity-7470506511111200769-BVLh
|
| 80 |
|
| 81 |
-
https://www.linkedin.com/posts/pedrolcarvalho_dataset-machinelearning-zobristhashing-activity-7470901078943760386-G0u6
|
| 82 |
|
| 83 |
-
https://www.linkedin.com/posts/pedrolcarvalho_caro5-day-5-and-6-generating-dataset-and-activity-7471207969880272896-1_r2
|
| 84 |
|
| 85 |
-
https://www.linkedin.com/posts/pedrolcarvalho_something-nice-is-coming-soon-activity-7472372419408621568-Cqkh
|
| 86 |
|
|
|
|
| 87 |
|
| 88 |
### REQ-05: Limited GPU
|
| 89 |
|
|
@@ -91,7 +93,7 @@ No GPU needed.
|
|
| 91 |
|
| 92 |
### REQ-06 Tag your README
|
| 93 |
|
| 94 |
-
|
| 95 |
|
| 96 |
|
| 97 |
## Sponsors
|
|
@@ -188,6 +190,8 @@ The goal is to help players understand *why* a move is good, not just what move
|
|
| 188 |
|
| 189 |
### Data Generation
|
| 190 |
|
|
|
|
|
|
|
| 191 |
Training data was generated through self-play. I started with a basic alpha-beta minimax, put in self-play to generate games. Eventually, I had enough games to start to train a model. It didn't work well as I had no idea how to train a model back then.
|
| 192 |
|
| 193 |
But steadily, and with some setbacks, the win rate of the model improved and I could finally deploy it. Since then I have been using this model to generate games and improve it further. The model is now able to play at a very high level, but it is not perfect and there is still room for improvement. It's nowhere near the strongest models out there, from which I mimic their strategies.
|
|
@@ -233,6 +237,7 @@ So I had to downscale and choose 2 models to train against smaller models.
|
|
| 233 |
Qwen/Qwen3-1.7B for the funny dragon, and nvidia/OpenReasoning-Nemotron-1.5B for the friendly dragon.
|
| 234 |
|
| 235 |
I had fine tuned my first model! [pedroc/caro5-nemotron-15b-friendly-lora-smoke](https://huggingface.co/pedroc/caro5-nemotron-15b-friendly-lora-smoke)
|
|
|
|
| 236 |
|
| 237 |
Next was doing Quantization on the little model. That reduced the size to less than 1Gb.
|
| 238 |
|
|
|
|
| 70 |
|
| 71 |
[Youtube Playthrough](https://www.youtube.com/shorts/rsKrMIF9-rU)
|
| 72 |
|
| 73 |
+
|
| 74 |
### REQ-04 Social Media Posts
|
| 75 |
|
| 76 |
+
[Instagram](https://www.instagram.com/pedro.stories/p/DZphpc3E2gJ/)
|
| 77 |
|
| 78 |
+
[Caro5: First Days](https://www.linkedin.com/posts/pedrolcarvalho_caro5-build-small-hackathon-first-days-activity-7470080151003840512-UbXC)
|
| 79 |
|
| 80 |
+
[Caro5: Day 3](https://www.linkedin.com/posts/pedrolcarvalho_reinforcedlearning-datapipeline-ml-activity-7470506511111200769-BVLh)
|
| 81 |
|
| 82 |
+
[Caro5: Day 4](https://www.linkedin.com/posts/pedrolcarvalho_dataset-machinelearning-zobristhashing-activity-7470901078943760386-G0u6)
|
| 83 |
|
| 84 |
+
[Caro5: Day 5](https://www.linkedin.com/posts/pedrolcarvalho_caro5-day-5-and-6-generating-dataset-and-activity-7471207969880272896-1_r2)
|
| 85 |
|
| 86 |
+
[Caro5: Coming soon](https://www.linkedin.com/posts/pedrolcarvalho_something-nice-is-coming-soon-activity-7472372419408621568-Cqkh)
|
| 87 |
|
| 88 |
+
[Caro5: First Release post](https://www.linkedin.com/posts/pedrolcarvalho_machinelearning-gamedev-huggingface-activity-7472656734801637376-EuJ4/)
|
| 89 |
|
| 90 |
### REQ-05: Limited GPU
|
| 91 |
|
|
|
|
| 93 |
|
| 94 |
### REQ-06 Tag your README
|
| 95 |
|
| 96 |
+
Tags addewd!
|
| 97 |
|
| 98 |
|
| 99 |
## Sponsors
|
|
|
|
| 190 |
|
| 191 |
### Data Generation
|
| 192 |
|
| 193 |
+
Contrary to Gomoku, there wasn't many sources of game datasets, so I started my own. Once the model gets any good, I hope to publish the datasets here.
|
| 194 |
+
|
| 195 |
Training data was generated through self-play. I started with a basic alpha-beta minimax, put in self-play to generate games. Eventually, I had enough games to start to train a model. It didn't work well as I had no idea how to train a model back then.
|
| 196 |
|
| 197 |
But steadily, and with some setbacks, the win rate of the model improved and I could finally deploy it. Since then I have been using this model to generate games and improve it further. The model is now able to play at a very high level, but it is not perfect and there is still room for improvement. It's nowhere near the strongest models out there, from which I mimic their strategies.
|
|
|
|
| 237 |
Qwen/Qwen3-1.7B for the funny dragon, and nvidia/OpenReasoning-Nemotron-1.5B for the friendly dragon.
|
| 238 |
|
| 239 |
I had fine tuned my first model! [pedroc/caro5-nemotron-15b-friendly-lora-smoke](https://huggingface.co/pedroc/caro5-nemotron-15b-friendly-lora-smoke)
|
| 240 |
+
Then, after more than 1 day running, the second model: [caro5-funny-qwen3-1.7b-run2](https://huggingface.co/build-small-hackathon/caro5-funny-qwen3-1.7b-run2)
|
| 241 |
|
| 242 |
Next was doing Quantization on the little model. That reduced the size to less than 1Gb.
|
| 243 |
|