Update README.md
Browse files
README.md
CHANGED
|
@@ -7,4 +7,4 @@ Experiments on training 0.4B RWKV models around midi notation in a manner simila
|
|
| 7 |
|
| 8 |

|
| 9 |
|
| 10 |
-
* WIP v6 pretrain.
|
|
|
|
| 7 |
|
| 8 |

|
| 9 |
|
| 10 |
+
* WIP v6 pretrain that also sucks. Loss was around 2.3 to 2.5 but I'm guessing it ended up at 2.5, kind of sad but this can be used as a base I guess?
|