Update README.md
Browse files
README.md
CHANGED
|
@@ -2,6 +2,6 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
-
This is a tiny
|
| 6 |
|
| 7 |
-
**
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
+
This is a tiny, dummy version of [Jamba](https://huggingface.co/ai21labs/Jamba-v0.1), used for debugging and experimentation over the Jamba architecture.
|
| 6 |
|
| 7 |
+
It has 128M parameters (instead of 52B), **and is initialized with random weights and did not undergo any training.**
|