Update usage for DeepJ 0.13.0-alpha
Browse filesDescribe the current neural network library and retain model loading requirements, weights, and evaluation details.
README.md
CHANGED
|
@@ -18,11 +18,11 @@ DeepJ is a Java neural network library with shared tensors, automatic differenti
|
|
| 18 |
|
| 19 |
This compact language model was created with [**DeepJ**](https://github.com/KirstenAli/DeepJ) and uses its Prism decoder-only Transformer architecture with 4 layers, a hidden size of 128, 4 attention heads, Q rank 64, KV rank 32, and a 2,048-token vocabulary.
|
| 20 |
|
| 21 |
-
Generation uses a request-scoped key/value cache. By default, DeepJ rebuilds it when the context window shifts. Optional [rolling generation](https://github.com/KirstenAli/DeepJ/blob/
|
| 22 |
|
| 23 |
## Usage
|
| 24 |
|
| 25 |
-
DeepJ
|
| 26 |
|
| 27 |
```xml
|
| 28 |
<dependency>
|
|
@@ -32,7 +32,7 @@ DeepJ `0.13.0-alpha` is prepared for release. Maven Central publication is pendi
|
|
| 32 |
</dependency>
|
| 33 |
```
|
| 34 |
|
| 35 |
-
|
| 36 |
|
| 37 |
Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`. Imports are omitted below.
|
| 38 |
|
|
|
|
| 18 |
|
| 19 |
This compact language model was created with [**DeepJ**](https://github.com/KirstenAli/DeepJ) and uses its Prism decoder-only Transformer architecture with 4 layers, a hidden size of 128, 4 attention heads, Q rank 64, KV rank 32, and a 2,048-token vocabulary.
|
| 20 |
|
| 21 |
+
Generation uses a request-scoped key/value cache. By default, DeepJ rebuilds it when the context window shifts. Optional [rolling generation](https://github.com/KirstenAli/DeepJ/blob/master/docs/inference.md#rolling-generation) avoids repeated rebuilds, with different attention behaviour after eviction; it does not extend the model's trained context capability. The `model.dj` checkpoint and `tokenizer.bpe` files use DeepJ's versioned binary formats. They are not directly loadable by the Python Transformers library. This older checkpoint predates embedded architecture settings, so its configuration must be supplied when loading it.
|
| 22 |
|
| 23 |
## Usage
|
| 24 |
|
| 25 |
+
Use [DeepJ 0.13.0-alpha](https://github.com/KirstenAli/DeepJ):
|
| 26 |
|
| 27 |
```xml
|
| 28 |
<dependency>
|
|
|
|
| 32 |
</dependency>
|
| 33 |
```
|
| 34 |
|
| 35 |
+
DeepJ 0.13.0-alpha expands the library’s network APIs. These model weights and their loading requirements are unchanged.
|
| 36 |
|
| 37 |
Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`. Imports are omitted below.
|
| 38 |
|