netsrik commited on
Commit
05360fd
·
verified ·
1 Parent(s): 6a6e365

Update usage for DeepJ 0.13.0-alpha

Browse files

Describe the current neural network library and retain model loading requirements, weights, and evaluation details.

Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -18,11 +18,11 @@ DeepJ is a Java neural network library with shared tensors, automatic differenti
18
 
19
  This compact language model was created with [**DeepJ**](https://github.com/KirstenAli/DeepJ) and uses its Prism decoder-only Transformer architecture with 4 layers, a hidden size of 128, 4 attention heads, Q rank 64, KV rank 32, and a 2,048-token vocabulary.
20
 
21
- Generation uses a request-scoped key/value cache. By default, DeepJ rebuilds it when the context window shifts. Optional [rolling generation](https://github.com/KirstenAli/DeepJ/blob/v0.12.0-alpha/docs/inference.md#rolling-generation) avoids repeated rebuilds, with different attention behaviour after eviction; it does not extend the model's trained context capability. The `model.dj` checkpoint and `tokenizer.bpe` files use DeepJ's versioned binary formats. They are not directly loadable by the Python Transformers library. This older checkpoint predates embedded architecture settings, so its configuration must be supplied when loading it.
22
 
23
  ## Usage
24
 
25
- DeepJ `0.13.0-alpha` is prepared for release. Maven Central publication is pending; after publication, use:
26
 
27
  ```xml
28
  <dependency>
@@ -32,7 +32,7 @@ DeepJ `0.13.0-alpha` is prepared for release. Maven Central publication is pendi
32
  </dependency>
33
  ```
34
 
35
- Until publication, use the currently published [DeepJ 0.12.0-alpha](https://github.com/KirstenAli/DeepJ/releases/tag/v0.12.0-alpha) with this checkpoint, or build the prepared 0.13.0-alpha source from the DeepJ repository. This library release does not retrain or replace these model weights.
36
 
37
  Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`. Imports are omitted below.
38
 
 
18
 
19
  This compact language model was created with [**DeepJ**](https://github.com/KirstenAli/DeepJ) and uses its Prism decoder-only Transformer architecture with 4 layers, a hidden size of 128, 4 attention heads, Q rank 64, KV rank 32, and a 2,048-token vocabulary.
20
 
21
+ Generation uses a request-scoped key/value cache. By default, DeepJ rebuilds it when the context window shifts. Optional [rolling generation](https://github.com/KirstenAli/DeepJ/blob/master/docs/inference.md#rolling-generation) avoids repeated rebuilds, with different attention behaviour after eviction; it does not extend the model's trained context capability. The `model.dj` checkpoint and `tokenizer.bpe` files use DeepJ's versioned binary formats. They are not directly loadable by the Python Transformers library. This older checkpoint predates embedded architecture settings, so its configuration must be supplied when loading it.
22
 
23
  ## Usage
24
 
25
+ Use [DeepJ 0.13.0-alpha](https://github.com/KirstenAli/DeepJ):
26
 
27
  ```xml
28
  <dependency>
 
32
  </dependency>
33
  ```
34
 
35
+ DeepJ 0.13.0-alpha expands the library’s network APIs. These model weights and their loading requirements are unchanged.
36
 
37
  Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`. Imports are omitted below.
38