Update Java imports for DeepJ 0.13 package layout
Browse filesUse nn.transformer TextGenerator and Prism APIs. Model weights, architecture, metrics, and loading behavior are unchanged.
README.md
CHANGED
|
@@ -34,9 +34,17 @@ Use [DeepJ 0.13.0-alpha](https://github.com/KirstenAli/DeepJ):
|
|
| 34 |
|
| 35 |
DeepJ 0.13.0-alpha expands the library’s network APIs. These model weights and their loading requirements are unchanged.
|
| 36 |
|
| 37 |
-
Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`.
|
| 38 |
|
| 39 |
```java
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
Path directory = Path.of("downloaded-model");
|
| 41 |
BPEModel bpe = BPEModelIO.load(directory.resolve("tokenizer.bpe"));
|
| 42 |
BPETokenizer tokenizer = new BPETokenizer(bpe);
|
|
|
|
| 34 |
|
| 35 |
DeepJ 0.13.0-alpha expands the library’s network APIs. These model weights and their loading requirements are unchanged.
|
| 36 |
|
| 37 |
+
Download this repository's `model.dj` and `tokenizer.bpe` into `downloaded-model`.
|
| 38 |
|
| 39 |
```java
|
| 40 |
+
import io.github.kirstenali.deepj.nn.transformer.TextGenerator;
|
| 41 |
+
import io.github.kirstenali.deepj.nn.transformer.prism.DeepJPrism;
|
| 42 |
+
import io.github.kirstenali.deepj.nn.transformer.prism.DeepJPrismConfig;
|
| 43 |
+
import io.github.kirstenali.deepj.tokenizers.bpe.BPEModel;
|
| 44 |
+
import io.github.kirstenali.deepj.tokenizers.bpe.BPEModelIO;
|
| 45 |
+
import io.github.kirstenali.deepj.tokenizers.bpe.BPETokenizer;
|
| 46 |
+
import java.nio.file.Path;
|
| 47 |
+
|
| 48 |
Path directory = Path.of("downloaded-model");
|
| 49 |
BPEModel bpe = BPEModelIO.load(directory.resolve("tokenizer.bpe"));
|
| 50 |
BPETokenizer tokenizer = new BPETokenizer(bpe);
|