AlaBoussoffara's picture
added infer docker & /config option & various bug fixes & new tests
b22e8ba
|
Raw
History Blame Contribute Delete
668 Bytes

Trained Models

Place model folders here, one directory per model. You can populate this directory via the CLI:

mini-transformer-fetch AlaBoussoffara/transformer_test   # tiny demo
mini-transformer-fetch AlaBoussoffara/transformer_small  # larger example

or copy your own exported checkpoints using the layout below:

trained_models/
  my-model/
    configs/
      config_inference.yaml
    checkpoints/
      best.pt
    tokenizer/
      tokenizer.json

The CLI (mini-transformer-infer) and apps will look for configs/config_inference.yaml inside each folder. Relative paths in that config should point to files inside the same model directory.