README.md

---
library_name: onnx
tags:
  - text2text-generation
  - t5
  - flan-t5
  - encoder-decoder
  - onnx
  - inference4j
license: apache-2.0
pipeline_tag: text2text-generation
---

# Flan-T5 Base — ONNX

ONNX export of [Flan-T5 Base](https://huggingface.co/google/flan-t5-base) (250M parameters) with encoder-decoder architecture and KV cache support.

Converted for use with [inference4j](https://github.com/inference4j/inference4j), an inference-only AI library for Java.

## Original Source

- **Repository:** [google/flan-t5-base](https://huggingface.co/google/flan-t5-base)
- **License:** Apache 2.0

## Usage with inference4j

```java
// Summarization
try (var gen = FlanT5TextGenerator.flanT5Base().build()) {
    System.out.println(gen.summarize("Long article text..."));
}

// Translation
try (var gen = FlanT5TextGenerator.flanT5Base().build()) {
    System.out.println(gen.translate("Hello!", Language.EN, Language.FR));
}
```

## Model Details

| Property | Value |
|----------|-------|
| Architecture | T5 encoder-decoder (250M parameters) |
| Tasks | Summarization, translation, grammar correction, text-to-SQL |
| Tokenizer | SentencePiece (32,128 tokens) |
| Original framework | PyTorch (transformers) |
| Export method | Hugging Face Optimum (encoder-decoder with KV cache) |

## License

This model is licensed under the [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0). Original model by [Google](https://huggingface.co/google).