File size: 956 Bytes
7bb9a31
 
 
 
 
 
 
 
 
 
 
3f35bb7
7bb9a31
dbc9bb2
 
 
 
 
 
 
7bb9a31
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---

library_name: transformers
license: apache-2.0
base_model:
- LifuWang/DistillT5
pipeline_tag: feature-extraction
tags:
- safetensors
- text-generation-inference
- summarization
---


- Unwrapped model: renamed tensors from `encoder.encoder.[...]` to `encoder.[...]` to align with T5 XXL.

## Available models:
| Filename | Quant type | File Size | Description |
| -------- | ---------- | --------- | ----------- |
| [DistillT5-F32.safetensors](https://huggingface.co/Eviation/DistillT5/blob/main/DistillT5-F32.safetensors) | F32 | 518MB | - |
| [DistillT5-BF16.safetensors](https://huggingface.co/Eviation/DistillT5/blob/main/DistillT5-BF16.safetensors) | BF16 | 259MB | - |
| [DistillT5-F15.safetensors](https://huggingface.co/Eviation/DistillT5/blob/main/DistillT5-F16.safetensors) | F16 | 259MB | - |
| [DistillT5-FP8.safetensors](https://huggingface.co/Eviation/DistillT5/blob/main/DistillT5-FP8.safetensors) | FP8 (F8_E4M3) | 130MB | - |