TroyDoesAI
/

Smaug-8-Layer-Chunk-Experiment1

Text Generation

text-generation-inference

Model card Files Files and versions

Smaug-8-Layer-Chunk-Experiment1

19 GB

1 contributor

History: 5 commits

TroyDoesAI's picture

Update README.md

8d4213f verified almost 2 years ago

.gitattributes

1.52 kB

initial commit almost 2 years ago
README.md

232 Bytes

Update README.md almost 2 years ago
config.json

726 Bytes

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
generation_config.json

142 Bytes

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
mergekit_config.yml

126 Bytes

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
model-00001-of-00004.safetensors

4.77 GB
xet

First Epoch Calibration Preparing for MoE almost 2 years ago
model-00002-of-00004.safetensors

4.97 GB
xet

First Epoch Calibration Preparing for MoE almost 2 years ago
model-00003-of-00004.safetensors

4.97 GB
xet

First Epoch Calibration Preparing for MoE almost 2 years ago
model-00004-of-00004.safetensors

4.24 GB
xet

First Epoch Calibration Preparing for MoE almost 2 years ago
model.safetensors.index.json

8.7 kB

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
special_tokens_map.json

441 Bytes

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
tokenizer.json

7.07 MB

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
tokenizer_config.json

37.6 kB

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago
vocab.json

2.78 MB

Really just an Experiment to see if Attention IS ALL YOU NEED almost 2 years ago