TroyDoesAI
/

Smaug-8-Layer-Chunk-Experiment1

Text Generation

text-generation-inference

Model card Files Files and versions

Smaug-8-Layer-Chunk-Experiment1 / mergekit_config.yml

TroyDoesAI's picture

Really just an Experiment to see if Attention IS ALL YOU NEED

eb55fb2 verified about 2 years ago

history blame contribute delete

126 Bytes

	slices:
	- sources:
	- model: abacusai/Smaug-72B-v0.1
	layer_range: [0, 8]

	merge_method: passthrough
	dtype: float16