mratsim
/

Seed-OSS-36B-Instruct-FP8-KV8

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Seed-OSS-36B-Instruct-FP8-KV8 / special_tokens_map.json

Mamy Ratsimbazafy

Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging

2b7d5a6 7 months ago

history blame contribute delete

432 Bytes

	{
	"bos_token": {
	"content": "<seed:bos>",
	"lstrip": false,
	"normalized": false,
	"rstrip": false,
	"single_word": false
	},
	"eos_token": {
	"content": "<seed:eos>",
	"lstrip": false,
	"normalized": false,
	"rstrip": false,
	"single_word": false
	},
	"pad_token": {
	"content": "<seed:pad>",
	"lstrip": false,
	"normalized": false,
	"rstrip": false,
	"single_word": false
	}
	}