Hugging Face's logo

tangledgroup
/
tangled-alpha-0.2-core

Text Generation
Transformers
chat
core
base
instruct
reason
conversational
Model card Files
xet
Community
tangled-alpha-0.2-core

Commit History

Merge branch 'main' of hf.co:tangledgroup/tangled-alpha-0.2-core
85fb549

Marko Tasic commited on

out/pretrain-core/step-00001200
5791f32

Marko Tasic commited on

global_batch_size: 256
2c37145

mtasic85 commited on

micro_batch_size: 1
62b0ee3

mtasic85 commited on

new tokens
c3905b0

mtasic85 commited on

new tokenizer
356cb1c

mtasic85 commited on

micro_batch_size: 4
ebc900d

mtasic85 commited on

class_path: torchao.prototype.low_bit_optim.AdamW8bit
220683e

mtasic85 commited on

class_path: torchao.prototype.low_bit_optim.AdamW4bit
0fb963b

mtasic85 commited on

class_path: torchao.prototype.low_bit_optim.AdamW8bit
be4649f

mtasic85 commited on

intermediate_size: 3584
4c21a80

mtasic85 commited on

max_seq_length: 8192
abd95b0

mtasic85 commited on

intermediate_size: 4096
5b960ac

mtasic85 commited on

pretrain core
5b81e55

mtasic85 commited on

git ignore
d8b273d

mtasic85 commited on

initial commit
eee83ca
verified

mtasic85 commited on