Commits · jounce/dummy-phi3

working tokenizer

f9d6e33
verified

AlonKellner-Jounce commited on Nov 17, 2024

Update config.json

58d3984
verified

jouDance commited on Nov 13, 2024

Upload 6 files

b766243
verified

jouDance commited on Nov 13, 2024

Upload 6 files

1727d34
verified

jouDance commited on Nov 13, 2024

simpler tokenizer

ca2f1bc
verified

AlonKellner-Jounce commited on Nov 11, 2024

silu instead of relu

6880118
verified

AlonKellner-Jounce commited on Nov 11, 2024

relu activations

d3e7e76
verified

AlonKellner-Jounce commited on Nov 10, 2024

smallest tokenizer and correct token indices

3af8b1c
verified

AlonKellner-Jounce commited on Nov 4, 2024

fast llama tokenizer

835dfcd
verified

AlonKellner-Jounce commited on Nov 4, 2024

tokenizer minimized

37a9b8c
verified

AlonKellner-Jounce commited on Nov 4, 2024

llama tokenizer

0c7047e
verified

AlonKellner-Jounce commited on Nov 4, 2024

much bigger model

cc98955
verified

AlonKellner-Jounce commited on Nov 4, 2024

bfloat by default

9d89595
verified

AlonKellner-Jounce commited on Nov 4, 2024

trying bigger model

1df2149
verified

AlonKellner-Jounce commited on Nov 4, 2024

4 hidden layers

3f8cdb4
verified

AlonKellner-Jounce commited on Nov 4, 2024

intermediate 64

09f74d0
verified

AlonKellner-Jounce commited on Nov 4, 2024

byt5 tokenizer

be43126
verified

AlonKellner-Jounce commited on Nov 4, 2024

intermediate 1

217358c
verified

AlonKellner-Jounce commited on Nov 4, 2024

64 per head

2de84c3
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden=32*8

3259292
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden=64, 2 channels per head

bda0e2d
verified

AlonKellner-Jounce commited on Nov 4, 2024

32 heads

7215da0
verified

AlonKellner-Jounce commited on Nov 4, 2024

2 hidden layers

951efca
verified

AlonKellner-Jounce commited on Nov 4, 2024

all dimensions are at least 8

171ed7c
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden_size=8

7b56ddb
verified

AlonKellner-Jounce commited on Nov 4, 2024

dummy-phi3 first try

234f2b0
verified

AlonKellner-Jounce commited on Nov 3, 2024

jounce
/

dummy-phi3

Commit History

working tokenizer

f9d6e33
verified

Update config.json

58d3984
verified

Upload 6 files

b766243
verified

Upload 6 files

1727d34
verified

simpler tokenizer

ca2f1bc
verified

silu instead of relu

6880118
verified

relu activations

d3e7e76
verified

smallest tokenizer and correct token indices

3af8b1c
verified

fast llama tokenizer

835dfcd
verified

tokenizer minimized

37a9b8c
verified

llama tokenizer

0c7047e
verified

much bigger model

cc98955
verified

bfloat by default

9d89595
verified

trying bigger model

1df2149
verified

4 hidden layers

3f8cdb4
verified

intermediate 64

09f74d0
verified

byt5 tokenizer

be43126
verified

intermediate 1

217358c
verified

64 per head

2de84c3
verified

hidden=32*8

3259292
verified

hidden=64, 2 channels per head

bda0e2d
verified

32 heads

7215da0
verified

2 hidden layers

951efca
verified

all dimensions are at least 8

171ed7c
verified

hidden_size=8

7b56ddb
verified

dummy-phi3 first try

234f2b0
verified

Commit History

working tokenizer f9d6e33 verified

Update config.json 58d3984 verified

Upload 6 files b766243 verified

Upload 6 files 1727d34 verified

simpler tokenizer ca2f1bc verified

silu instead of relu 6880118 verified

relu activations d3e7e76 verified

smallest tokenizer and correct token indices 3af8b1c verified

fast llama tokenizer 835dfcd verified

tokenizer minimized 37a9b8c verified

llama tokenizer 0c7047e verified

much bigger model cc98955 verified

bfloat by default 9d89595 verified

trying bigger model 1df2149 verified

4 hidden layers 3f8cdb4 verified

intermediate 64 09f74d0 verified

byt5 tokenizer be43126 verified

intermediate 1 217358c verified

64 per head 2de84c3 verified

hidden=32*8 3259292 verified

hidden=64, 2 channels per head bda0e2d verified

32 heads 7215da0 verified

2 hidden layers 951efca verified

all dimensions are at least 8 171ed7c verified

hidden_size=8 7b56ddb verified

dummy-phi3 first try 234f2b0 verified

working tokenizer

f9d6e33
verified

Update config.json

58d3984
verified

Upload 6 files

b766243
verified

Upload 6 files

1727d34
verified

simpler tokenizer

ca2f1bc
verified

silu instead of relu

6880118
verified

relu activations

d3e7e76
verified

smallest tokenizer and correct token indices

3af8b1c
verified

fast llama tokenizer

835dfcd
verified

tokenizer minimized

37a9b8c
verified

llama tokenizer

0c7047e
verified

much bigger model

cc98955
verified

bfloat by default

9d89595
verified

trying bigger model

1df2149
verified

4 hidden layers

3f8cdb4
verified

intermediate 64

09f74d0
verified

byt5 tokenizer

be43126
verified

intermediate 1

217358c
verified

64 per head

2de84c3
verified

hidden=32*8

3259292
verified

hidden=64, 2 channels per head

bda0e2d
verified

32 heads

7215da0
verified

2 hidden layers

951efca
verified

all dimensions are at least 8

171ed7c
verified

hidden_size=8

7b56ddb
verified

dummy-phi3 first try

234f2b0
verified