jounce
/

dummy-phi3

Model card Files Files and versions

Commit History

tokenizer chat template

6e50a01
verified

AlonKellner-Jounce commited on Nov 11, 2024

silu instead of relu

6880118
verified

AlonKellner-Jounce commited on Nov 11, 2024

relu activations

d3e7e76
verified

AlonKellner-Jounce commited on Nov 10, 2024

Delete added_tokens.json

3f23295
verified

AlonKellner-Jounce commited on Nov 4, 2024

smallest tokenizer and correct token indices

3af8b1c
verified

AlonKellner-Jounce commited on Nov 4, 2024

phi tokenizer

42e1b9e
verified

AlonKellner-Jounce commited on Nov 4, 2024

fast llama tokenizer

835dfcd
verified

AlonKellner-Jounce commited on Nov 4, 2024

tokenizer minimized

37a9b8c
verified

AlonKellner-Jounce commited on Nov 4, 2024

llama tokenizer

0c7047e
verified

AlonKellner-Jounce commited on Nov 4, 2024

much bigger model

cc98955
verified

AlonKellner-Jounce commited on Nov 4, 2024

bfloat by default

9d89595
verified

AlonKellner-Jounce commited on Nov 4, 2024

trying bigger model

1df2149
verified

AlonKellner-Jounce commited on Nov 4, 2024

4 hidden layers

3f8cdb4
verified

AlonKellner-Jounce commited on Nov 4, 2024

intermediate 64

09f74d0
verified

AlonKellner-Jounce commited on Nov 4, 2024

byt5 tokenizer

be43126
verified

AlonKellner-Jounce commited on Nov 4, 2024

intermediate 1

217358c
verified

AlonKellner-Jounce commited on Nov 4, 2024

64 per head

2de84c3
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden=32*8

3259292
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden=64, 2 channels per head

bda0e2d
verified

AlonKellner-Jounce commited on Nov 4, 2024

32 heads

7215da0
verified

AlonKellner-Jounce commited on Nov 4, 2024

2 hidden layers

951efca
verified

AlonKellner-Jounce commited on Nov 4, 2024

all dimensions are at least 8

171ed7c
verified

AlonKellner-Jounce commited on Nov 4, 2024

hidden_size=8

7b56ddb
verified

AlonKellner-Jounce commited on Nov 4, 2024

dummy-phi3 recreated

6f5df4c
verified

AlonKellner-Jounce commited on Nov 3, 2024

dummy-phi3 first try

234f2b0
verified

AlonKellner-Jounce commited on Nov 3, 2024

initial commit

bba65d1
verified

AlonKellner-Jounce commited on Nov 3, 2024