prismalabs/text-embedding-3-small
Updated • 1
AI & ML interests
None defined yet.
aldigobbler
updated a
model 8 months ago
aldigobbler
published a
model 8 months ago
aldigobbler
updated a
model 8 months ago
aldigobbler
published a
model 8 months ago
aldigobbler
updated a
Space 9 months ago
aldigobbler
published a
Space 9 months ago
aldigobbler
posted an update over 1 year ago
Post
459
no ai slop posted here today i just feel like posting what i did for today
wrote a little framework for turning multiple dense models (llama based) into Sparse MoEs.. i found it fun, spent the whole day and a half on it.
code @ https://gist.github.com/cappuch/6a454ec8d2d349a27f9fd84f6ac90554
wrote a little framework for turning multiple dense models (llama based) into Sparse MoEs.. i found it fun, spent the whole day and a half on it.
code @ https://gist.github.com/cappuch/6a454ec8d2d349a27f9fd84f6ac90554