Hugging Face's logo
Activity Feed

AI & ML interests

None defined yet.
KlondikeDev 
posted an update about 2 months ago
view post
Post
261
Important Boris-2 news:

Boris-2 is 30B out of 200B tokens in, and it is severely behind its competitors in training.

We have determined the bug to be a configuration error. Boris-2 has been in training for ~1 week, and was projected to finish on November 3rd, 2026.

We are unfortunately going to restart training, with proper configuration.

The new projected finish date is ~15-18th of November.

We apologize for the delay.
  • 17 replies
·
KlondikeDev 
posted an update 2 months ago
view post
Post
2,174
The SLM Consortium has begun work on a safety dataset for Small Language Models, with the creation of the dataset being headed by @wayneworkman2012

The dataset will focus on refusals and redirects surrounding dangerous or extreme sexual content, designed to be shaped sized appropriately for SLMs, without significantly lowering benchmark performance.

More info will be out soon!

slmconsortium
  • 3 replies
·
KlondikeDev 
posted an update 2 months ago
view post
Post
2,437
Boris-1.7-D60M-n30M out NOW!

opencerebral/Boris-1.7-D60M-n30M

Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.

Then, Boris-2 will begin training!
KlondikeDev 
posted an update 2 months ago
view post
Post
3,477
A Preview of Boris-2!

Hello! Tomorrow, OpenCerebral will be releasing Boris-1.7-D60M-n30M — an experimental architecture. It will be testing a new data mixture, a new tokenizer, and testing Qwen4-like n-gram embeddings.

Following this will be Boris-1.8-D60M-n30M, which will test both the n-gram embeddings AND a new architecture.

Then, Boris-2 will begin training!

Edit: the model is OUT NOW! opencerebral/Boris-1.7-D60M-n30M
  • 71 replies
·
KlondikeDev 
posted an update 2 months ago
view post
Post
2,316
The Small Language Model Consortium has reached 10 members!

Anybody is welcome to join, via two methods:

1. Starting a community discussion on the group’s README
2. Receiving an invite from me: @KlondikeDev

The Discord Community is also live! Feel free to join, even if you aren’t in the consortium, to discuss Small Language Models, or even just AI in general!

https://discord.gg/FngBKjja4

You’re more than welcome to apply!

— KlondikeDev
  • 2 replies
·
KlondikeDev 
posted an update 2 months ago
view post
Post
2,735
Announcing the Small Language Model Consortium!

slmconsortium

We seek to provide a space for members to show off research, models, and benchmarks!

The following users are hereby invited to join without ratification, provided they accept the invitation by starting a discussion.

@Datdanboi25
@Banaxi-Tech
@appvoid
@AxionLab-official

Feel free to submit ratification requests! Anybody is welcome!
  • 53 replies
·
KlondikeDev 
posted an update 3 months ago
view post
Post
118
Lucy out now!

Lucy is a series of Image Generation models created by OpenCerebral.

Lucy: Prototype, faces only -- unconditional, no prompts.
Lucy-2: Text-to-image, general purpose (though still small)

More Lucy models will be arriving in the future!

opencerebral/Lucy
opencerebral/Lucy-2
KlondikeDev 
posted an update 3 months ago
view post
Post
2,181
Boris-2 coming soon!

The Models:

Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.

Why does 125M get more tokens than 250M?

Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.

Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!

We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview

Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
  • 4 replies
·
KlondikeDev 
updated a Space 3 months ago
KlondikeDev 
updated a model 3 months ago
KlondikeDev 
updated a collection 3 months ago
KlondikeDev 
published a model 3 months ago
KlondikeDev 
updated a collection 3 months ago
KlondikeDev 
updated a model 3 months ago
KlondikeDev 
published a model 3 months ago
KlondikeDev 
updated a collection 3 months ago
KlondikeDev 
updated a model 3 months ago
KlondikeDev 
published a Space 3 months ago
KlondikeDev 
updated a model 3 months ago
KlondikeDev 
updated a collection 3 months ago