Hugging Face's logo
Equinox Psychosis's picture
39 5 172

Equinox Psychosis

Casual-Autopsy
CrouchingHippo's profile picture lapkon's profile picture Shiman's profile picture
·

AI & ML interests

RP AIs that can run on everyday hardware and the usage of AI in vidya gaem mechanics.

Recent Activity

reacted to Parveshiiii's post with 🔥 6 days ago
Just did something I’ve been meaning to try for ages. In only 3 hours, on 10 billion+ tokens, I trained a custom BPE + tiktoken-style tokenizer using my new library microtok — and it hits the same token efficiency as Qwen3. Tokenizers have always felt like black magic to me. We drop them into every LLM project, but actually training one from scratch? That always seemed way too complicated. Turns out it doesn’t have to be. microtok makes the whole process stupidly simple — literally just 3 lines of code. No heavy setup, no GPU required. I built it on top of the Hugging Face tokenizers library so it stays clean, fast, and actually understandable. If you’ve ever wanted to look under the hood and build your own optimized vocabulary instead of just copying someone else’s, this is the entry point you’ve been waiting for. I wrote up the full story, threw in a ready-to-run Colab template, and dropped the trained tokenizer on Hugging Face. Blog → https://parveshiiii.github.io/blogs/microtok/ Trained tokenizer → https://huggingface.co/Parveshiiii/microtok GitHub repo → https://github.com/Parveshiiii/microtok
liked a model 19 days ago
llmfan46/Qwen3.5-35B-A3B-uncensored-heretic
liked a Space 22 days ago
smelukov/WeightRoom
View all activity

Organizations

Hugging Face Discord Community's profile picture Cas' Archived Models's profile picture Cas' Merger Warehouse's profile picture