I would start with the same base model before and after fine-tuning, using the same census prompts. That gives a more interpretable comparison than matching channel numbers across unrelated architectures. For the shared 8,965-prompt basis, does the atlas expose how activations are pooled over tokens and whether padding and chat-template tokens are excluded? I would want to separate a topic effect from a change in input length or formatting.
🤝 Open to Collab
Andrei Ovcharenko
Kreout
AI & ML interests
Java backend development, Spring Boot, Kafka, infrastructure and automation. Interested in local AI tools and practical developer workflows. Open-source developer tools: https://github.com/krotname.
Recent Activity
repliedto juiceb0xc0de's post about 7 hours ago
You built a model. Wanna know what lights up inside it?💡
I put a little juice in the box so you can find out!🧃
I built Cartographics, a HF ZeroGPU Space for building neural activation atlases of language models.
I wanted to make the tools I use to explore model internals accessible to people building their own LLMs. Punch in a Hugging Face model ID, run the compatibility check, and start a capture. Prompt formatting and the full corpus are handled automatically.
The atlases help you investigate questions like:
- Which layers and channels respond most strongly to different kinds of prompts?
- How do activation patterns vary across code, math, reasoning, and other topics?
- Which features activate together, and where do unusually strong activations appear?
The census contains 8,965 prompts, giving you a shared basis for exploring different models.
GPU capture runs through ZeroGPU using your account’s allowance. I handle the CPU analysis separately. This release supports compatible architectures and models that fit the available GPU memory.
I’m building this independently, and I’d love to see what models builders explore with it.
What would you want to investigate in your own model?
Try Cartographics Beta:
https://huggingface.co/spaces/juiceb0xc0de/cartographics
https://huggingface.co/datasets/juiceb0xc0de/bella-bartender-gemma-e4b-cgs-atlas
If you make an atlas with us, leave the Space a ❤️. You're helping other people discover mechanistic interpretability the way I wish I did.
Prerequisites:
Models under 10B parameters (20GB of weights in bf16)
No trust_remote_code models, for now.
Preflight catches edge cases. Don't be scared to test it out. It's free to check.
Sign in with Hugging Face. The capture runs on your ZeroGPU quota, the atlas build runs on ours. upvoted an article 1 day ago
We Fine-Tuned a Memory Classifier for Our Agent. Here's Why We Didn't Ship It