Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
AbstractPhil 
posted an update 4 days ago
Post
85
We proudly present the preview version Qwen 3.5 4b - Lucia V1.1 apache-2.0 prototype.
AbstractPhil/qwen3.5-4b-think-symbolic-image

The space is set up with ZeroGPU capacity for testing. You can use Look With Help to combine a blend of prompts, or simply Free Look to test your images with just the model herself.
AbstractPhil/think-symbolic-images-testbed

The first of multiple prototypes. Trained using >10,000 rows of highly complex, high quality, curated apache-friendly data, sourced as described in the recent posts and the readme.
AbstractPhil/thought-symbolic-image-recaptioned

Respect the licenses.

This model is not as strong as the original for museum data. In the original's case, Claude and I decided to focus on the museum information due to it being a weak-point of Qwen, sort of improve the weakness. For the new version of Lucia we couldn't use the Claude data, so the specific museum data is on the to-do list of data to curate for deep thought, not just shallow or medium thought. Really give the Lucia line some introspection capacity in the real academic sense. So the upcoming dataset improvements will improve the Lucia line substantially over time.

The current model and training process preserves most of the Qwen 3.5 4b structure via very low token drift from the original model, while presenting an extractable utilizable format of multi-introspective chain of thought, formatted into a series of image captioning structures.

The upcoming 4b train ready by tomorrow; is the non-commercial train with nearly 4x more rows. This non-commercial variant includes a large amount of deepfashion rows, docci rows, and coco rows. A humongous experimental model train, meant to be used for non-commercial and research purposes only.

We would like to have the 9b apache variant ready by Monday and the non-commercial variant by hopefully next Friday, so the specialized forms can be trained.

The 9b prototype is ready. The prototypes are having problems with text currently, but there will be some definite strengths the other variation couldn't handle. The space's setting "Look With Help" can assist with text, however I think the strongest course of action would be to commit Lucia to curating rows, and then feeding those for sorting to GPT-Luna 6.1.

There will be a full prototype weakness check to decide which data to curate next week for v1.2.


After an attempt to regularize the learned word spotting into the mix without the proper row shape, the model did not respond yet from just regularization training. Next up, text rows.


Before Lucia can be tasked with curating rows to create the proper scene classifier collective experiment, the system needs to be properly curated to extract the necessary rows from any image. This means text as well.

Additionally, long and deeper thoughts are also being shored up. Specifically for museum for our v1.2 variant. I'll create a methodology and a paper related to training in this way, along with a process to expand the model, the code related, and the systems of integration as well this week.

In this post