|
|
--- |
|
|
license: apache-2.0 |
|
|
base_model: |
|
|
- Qwen/Qwen3-8B |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
# Gadsby |
|
|
|
|
|
These are versions of Qwen3-0.6B and Qwen3-8B that modifies the output weights so that any tokens containing the letter 'e' has probability set to zero. |
|
|
|
|
|
In effect, this model never outputs the letter 'e'. |
|
|
|
|
|
The models are offered as GGUFs quantized to Q4. |
|
|
|
|
|
*Hint:* as the model can quickly get stuck in a low probability hole, it is useful to use some kind of beam search or back-tracking algorithm to select tokens. |
|
|
|
|
|
### Observations |
|
|
|
|
|
* The model can be creative in working around the lack of a letter 'e', for example instead of sheep it can say "adult lamb" or "dominant wool-producing animal". |
|
|
* Sometimes it drops the 'e' and mis-spells a word |
|
|
* I did not filter out some cyrillic letters which look like and 'e' and sometimes it uses those (or even Chinese words) |
|
|
* The smaller model can output refusals if it doesn't find a suitable token |
|
|
* Instead of greedy sampling or probability sampling, beam search with back-tracking is useful to avoid leading the generation into an 'e' dominated dead-end |
|
|
|
|
|
### Example |
|
|
|
|
|
***PROMPT: "tell me about different farm animals, esp. those that are used for wool"*** |
|
|
|
|
|
>Farm animals play a vital part in human civilization, providing food, labor, and various products such as wool, milk, and transportation. Among farm animals, **wool-producing animals** hold a significant position in many agricultural and pastoral traditions. Wool is a natural, insulating, and highly sought commodity, and it is primarily grown from animals that naturally carry a thick coat of hair. In this discussion, I'll focus on **wool-producing farm animals**, with a particular focus on **dominant wool-producing animals**, and also touch on **non-wool farm animals** for a broad comparison. |
|
|
> |
|
|
>### 1. **Wool-Producing Farm Animals** |
|
|
> |
|
|
>#### A. **Lambs (Wool from Lambs)** |
|
|
>- **Primary Wool-Producing Animal**: **Wool is primarily from **lambs**, which is a young **dominant wool-producing animal**. |
|
|
>- **Common Wool-Producing Lamb Variants**: |
|
|
> - **Shropshir** – Known for high-quality, long, and soft wool. |
|
|
> - **Ramboult** – Known for high wool production and good quality. |
|
|
> - **Suffolk** – Known for high wool production and good quality. |
|
|
|
|
|
|
