| --- |
| license: apache-2.0 |
| datasets: |
| - HuggingFaceFW/fineweb-edu |
| - EleutherAI/the_pile_deduplicated |
| language: |
| - en |
| --- |
| ### Simllama 1.1 Base model |
| #### Training |
|
|
| Training was stopped at around 310 hours using a 4090.<br> |
| We want to minimize our carbon footprint so we used solar and only trained durning the day.<br> |
| Dataset was a mix of 40gb finewebedu and 10gb pile, but only a small portion (124k steps was used for training.<br> |
| This is step 124000, with a loss around 2.8-2.9. |
|
|
| #### Examples |
| Note: These examples ware cropped to save space, and I didnt cherry pick examples.<br> |
| PROMPT: Google<br> |
| ``` |
| 's new Google Maps feature could help curb the spread of disease. |
| Researchers at Google say it's possible to use Google Maps to track the spread o |
| f infectious diseases such as measles and pneumonia. |
| "This is a big step forward in understanding how the spread of disease is spread |
| ," said Michael H. Patterson, professor of microbiology, in a statement. |
| The research was published online Feb. 10 in the journal Science. |
| "There's no cure for the spread of disease," Patterson said. "In fact, we're sti |
| ll a long way from understanding what's going on." |
| The study, which was published in the journal Science, found that the number of |
| cases in the United States rose dramatically from 2010 to 2013, compared with 20 |
| 11. |
| ``` |
| PROMPT: Cats<br> |
| ``` |
| are always a favorite subject in the home, but they are also a favorite toys for children. But how do you teach your kitty to play with toys? |
| - Encourage your kitty to play with toys and games. If your kitty is a little too ambitious, it might be time to introduce toys. You can also use the same play-by-playing approach that your cat likes to play w |
| ith other dogs. |
| - Try to make your kitty play toys with a few basic household items. This will give her more independence. |
| - Use a toy like a toy or a dog. It can be a pet, dog, or toy. |
| - Use a toy like a dog or dog. If your kitty likes to play with other dogs, she may want to add to her play. |
| - Avoid using toys that are made of plastic, plastic or even wooden. They can attract pets who are prone to biting. |
| - Make your kitty play toys with toys. |
| ``` |
| PROMPT: Hello<br> |
| ``` |
| , |
| I am new to this topic and am new to this topic. |
| I am working on an iPhone app using a touch screen. |
| I am trying to create a touch screen in a touch screen using the touch screen interface. |
| In my android studio I have a touch screen with touch screen. |
| My touch screen looks like this: |
| public void touch(View view) { |
| Touch screen = (Touch) view; |
| } |
| <input name="TouchScreen" type="text" name="TouchScreen" value="true" /> |
| ``` |
