Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,13 @@ metrics:
|
|
| 19 |
|
| 20 |
# SwipeALot Base Model
|
| 21 |
|
| 22 |
-
Multimodal transformer for swipe keyboard prediction. Trained on the [futo-org/swipe.futo.org](https://huggingface.co/datasets/futo-org/swipe.futo.org) dataset.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
<p align="center">
|
| 25 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/65ff92ea467d83751a727538/OV87xy-_ID0TqKW0bfvVq.png" style="width: 400px;">
|
|
@@ -78,9 +84,7 @@ print(f"Predicted word length: {predicted_length}")
|
|
| 78 |
- Path coordinates must be normalized to [0, 1] range for x, y
|
| 79 |
- Timestamps must be normalized to [0, 1] range
|
| 80 |
- Paths longer than 128 points are downsampled using linear interpolation
|
| 81 |
-
- Paths shorter than 128 points are zero-padded
|
| 82 |
- Text longer than 48 characters is truncated with EOS preserved
|
| 83 |
-
- Text shorter than 48 characters is zero-padded
|
| 84 |
|
| 85 |
## Capabilities
|
| 86 |
|
|
|
|
| 19 |
|
| 20 |
# SwipeALot Base Model
|
| 21 |
|
| 22 |
+
Multimodal, multi-objective transformer for swipe keyboard prediction. Trained on the [futo-org/swipe.futo.org](https://huggingface.co/datasets/futo-org/swipe.futo.org) dataset.
|
| 23 |
+
|
| 24 |
+
This model is trained with the following objectives:
|
| 25 |
+
- Masked character prediction
|
| 26 |
+
- Masked path prediction
|
| 27 |
+
- Text length prediction (CLS token)
|
| 28 |
+
- Path/text embedding (SEP token)
|
| 29 |
|
| 30 |
<p align="center">
|
| 31 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/65ff92ea467d83751a727538/OV87xy-_ID0TqKW0bfvVq.png" style="width: 400px;">
|
|
|
|
| 84 |
- Path coordinates must be normalized to [0, 1] range for x, y
|
| 85 |
- Timestamps must be normalized to [0, 1] range
|
| 86 |
- Paths longer than 128 points are downsampled using linear interpolation
|
|
|
|
| 87 |
- Text longer than 48 characters is truncated with EOS preserved
|
|
|
|
| 88 |
|
| 89 |
## Capabilities
|
| 90 |
|