dleemiller commited on
Commit
3b6d8b5
·
verified ·
1 Parent(s): 4809086

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -19,7 +19,13 @@ metrics:
19
 
20
  # SwipeALot Base Model
21
 
22
- Multimodal transformer for swipe keyboard prediction. Trained on the [futo-org/swipe.futo.org](https://huggingface.co/datasets/futo-org/swipe.futo.org) dataset.
 
 
 
 
 
 
23
 
24
  <p align="center">
25
  <img src="https://cdn-uploads.huggingface.co/production/uploads/65ff92ea467d83751a727538/OV87xy-_ID0TqKW0bfvVq.png" style="width: 400px;">
@@ -78,9 +84,7 @@ print(f"Predicted word length: {predicted_length}")
78
  - Path coordinates must be normalized to [0, 1] range for x, y
79
  - Timestamps must be normalized to [0, 1] range
80
  - Paths longer than 128 points are downsampled using linear interpolation
81
- - Paths shorter than 128 points are zero-padded
82
  - Text longer than 48 characters is truncated with EOS preserved
83
- - Text shorter than 48 characters is zero-padded
84
 
85
  ## Capabilities
86
 
 
19
 
20
  # SwipeALot Base Model
21
 
22
+ Multimodal, multi-objective transformer for swipe keyboard prediction. Trained on the [futo-org/swipe.futo.org](https://huggingface.co/datasets/futo-org/swipe.futo.org) dataset.
23
+
24
+ This model is trained with the following objectives:
25
+ - Masked character prediction
26
+ - Masked path prediction
27
+ - Text length prediction (CLS token)
28
+ - Path/text embedding (SEP token)
29
 
30
  <p align="center">
31
  <img src="https://cdn-uploads.huggingface.co/production/uploads/65ff92ea467d83751a727538/OV87xy-_ID0TqKW0bfvVq.png" style="width: 400px;">
 
84
  - Path coordinates must be normalized to [0, 1] range for x, y
85
  - Timestamps must be normalized to [0, 1] range
86
  - Paths longer than 128 points are downsampled using linear interpolation
 
87
  - Text longer than 48 characters is truncated with EOS preserved
 
88
 
89
  ## Capabilities
90