Spaces:
Sleeping
Sleeping
Commit ·
2b3768e
1
Parent(s): 2ab342b
weirdness
Browse files
README.md
CHANGED
|
@@ -38,6 +38,15 @@ We do not get the same results for sub_40FD86. In fact, we don't create the sam
|
|
| 38 |
|
| 39 |
It's unclear why a1, a2, and result are not listed.
|
| 40 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
## Todo
|
| 42 |
|
| 43 |
* Add field decoding (probably needs Docker)
|
|
|
|
| 38 |
|
| 39 |
It's unclear why a1, a2, and result are not listed.
|
| 40 |
|
| 41 |
+
### `first_token` weirdness
|
| 42 |
+
|
| 43 |
+
The [example
|
| 44 |
+
inference](https://github.com/lt-asset/resym/blob/main/training_src/fielddecoder_inf.py)
|
| 45 |
+
scripts get the first token of the output and include it in the prompt.
|
| 46 |
+
Technically this is data leakage, but since the first token is usually part of
|
| 47 |
+
the prompt (a variable name or field expression) it's probably OK? But it's
|
| 48 |
+
also pretty weird.
|
| 49 |
+
|
| 50 |
## Todo
|
| 51 |
|
| 52 |
* Add field decoding (probably needs Docker)
|