fiwjeoi

README.md

@@ -4,6 +4,10 @@ BORT is a pretrained LLM that is designed to accept a mixture of English phoneme
 
 > Robert Gale, Alexandra C. Salem, Gerasimos Fergadiotis, and Steven Bedrick. 2023. **Mixed Orthographic/Phonemic Language Modeling: Beyond Orthographically Restricted Transformers (BORT).** In Proceedings of the 8th Workshop on Representation Learning for NLP (RepL4NLP-2023), pages TBD, Online. Association for Computational Linguistics.
 
+## Acknowledgements
+
+This work was supported by the National Institute on Deafness and Other Communication Disorders of the National Institutes of Health under award 5R01DC015999 (Principal Investigators: Bedrick \& Fergadiotis). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. 
+
 ## Limitations
 
 The models presented here were trained with the basic inventory of English phonemes found in CMUDict. However, a more fine-grained phonetic analysis would require a pronunciation dictionary with more narrowly defined entries. Additionally, while this paper focused on models trained with English-only resources (pre-trained BART-BASE, English Wikipedia text, CMUDict, and the English AphasiaBank), the techniques should be applicable to non-English language models as well. Finally, from a clinical standpoint, the model we describe in this paper assumes the existence of transcribed input (from either a manual or automated source, discussed in detail in §2.1 of the paper; in its current form, this represents a limitation to its clinical implementation, though not to its use in research settings with archival or newly-transcribed datasets.
@@ -14,6 +18,12 @@ Our use of the AphasiaBank data was governed by the TalkBank consortium's data u
 Limitations exist regarding accents and dialect, which in turn would affect the scenarios in which a system based on our model could (and should) be used.
 It should also be noted that these models and any derived technology are not meant to be tools to diagnose medical conditions, a task best left to qualified clinicians.
 
+## Wikipedia Dataset Used in Pre-Training
+
+The BPE-tokenized version of the dataset, including metadata used in word transforms.
+
+- **Dataset** (upload ETA ≤ ACL 2023)
+
 ## Usage
 
 ### Downloading BORT
@@ -93,14 +103,3 @@ Out:  	Due to its coastal location, Long Beach winter temperatures are milder th
 In:   	Due to its coastal location, lɔŋfɝd winter temperatures are milder than most of the state.
 Out:  	Due to its coastal location, Longford winter temperatures are milder than most of the state.
 ```
-
-
-## Wikipedia Dataset Used in Pre-Training
-
-The BPE-tokenized version of the dataset, including metadata used in word transforms.
-
-- **Dataset** (upload ETA ≤ ACL 2023)
-
-## Acknowledgements
-
-This work was supported by the National Institute on Deafness and Other Communication Disorders of the National Institutes of Health under award 5R01DC015999 (Principal Investigators: Bedrick \& Fergadiotis). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.