suchirsalhan commited on
Commit
9417c82
·
verified ·
1 Parent(s): 4cddef6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -0
README.md CHANGED
@@ -7,6 +7,15 @@ sdk: streamlit
7
  pinned: false
8
  ---
9
 
 
 
 
 
 
 
 
 
 
10
  # Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies. Available from: https://arxiv.org/abs/2410.22886.
11
 
12
  Salhan et al (2024) creates age-ordered corpora of Child-Directed Speech for four typologically distant language families to implement SSLMs and acquisition-inspired curricula cross-lingually.
 
7
  pinned: false
8
  ---
9
 
10
+ # 🔥 NEW! BLiSS: Evaluating Bilingual Learner Competence in Second Language Small Language Models
11
+
12
+ Cross-lingual extensions of the BabyLM Shared Task beyond English incentivise the development of Small Language Models that simulate a much wider range of language acquisition scenarios, including code-switching, simultaneous and successive bilingualism and second language acquisition. However, to our knowledge, there is no benchmark of the formal competence of cognitively-inspired models of L2 acquisition, or **L2LMs**. To address this, we introduce the **Benchmark of Learner Interlingual Syntactic Structure (BLiSS)**.
13
+
14
+ BLiSS consists of 1.5M naturalistic minimal pairs dataset derived from errorful sentence–correction pairs in parallel learner corpora. These are systematic patterns --overlooked by standard benchmarks of the formal competence of Language Models -- which we use to evaluate L2LMs trained in a variety of training regimes on specific properties of L2 learner language to provide a linguistically-motivated framework for controlled measure of the interlanguage competence of L2LMs.
15
+
16
+
17
+
18
+
19
  # Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies. Available from: https://arxiv.org/abs/2410.22886.
20
 
21
  Salhan et al (2024) creates age-ordered corpora of Child-Directed Speech for four typologically distant language families to implement SSLMs and acquisition-inspired curricula cross-lingually.