Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
Paper • 1406.1078 • Published • 1
NLP Papers
Natural Language Processing and Large Language Models 💬
-
-
Distributed Representations of Sentences and Documents
Paper • 1405.4053 • Published -
Sequence to Sequence Learning with Neural Networks
Paper • 1409.3215 • Published • 3 -
Neural Machine Translation by Jointly Learning to Align and Translate
Paper • 1409.0473 • Published • 7 -
Text Understanding from Scratch
Paper • 1502.01710 • Published -
Attention Is All You Need
Paper • 1706.03762 • Published • 122 -
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Paper • 1804.07461 • Published • 4 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 27 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 10 -
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Paper • 1906.08237 • Published • 1 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 22 -
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Paper • 1910.10683 • Published • 18 -
GLU Variants Improve Transformer
Paper • 2002.05202 • Published • 5 -
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Paper • 2003.10555 • Published -
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Paper • 1606.05250 • Published • 4 -
The Pile: An 800GB Dataset of Diverse Text for Language Modeling
Paper • 2101.00027 • Published • 10 -
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Paper • 2101.03961 • Published • 13 -
LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 60 -
Evaluating Large Language Models Trained on Code
Paper • 2107.03374 • Published • 10 -
LLaMA: Open and Efficient Foundation Language Models
Paper • 2302.13971 • Published • 23 -
Teaching Machines to Read and Comprehend
Paper • 1506.03340 • Published • 2 -
TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents
Paper • 1901.08149 • Published • 3 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 150 -
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68 -
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
Paper • 2406.17557 • Published • 102 -
Were RNNs All We Needed?
Paper • 2410.01201 • Published • 53 -
s1: Simple test-time scaling
Paper • 2501.19393 • Published • 126