Metadata Conditioned LLMs

iamshnoo 's Collections

updated Apr 11

Pretraining Data: English NOW corpus (english-corpora.org/now). Paper: arxiv.org/abs/2601.15236. Code: github.com/iamshnoo/metadata_localization

Upvote

iamshnoo/combined_with_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 23

Note Global | 500M | with metadata
iamshnoo/combined_without_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 23

Note Global | 500M | without metadata
iamshnoo/combined_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 26

Note Global | 1B | with metadata | checkpoint 2k
iamshnoo/combined_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 25

Note Global | 1B | with metadata | checkpoint 4k
iamshnoo/combined_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 25

Note Global | 1B | with metadata | checkpoint 8k
iamshnoo/combined_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 25

Note Global | 1B | with metadata
iamshnoo/combined_without_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 29

Note Global | 1B | without metadata | checkpoint 2k
iamshnoo/combined_without_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 27

Note Global | 1B | without metadata | checkpoint 4k
iamshnoo/combined_without_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 26

Note Global | 1B | without metadata | checkpoint 8k
iamshnoo/combined_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 20

Note Global | 1B | without metadata
iamshnoo/combined_with_metadata_3b_step2k

Text Generation • 4B • Updated Apr 2 • 27

Note Global | 3B | with metadata | checkpoint 2k
iamshnoo/combined_with_metadata_3b_step4k

Text Generation • 4B • Updated Apr 2 • 27

Note Global | 3B | with metadata | checkpoint 4k
iamshnoo/combined_with_metadata_3b_step8k

Text Generation • 4B • Updated Apr 2 • 28

Note Global | 3B | with metadata | checkpoint 8k
iamshnoo/combined_with_metadata_3b

Text Generation • 4B • Updated Apr 2 • 38

Note Global | 3B | with metadata
iamshnoo/combined_without_metadata_3b_step2k

Text Generation • 4B • Updated Apr 2 • 27

Note Global | 3B | without metadata | checkpoint 2k
iamshnoo/combined_without_metadata_3b_step4k

Text Generation • 4B • Updated Apr 2 • 28

Note Global | 3B | without metadata | checkpoint 4k
iamshnoo/combined_without_metadata_3b_step8k

Text Generation • 4B • Updated Apr 2 • 27

Note Global | 3B | without metadata | checkpoint 8k
iamshnoo/combined_without_metadata_3b

Text Generation • 4B • Updated Apr 2 • 48

Note Global | 3B | without metadata
iamshnoo/africa_with_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 26

Note Local Continent | 500M | with metadata
iamshnoo/america_with_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 18

Note Local Continent | 500M | with metadata
iamshnoo/asia_with_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 22

Note Local Continent | 500M | with metadata
iamshnoo/europe_with_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 21

Note Local Continent | 500M | with metadata
iamshnoo/africa_without_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 23

Note Local Continent | 500M | without metadata
iamshnoo/america_without_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 24

Note Local Continent | 500M | without metadata
iamshnoo/asia_without_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 35

Note Local Continent | 500M | without metadata
iamshnoo/europe_without_metadata_500m

Text Generation • 0.7B • Updated Apr 2 • 23

Note Local Continent | 500M | without metadata
iamshnoo/africa_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 23

Note Local Continent | 1B | with metadata
iamshnoo/america_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 25

Note Local Continent | 1B | with metadata
iamshnoo/asia_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 20

Note Local Continent | 1B | with metadata
iamshnoo/europe_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 25

Note Local Continent | 1B | with metadata
iamshnoo/africa_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 28

Note Local Continent | 1B | without metadata
iamshnoo/america_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 19

Note Local Continent | 1B | without metadata
iamshnoo/asia_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 24

Note Local Continent | 1B | without metadata
iamshnoo/europe_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 21

Note Local Continent | 1B | without metadata
iamshnoo/combined_only_continent_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 29

Note Metadata Ablation | 1B | with metadata
iamshnoo/combined_only_continent_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 24

Note Metadata Ablation | 1B | with metadata | checkpoint 2k
iamshnoo/combined_only_continent_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 22

Note Metadata Ablation | 1B | with metadata | checkpoint 4k
iamshnoo/combined_only_continent_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 21

Note Metadata Ablation | 1B | with metadata | checkpoint 8k
iamshnoo/combined_only_country_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 22

Note Metadata Ablation | 1B | with metadata
iamshnoo/combined_only_country_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 21

Note Metadata Ablation | 1B | with metadata | checkpoint 2k
iamshnoo/combined_only_country_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 21

Note Metadata Ablation | 1B | with metadata | checkpoint 4k
iamshnoo/combined_only_country_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 22

Note Metadata Ablation | 1B | with metadata | checkpoint 8k
iamshnoo/combined_only_url_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 46

Note Metadata Ablation | 1B | with metadata
iamshnoo/combined_only_url_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 40

Note Metadata Ablation | 1B | with metadata | checkpoint 2k
iamshnoo/combined_only_url_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 47

Note Metadata Ablation | 1B | with metadata | checkpoint 4k
iamshnoo/combined_only_url_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 47

Note Metadata Ablation | 1B | with metadata | checkpoint 8k
iamshnoo/combined_only_url_continent_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 43

Note Metadata Ablation | 1B | with metadata
iamshnoo/combined_only_url_continent_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 47

Note Metadata Ablation | 1B | with metadata | checkpoint 2k
iamshnoo/combined_only_url_continent_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 47

Note Metadata Ablation | 1B | with metadata | checkpoint 4k
iamshnoo/combined_only_url_continent_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 50

Note Metadata Ablation | 1B | with metadata | checkpoint 8k
iamshnoo/combined_only_url_country_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 45

Note Metadata Ablation | 1B | with metadata
iamshnoo/combined_only_url_country_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 51

Note Metadata Ablation | 1B | with metadata | checkpoint 2k
iamshnoo/combined_only_url_country_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 47

Note Metadata Ablation | 1B | with metadata | checkpoint 4k
iamshnoo/combined_only_url_country_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 48

Note Metadata Ablation | 1B | with metadata | checkpoint 8k
iamshnoo/combined_no_africa_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 46

Note Leave One Out | 1B | with metadata
iamshnoo/combined_no_africa_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | with metadata | checkpoint 2k
iamshnoo/combined_no_africa_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 54

Note Leave One Out | 1B | with metadata | checkpoint 4k
iamshnoo/combined_no_africa_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 47

Note Leave One Out | 1B | with metadata | checkpoint 8k
iamshnoo/combined_no_america_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 48

Note Leave One Out | 1B | with metadata
iamshnoo/combined_no_america_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata | checkpoint 2k
iamshnoo/combined_no_america_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 50

Note Leave One Out | 1B | with metadata | checkpoint 4k
iamshnoo/combined_no_america_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata | checkpoint 8k
iamshnoo/combined_no_asia_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata
iamshnoo/combined_no_asia_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata | checkpoint 2k
iamshnoo/combined_no_asia_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata | checkpoint 4k
iamshnoo/combined_no_asia_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | with metadata | checkpoint 8k
iamshnoo/combined_no_europe_with_metadata_1b

Text Generation • 1B • Updated Apr 2 • 50

Note Leave One Out | 1B | with metadata
iamshnoo/combined_no_europe_with_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 62

Note Leave One Out | 1B | with metadata | checkpoint 2k
iamshnoo/combined_no_europe_with_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 52

Note Leave One Out | 1B | with metadata | checkpoint 4k
iamshnoo/combined_no_europe_with_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | with metadata | checkpoint 8k
iamshnoo/combined_no_africa_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 49

Note Leave One Out | 1B | without metadata
iamshnoo/combined_no_africa_without_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 50

Note Leave One Out | 1B | without metadata | checkpoint 2k
iamshnoo/combined_no_africa_without_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 51

Note Leave One Out | 1B | without metadata | checkpoint 4k
iamshnoo/combined_no_africa_without_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 54

Note Leave One Out | 1B | without metadata | checkpoint 8k
iamshnoo/combined_no_america_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 54

Note Leave One Out | 1B | without metadata
iamshnoo/combined_no_america_without_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | without metadata | checkpoint 2k
iamshnoo/combined_no_america_without_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 53

Note Leave One Out | 1B | without metadata | checkpoint 4k
iamshnoo/combined_no_america_without_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | without metadata | checkpoint 8k
iamshnoo/combined_no_asia_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 56

Note Leave One Out | 1B | without metadata
iamshnoo/combined_no_asia_without_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 54

Note Leave One Out | 1B | without metadata | checkpoint 2k
iamshnoo/combined_no_asia_without_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | without metadata | checkpoint 4k
iamshnoo/combined_no_asia_without_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 51

Note Leave One Out | 1B | without metadata | checkpoint 8k
iamshnoo/combined_no_europe_without_metadata_1b

Text Generation • 1B • Updated Apr 2 • 56

Note Leave One Out | 1B | without metadata
iamshnoo/combined_no_europe_without_metadata_1b_step2k

Text Generation • 1B • Updated Apr 2 • 61

Note Leave One Out | 1B | without metadata | checkpoint 2k
iamshnoo/combined_no_europe_without_metadata_1b_step4k

Text Generation • 1B • Updated Apr 2 • 55

Note Leave One Out | 1B | without metadata | checkpoint 4k
iamshnoo/combined_no_europe_without_metadata_1b_step8k

Text Generation • 1B • Updated Apr 2 • 56

Note Leave One Out | 1B | without metadata | checkpoint 8k
iamshnoo/combined_with_metadata_chat

Text Generation • 1B • Updated Apr 2 • 52

Note Chat | with metadata | chat
iamshnoo/combined_without_metadata_chat

Text Generation • 1B • Updated Apr 2 • 58

Note Chat | without metadata | chat
iamshnoo/qa_metacul

Viewer • Updated Apr 1 • 800 • 33

Note Evaluation dataset | 800-question QA benchmark
iamshnoo/combined_with_metadata_3b_chat

Text Generation • 4B • Updated Apr 2 • 50

Note Chat | 3B | with metadata | chat
iamshnoo/combined_without_metadata_3b_chat

Text Generation • 4B • Updated Apr 2 • 54

Note Chat | 3B | without metadata | chat
iamshnoo/LocalNewsQA

Viewer • Updated about 13 hours ago • 18.7k • 234

Upvote