De Francesco Nazareno

nazdef

1 3

·

AI & ML interests

LLM pretraining from scratch, single-GPU training, bilingual EN/IT models, Supervised finetuning SFT, Reinforcement learning GRPO/GSPO

Recent Activity

updated a model about 12 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14700

published a model about 12 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14700

updated a model about 12 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14500

View all activity

Organizations

None yet

nazdef 's models 33

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14700

Text Generation • 0.3B • Updated about 12 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14500

Text Generation • 0.3B • Updated about 12 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14250

Text Generation • 0.3B • Updated about 13 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-decay13500-step14200

Text Generation • 0.3B • Updated about 14 hours ago

nazdef/gpt2medium-en-it-nanochat-gpt2preln-lr2e4-bs2-ga48-wsd-anchor20k-final2e5-webwiki-step13500

Text Generation • 0.3B • Updated 2 days ago • 4

nazdef/1gpu-llm-small-en-it-base

Text Generation • 0.1B • Updated 4 days ago • 113

nazdef/gpt2small-en-it-nanochat-gpt2preln-lr2e4-bs6-wsd-final2e5-webwiki-step7000

Updated 8 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final2e5-webwiki-step7525

Updated 21 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final2e5-webwiki-step7700

Updated 21 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final5e6-webwiki-step7525

Updated 22 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsds700-final5e6-webwiki-step7700

Updated 22 days ago

nazdef/gpt2small-en-it-nanochat-lr3e4-bs6-wsd-shortfastdecay8k-final5e6-webwiki-step8000

Text Generation • Updated 23 days ago

nazdef/gpt2small-en-it-nanochat-lr3e4-bs6-wsd-shortfastdecay8k-final5e6-webwiki-step4000

Text Generation • Updated 23 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step7000

Text Generation • Updated 24 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step11000

Text Generation • Updated 24 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-shortfastdecay11k-final5e6-webwiki-step_7000

Text Generation • Updated 24 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-earlydecay3500-final5e6-webwiki-step7000

Text Generation • Updated 27 days ago

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-earlydecay7000-final5e6-webwiki-step7000

Text Generation • Updated 27 days ago

nazdef/gpt2small-en-it-nanochat-lr1e4-bs6-cosine-webwiki-step23000-stable

Text Generation • Updated May 28

nazdef/gpt2small-en-it-nanochat-lr1e4-bs6-cosine-webwiki-step14000

Text Generation • Updated May 24

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-cosine-webwiki-step7000

Text Generation • Updated May 22

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-fastdecay-webwiki-step11000

Text Generation • Updated May 21

nazdef/gpt2small-en-it-nanochat-lr2e4-bs6-wsd-fastdecay-step10000

Text Generation • Updated May 19

nazdef/gpt2small-en-it-nanochat-lr2e4-bs7-step9000

Text Generation • Updated May 15

nazdef/gpt2small-en-it-nanochat-lr2e4-step32000

Text Generation • Updated May 12

nazdef/gemma-3-4b-it-ghigliottina-grpo-v6-combinatorial-ckpt625

Text Generation • Updated Mar 21

nazdef/gemma-3-4b-it-ghigliottina-grpo-ckpt420

Updated Mar 15 • 1

nazdef/gemma-3-4b-it-ghigliottina-gspo-drgrpo-run2-checkpoint564

nazdef/gemma-3-4b-it-ghigliottina-grpo-ckpt564

nazdef/gemma-3-1b-it-ghigliottina-grpo-merged-ckpt1880

1.0B • Updated Mar 5 • 3