augustocsc's picture
GPT-2 Medium trained on prefix dataset (682K)
a1190da verified
[INFO] Launching instance for GPT-2 Medium training...
[INFO] Finding Deep Learning AMI...
[INFO] Using AMI: ami-0e4ef96c62e7cc2fe
[INFO] Using key pair: chave-gpu-nova
[INFO] Using security group: sg-0deaa73e23482e3f6
[INFO] Launching instance...
[INFO] Instance launched: i-0eea77c3bbf1ea976
[INFO] Waiting for instance to start...
==========================================
GPT-2 Medium Training Instance Ready!
==========================================
Instance ID: i-0eea77c3bbf1ea976
Public IP: 13.220.236.233
Monitor training:
ssh -i ~/.ssh/chave-gpu-nova.pem ubuntu@13.220.236.233
tail -f /home/ubuntu/training_medium.log
Check when complete:
ssh ubuntu@13.220.236.233 'while [ ! -f ~/.training_complete ]; do sleep 60; echo "Training in progress..."; done; cat ~/training_results.txt'
Estimated time: ~2-3 hours for 3 epochs
[INFO] Instance info saved to: /c/Users/madeinweb/.seriguela/medium_instance_info.txt