diff --git a/eval/ar_baseline_latest_test/logs/temp0.2_gpu1.log b/eval/ar_baseline_latest_test/logs/temp0.2_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..eaccae215572b496790a0e76a10764e77c085503 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.2_gpu1.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.2)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The first-ever “Star Wars” movie is set to hit theaters on May 25, 2018, but the film’s director, George Lucas, has alre' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.2_gpu1.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.2_gpu1.json +Diversity metrics for temp0.2_gpu1.json: + distinct_1: 0.0380 + repetition_1: 0.8770 + d1: 0.0380 + r1: 0.8770 + distinct_2: 0.0906 + repetition_2: 0.8249 + d2: 0.0906 + r2: 0.8249 + distinct_4: 0.1524 + repetition_4: 0.7935 + d4: 0.1524 + r4: 0.7935 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.2_gpu1.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.2_gpu3.log b/eval/ar_baseline_latest_test/logs/temp0.2_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..e25f125459e9cd201bb498abd730c8b8f6b6ede4 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.2_gpu3.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.2)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The U.S. Army Corps of Engineers has approved a plan to build a $1.6 billion, 1,000-mile pipeline that would carry oil f' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.2_gpu3.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.2_gpu3.json +Diversity metrics for temp0.2_gpu3.json: + distinct_1: 0.0375 + repetition_1: 0.8804 + d1: 0.0375 + r1: 0.8804 + distinct_2: 0.0909 + repetition_2: 0.8279 + d2: 0.0909 + r2: 0.8279 + distinct_4: 0.1540 + repetition_4: 0.7965 + d4: 0.1540 + r4: 0.7965 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.2_gpu3.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.2_gpu5.log b/eval/ar_baseline_latest_test/logs/temp0.2_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..b6dcfeb6764bcc70407a7ac6648f91a0280929a9 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.2_gpu5.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.2)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The first time I saw the movie, I was in the middle of a long drive to the airport. I was driving a car, and I was in th' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.2_gpu5.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.2_gpu5.json +Diversity metrics for temp0.2_gpu5.json: + distinct_1: 0.0388 + repetition_1: 0.8733 + d1: 0.0388 + r1: 0.8733 + distinct_2: 0.0973 + repetition_2: 0.8148 + d2: 0.0973 + r2: 0.8148 + distinct_4: 0.1693 + repetition_4: 0.7799 + d4: 0.1693 + r4: 0.7799 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.2_gpu5.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.4_gpu5.log b/eval/ar_baseline_latest_test/logs/temp0.4_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..e14257cd43f296d4827b05f0bbb48ef826e0d559 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.4_gpu5.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.4)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The United States has been on a roll in the global economic and financial crisis, but its efforts to contain the crisis ' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.4_gpu5.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.4_gpu5.json +Diversity metrics for temp0.4_gpu5.json: + distinct_1: 0.0767 + repetition_1: 0.7744 + d1: 0.0767 + r1: 0.7744 + distinct_2: 0.2035 + repetition_2: 0.6561 + d2: 0.2035 + r2: 0.6561 + distinct_4: 0.3410 + repetition_4: 0.5816 + d4: 0.3410 + r4: 0.5816 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.4_gpu5.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.4_gpu7.log b/eval/ar_baseline_latest_test/logs/temp0.4_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..43f1968808d7e322d42c897b80da638bd6791cd5 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.4_gpu7.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.4)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The U.S. Department of Justice has issued a subpoena to the New York Times and its owner, Daniel Richman, seeking docume' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.4_gpu7.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.4_gpu7.json +Diversity metrics for temp0.4_gpu7.json: + distinct_1: 0.0866 + repetition_1: 0.7545 + d1: 0.0866 + r1: 0.7545 + distinct_2: 0.2257 + repetition_2: 0.6243 + d2: 0.2257 + r2: 0.6243 + distinct_4: 0.3803 + repetition_4: 0.5404 + d4: 0.3803 + r4: 0.5404 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.4_gpu7.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.82_gpu6.log b/eval/ar_baseline_latest_test/logs/temp0.82_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..38ed1bfd52ff91aebb021dc34109b40efc5a21f8 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.82_gpu6.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.82)... + sampled 64/128 + sampled 128/128 +First sample preview: 'BETHLEHEM (Ma’an) -- The Palestinian Authority on Wednesday announced it was establishing a new state in the West Bank w' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.82_gpu6.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.82_gpu6.json +Diversity metrics for temp0.82_gpu6.json: + distinct_1: 0.2445 + repetition_1: 0.4226 + d1: 0.2445 + r1: 0.4226 + distinct_2: 0.6910 + repetition_2: 0.1198 + d2: 0.6910 + r2: 0.1198 + distinct_4: 0.9589 + repetition_4: 0.0340 + d4: 0.9589 + r4: 0.0340 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.82_gpu6.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.84_gpu0.log b/eval/ar_baseline_latest_test/logs/temp0.84_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..b43fee814a6eea839443dd650d3c7ab76d5d6be6 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.84_gpu0.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.84)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The protagonist of the Möbius strip is a high school student who is teaching the world about the “Mokai,” the Japanese t' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.84_gpu0.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.84_gpu0.json +Diversity metrics for temp0.84_gpu0.json: + distinct_1: 0.2500 + repetition_1: 0.4025 + d1: 0.2500 + r1: 0.4025 + distinct_2: 0.7106 + repetition_2: 0.0995 + d2: 0.7106 + r2: 0.0995 + distinct_4: 0.9752 + repetition_4: 0.0205 + d4: 0.9752 + r4: 0.0205 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.84_gpu0.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.84_gpu2.log b/eval/ar_baseline_latest_test/logs/temp0.84_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..5aca799d2f926b46df999985f34757dd755a9166 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.84_gpu2.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.84)... + sampled 64/128 + sampled 128/128 +First sample preview: 'LONDON — The British government’s allowance for tax avoidance had been so underreported that in some cases they were so ' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.84_gpu2.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.84_gpu2.json +Diversity metrics for temp0.84_gpu2.json: + distinct_1: 0.2474 + repetition_1: 0.4114 + d1: 0.2474 + r1: 0.4114 + distinct_2: 0.7007 + repetition_2: 0.1073 + d2: 0.7007 + r2: 0.1073 + distinct_4: 0.9659 + repetition_4: 0.0270 + d4: 0.9659 + r4: 0.0270 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.84_gpu2.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.84_gpu6.log b/eval/ar_baseline_latest_test/logs/temp0.84_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..a9dfedfd15a878b4d13f2be5ef06ed3c8bc2b6a3 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.84_gpu6.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.84)... + sampled 64/128 + sampled 128/128 +First sample preview: 'BETHLEHEM (Ma’an) -- The Palestinian Authority on Wednesday announced it was establishing a “protective force” in the We' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.84_gpu6.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.84_gpu6.json +Diversity metrics for temp0.84_gpu6.json: + distinct_1: 0.2487 + repetition_1: 0.4072 + d1: 0.2487 + r1: 0.4072 + distinct_2: 0.7112 + repetition_2: 0.1041 + d2: 0.7112 + r2: 0.1041 + distinct_4: 0.9685 + repetition_4: 0.0285 + d4: 0.9685 + r4: 0.0285 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.84_gpu6.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.86_gpu0.log b/eval/ar_baseline_latest_test/logs/temp0.86_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..804852e7475463e51b7d3b296bc9d2bce588a274 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.86_gpu0.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.86)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The protagonist of the Möbius strip is a high school student who is teaching the world about the “Mokai,” the Japanese t' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.86_gpu0.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.86_gpu0.json +Diversity metrics for temp0.86_gpu0.json: + distinct_1: 0.2587 + repetition_1: 0.3975 + d1: 0.2587 + r1: 0.3975 + distinct_2: 0.7234 + repetition_2: 0.0981 + d2: 0.7234 + r2: 0.0981 + distinct_4: 0.9763 + repetition_4: 0.0233 + d4: 0.9763 + r4: 0.0233 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.86_gpu0.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.8_gpu3.log b/eval/ar_baseline_latest_test/logs/temp0.8_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..06d8ec8789399967d43829a9d11dbb5b0d05a38a --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.8_gpu3.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.8)... + sampled 64/128 + sampled 128/128 +First sample preview: 'Jürgen Klopp has hailed the work of the Liverpool Foundation, who are working to raise funds to help children in the are' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.8_gpu3.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.8_gpu3.json +Diversity metrics for temp0.8_gpu3.json: + distinct_1: 0.2305 + repetition_1: 0.4438 + d1: 0.2305 + r1: 0.4438 + distinct_2: 0.6679 + repetition_2: 0.1320 + d2: 0.6679 + r2: 0.1320 + distinct_4: 0.9588 + repetition_4: 0.0337 + d4: 0.9588 + r4: 0.0337 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.8_gpu3.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.8_gpu4.log b/eval/ar_baseline_latest_test/logs/temp0.8_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..5515d9d79b8e664618b0959b2ed390e838b79a88 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.8_gpu4.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.8)... + sampled 64/128 + sampled 128/128 +First sample preview: 'There is a lot of interest when it comes to the Blackhawks, and the World Series and Stanley Cup. Here’s a few great way' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.8_gpu4.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.8_gpu4.json +Diversity metrics for temp0.8_gpu4.json: + distinct_1: 0.2408 + repetition_1: 0.4306 + d1: 0.2408 + r1: 0.4306 + distinct_2: 0.6806 + repetition_2: 0.1304 + d2: 0.6806 + r2: 0.1304 + distinct_4: 0.9530 + repetition_4: 0.0372 + d4: 0.9530 + r4: 0.0372 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.8_gpu4.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.8_gpu7.log b/eval/ar_baseline_latest_test/logs/temp0.8_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..81f293dbf3cc656103108a7758a2e0250c883387 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.8_gpu7.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.8)... + sampled 64/128 + sampled 128/128 +First sample preview: '“Muppets” creators John DiLanzo and Gary Ungarick have announced that they will be returning to the studio with “Star Wa' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.8_gpu7.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.8_gpu7.json +Diversity metrics for temp0.8_gpu7.json: + distinct_1: 0.2386 + repetition_1: 0.4307 + d1: 0.2386 + r1: 0.4307 + distinct_2: 0.6809 + repetition_2: 0.1280 + d2: 0.6809 + r2: 0.1280 + distinct_4: 0.9595 + repetition_4: 0.0308 + d4: 0.9595 + r4: 0.0308 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.8_gpu7.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.92_gpu0.log b/eval/ar_baseline_latest_test/logs/temp0.92_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..f6a2532d9cf5cedafa18859160f0c5120be1b9fd --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.92_gpu0.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.92)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The protagonist? Angela Möller. The screenwriter?\n\nGlenn Tych at The Telegraph has had a chance to take a look at the sc' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.92_gpu0.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.92_gpu0.json +Diversity metrics for temp0.92_gpu0.json: + distinct_1: 0.2825 + repetition_1: 0.3581 + d1: 0.2825 + r1: 0.3581 + distinct_2: 0.7673 + repetition_2: 0.0632 + d2: 0.7673 + r2: 0.0632 + distinct_4: 0.9886 + repetition_4: 0.0095 + d4: 0.9886 + r4: 0.0095 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.92_gpu0.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.92_gpu6.log b/eval/ar_baseline_latest_test/logs/temp0.92_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..1cf4cd8b9655828c55c262c69878419c6ad491c2 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.92_gpu6.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.92)... + sampled 64/128 + sampled 128/128 +First sample preview: 'BETHLEHEM (Ma’an) -- The Palestinian Authority on Wednesday announced it was establishing a “protective force” in the We' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.92_gpu6.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.92_gpu6.json +Diversity metrics for temp0.92_gpu6.json: + distinct_1: 0.2937 + repetition_1: 0.3543 + d1: 0.2937 + r1: 0.3543 + distinct_2: 0.7686 + repetition_2: 0.0697 + d2: 0.7686 + r2: 0.0697 + distinct_4: 0.9845 + repetition_4: 0.0134 + d4: 0.9845 + r4: 0.0134 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.92_gpu6.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.94_gpu0.log b/eval/ar_baseline_latest_test/logs/temp0.94_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..6b09409d561aad0f859503e4b06d460988108158 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.94_gpu0.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.94)... + sampled 64/128 + sampled 128/128 +First sample preview: 'The protagonist? Angela Möttins, better known as "Griezmann" at Real Madrid.\n\nIn reality, this role in the history of th' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.94_gpu0.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.94_gpu0.json +Diversity metrics for temp0.94_gpu0.json: + distinct_1: 0.2940 + repetition_1: 0.3367 + d1: 0.2940 + r1: 0.3367 + distinct_2: 0.7849 + repetition_2: 0.0527 + d2: 0.7849 + r2: 0.0527 + distinct_4: 0.9901 + repetition_4: 0.0084 + d4: 0.9901 + r4: 0.0084 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.94_gpu0.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.94_gpu2.log b/eval/ar_baseline_latest_test/logs/temp0.94_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..a3045ea3ec7e236b3ea711ad0e2771d32ad781a8 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.94_gpu2.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.94)... + sampled 64/128 + sampled 128/128 +First sample preview: 'LONDON — The British media reported in articles Wednesday that ISIS has taken over Kirkuk, the Iraqi town that is disput' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.94_gpu2.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.94_gpu2.json +Diversity metrics for temp0.94_gpu2.json: + distinct_1: 0.2911 + repetition_1: 0.3433 + d1: 0.2911 + r1: 0.3433 + distinct_2: 0.7821 + repetition_2: 0.0540 + d2: 0.7821 + r2: 0.0540 + distinct_4: 0.9914 + repetition_4: 0.0063 + d4: 0.9914 + r4: 0.0063 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.94_gpu2.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.94_gpu5.log b/eval/ar_baseline_latest_test/logs/temp0.94_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..ef40d9c8a12268e510763c40fa0f882d3824c5b1 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.94_gpu5.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.94)... + sampled 64/128 + sampled 128/128 +First sample preview: 'Bless up! So happy to be back to where I started!I want to thank yoeoi for the email comment taking me back to when I go' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.94_gpu5.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.94_gpu5.json +Diversity metrics for temp0.94_gpu5.json: + distinct_1: 0.2964 + repetition_1: 0.3412 + d1: 0.2964 + r1: 0.3412 + distinct_2: 0.7810 + repetition_2: 0.0550 + d2: 0.7810 + r2: 0.0550 + distinct_4: 0.9902 + repetition_4: 0.0068 + d4: 0.9902 + r4: 0.0068 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.94_gpu5.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.94_gpu6.log b/eval/ar_baseline_latest_test/logs/temp0.94_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..36b5ac34b187867498367f469bb570ed10afd8df --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.94_gpu6.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.94)... + sampled 64/128 + sampled 128/128 +First sample preview: 'BETHLEHEM (Ma’an) -- The Palestinian Authority on Wednesday announced it was establishing a “protective force” in the We' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.94_gpu6.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.94_gpu6.json +Diversity metrics for temp0.94_gpu6.json: + distinct_1: 0.3008 + repetition_1: 0.3345 + d1: 0.3008 + r1: 0.3345 + distinct_2: 0.7881 + repetition_2: 0.0529 + d2: 0.7881 + r2: 0.0529 + distinct_4: 0.9895 + repetition_4: 0.0072 + d4: 0.9895 + r4: 0.0072 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.94_gpu6.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.96_gpu7.log b/eval/ar_baseline_latest_test/logs/temp0.96_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..d90b610c5855a616e3543bfa684035c4f60329f7 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.96_gpu7.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.96)... + sampled 64/128 + sampled 128/128 +First sample preview: '“Muppets” creators William And Bryan Thompson and Coleman Hentzen are perhaps the biggest Javascript evangelists you won' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.96_gpu7.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.96_gpu7.json +Diversity metrics for temp0.96_gpu7.json: + distinct_1: 0.3048 + repetition_1: 0.3282 + d1: 0.3048 + r1: 0.3282 + distinct_2: 0.7967 + repetition_2: 0.0504 + d2: 0.7967 + r2: 0.0504 + distinct_4: 0.9934 + repetition_4: 0.0056 + d4: 0.9934 + r4: 0.0056 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.96_gpu7.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.98_gpu1.log b/eval/ar_baseline_latest_test/logs/temp0.98_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..a38a8326beceef4156690392a074fdc050a5e84a --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.98_gpu1.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.98)... + sampled 64/128 + sampled 128/128 +First sample preview: "First and foremost we'd like to thank everyone who participated in the Equestrian/SFX / Rock ’Em Puppy contest and those" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.98_gpu1.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.98_gpu1.json +Diversity metrics for temp0.98_gpu1.json: + distinct_1: 0.3052 + repetition_1: 0.3218 + d1: 0.3052 + r1: 0.3218 + distinct_2: 0.7911 + repetition_2: 0.0527 + d2: 0.7911 + r2: 0.0527 + distinct_4: 0.9768 + repetition_4: 0.0154 + d4: 0.9768 + r4: 0.0154 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.98_gpu1.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.98_gpu2.log b/eval/ar_baseline_latest_test/logs/temp0.98_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..136a3ec56c7d1ffd043e52eaec2c7711ad4af1a6 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.98_gpu2.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.98)... + sampled 64/128 + sampled 128/128 +First sample preview: 'LONDON — The British media reported in articles Wednesday that ISIS has taken over Kirkuk, the Iraqi town that is disput' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.98_gpu2.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.98_gpu2.json +Diversity metrics for temp0.98_gpu2.json: + distinct_1: 0.3213 + repetition_1: 0.3055 + d1: 0.3213 + r1: 0.3055 + distinct_2: 0.8150 + repetition_2: 0.0394 + d2: 0.8150 + r2: 0.0394 + distinct_4: 0.9945 + repetition_4: 0.0031 + d4: 0.9945 + r4: 0.0031 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.98_gpu2.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.9_gpu2.log b/eval/ar_baseline_latest_test/logs/temp0.9_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..c7407a333b4194b563f2e5701454b3a8b3fb14c5 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.9_gpu2.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.9)... + sampled 64/128 + sampled 128/128 +First sample preview: 'LONDON — The British media reported in articles Wednesday that the New York-based investment fund founded in London by e' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.9_gpu2.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.9_gpu2.json +Diversity metrics for temp0.9_gpu2.json: + distinct_1: 0.2695 + repetition_1: 0.3647 + d1: 0.2695 + r1: 0.3647 + distinct_2: 0.7520 + repetition_2: 0.0685 + d2: 0.7520 + r2: 0.0685 + distinct_4: 0.9846 + repetition_4: 0.0106 + d4: 0.9846 + r4: 0.0106 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.9_gpu2.json diff --git a/eval/ar_baseline_latest_test/logs/temp0.9_gpu4.log b/eval/ar_baseline_latest_test/logs/temp0.9_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..98b9746d384946762372b41ce4339f0c39926a64 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp0.9_gpu4.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=0.9)... + sampled 64/128 + sampled 128/128 +First sample preview: 'There is much heroism in the history of theatre in the United States. Whom to thank for this? Civil rights activist and ' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp0.9_gpu4.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp0.9_gpu4.json +Diversity metrics for temp0.9_gpu4.json: + distinct_1: 0.2818 + repetition_1: 0.3673 + d1: 0.2818 + r1: 0.3673 + distinct_2: 0.7574 + repetition_2: 0.0721 + d2: 0.7574 + r2: 0.0721 + distinct_4: 0.9824 + repetition_4: 0.0126 + d4: 0.9824 + r4: 0.0126 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp0.9_gpu4.json diff --git a/eval/ar_baseline_latest_test/logs/temp1_gpu7.log b/eval/ar_baseline_latest_test/logs/temp1_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..ebc7cb651579fadc1ef9411c81b60e48c2d65342 --- /dev/null +++ b/eval/ar_baseline_latest_test/logs/temp1_gpu7.log @@ -0,0 +1,50 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) +Generating 128 samples (seq_len=512, temperature=1.0)... + sampled 64/128 + sampled 128/128 +First sample preview: '“Muppets” creators William And Bryan Thompson and Coleman Hentzen are perhaps the biggest Javascript evangelists you won' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/metrics/temp1_gpu7.json +Saved samples -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/samples/temp1_gpu7.json +Diversity metrics for temp1_gpu7.json: + distinct_1: 0.3382 + repetition_1: 0.2992 + d1: 0.3382 + r1: 0.2992 + distinct_2: 0.8313 + repetition_2: 0.0370 + d2: 0.8313 + r2: 0.0370 + distinct_4: 0.9945 + repetition_4: 0.0036 + d4: 0.9945 + r4: 0.0036 + num_samples: 128.0000 +Saved -> /home/sunhc/diffusion/sad/eval/ar_baseline_latest_test/diversity/temp1_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp0.98_gpu4.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp0.98_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..a57369dbe38f513b46ca6b6ccd7428959f7e37ff --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp0.98_gpu4.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 0.98 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 871) +Average denoising rounds per sample: 871.00 +First sample preview: '. "It was like it was the alleged victim at night. It was so dark, and as the computers woke up -- having really shut up' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.2_temp0.98_gpu4.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu6.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..ea185e582c306e44c9e0e91b0008b3e4f2dd4436 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu6.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 953) +Average denoising rounds per sample: 953.00 +First sample preview: ' to point to Twitter will help too.\n\n20: The CW •• DC • Eleventh\u200bArrow plus CW\n\nTriDest does have an expanded look withi' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.2_temp1_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu7.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..0bd66d5d0cabbb6390a0ff76b9fba39549816b0d --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.2_temp1_gpu7.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 939) +Average denoising rounds per sample: 939.00 +First sample preview: 's her resounding expedition to fuel use failed to kill the house, which eloquently echoes a notorious perhaps like Frank' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.2_temp1_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu1.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..5f165bc4375bbaaa433a9aa5be3b8d2563538a28 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu1.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 736) +Average denoising rounds per sample: 736.00 +First sample preview: ' 3, 4, 7 3, 2, 8, 5, 7 3, 3, 3, 4 3, 3, 5 3, 3, 3 3, 3, 8, 7 3, 3, 6, 5 3, 3, 6, 6 3, 3, 3, 3 7 3, 5 4, 1, 2, 1, 7 5, 1,' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.3_temp0.8_gpu1.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu3.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..079ec03928bed4d304a7bcb86eab7f4e02f89763 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.3_temp0.8_gpu3.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 753) +Average denoising rounds per sample: 753.00 +First sample preview: ' sure that nobody covers them.\n\nAdvertisement\n\nThey chanted and sang for the national anthem and the Astoria State anthe' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.3_temp0.8_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.4_temp0.8_gpu0.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.4_temp0.8_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..45a01739074601e1a27f8c530c0cc6d5efd62f01 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.4_temp0.8_gpu0.log @@ -0,0 +1,40 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.4, 0.4] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 32/128 (steps this call: 778) + sampled 64/128 (steps this call: 812) + sampled 96/128 (steps this call: 821) + sampled 128/128 (steps this call: 832) +Average denoising rounds per sample: 810.75 +First sample preview: 'Australians hate Kim Shau, a social media user who would like to say: "Oh no, only rich people are waiting for me", says' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.6_temp0.98_gpu4.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.6_temp0.9_gpu5.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.6_temp0.9_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..e80f4bebde2040a5b7f29860941d078bc8c7c0c4 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.6_temp0.9_gpu5.log @@ -0,0 +1,55 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 32/128 (steps this call: 1105) + sampled 64/128 (steps this call: 1157) + sampled 96/128 (steps this call: 1120) + sampled 128/128 (steps this call: 1127) +Average denoising rounds per sample: 1127.25 +First sample preview: ' hemp.\n\nLegal\n\nThe growing market for hemp has drummed up goodwill. According to its website, the American Dictionary of' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.6_temp0.9_gpu5.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0.7_temp0.9_gpu0.log b/eval/h2_mixed_latest_test/logs/pps1_lam0.7_temp0.9_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..68b4c022f0e7e7e5d78d8c20e01e887d353bd80b --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0.7_temp0.9_gpu0.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.7, 0.7] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 1215) + sampled 128/128 (steps this call: 1198) +Average denoising rounds per sample: 1206.50 +First sample preview: "'s why [the] state's like destabilizing it. I remember [the state] had a 100-page list of nuclear weapons and they didn'" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0.7_temp0.9_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps1_lam0_temp0.7_gpu1.log b/eval/h2_mixed_latest_test/logs/pps1_lam0_temp0.7_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..3d1aed553f6831db5441ad33f639c5e214f76d91 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps1_lam0_temp0.7_gpu1.log @@ -0,0 +1,55 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.0, 0.0] +leaf_temperature = 0.7 +Generating 128 samples (L=512)... + sampled 32/128 (steps this call: 512) + sampled 64/128 (steps this call: 512) + sampled 96/128 (steps this call: 512) + sampled 128/128 (steps this call: 512) +Average denoising rounds per sample: 512.00 +First sample preview: 'Hello Military Users,\n\n---\n\nNote: Some want to quote us from:\n\nAs of last Thursday, we went to work on the new engine us' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps1_lam0_temp0.7_gpu1.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.2_temp1_gpu1.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.2_temp1_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..43a1db1fb3eeccba5567168e93463fb26176229d --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.2_temp1_gpu1.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 512) +Average denoising rounds per sample: 512.00 +First sample preview: ' and donate to a grassroots movement\n\nin Bali municipalities,\nweijmas Campaign for demolition of 3rd house and stone ent' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.2_temp1_gpu1.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.8_gpu4.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.8_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..9ffe84b782353d6f8fa31a9db52c681bb88d5875 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.8_gpu4.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 387) +Average denoising rounds per sample: 387.00 +First sample preview: '"It was like we gave up," he said.\n\nThe residents of the tower declined to comment for the story, but have pointed to th' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.3_temp0.8_gpu4.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.9_gpu4.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.9_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..c837c0e51491c4fce4b254425ff93885b0c12061 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.3_temp0.9_gpu4.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 453) + sampled 128/128 (steps this call: 454) +Average denoising rounds per sample: 453.50 +First sample preview: ' that rather than being helped by others like Manning’s chronic lack of eagerness.\n\nThat said, the Broncos need a dire c' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.3_temp0.9_gpu4.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp0.94_gpu3.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp0.94_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..f08ef9e552e94a43299e27effa119bce2343f4fa --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp0.94_gpu3.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 0.94 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 652) +Average denoising rounds per sample: 652.00 +First sample preview: ' Minutearo Minus.\n\n9,8 Marcel Jr.\n\n9\n\nmolonio Junior nabbed a replay, adding 1 TOV to the game in a row.\n\nJust 2 percent' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.6_temp0.94_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu5.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..8e79de39a0651074e2658b1f47cb3f5e266b8f33 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu5.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 719) +Average denoising rounds per sample: 719.00 +First sample preview: ' the quasi-Suicide template.\n\nEvery surrogate of the Australian “killer cop” provided by Spox (whose cops were eclipsed ' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.6_temp1_gpu5.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu6.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..7f0befeb4b3f6b6ead7feca25170886b96bedd4a --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.6_temp1_gpu6.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 703) +Average denoising rounds per sample: 703.00 +First sample preview: ' -- I had the [Obama] children on that plane, they really have to." He offered recollections about the Romney\'s White Ho' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.6_temp1_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.7_temp0.9_gpu6.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.7_temp0.9_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..0967faa7af05bcd44854775999afccb9684fa6e6 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.7_temp0.9_gpu6.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.7, 0.7] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 620) + sampled 128/128 (steps this call: 622) +Average denoising rounds per sample: 621.00 +First sample preview: 'Earlier this week, father of two Supreme Court Justices, S. Humayun (also known as the father of equal marriage) was ask' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.7_temp0.9_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.7_gpu4.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.7_gpu4.log new file mode 100644 index 0000000000000000000000000000000000000000..5daa9031b3bbd59b021eb04df1bea325d02d0922 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.7_gpu4.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.7 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 508) + sampled 128/128 (steps this call: 505) +Average denoising rounds per sample: 506.50 +First sample preview: ' stage at the newly opened Lucas and Mark Parker’s The Tour of Owings.\n\nI arrived in Raleigh to celebrate The Tour and t' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.8_temp0.7_gpu4.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.94_gpu1.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.94_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..298d563c5865431185e5703839f529b3dde7d85f --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.94_gpu1.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.94 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 695) +Average denoising rounds per sample: 695.00 +First sample preview: 'A young Australian citizen has been taken to a police station in Christchurch, charged with simple theft of his identity' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.8_temp0.94_gpu1.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu0.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..1bbea1bb140df6f7482f02b03baacc23bbb0be1e --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu0.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 694) +Average denoising rounds per sample: 694.00 +First sample preview: 'Microsoft CEO, Dennis Hewitt in his keynote speech this week called layoffs "unthinkable and unary" and What he reported' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.8_temp0.96_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu3.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..468bd9d9da54461b5fcaf30c5e4a1ef63697a9a9 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.8_temp0.96_gpu3.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 704) +Average denoising rounds per sample: 704.00 +First sample preview: " sure, you'll choose.\n\nFavor white. Range can be $necky. Then vary the widest. Exclusively in store TICKS TO Configure t" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.8_temp0.96_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0.9_temp0.8_gpu7.log b/eval/h2_mixed_latest_test/logs/pps2_lam0.9_temp0.8_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..776341cffbdd3b85c2b6537356b2f96d6dd20dac --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0.9_temp0.8_gpu7.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.9, 0.9] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 606) +Average denoising rounds per sample: 606.00 +First sample preview: '\nPolice say the habit of drifting in, from water, streams and streams driven by burning cars, is colloquially known as “' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0.9_temp0.8_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam0_temp0.8_gpu2.log b/eval/h2_mixed_latest_test/logs/pps2_lam0_temp0.8_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..c3848b34001d051dcb8f9fb034f3dd5553cceba2 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam0_temp0.8_gpu2.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.0, 0.0] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 256) + sampled 128/128 (steps this call: 256) +Average denoising rounds per sample: 256.00 +First sample preview: ' hotel bookings lost interest in the second half of the year after another 19-year-old student suffered an overdose in J' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam0_temp0.8_gpu2.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.8_gpu3.log b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.8_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..29c70f0af7f4e32d099fb30f356500497fe6214b --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.8_gpu3.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [1.0, 1.0] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 633) + sampled 128/128 (steps this call: 619) +Average denoising rounds per sample: 626.00 +First sample preview: ' Novemberó, Pan, Kyana, Picá and Cocoding. You can check out the Loop’s history of graffiti, or view a text list of graf' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam1_temp0.8_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.9_gpu6.log b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.9_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..30f379c2bd7cd4f3682aeb415561cc6ff1573d28 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp0.9_gpu6.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [1.0, 1.0] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 686) + sampled 128/128 (steps this call: 677) +Average denoising rounds per sample: 681.50 +First sample preview: 'Earlier this year, gender was being enforced with our calendar, but this year that is correct. We know it with most peop' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam1_temp0.9_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps2_lam1_temp1_gpu0.log b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp1_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..950e1ff610962f859df6f690193d15e9477b5458 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps2_lam1_temp1_gpu0.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [1.0, 1.0] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 750) +Average denoising rounds per sample: 750.00 +First sample preview: 'Microsoft CEO Satuj Foley, delivering his keynote earlier this week to an open duuce and svelte remarks that he argued w' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps2_lam1_temp1_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.1_temp0.9_gpu7.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.1_temp0.9_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..48ec267e5cbcddd5e66aca4efde2bf85a32e7948 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.1_temp0.9_gpu7.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.1, 0.1] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 151) + sampled 128/128 (steps this call: 146) +Average denoising rounds per sample: 148.50 +First sample preview: ' construction sites of TorrentFre from superfight themselves to the Attempts the lead us to F.im.\n\nBut then not the true' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.1_temp0.9_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp0.96_gpu0.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp0.96_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..e553f9661ebd35b4e7aaafeb3b84c18c7c022e0a --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp0.96_gpu0.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 248) +Average denoising rounds per sample: 248.00 +First sample preview: ' personal power consumption and make Chromebooks a stage that you can adapt to the daily risk Using theSony Rootkit free' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.2_temp0.96_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp1_gpu3.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp1_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..18d6983da71ec99c559903b4c6a0822eb212c81d --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.2_temp1_gpu3.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2] +leaf_temperature = 1.0 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 280) +Average denoising rounds per sample: 280.00 +First sample preview: ' weary months to the morning in November 2014, though, Chris’s behavior was more closely identified:\n\nPLELL, LIVE NOT BE' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.2_temp1_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu3.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..00ed5478cf233d589a92b15860ce9e5a53c77fbe --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu3.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 201) +Average denoising rounds per sample: 201.00 +First sample preview: 'This is not a morning-to-morning address in La Solla, but this very closely related:\n\nIn 1994, email address # 538 was i' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.3_temp0.8_gpu3.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu6.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..b4ecd3fb41c91bc9b5de73d3df8399734750a10b --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.3_temp0.8_gpu6.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.3, 0.3] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 215) +Average denoising rounds per sample: 215.00 +First sample preview: "The AFL will officially announce the location of next season's All-League, with the season 36\u200b map last year's game too\n" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.3_temp0.8_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.7_gpu2.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.7_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..9a412e114933de04603ba2668ae0358f0540bbda --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.7_gpu2.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 0.7 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 238) + sampled 128/128 (steps this call: 242) +Average denoising rounds per sample: 240.00 +First sample preview: ' end of the battles.The Strand\'s Song is named after the "The Battle Begins" by theLord of Battle of the Worms. Accordin' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.6_temp0.7_gpu2.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.94_gpu0.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.94_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..92cbebb5944bd471d503ddff578c808b38d277d7 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.94_gpu0.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 0.94 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 342) +Average denoising rounds per sample: 342.00 +First sample preview: 'After halting CEO Diddy Baldwin from the stage interviewing panel for high-defence skuffer at Chicago Sybil, the manager' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.6_temp0.94_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.96_gpu6.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.96_gpu6.log new file mode 100644 index 0000000000000000000000000000000000000000..d1791a12f20aa7140064888664a6dd873a1e8e13 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.6_temp0.96_gpu6.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.6, 0.6] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 357) +Average denoising rounds per sample: 357.00 +First sample preview: " goal, Carlton had to find new ways to assert themselves.\n\nLiverpool were denied by the half foot mark, Downing's free-k" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.6_temp0.96_gpu6.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.7_gpu7.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.7_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..86086d311d0a3ad5a47b827f029807e1ccb04469 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.7_gpu7.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.7 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 269) + sampled 128/128 (steps this call: 268) +Average denoising rounds per sample: 268.50 +First sample preview: 'The Samsung-Mobile App World to Apptopia exhibition is tomorrow afternoon at 4:00 p.m. in at the Chao Stadium in Hong Ko' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.8_temp0.7_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu0.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..e26786302bfd0e101cd52a78d7d842b2dbb34cfc --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu0.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 374) +Average denoising rounds per sample: 374.00 +First sample preview: 'The CEO of The Hew (and its external competitor as well) is also Duffer and Jackson Holball, and is tied among their top' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.8_temp0.96_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu5.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..22c881822d03bf3bddc65b9ce37587e067ed195f --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.8_temp0.96_gpu5.log @@ -0,0 +1,53 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.8, 0.8] +leaf_temperature = 0.96 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 375) +Average denoising rounds per sample: 375.00 +First sample preview: ' for a good reason that perspective understood is just a start.\n\n‘As long asurers aren’t trying us.’\n\nThat of has’s mult' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.8_temp0.96_gpu5.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.8_gpu7.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.8_gpu7.log new file mode 100644 index 0000000000000000000000000000000000000000..7d6d75d1c6f27eab580d5621d1b355dc3f1541c5 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.8_gpu7.log @@ -0,0 +1,52 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from cli:/home/sunhc/diffusion/sad/configs/block_ar_owt_b32_h2_mixed.yaml +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.9, 0.9] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 128/128 (steps this call: 324) +Average denoising rounds per sample: 324.00 +First sample preview: '\nPolice discovered detectives who walked over to a table at Alameda, Sartalozzi’s bed breakfast, and Edgar’s house. Henn' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.9_temp0.8_gpu7.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu0.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu0.log new file mode 100644 index 0000000000000000000000000000000000000000..36223df115df4b862bd11421b4f1df8e465980c1 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu0.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.9, 0.9] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 349) + sampled 128/128 (steps this call: 351) +Average denoising rounds per sample: 350.00 +First sample preview: 'branded, their team of developers wrote NYT how fast they will get ready. They also have points to ensure security and a' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.9_temp0.9_gpu0.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu5.log b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu5.log new file mode 100644 index 0000000000000000000000000000000000000000..5500a188b93892cc4ee07d88e0d9621d03632f0f --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam0.9_temp0.9_gpu5.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [0.9, 0.9] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 350) + sampled 128/128 (steps this call: 354) +Average denoising rounds per sample: 352.00 +First sample preview: "Just talking when the game starts,'t everyone thinks an interception Calvin makes is easier when thrown on? But having a" +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam0.9_temp0.9_gpu5.json diff --git a/eval/h2_mixed_latest_test/logs/pps4_lam1_temp0.7_gpu2.log b/eval/h2_mixed_latest_test/logs/pps4_lam1_temp0.7_gpu2.log new file mode 100644 index 0000000000000000000000000000000000000000..bf2165e76c77bc3e85980627eb06f2c7dd1204b0 --- /dev/null +++ b/eval/h2_mixed_latest_test/logs/pps4_lam1_temp0.7_gpu2.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h2_mixed/latest.pt (step=500000) +level_lambdas = [1.0, 1.0] +leaf_temperature = 0.7 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 297) + sampled 128/128 (steps this call: 298) +Average denoising rounds per sample: 297.50 +First sample preview: 'Welcome to the "Snap-in-a-Play"\n\nSingle-Share!\n\nEarn 50 Miles\n\nEvery 20 Days to\n\nChallenge and complete the Challenge (A' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h2_mixed_latest_test/diversity/pps4_lam1_temp0.7_gpu2.json diff --git a/eval/h3_mixed_latest_test/logs/pps1_lam0_temp0.8_gpu1.log b/eval/h3_mixed_latest_test/logs/pps1_lam0_temp0.8_gpu1.log new file mode 100644 index 0000000000000000000000000000000000000000..398b9caf4ee76b6eaaf66f39a627ee514762b467 --- /dev/null +++ b/eval/h3_mixed_latest_test/logs/pps1_lam0_temp0.8_gpu1.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h3_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h3_mixed/latest.pt (step=500000) +level_lambdas = [0.0, 0.0, 0.0] +leaf_temperature = 0.8 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 512) + sampled 128/128 (steps this call: 512) +Average denoising rounds per sample: 512.00 +First sample preview: ' estimated 19 million workers are being deported from all of Texas, including a 7.8 million undocumented workers manufac' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h3_mixed_latest_test/diversity/pps1_lam0_temp0.8_gpu1.json diff --git a/eval/h3_mixed_latest_test/logs/pps4_lam0.2_temp0.9_gpu3.log b/eval/h3_mixed_latest_test/logs/pps4_lam0.2_temp0.9_gpu3.log new file mode 100644 index 0000000000000000000000000000000000000000..a9f5e4ba8a2381300f37801ea4de737aa59c90d6 --- /dev/null +++ b/eval/h3_mixed_latest_test/logs/pps4_lam0.2_temp0.9_gpu3.log @@ -0,0 +1,51 @@ +`torch_dtype` is deprecated! Use `dtype` instead! +Using config from checkpoint:/home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h3_mixed/latest.pt +Loaded SAD checkpoint: /home/sunhc/diffusion/sad/outputs/sad_block_ar_b32_h3_mixed/latest.pt (step=500000) +level_lambdas = [0.2, 0.2, 0.2] +leaf_temperature = 0.9 +Generating 128 samples (L=512)... + sampled 64/128 (steps this call: 289) + sampled 128/128 (steps this call: 285) +Average denoising rounds per sample: 287.00 +First sample preview: ' defenders under the position and tactics of the Huskies.\n\nThat was surprising. The 25-year-old Kenyan native of Harvard' +Loading eval LM: /home/sunhc/diffusion/sad/models/gpt2-large +Loading eval tokenizer: /home/sunhc/diffusion/sad/models/gpt2-large + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/h3_mixed_latest_test/diversity/pps4_lam0.2_temp0.9_gpu3.json diff --git a/eval/mauve_ar/logs/ar_temp0.8.log b/eval/mauve_ar/logs/ar_temp0.8.log new file mode 100644 index 0000000000000000000000000000000000000000..42fff67179486e7d4f3a102b1176bda8c7aaf450 --- /dev/null +++ b/eval/mauve_ar/logs/ar_temp0.8.log @@ -0,0 +1,65 @@ +Launching 8 shards for temp=0.8, 128 samples per GPU +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + sampled 128/128 +Completed shard 5 on gpu5 seed=47 n=128 +Completed shard 6 on gpu6 seed=48 n=128 +Completed shard 0 on gpu0 seed=42 n=128 +Completed shard 4 on gpu4 seed=46 n=128 +Completed shard 7 on gpu7 seed=49 n=128 +Completed shard 1 on gpu1 seed=43 n=128 +Completed shard 2 on gpu2 seed=44 n=128 +Completed shard 3 on gpu3 seed=45 n=128 +Loading reference texts from OWT ... +Loading OWT reference pool: train[-100000:] ... +Token indices sequence length is longer than the specified maximum sequence length for this model (1704 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 1024 reference texts +Computing MAUVE on gpu0 ... +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 /home/sunhc/diffusion/sad/eval/mauve_ar/ar_temp0.8.json +Saved samples -> /home/sunhc/diffusion/sad/eval/mauve_ar/ar_temp0.8_samples_1024.json +MAUVE score: 0.197592 + diff --git a/eval/mauve_ar/logs/ar_temp0.85.log b/eval/mauve_ar/logs/ar_temp0.85.log new file mode 100644 index 0000000000000000000000000000000000000000..f446949ccb422af539605a501eeef1286167e8bd --- /dev/null +++ b/eval/mauve_ar/logs/ar_temp0.85.log @@ -0,0 +1,77 @@ +Config from checkpoint:outputs/ar_baseline/latest.pt +Model type: ar +Loaded AR checkpoint: /home/sunhc/diffusion/sad/outputs/ar_baseline/latest.pt (step=500000) + +Generating 5000 AR samples (max_new_tokens=511) ... + sampled 256/5000 + sampled 512/5000 + sampled 768/5000 + sampled 1024/5000 + sampled 1280/5000 + sampled 1536/5000 + sampled 1792/5000 + sampled 2048/5000 + sampled 2304/5000 + sampled 2560/5000 + sampled 2816/5000 + sampled 3072/5000 + sampled 3328/5000 + sampled 3584/5000 + sampled 3840/5000 + sampled 4096/5000 + sampled 4352/5000 + sampled 4608/5000 + sampled 4864/5000 + sampled 5000/5000 +First generated sample: 'The Obama administration and Republican lawmakers have been trying to use offshore drilling as a way to decrease the env' + +Loading reference texts from OWT ... +Loading OWT reference pool: train[-100000:] ... +Token indices sequence length is longer than the specified maximum sequence length for this model (1704 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2253 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (2097 > 1024). Running this sequence through the model will result in indexing errors +Token indices sequence length is longer than the specified maximum sequence length for this model (1384 > 1024). Running this sequence through the model will result in indexing errors + collected 100000 reference texts from OWT pool + selected 5000 reference texts + +Computing MAUVE ... + featurize model : /home/sunhc/diffusion/sad/models/gpt2-large + device_id : 0 + max_text_length : 512 + p (reference) : 5000 texts + q (generated) : 5000 texts +Loading tokenizer +Tokenizing text... +Loading tokenizer +Loading model + Loading weights: 0%| | 0/436 [00:00