File size: 1,560 Bytes
a2966b3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]/home/henry/Documents/PythonProjects/variable-reap/.venv/lib/python3.12/site-packages/bitsandbytes/backends/cuda/ops.py:213: FutureWarning: _check_is_size will be removed in a future PyTorch release along with guard_size_oblivious. Use _check(i >= 0) instead.
torch._check_is_size(blocksize)
Loading checkpoint shards: 33%|███▎ | 1/3 [00:02<00:04, 2.21s/it]
Loading checkpoint shards: 67%|██████▋ | 2/3 [00:04<00:02, 2.17s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:06<00:00, 1.99s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:06<00:00, 2.04s/it]
/home/henry/Documents/PythonProjects/variable-reap/.venv/lib/python3.12/site-packages/bitsandbytes/backends/cuda/ops.py:468: FutureWarning: _check_is_size will be removed in a future PyTorch release along with guard_size_oblivious. Use _check(i >= 0) instead.
torch._check_is_size(blocksize)
shard shard_00000.pt: cumulative 73031 tokens
shard shard_00001.pt: cumulative 142706 tokens
shard shard_00002.pt: cumulative 221592 tokens
{
"quant": "nf4",
"shards": 3,
"tokens": 221592,
"kl_mean_nats": 0.03224208885256773,
"kl_median_nats": 0.00010718336125137284,
"kl_p95_nats": 0.15037551522254944,
"kl_max_nats": 14.360836029052734,
"top128_jaccard_mean": 0.7352590498594933,
"top1_agreement": 0.9612215242427524,
"captured_mass_bf16": 0.9997188871511677,
"captured_mass_quant_at_bf16_support": 0.9996136682180469
}
|