Buckets:

Pranav2748's picture
download
raw
2.05 kB
`torch_dtype` is deprecated! Use `dtype` instead!
{"event": "eval_done", "out": "runs/e2/core", "n": 6744, "unsupported": 0, "seconds": 1601.1}
K=1 reasoning 64.67 lookup 74.45 other 59.82 core17_macro 65.83 core14_macro 63.93 reasoning_no_mnli 61.82
K=2 reasoning 64.65 lookup 74.45 other 59.75 core17_macro 65.80 core14_macro 63.84 reasoning_no_mnli 61.72
K=3 reasoning 64.63 lookup 74.43 other 59.94 core17_macro 65.86 core14_macro 63.96 reasoning_no_mnli 61.77
K=4 reasoning 64.82 lookup 74.43 other 59.82 core17_macro 65.88 core14_macro 63.97 reasoning_no_mnli 61.93
K=5 reasoning 64.85 lookup 74.37 other 59.71 core17_macro 65.83 core14_macro 63.88 reasoning_no_mnli 61.90
K=6 reasoning 64.60 lookup 74.51 other 59.91 core17_macro 65.86 core14_macro 63.93 reasoning_no_mnli 61.74
K=7 reasoning 64.78 lookup 74.70 other 59.94 core17_macro 65.99 core14_macro 64.07 reasoning_no_mnli 61.89
K=8 reasoning 64.76 lookup 74.35 other 59.94 core17_macro 65.88 core14_macro 63.97 reasoning_no_mnli 61.79
`torch_dtype` is deprecated! Use `dtype` instead!
/usr/local/lib/python3.12/dist-packages/numpy/_core/fromnumeric.py:3862: RuntimeWarning: Mean of empty slice
return _methods._mean(a, axis=axis, dtype=dtype,
/usr/local/lib/python3.12/dist-packages/numpy/_core/_methods.py:142: RuntimeWarning: invalid value encountered in scalar divide
ret = ret.dtype.type(ret / rcount)
{"event": "eval_done", "out": "runs/e2/dev", "n": 1000, "unsupported": 0, "seconds": 63.1}
K=1 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan
K=2 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan
K=3 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan
K=4 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan
K=5 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan
K=6 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan
K=7 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan
K=8 core17_macro 90.39 core14_macro 90.39 reasoning_no_mnli nan

Xet Storage Details

Size:
2.05 kB
·
Xet hash:
783166d830603ea1555e9e85d4cd955f0cfb006c40b50f040b3355f6881f9455

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.