Buckets:
| `torch_dtype` is deprecated! Use `dtype` instead! | |
| {"event": "eval_done", "out": "runs/e3/core", "n": 6744, "unsupported": 0, "seconds": 1393.6} | |
| K=1 reasoning 64.51 lookup 75.31 other 59.56 core17_macro 65.94 core14_macro 64.02 reasoning_no_mnli 61.82 | |
| K=2 reasoning 64.08 lookup 75.28 other 59.49 core17_macro 65.75 core14_macro 63.76 reasoning_no_mnli 61.31 | |
| K=3 reasoning 64.51 lookup 75.12 other 59.63 core17_macro 65.91 core14_macro 64.01 reasoning_no_mnli 61.83 | |
| K=4 reasoning 64.39 lookup 75.41 other 59.55 core17_macro 65.92 core14_macro 63.94 reasoning_no_mnli 61.69 | |
| K=5 reasoning 64.33 lookup 75.29 other 59.59 core17_macro 65.88 core14_macro 63.94 reasoning_no_mnli 61.68 | |
| K=6 reasoning 64.46 lookup 75.22 other 59.47 core17_macro 65.86 core14_macro 63.89 reasoning_no_mnli 61.76 | |
| K=7 reasoning 64.39 lookup 75.42 other 59.64 core17_macro 65.96 core14_macro 63.98 reasoning_no_mnli 61.69 | |
| K=8 reasoning 64.47 lookup 75.34 other 59.63 core17_macro 65.96 core14_macro 64.01 reasoning_no_mnli 61.78 | |
| `torch_dtype` is deprecated! Use `dtype` instead! | |
| /usr/local/lib/python3.12/dist-packages/numpy/_core/fromnumeric.py:3862: RuntimeWarning: Mean of empty slice | |
| return _methods._mean(a, axis=axis, dtype=dtype, | |
| /usr/local/lib/python3.12/dist-packages/numpy/_core/_methods.py:142: RuntimeWarning: invalid value encountered in scalar divide | |
| ret = ret.dtype.type(ret / rcount) | |
| {"event": "eval_done", "out": "runs/e3/dev", "n": 1000, "unsupported": 0, "seconds": 28.8} | |
| K=1 core17_macro 90.28 core14_macro 90.28 reasoning_no_mnli nan | |
| K=2 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan | |
| K=3 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan | |
| K=4 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan | |
| K=5 core17_macro 90.28 core14_macro 90.28 reasoning_no_mnli nan | |
| K=6 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan | |
| K=7 core17_macro 90.28 core14_macro 90.28 reasoning_no_mnli nan | |
| K=8 core17_macro 90.45 core14_macro 90.45 reasoning_no_mnli nan | |
Xet Storage Details
- Size:
- 2.05 kB
- Xet hash:
- 685ebc4841a85985f68a92babf717a5f7896dc39d0e6040854a09e10f33bd514
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.