Rate limited when trying to get this kernel

#1
by cynricfu - opened

It seems that there are too many files in each build of this kernel (expecially cutlass third-party module I guess).

I cannnot successfully use this kernel via get_kernel due to huggingface rate limit.

>>> from kernels import get_kernel
>>> kernel = get_kernel("kernels-community/deep-gemm", version=2)
Downloading (incomplete total...): 0.00B [00:0HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/array_planar_complex.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/barrier.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/bfloat16.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/blas3.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/blas3_types.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/block_striped.h
Rate limited. Waiting 111.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/array_subbyte.h
Rate limited. Waiting 110.0s before retry [Retry 1/5].
HTTP Error 429 thrown while requesting HEAD https://huggingface.co/kernels/kernels-community/deep-gemm/resolve/c90c3a7717cf7efd70e6b1be18a9a391dcb9df4f/build/torch211-cu128-x86_64-linux/include/third-party/cutlass/include/cutlass/cluster_launch.hpp
Rate limited. Waiting 110.0s before retry [Retry 1/5].
Fetching ... files: 398it [00:11, 35.94it/s]

Sign up or log in to comment