Buckets:

hf-doc-build/doc-dev / kernels /pr_607 /en /basic-usage.md
|
download
raw
3.41 kB
# Quickstart
## Loading Kernels
Here is how you would use the [activation](https://huggingface.co/kernels-community/activation) kernels from the Hugging Face Hub:
```python
import torch
from kernels import get_kernel
# Download optimized kernels from the Hugging Face hub
activation = get_kernel("kernels-community/activation", version=1)
# Create a random tensor
x = torch.randn((10, 10), dtype=torch.float16, device="cuda")
# Run the kernel
y = torch.empty_like(x)
activation.gelu_fast(y, x)
print(y)
```
This fetches version `1` of the kernel `kernels-community/activation`.
Kernels are versioned using a major version number. Using `version=1` will
get the latest kernel build from the `v1` branch.
Kernels within a version branch must never break the API or remove builds
for older PyTorch versions. This ensures that your code will continue to work.
Hub kernels must be loaded with either a `version` or an explicit `revision`.
## Checking Kernel Availability
You can check if a particular version of a kernel supports the environment
that the program is running on:
```python
from kernels import has_kernel
# Check if kernel is available for current environment
is_available = has_kernel("kernels-community/activation", version=1)
print(f"Kernel available: {is_available}")
```
When no compatible kernel is found, [has_kernel()](/docs/kernels/pr_607/en/api/kernels#kernels.has_kernel) does not say *why*.
[get_kernel_variants()](/docs/kernels/pr_607/en/api/kernels#kernels.get_kernel_variants) returns the full resolution trace instead: one
decision per build variant in the repository, with compatible variants listed
first. Each decision is a `VariantAccepted` or a `VariantRejected`, and rejected
variants carry a human-readable `reason`:
```python
from kernels import get_kernel_variants, VariantAccepted
for decision in get_kernel_variants("kernels-community/activation", version=1):
name = decision.variant.variant_str
if isinstance(decision, VariantAccepted):
print(f"{name}: compatible")
else:
print(f"{name}: rejected ({decision.reason})")
```
## Inspecting Loaded Kernels
[get_loaded_kernels()](/docs/kernels/pr_607/en/api/kernels#kernels.get_loaded_kernels) returns a snapshot of every kernel that has been loaded
into the current process. Each entry is a [LoadedKernel](/docs/kernels/pr_607/en/api/kernels#kernels.LoadedKernel) namedtuple with the
imported `module`, the `package_name`, and `repo_infos` (repo id, resolved
revision, and the backend argument that was passed).
```python
from kernels import get_kernel, get_loaded_kernels
get_kernel("kernels-community/activation", version=1)
for loaded in get_loaded_kernels():
print(loaded.package_name, loaded.repo_infos)
```
`repo_infos` is populated only for kernels loaded with [get_kernel()](/docs/kernels/pr_607/en/api/kernels#kernels.get_kernel). Kernels
loaded from a local path ([get_local_kernel()](/docs/kernels/pr_607/en/api/kernels#kernels.get_local_kernel)) or via a lockfile
([get_locked_kernel()](/docs/kernels/pr_607/en/api/kernels#kernels.get_locked_kernel), [load_kernel()](/docs/kernels/pr_607/en/api/kernels#kernels.load_kernel)) have `repo_infos=None`.
Browse through different kernels compatible with `kernels` from [here](https://huggingface.co/kernels).
A kernel can provide layers in addition to kernel functions. Refer to [Layers](./layers) to know more.

Xet Storage Details

Size:
3.41 kB
·
Xet hash:
596dfff7852a0f15fb80fa99427a96c285d1ba9a7d2b1d4146bb7d1be55d2136

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.