File size: 1,027 Bytes
13bcef4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
library_name: kernels
license: apache-2.0
---

This is the repository card of kernels-community/activation that has been pushed on the Hub. It was built to be used with the [`kernels` library](https://github.com/huggingface/kernels). This card was automatically generated.

## How to use

```python
# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/activation", version=1)
silu_and_mul = kernel_module.silu_and_mul

silu_and_mul(...)
```

## Available functions
- `silu_and_mul`
- `mul_and_silu`
- `gelu_and_mul`
- `gelu_tanh_and_mul`
- `fatrelu_and_mul`
- `gelu_fast`
- `gelu_new`
- `gelu_quick`
- `gelu_tanh`
- `silu`
- `gelu`

## Available layers
- `SiluAndMul`
- `Silu`
- `Gelu`
- `GeluTanh`
- `MulAndSilu`
- `GeluAndMul`
- `GeluTanhAndMul`
- `FatreluAndMul`
- `FastGELU`
- `NewGELU`
- `QuickGELU`

## Benchmarks

Benchmarking script is available for this kernel. Run `kernels benchmark kernels-community/activation --version 1`.