Khanin Udomchoksakul
Add optimized Mistral-7B-Instruct-v0.3 build (MistralRMSNorm + MistralMLP CUDA kernels)
e57527b verified | from setuptools import setup | |
| setup( | |
| name="mistralrmsnorm_ext", | |
| packages=["mistralrmsnorm_cuda"], | |
| package_data={"mistralrmsnorm_cuda": ["*.so"]}, | |
| ) | |