Instructions to use kernels-community/quantization-bitsandbytes with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Kernels
How to use kernels-community/quantization-bitsandbytes with Kernels:
# !pip install kernels from kernels import get_kernel kernel = get_kernel("kernels-community/quantization-bitsandbytes") - Notebooks
- Google Colab
- Kaggle
| {"mediaType":"application/vnd.dev.sigstore.bundle.v0.3+json","verificationMaterial":{"certificate":{"rawBytes":"MIIHSzCCBtKgAwIBAgIUW4L4ADyr37L5dT5iCbE3SVCAizUwCgYIKoZIzj0EAwMwNzEVMBMGA1UEChMMc2lnc3RvcmUuZGV2MR4wHAYDVQQDExVzaWdzdG9yZS1pbnRlcm1lZGlhdGUwHhcNMjYwNjExMTQzODI0WhcNMjYwNjExMTQ0ODI0WjAAMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEcJDibyARzYy2DGBYpjkEbJEPCdj5ORaNXIWhhFZhWHSHH6dY7BP9LI9NzlZG0vK7hhns+7yCuPkKCa5M0xxT9qOCBfEwggXtMA4GA1UdDwEB/wQEAwIHgDATBgNVHSUEDDAKBggrBgEFBQcDAzAdBgNVHQ4EFgQUQJSOv+tSidHhqbUZQ63zG3YAmgcwHwYDVR0jBBgwFoAU39Ppz1YkEZb5qNjpKFWixi4YZD8wawYDVR0RAQH/BGEwX4ZdaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5Ly5naXRodWIvd29ya2Zsb3dzL2J1aWxkLnlhbWxAcmVmcy9oZWFkcy9tYWluMDkGCisGAQQBg78wAQEEK2h0dHBzOi8vdG9rZW4uYWN0aW9ucy5naXRodWJ1c2VyY29udGVudC5jb20wHwYKKwYBBAGDvzABAgQRd29ya2Zsb3dfZGlzcGF0Y2gwNgYKKwYBBAGDvzABAwQoZGJjNGQxOTc1OWQ3OTNkNzQ5NDhiM2RhODc1MWM4ZGQxM2UxYzUwZDATBgorBgEEAYO/MAEEBAVCdWlsZDArBgorBgEEAYO/MAEFBB1odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eTAdBgorBgEEAYO/MAEGBA9yZWZzL2hlYWRzL21haW4wOwYKKwYBBAGDvzABCAQtDCtodHRwczovL3Rva2VuLmFjdGlvbnMuZ2l0aHVidXNlcmNvbnRlbnQuY29tMG0GCisGAQQBg78wAQkEXwxdaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5Ly5naXRodWIvd29ya2Zsb3dzL2J1aWxkLnlhbWxAcmVmcy9oZWFkcy9tYWluMDgGCisGAQQBg78wAQoEKgwoZGJjNGQxOTc1OWQ3OTNkNzQ5NDhiM2RhODc1MWM4ZGQxM2UxYzUwZDAbBgorBgEEAYO/MAELBA0MC3NlbGYtaG9zdGVkMEAGCisGAQQBg78wAQwEMgwwaHR0cHM6Ly9naXRodWIuY29tL2h1Z2dpbmdmYWNlL2tlcm5lbHMtY29tbXVuaXR5MDgGCisGAQQBg78wAQ0EKgwoZGJjNGQxOTc1OWQ3OTNkNzQ5NDhiM2RhODc1MWM4ZGQxM2UxYzUwZDAfBgorBgEEAYO/MAEOBBEMD3JlZnMvaGVhZHMvbWFpbjAaBgorBgEEAYO/MAEPBAwMCjEwNzE0NzU1MjkwLgYKKwYBBAGDvzABEAQgDB5odHRwczovL2dpdGh1Yi5jb20vaHVnZ2luZ2ZhY2UwGAYKKwYBBAGDvzABEQQKDAgyNTcyMDc0MzBtBgorBgEEAYO/MAESBF8MXWh0dHBzOi8vZ2l0aHViLmNvbS9odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eS8uZ2l0aHViL3dvcmtmbG93cy9idWlsZC55YW1sQHJlZnMvaGVhZHMvbWFpbjA4BgorBgEEAYO/MAETBCoMKGRiYzRkMTk3NTlkNzkzZDc0OTQ4YjNkYTg3NTFjOGRkMTNlMWM1MGQwIQYKKwYBBAGDvzABFAQTDBF3b3JrZmxvd19kaXNwYXRjaDBkBgorBgEEAYO/MAEVBFYMVGh0dHBzOi8vZ2l0aHViLmNvbS9odWdnaW5nZmFjZS9rZXJuZWxzLWNvbW11bml0eS9hY3Rpb25zL3J1bnMvMjczNTQ0ODAyMjMvYXR0ZW1wdHMvMTAWBgorBgEEAYO/MAEWBAgMBnB1YmxpYzBGBgorBgEEAYO/MAEYBDgMNnJlcG86aHVnZ2luZ2ZhY2Uva2VybmVscy1jb21tdW5pdHk6cmVmOnJlZnMvaGVhZHMvbWFpbjCBiwYKKwYBBAHWeQIEAgR9BHsAeQB3AN09MGrGxxEyYxkeHJlnNwKiSl643jyt/4eKcoAvKe6OAAABnrcet3cAAAQDAEgwRgIhAJpRFyjc8yn044RVBE/fB0ywY+at0ol0oUhu2JCDx9Z6AiEAgFgL/AG0kDKC6Oo63PfPncnudDoxEmXgIbdIv69H/NAwCgYIKoZIzj0EAwMDZwAwZAIwYz2sg+tLHfuMJCwKzQdO8y0g8UZz5etuPLGMEStVvyovHh+0tR8lymSOPrBeKzEwAjBP0CiAsfoLIFTNjiD54ZkDmCd2/pfFwLu8sc3pTMpDMtALn/ICgVF9A3miv+GCWJk="},"tlogEntries":[{"logIndex":"1790495352","logId":{"keyId":"wNI9atQGlz+VWfO6LRygH4QUfY/8W4RFwiT5i5WRgB0="},"kindVersion":{"kind":"hashedrekord","version":"0.0.1"},"integratedTime":"1781188704","inclusionPromise":{"signedEntryTimestamp":"MEQCIDYZ/snhtF1fMSGmUG5BG0Oov16g+Pdj1VBP8v81IV9QAiAacu651rm67G8sOyaSBd+9Ovtd4ox1/Y3xXPjf2E8R6A=="},"inclusionProof":{"logIndex":"1668591090","rootHash":"HoXO5LdFvwTeNLHNtz9iH8TL/R2QXpNNIYO91vpMmU4=","treeSize":"1668591101","hashes":["4CfaB676QKiiV/1kw1k12Zz7iQ3yL1dnh1nLiHhAANw=","Uy9Aic603ZkLB9MgA1xVqLQ1NjvlFwzEt5y1xwZdWh0=","p+aLe0THMjJXUfJfQrxU+6+8YerNoY1Lu3qfEmt1XNE=","mhosbFYscWBxIP6Gc6fCfYsqsYIezPsVUL0bZTKgTzo=","w1ItCHeXD/n9S0pgSmp3/VmU8CfYoH9a9jDmbErpwro=","IgkNFRuSrLgWqqTuhjRLVRW5f7B2nNTLQehUvy8VX9M=","jYk+rPZcfPZxlZz5QL8/ym6UAMApCqWUpPT2lrU7KzA=","VLjNIn+/FT/sj2plp3EFUA9OUotpbCZUQAskW11yTRo=","xjajsLAqU3kKq9bsho/O187CsKAD1bBB8bjmajSi73g=","Jn8NfeTKA/Wn+Sy867uybzuVI3sjagiKnsoulCT4QQU=","TdBfLS9SMe3ZsoszIUiQumvBe3dmck14VtdRElEs1K8=","MmhYSGL9tV9VqAd0kdSlK1D1YFnROf/Fas/Lr7yjtqo=","51TeddbV5u7z9K441lGPz1LjhfDNDenrKBiOVK8RbpE=","6tW244rjPmq7305sgydyiJtETkQtUfD0bAJbxSULMYY=","PxdW73inovRM3x/bZLcDE4x1x0Vc7Vgq+BdZi+CmcQQ=","uY7Ph0LAktbD9csB1/ryC2QihiqtmSV1p5xVUI3/v6k=","JGbMh1cw1XivPXL+BQCwS2qUIt+0TTRwi4yz793EWaw=","FmLvkxuZj/neQyepEyXhOWi3mAg02QIohp2zk4HDWK8=","mDCdA8t/LGc+hqiV0SOyqPXlOYPyWpasRaDDvCC8JAE=","daxmZaajRpZV+JxHiOYZhJBiSKN5ucqjh2WnGbHhirw=","DOCeoSMovIvLExkhIvisow9AuNXgeWs4ECkyR6EcqYU="],"checkpoint":{"envelope":"rekor.sigstore.dev - 1193050959916656506\n1668591101\nHoXO5LdFvwTeNLHNtz9iH8TL/R2QXpNNIYO91vpMmU4=\n\n— rekor.sigstore.dev wNI9ajBFAiEA8IEp6Ad0Uhj53RwYt2d//vUa0ILPWzE5oDCk7mQia78CIA2c0toiQUQgBTY5Nx/2QkKteScZFPMVdOCnt3q9F5CX\n"}},"canonicalizedBody":"eyJhcGlWZXJzaW9uIjoiMC4wLjEiLCJraW5kIjoiaGFzaGVkcmVrb3JkIiwic3BlYyI6eyJkYXRhIjp7Imhhc2giOnsiYWxnb3JpdGhtIjoic2hhMjU2IiwidmFsdWUiOiIwOTYxZjJjYzc4ZmYxZjRiMTE4NmYxNmU1ZTVmNjg2NzA0ZTVlMzM4ZjQ3OTdkNzAzNWE0OGU2ZDVlODljNDhlIn19LCJzaWduYXR1cmUiOnsiY29udGVudCI6Ik1FVUNJQURiZTVFbjRTeE5rVThZMk9TWmlYUXN4c1hyVVhqL0c5cTJ2aWFGZVBMSUFpRUExRy9JSUlURVZZTkpKUjR2RVlZLzU4SHhMRVM5b01iS3hZNGhKZ3dsT0hZPSIsInB1YmxpY0tleSI6eyJjb250ZW50IjoiTFMwdExTMUNSVWRKVGlCRFJWSlVTVVpKUTBGVVJTMHRMUzB0Q2sxSlNVaFRla05EUW5STFowRjNTVUpCWjBsVlZ6Uk1ORUZFZVhJek4wdzFaRlExYVVOaVJUTlRWa05CYVhwVmQwTm5XVWxMYjFwSmVtb3dSVUYzVFhjS1RucEZWazFDVFVkQk1WVkZRMmhOVFdNeWJHNWpNMUoyWTIxVmRWcEhWakpOVWpSM1NFRlpSRlpSVVVSRmVGWjZZVmRrZW1SSE9YbGFVekZ3WW01U2JBcGpiVEZzV2tkc2FHUkhWWGRJYUdOT1RXcFpkMDVxUlhoTlZGRjZUMFJKTUZkb1kwNU5hbGwzVG1wRmVFMVVVVEJQUkVrd1YycEJRVTFHYTNkRmQxbElDa3R2V2tsNmFqQkRRVkZaU1V0dldrbDZhakJFUVZGalJGRm5RVVZqU2tScFlubEJVbnBaZVRKRVIwSlpjR3ByUldKS1JWQkRaR28xVDFKaFRsaEpWMmdLYUVaYWFGZElVMGhJTm1SWk4wSlFPVXhKT1U1NmJGcEhNSFpMTjJob2JuTXJOM2xEZFZCclMwTmhOVTB3ZUhoVU9YRlBRMEptUlhkbloxaDBUVUUwUndwQk1WVmtSSGRGUWk5M1VVVkJkMGxJWjBSQlZFSm5UbFpJVTFWRlJFUkJTMEpuWjNKQ1owVkdRbEZqUkVGNlFXUkNaMDVXU0ZFMFJVWm5VVlZSU2xOUENuWXJkRk5wWkVob2NXSlZXbEUyTTNwSE0xbEJiV2RqZDBoM1dVUldVakJxUWtKbmQwWnZRVlV6T1ZCd2VqRlphMFZhWWpWeFRtcHdTMFpYYVhocE5Ga0tXa1E0ZDJGM1dVUldVakJTUVZGSUwwSkhSWGRZTkZwa1lVaFNNR05JVFRaTWVUbHVZVmhTYjJSWFNYVlpNamwwVERKb01Wb3laSEJpYldSdFdWZE9iQXBNTW5Sc1kyMDFiR0pJVFhSWk1qbDBZbGhXZFdGWVVqVk1lVFZ1WVZoU2IyUlhTWFprTWpsNVlUSmFjMkl6WkhwTU1rb3hZVmQ0YTB4dWJHaGlWM2hCQ21OdFZtMWplVGx2V2xkR2EyTjVPWFJaVjJ4MVRVUnJSME5wYzBkQlVWRkNaemM0ZDBGUlJVVkxNbWd3WkVoQ2VrOXBPSFprUnpseVdsYzBkVmxYVGpBS1lWYzVkV041Tlc1aFdGSnZaRmRLTVdNeVZubFpNamwxWkVkV2RXUkROV3BpTWpCM1NIZFpTMHQzV1VKQ1FVZEVkbnBCUWtGblVWSmtNamw1WVRKYWN3cGlNMlJtV2tkc2VtTkhSakJaTW1kM1RtZFpTMHQzV1VKQ1FVZEVkbnBCUWtGM1VXOWFSMHBxVGtkUmVFOVVZekZQVjFFelQxUk9hMDU2VVRWT1JHaHBDazB5VW1oUFJHTXhUVmROTkZwSFVYaE5NbFY0V1hwVmQxcEVRVlJDWjI5eVFtZEZSVUZaVHk5TlFVVkZRa0ZXUTJSWGJITmFSRUZ5UW1kdmNrSm5SVVVLUVZsUEwwMUJSVVpDUWpGdlpGZGtibUZYTlc1YWJVWnFXbE01Y2xwWVNuVmFWM2g2VEZkT2RtSlhNVEZpYld3d1pWUkJaRUpuYjNKQ1owVkZRVmxQTHdwTlFVVkhRa0U1ZVZwWFducE1NbWhzV1ZkU2Vrd3lNV2hoVnpSM1QzZFpTMHQzV1VKQ1FVZEVkbnBCUWtOQlVYUkVRM1J2WkVoU2QyTjZiM1pNTTFKMkNtRXlWblZNYlVacVpFZHNkbUp1VFhWYU1td3dZVWhXYVdSWVRteGpiVTUyWW01U2JHSnVVWFZaTWpsMFRVY3dSME5wYzBkQlVWRkNaemM0ZDBGUmEwVUtXSGQ0WkdGSVVqQmpTRTAyVEhrNWJtRllVbTlrVjBsMVdUSTVkRXd5YURGYU1tUndZbTFrYlZsWFRteE1NblJzWTIwMWJHSklUWFJaTWpsMFlsaFdkUXBoV0ZJMVRIazFibUZZVW05a1YwbDJaREk1ZVdFeVduTmlNMlI2VERKS01XRlhlR3RNYm14b1lsZDRRV050Vm0xamVUbHZXbGRHYTJONU9YUlpWMngxQ2sxRVowZERhWE5IUVZGUlFtYzNPSGRCVVc5RlMyZDNiMXBIU21wT1IxRjRUMVJqTVU5WFVUTlBWRTVyVG5wUk5VNUVhR2xOTWxKb1QwUmpNVTFYVFRRS1drZFJlRTB5VlhoWmVsVjNXa1JCWWtKbmIzSkNaMFZGUVZsUEwwMUJSVXhDUVRCTlF6Tk9iR0pIV1hSaFJ6bDZaRWRXYTAxRlFVZERhWE5IUVZGUlFncG5OemgzUVZGM1JVMW5kM2RoU0ZJd1kwaE5Oa3g1T1c1aFdGSnZaRmRKZFZreU9YUk1NbWd4V2pKa2NHSnRaRzFaVjA1c1RESjBiR050Tld4aVNFMTBDbGt5T1hSaVdGWjFZVmhTTlUxRVowZERhWE5IUVZGUlFtYzNPSGRCVVRCRlMyZDNiMXBIU21wT1IxRjRUMVJqTVU5WFVUTlBWRTVyVG5wUk5VNUVhR2tLVFRKU2FFOUVZekZOVjAwMFdrZFJlRTB5VlhoWmVsVjNXa1JCWmtKbmIzSkNaMFZGUVZsUEwwMUJSVTlDUWtWTlJETktiRnB1VFhaaFIxWm9Xa2hOZGdwaVYwWndZbXBCWVVKbmIzSkNaMFZGUVZsUEwwMUJSVkJDUVhkTlEycEZkMDU2UlRCT2VsVXhUV3ByZDB4bldVdExkMWxDUWtGSFJIWjZRVUpGUVZGbkNrUkNOVzlrU0ZKM1kzcHZka3d5WkhCa1IyZ3hXV2sxYW1JeU1IWmhTRlp1V2pKc2RWb3lXbWhaTWxWM1IwRlpTMHQzV1VKQ1FVZEVkbnBCUWtWUlVVc0tSRUZuZVU1VVkzbE5SR013VFhwQ2RFSm5iM0pDWjBWRlFWbFBMMDFCUlZOQ1JqaE5XRmRvTUdSSVFucFBhVGgyV2pKc01HRklWbWxNYlU1MllsTTVid3BrVjJSdVlWYzFibHB0Um1wYVV6bHlXbGhLZFZwWGVIcE1WMDUyWWxjeE1XSnRiREJsVXpoMVdqSnNNR0ZJVm1sTU0yUjJZMjEwYldKSE9UTmplVGxwQ21SWGJITmFRelUxV1ZjeGMxRklTbXhhYmsxMllVZFdhRnBJVFhaaVYwWndZbXBCTkVKbmIzSkNaMFZGUVZsUEwwMUJSVlJDUTI5TlMwZFNhVmw2VW1zS1RWUnJNMDVVYkd0T2VtdDZXa1JqTUU5VVVUUlphazVyV1ZSbk0wNVVSbXBQUjFKclRWUk9iRTFYVFRGTlIxRjNTVkZaUzB0M1dVSkNRVWRFZG5wQlFncEdRVkZVUkVKR00ySXpTbkphYlhoMlpERTVhMkZZVG5kWldGSnFZVVJDYTBKbmIzSkNaMFZGUVZsUEwwMUJSVlpDUmxsTlZrZG9NR1JJUW5wUGFUaDJDbG95YkRCaFNGWnBURzFPZG1KVE9XOWtWMlJ1WVZjMWJscHRSbXBhVXpseVdsaEtkVnBYZUhwTVYwNTJZbGN4TVdKdGJEQmxVemxvV1ROU2NHSXlOWG9LVEROS01XSnVUWFpOYW1ONlRsUlJNRTlFUVhsTmFrMTJXVmhTTUZwWE1YZGtTRTEyVFZSQlYwSm5iM0pDWjBWRlFWbFBMMDFCUlZkQ1FXZE5RbTVDTVFwWmJYaHdXWHBDUjBKbmIzSkNaMFZGUVZsUEwwMUJSVmxDUkdkTlRtNUtiR05IT0RaaFNGWnVXakpzZFZveVdtaFpNbFYyWVRKV2VXSnRWbk5qZVRGcUNtSXlNWFJrVnpWd1pFaHJObU50Vm0xUGJrcHNXbTVOZG1GSFZtaGFTRTEyWWxkR2NHSnFRMEpwZDFsTFMzZFpRa0pCU0ZkbFVVbEZRV2RTT1VKSWMwRUtaVkZDTTBGT01EbE5SM0pIZUhoRmVWbDRhMlZJU214dVRuZExhVk5zTmpRemFubDBMelJsUzJOdlFYWkxaVFpQUVVGQlFtNXlZMlYwTTJOQlFVRlJSQXBCUldkM1VtZEphRUZLY0ZKR2VXcGpPSGx1TURRMFVsWkNSUzltUWpCNWQxa3JZWFF3YjJ3d2IxVm9kVEpLUTBSNE9WbzJRV2xGUVdkR1owd3ZRVWN3Q210RVMwTTJUMjgyTTFCbVVHNWpiblZrUkc5NFJXMVlaMGxpWkVsMk5qbElMMDVCZDBObldVbExiMXBKZW1vd1JVRjNUVVJhZDBGM1drRkpkMWw2TW5NS1p5dDBURWhtZFUxS1EzZExlbEZrVHpoNU1HYzRWVnA2TldWMGRWQk1SMDFGVTNSV2RubHZka2hvS3pCMFVqaHNlVzFUVDFCeVFtVkxla1YzUVdwQ1VBb3dRMmxCYzJadlRFbEdWRTVxYVVRMU5GcHJSRzFEWkRJdmNHWkdkMHgxT0hOak0zQlVUWEJFVFhSQlRHNHZTVU5uVmtZNVFUTnRhWFlyUjBOWFNtczlDaTB0TFMwdFJVNUVJRU5GVWxSSlJrbERRVlJGTFMwdExTMEsifX19fQ=="}],"timestampVerificationData":{"rfc3161Timestamps":[{"signedTimestamp":"MIICyjADAgEAMIICwQYJKoZIhvcNAQcCoIICsjCCAq4CAQMxDTALBglghkgBZQMEAgEwgbcGCyqGSIb3DQEJEAEEoIGnBIGkMIGhAgEBBgkrBgEEAYO/MAIwMTANBglghkgBZQMEAgEFAAQgCDrRhAEmcVU+94+5ngllWnBmq9eqYsVen6+OnIKXmSECFGV53ZQXPYSl/KB+mGfOTor0iXo/GA8yMDI2MDYxMTE0MzgyNFowAwIBAaAypDAwLjEVMBMGA1UEChMMc2lnc3RvcmUuZGV2MRUwEwYDVQQDEwxzaWdzdG9yZS10c2GgADGCAdwwggHYAgEBMFEwOTEVMBMGA1UEChMMc2lnc3RvcmUuZGV2MSAwHgYDVQQDExdzaWdzdG9yZS10c2Etc2VsZnNpZ25lZAIUOhNULwyQYe68wUMvy4qOiyojiwwwCwYJYIZIAWUDBAIBoIH8MBoGCSqGSIb3DQEJAzENBgsqhkiG9w0BCRABBDAcBgkqhkiG9w0BCQUxDxcNMjYwNjExMTQzODI0WjAvBgkqhkiG9w0BCQQxIgQgjUsyhBNSOVWci7ibkGTuUfT6KwCxhmX5bSymoUIVzXMwgY4GCyqGSIb3DQEJEAIvMX8wfTB7MHkEIIX5J7wHq2LKw7RDVsEO/IGyxog/2nq55thw2dE6zQW3MFUwPaQ7MDkxFTATBgNVBAoTDHNpZ3N0b3JlLmRldjEgMB4GA1UEAxMXc2lnc3RvcmUtdHNhLXNlbGZzaWduZWQCFDoTVC8MkGHuvMFDL8uKjosqI4sMMAoGCCqGSM49BAMCBGgwZgIxAN1BMkA520R8uHQaaLYn+1BYCVAHmu73aPBbN6JoiwZPJwPEkEya8UId7QXPabjRHwIxAILS9jIIcsksJ9GIR1UIf8kXlY2+0HXvRRn8+ivA2NW7C9gPArtMdKFtm/2kpecJJw=="}]}},"messageSignature":{"messageDigest":{"algorithm":"SHA2_256","digest":"CWHyzHj/H0sRhvFuXl9oZwTl4zj0eX1wNaSObV6JxI4="},"signature":"MEUCIADbe5En4SxNkU8Y2OSZiXQsxsXrUXj/G9q2viaFePLIAiEA1G/IIITEVYNJJR4vEYY/58HxLES9oMbKxY4hJgwlOHY="}} |