Exception has occurred: RuntimeError CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
#5
by bernlxrnd - opened
When I try running the model on with float 16 , I run into this error. Does it mean I run out of memory? Somebody else has this isse?
This error might be raised, if you are running out of memory and cublas fails to create the handle, so try to reduce the memory usage:
See: https://discuss.pytorch.org/t/cuda-error-cublas-status-not-initialized-when-calling-cublascreate-handle/125450/3
This was my solution:
https://huggingface.co/facebook/galactica-6.7b/discussions/7#6390f3fcde25f9eda5714014