title: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)`
body: <p>I got the following error when I ran my pytorch deep learning model in colab</p>
  
  <pre><code>/usr/local/lib/python3.6/dist-packages/torch/nn/functional.py in linear(input, weight, bias)
     1370         ret = torch.addmm(bias, input, weight.t())
     1371     else:
  -&gt; 1372         output = input.matmul(weight.t())
     1373         if bias is not None:
     1374             output += bias
  
  RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)`
  </code></pre>
  
  <p>I even reduced batch size from 128 to 64 i.e., reduced to half,  but still, I got this error. Earlier, I ran the same code with a batch size of 128 but didn't get any error like this.</p>