Reduce number of cores
Hello,when I fine-tune my BERT model on our company’s server I nearly take on all our capacity. Is there any way to reduce the number of used cores?
2021-08-25T02:14:46Z
what doesthe number of used coresmean?whatdllibrary you use? pytorch or tensorflowi assume you fine-tune with pytorch, and thecoresmeans gpu device.generally, there are two ways to limit the gpu usage:setvisible deviceenvironment  variable# n means your gpu device id
export CUDA_VISIBLE_DEVICES=0,1,2,..n``directly set gpu device  with pytorch libraryimport torch
torch.cuda.set_device(1)tensorflow provide similar configure options, you can look the official document for reference