GPUUtill

• like nvidia-smi : shows the current state of GPU

!pip install GPUill
import GPUtill
GPUtill.showUtilization()

torch.cuda.empty_cache()

• empty unused GPU cache
• not the same as del
• good substitute for reset function

Use del

• delete Variables that are not used

torch.no_grad()