A top-like utility for monitoring CUDA activity on a GPU
Solution 1:
To get real-time insight on used resources, do:
nvidia-smi -l 1
This will loop and call the view at every second.
If you do not want to keep past traces of the looped call in the console history, you can also do:
watch -n0.1 nvidia-smi
Where 0.1 is the time interval, in seconds.
Solution 2:
I find gpustat very useful. In can be installed with pip install gpustat, and prints breakdown of usage by processes or users.
