You can measure the power at the wall and that will be a bit more than the PSU is providing to the system, but I never push too near PSU limits due to long term component degradation. However I am running two Proxmox hosts with various VMs including VMs for BI and Docker containers for CPAI on each host. Both hosts have 3060 12GB GPUs and the power draw for each host is averaging around 75W and that's doing AI for 14 cameras. This means the GPUs are using a fraction of their 170W TDP. The GPU fans never kick even when its raining and the AI is doing a lot of work and just checking over the last 18 days I've averaged one AI analysis a second on one host.
If you're close to PSU limit you could also use nvidia-smi command line utility to power limit the GPU to avoid any high load spikes.