Poor AI Detection Speed

[adventuredphoto]

I found some of the new drivers did not work well, that might be your issue, I am using the below driver

GeForce Driver Results | NVIDIA

Download the <dd~LanguageName> <dd~Name> for <dd~OSName> systems. Released <dd~ReleaseDateTime>

www.nvidia.com

Tried that version too. I don’t get why BI has two GPUs to select in the Ui.

I’m currently using BI for 2 cameras. When I select one gpu the one camera is significantly low on ms speeds BUT the other one is now slow.

When I go to select the other GPU it goes in reverse. Now the other camera is fast in detection speed but the first one is now slow.

 

[bethzur]

As noted, I also see two GPUs listed, but I only have one. Both are slow. The CPU is even slower, but it's older.

I finally reconfigured everything and I'm now using sub-streams where possible. Still getting 450 ms for detections.

I'm using CUDA 11.7. It works, so I'm not sure anything newer will help? Seems like it should work or not.

 

[wpiman]

I am in this exact same boat... Doesn't even seem to touch the NVIDIA card during AI.

What is strange is when I replace a video and turn the AI debug on, I do see the GPU usage go up. But during actual running it seems to stay unused.


C:\Users\wpima>nvidia-smi
Sat Mar 21 20:09:21 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 591.44 Driver Version: 591.44 CUDA Version: 13.1 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 3060 WDDM | 00000000:01:00.0 Off | N/A |
| 0% 33C P8 13W / 170W | 4596MiB / 12288MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 7272 C+G ...t\Edge\Application\msedge.exe N/A |
| 0 N/A N/A 7504 C+G ...h_cw5n1h2txyewy\SearchApp.exe N/A |
| 0 N/A N/A 7912 C+G C:\Windows\explorer.exe N/A |
| 0 N/A N/A 8608 C+G ...5n1h2txyewy\TextInputHost.exe N/A |
| 0 N/A N/A 8780 C+G ...y\StartMenuExperienceHost.exe N/A |
| 0 N/A N/A 10820 C+G ...crosoft\OneDrive\OneDrive.exe N/A |
| 0 N/A N/A 12432 C+G ...xyewy\ShellExperienceHost.exe N/A |
| 0 N/A N/A 14892 C+G ....0.3856.72\msedgewebview2.exe N/A |
| 0 N/A N/A 16448 C+G ...8wekyb3d8bbwe\M365Copilot.exe N/A |
| 0 N/A N/A 18216 C+G ....0.3856.72\msedgewebview2.exe N/A |
| 0 N/A N/A 18644 C+G ...h_cw5n1h2txyewy\SearchApp.exe N/A |
+-----------------------------------------------------------------------------------------+

C:\Users\wpima>

 

[bethzur]

The logs for me do say:

"executionProvider":"ONNXRunTime: 1 (NVIDIA GeForce RTX 3050)",