[Release] OpenVINO for BI

What is the recommended method to handle a system restart. I'd like this server to start without requiring a login.
 
My stats so far on i5-8500 with GPU enabled:
API Requests: 1248 total requests
Average Response Time ():97.7milliseconds
Last Response Time: 76.9 milliseconds
Frames Per Second (FPS): 10.2
 
Last edited:
  • Love
Reactions: jrbeddow
I5 6500t igpu with a medium yolov11 model is average 270ms.
The times are on par with a gtx1660 (AI server was hosted on another pc) running blue onyx with the largest ONNX model.
However I find the accuracy significantly better. No false positives in over 3 days of running (>10000 requests)

Gpu benchmark:
L: 170.52 ms (5.9 FPS)
T: 7.1 FPS (req 4)
 
Last edited:
  • Like
Reactions: jrbeddow
Also started working on openvino integration, but differently: based on openvino/model_server container images, using the latest models from ultralytics (26). It will allow spreading the load over multiple servers/devices (Jetson Nano should in theory work as well), and will allow deploying to the OS of your liking. Will update here if I get it working properly.
Preliminary results show that inference with yolo26n is about 20% faster than yolo11n (on CPU, without any GPU).
 
Last edited:
Hello again, had a question, with code project AI when using custom models, it was possible to enter objects:0 in custom models (AI options in each camera) and this would limit object detection to the desired object types in 'to confirm'. Is there a way to configure the openvino server this way ?.
I am still using the initial release and it hasn't missed a beat !. I'm just checking if there is a way to further optimise CPU/GPU utilisation.
 
I just upgraded to BI v6 to utilize the built AI and see if it utilizes QuickSync better only to have AI tell me that since I have an NPU I should be running OpenVINO instead. Well, that was the hardest thing I've ever installed. AI was useless and kept insisting I can download from links that don't work.

I think I've got it installed correctly, but now to configure?

Which of these do I want set to NPU, and which should be GPU? I want to utilize the Intel GPU instead of the Nvidia since they are more power efficient. Now to figure out LPR...

1777334880378.png
 
Just discovered the Hardware Matrix Benchmark which seems to have answered my prior question. NPU is crushing it for all models. Still trying to figure out the face recognition thing. I created a name for every regular person at the house and put some photos into those names, but not sure how it actually gets used, or what the utility of learning faces is.

Very impressed with the triggers and categorization in the alerts now. Seems to be picking up more alerts than before.

Next I want to start playing around with LPR.

Thanks to the OP for putting this together.

1777488829072.png
 
I didn't realize I had to leave the powershell window open for this to run... and now python start.py isn't executing anymore. Broke it already.
 
No it doesn't need a shell console. I have it running on system boot via task scheduler even without logging in. No open consoles and it's been running non-stop for months now.
 
redpoint5 said:
I just upgraded to BI v6 to utilize the built AI and see if it utilizes QuickSync better only to have AI tell me that since I have an NPU I should be running OpenVINO instead. Well, that was the hardest thing I've ever installed. AI was useless and kept insisting I can download from links that don't work.

I think I've got it installed correctly, but now to configure?

Which of these do I want set to NPU, and which should be GPU? I want to utilize the Intel GPU instead of the Nvidia since they are more power efficient. Now to figure out LPR...

View attachment 242638
Click to expand...


I have not been able to get the built in AI to work on my system. How did you get to this screen?
 
The thread title is literally OpenVINO for BI, and the entire discussion is about that.
 
You must log in or register to reply here.
Top Bottom