Saw tooth BI CPU usage - Coral TPU/A310 GPU & AMD EYPC

[dastrix]

Hi Guys

Seeing this in my CPU usage. I've had a fair shot using AI to try and work out why but I cant beat it.

Cameras are 15FPS with 15FPS substreams and 2MP cameras - 7 of them with 3 using 4MP, Intel Beta hardware decoding on the Intel ARC 310 GPU with Deepstack AI using a Coral Google TPU. I've passed through 8 x AMD Eypc 7452 cores and 32GB ram without ballooning from Proxmox to this SSD with the OS running on NVME SSD and 4TB WD Red Pro spinning disk for everything but clips/alerts/db.

Detection speed looks OK to me.

21:45:24:Response rec'd from Object Detection (Coral) command 'detect' (...11d244) [''] took 15ms
21:45:24:Response rec'd from Object Detection (Coral) command 'detect' (...4d70fc) [''] took 12ms
21:45:24:Response rec'd from Object Detection (Coral) command 'detect' (...983e7d) [''] took 16ms
21:45:24:Response rec'd from Object Detection (Coral) command 'detect' (...65e6db) ['Found person, person'] took 51ms
21:51:29:Response rec'd from Object Detection (Coral) command 'detect' (...ab1adb) [''] took 14ms
21:51:29:Response rec'd from Object Detection (Coral) command 'detect' (...776cd3) ['Found tv'] took 50ms
21:51:30:Response rec'd from Object Detection (Coral) command 'detect' (...4826c6) ['Found person, tv'] took 50ms
21:51:31:Response rec'd from Object Detection (Coral) command 'detect' (...9c5e92) [''] took 16ms
21:51:31:Response rec'd from Object Detection (Coral) command 'detect' (...bfd488) [''] took 16ms
21:51:31:Response rec'd from Object Detection (Coral) command 'detect' (...e20900) [''] took 15ms
21:51:31:Response rec'd from Object Detection (Coral) command 'detect' (...57b05c) [''] took 14ms
21:51:31:Response rec'd from Object Detection (Coral) command 'detect' (...8b5eca) ['Found person'] took 52ms
21:54:39:Response rec'd from Object Detection (Coral) command 'detect' (...d7dd45) [''] took 15ms
21:54:39:Response rec'd from Object Detection (Coral) command 'detect' (...2abc41) [''] took 15ms
21:54:39:Response rec'd from Object Detection (Coral) command 'detect' (...904c73) [''] took 23ms

Be keen on hearing any thoughts as to why the general high CPU , thanks guys!

Disk and CPU correlated

 

[The Automation Guy]

Does the system use both the Corel TPU and the graphics card at the same time? I haven't really dove into the whole world of AI in BI, but I think you have to choose one or the other. I would try the GPU instead of the Corel and see if things get better or worse.

On a related note, the Corel's seem to be a dead product now. Obviously you can keep using any that you might have, but it seems they are unobtainium now. Perhaps it's because they seem to have a pretty short life expectancy (based on the reviews I've seen). Most people seem to be lucky to get 24 months out of them before they stop working. This is another reason why you might want to try the GPU instead. I think it's not if your Corel is going to die, but WHEN.....