Jetson Orin Super Nano

I recently got one of these Jetson Super Nanos and I got Ubuntu running on it.

I got codeproject to work in a container, but I think there is an issue with the ARM and CUDA incompatibilities. Wonder if anyone else has manage to get it working.

So just an update....

I have been playing with this NVIDIA board once again, and I manage to get the CUDA working for the YoloV5 6.2 models. I added the delivery and package models.

I tested this photo on a truck in my driveway. The first picture is the Jetson Super Nano. Detects the "bus" and that is it. 93ms round trip. Inference 52 ms.

Same photo: older Xeon E3 but with a 3090. Windows on Proxmox. 140ms with 97 ms inference. It also sees a person in the window.

The Orin was $250 while the GPU was $300. I bought a $50 NVME drive for it.

The ALPR works but is doing CPU only. Working on that next. I have this running on Docker so it should just be a pull.

Seems like it is pretty good value for this application.

Forgot to mention; just 15 watts.

Ok, so I don't think anyone else is using this-- and probably doesn't care.. but I had the original 3.3.4 ALPR running with the CPU. I took Mike's Yolo11 ONNX file and with the help of my friend Claude, I managed to get the ALPR working with CUDA acceleration. Seems to be beating my 3090 and appears to be more consistent on Speed.

Ok, so just adding one more thing here. The board comes in 15W mode when shipped. I just learned you can put it in "SUPER" mode which increases the speed and the wattage to 25 Watts.

I am now running TWICE the speed of the 3090 at 25 watts Max. My ALPR reads are 67 ms round trip 33 ms processing, inference 31 ms.