New CodeProject.AI Object Detection (YOLO11 .NET) Module

Try installing Cuda 12.4.0_551.61?
As i understand it, cuda is backwards compatible, so using the latest version of cuda (13 in my case) should work with any previous version of cuda.
But, because I'm running CPAI in docker, I think CUDA is handled by the container and not what's running on the host.
The issue with CPAI in docker is that pytorch isnt compiled or built for rtx 5000 series GPUs yet.
 
As i understand it, cuda is backwards compatible, so using the latest version of cuda (13 in my case) should work with any previous version of cuda.
But, because I'm running CPAI in docker, I think CUDA is handled by the container and not what's running on the host.
The issue with CPAI in docker is that pytorch isnt compiled or built for rtx 5000 series GPUs yet.
I am working on building a Docker container that should work with RTX 5000 series GPUs. I will try to get the container released this weekend
 
  • Like
Reactions: nullex
I am working on building a Docker container that should work with RTX 5000 series GPUs. I will try to get the container released this weekend
That would be awesome and greatly appreciated. I've been messing around exec'd in to the running container trying to replace python 3.8 venv with 3.10 for yolov8 module to run newer versions of pytorch that support 5000 series but have not been having much luck.
 
That would be awesome and greatly appreciated. I've been messing around exec'd in to the running container trying to replace python 3.8 venv with 3.10 for yolov8 module to run newer versions of pytorch that support 5000 series but have not been having much luck.
I just pushed mikelud/ai-server:cuda12_8, try and see if this works for you using the Object Detection (YOLOv5 .NET) 1.14.0 module, it should be using GPU (CUDA). I have the container running and my RTX 5090 works. The Object Detection (YOLOv5 6.2) 1.10.0 module still does not work, I need to still work on this. I just need to know if I am going in the right path.


1762016088718.png

1762016144594.png

1762016242745.png
 
  • Like
Reactions: nullex
I just pushed mikelud/ai-server:cuda12_8, try and see if this works for you using the Object Detection (YOLOv5 .NET) 1.14.0 module, it should be using GPU (CUDA). I have the container running and my RTX 5090 works. The Object Detection (YOLOv5 6.2) 1.10.0 module still does not work, I need to still work on this. I just need to know if I am going in the right path.

You rock!! YOLOv5 .NET is working great with GPU now!!

Thank you, this is great!!! Definitely feel free to let me know if I can help more in any way, I'd be happy to!


1762016948809.png1762016937775.png
 
  • Like
Reactions: MikeLud1
I have been running an older CPAI version and feel it is time to make the jump to the latest and use these new modules.

I was going to delete my current one and install a fresh copy.

Do we have a cheat sheet on how/where to go about downloading the latest version and getting it running - is it Github now?
 
  • Like
Reactions: tinker3433
I have been running an older CPAI version and feel it is time to make the jump to the latest and use these new modules.

I was going to delete my current one and install a fresh copy.

Do we have a cheat sheet on how/where to go about downloading the latest version and getting it running - is it Github now?
I'm still hanging out here in the back row watching things unfold. Had no time anyway last few weeks to change anything, but I have time off coming up and I'm close to moving forward.

I would till need the delivery model to work with this new setup before I proceed. Is that coming soon?