MATLAB: Machine vision targeting shapes

Question

I want to have my webcam pointed at the screen and have it recognize shapes. Can you point me in the right direction

I dont have the software yet, I'm just asking questions about it.

I was challenged by a friend that I couldn't never become good enough to beat him in Battlefield4. Sadly this is true. But given my never give up personality, I decided if I could beat him with a crutch.

I want to have my webcam pointed at the screen and have it recognize shapes and have it move the cursor to that particular shape. After this is accomplished I want to customize a PS4 into a PC.

The PC will have a secondary more powerful and faster system so it can eavesdrop on the PS4 during FPS games like Battlefield 4

The PC will have a large SSD full of processed images from the game in a database. The enemy is easily identifiable by the red triangle about its head

With the correct type of machine learning and visual identifying processes the PC should be able to target the enemy by parsing the info on the screen. Allowing the me an auto aim feature (through CronusMAX)

With a CronusMAX and the correct python and machine learning programs it should be able to learn how to play the games on the PS4. I would never sell this machine It will be too costly to build and code. It would just be my personal crutch If i could make it happen.

Answer 1

The Computer Vision System Toolbox has lots of demos in it on tracking people and vehicles. You can try some of those. This will be a long and complex problem that may take you weeks or years to almost get right for the wide variety of things that will move in your scenes.