LovCAPONE

The tool I'm coding right now focuses first on the hitboxes definitions. But would you give me permission to extend your framework to support light gun games? The way I see it is that first the user would load all the video frames. Then with my tool, place all the hitboxes for each frame. Using the Mask R-CNN technique a lot of this work would be done for the user by the CPU (or GPU). For the framework, instead of processing inputs for "moves", the framework extension would process inputs (position on screen) VS hitboxes. There would be a lot of modification to be done on the original code but if you give me permission I can do it. If not, then I can just focus on coding the hitbox tool and when you can, you'll extend your framework if you see a need for it.

It was said that GPU support would be implemented but I don't know when exactly. Maybe it's event avaible now, so that would be even more sweet.

Actually, with the OpenCV library, the input bitmap has to be of size 600x600 ideally but with scaling I can support any video resolution. For example if the original video frame resolution is 720x480, I will just resize the bitmap to 600x400. Because from what I saw, in the game Mad Dog McCree, hitboxes were defined in a different resolution than the actual video frame (I think the hitbox resolution was in 360x240 as you said). So with a bit of scaling it's not a problem. But when I originally had the idea to use object recognition for this problem, I was sure it wouldn't work. I talked about it with @mazinger4life a bit with no hope. But when I discovered the Mask R-CNN technique I was pretty excited with the possibilities. My last fear is the speed of the computation, that can be a major deal breaker since now it's done on the CPU and not the GPU. So I haven't tested when on the input bitmap there are a lot of object to detect. So I hope @Karis and @sduensin can give us their inputs on this also...

Hi @xxOToTOxx , so for the problem of defining hitboxes in light gun games, I think I found a solution. By using the OpenCV library and the Mask R-CNN technique, the definition of hitboxes can be computed automatically. In the picture, all the blue boxes were placed automatically. It's not perfect but imagine all the work that it saves! On a Intel Core i5 2.5 Ghz laptop, the computation takes about 3 seconds. So, the next thing to program is an algorithm to reduce the number of hitboxes (all boxes that are adjacent can be "merged" into bigger hitboxes). Then test this technique on actual frames of existing light gun games. So I think that with a decent tool that will allow the user to "adjust" the hitboxes in an intuitive way, this could be a decent solution. Tell me what you think.

@mazinger4life Great job on your latest game! Keep up the good work. Can't wait to see the bike level haha

Hi @xxOToTOxx , so the first thing I wanted to do was to analyze how the game "Maddog McCree HD" was handling its hitboxes. So I coded a quick test program that extracts a frame from the game's video file and "blits" hitboxes on the frame (just as a visual proof that my analysis was right). So here's a frame from the bank level. So for the next step I'll research existing tools for hitbox managam ent in game engines to see if I can use/extend an existing tool so that I don't reinvent the wheel.

Thanks for the reply @xxOToTOxx I already read the tutorial you linked me and it's only for FMV game à la Dragon's Lair. The tutorial @Karisrefered to seems to be a different one (or is it?). About the tool, actually what I wanted to do is first do an analysis of the actual problem (looking at existing gun games, etc.). Then code the tool that solves the problem and do a prototype game with @mazinger4life And as we go along we get feedback from you guys. When @mazinger4life told me about this I was immediatly interested. So @xxOToTOxx when I'm done with the analysis, before actually staring to code I'll share with you (and anyone interested) my solution.

Following discussions with @mazinger4life I'm interested to code a tool to help with the creation of hitboxes for key frames for light gun games. @Karis can I have the link to the tutorial you are refering to here please? Thanks in advance.