How to choice CNN architecture for stitching images


I decided to start learning neural networks by creating a bot for the game. One of the intermediate steps is to create a global map from a series of inaccurate overlapping sub-maps. This task can be solved using OpenCV, but this solution will be too limited and sensitive (in the future I intend to complicate the task and work directly with the map image, instead of binary masks).

I've tried the following options:

  • predict the position of a new map area within the global map. (as a probability distribution)

  • predict the new state of the global map from the old and new minimap.

I've tried a lot of options formulation of the problem of network architecture, including the idea of conjoined networks, but nothing gave any relevant results.

Some articles about solving similar problems:

Here is an example of one of the options statement of the problem:

enter image description here


Posted 2020-07-31T15:34:48.043

Reputation: 101

Can you please put your main question in the title? – nbro – 2020-08-02T20:46:26.070

@nbro, thank you for your feedback! Is it better now? – Green_Wizard – 2020-08-02T22:07:31.263

No answers