使用网格进行图像变形

Question

I would like to warp one fisheye image: Left:

Into this target image:

The target image is actually a part of the synthetic panorama:

I know a method called mesh warping, like:

But how am I able to find or define a irregular mesh like this? Very grateful if someone can give me some suggestions. I would like to have this mesh, so that I can use this mesh for every frame of a video and warp every frame into this target image.

Answer 1

Is this a one-off project, or are you trying to write an automatic procedure?

If the former, you can just hand-tag corresponding points in the two images till you have enough coverage, particularly in the more "curvy" areas, then warp using (for example) a thin-plate spline defined by the point correspondences. This works iteratively: match some points, warp, figure out where the error is largest, add more point matches there. Doing all this in, say, Matlab or Python+OpenCv is quite easy.

You can then try to automate it using feature extraction and matching. The trouble is you'll need to use both point and line correspondences...