TY - JOUR
T1 - Graph-based registration and blending for undersea image stitching
AU - Yang, Xu
AU - Liu, Zhi Yong
AU - Qiao, Hong
AU - Su, Jian Hua
AU - Ji, Da Xiong
AU - Zang, Ai Yun
AU - Huang, Hai
N1 - Publisher Copyright:
© Cambridge University Press 2019.
PY - 2020/3/1
Y1 - 2020/3/1
N2 - Image stitching is important for the perception and manipulation of undersea robots. In spite of a well-developed technique, it is still challenging for undersea images because of their inevitable appearance ambiguity caused by the limited light in the undersea environment, and local disturbance caused by moving objects, ocean current, etc. To get a clean and stable background panorama in the undersea environment, this paper proposes an undersea image-stitching method by introducing graph-based registration and blending procedures. Specifically, in the registration procedure, matching the features in each undersea image pair is formulated and solved by graph matching, to incorporate the structural information between features. In the blending procedure, an energy function on the indirect graph Markov random field is proposed, which takes both image consistency and neighboring consistency into consideration. Coincidentally, both graph matching and energy minimization can be mathematically formulated by integer quadratic programming problems with different constraints; the recently proposed graduated nonconvexity and concavity procedure is used to optimize both problems. Experiments on both synthetic images and real-world undersea images witness the effectiveness of the proposed method.
AB - Image stitching is important for the perception and manipulation of undersea robots. In spite of a well-developed technique, it is still challenging for undersea images because of their inevitable appearance ambiguity caused by the limited light in the undersea environment, and local disturbance caused by moving objects, ocean current, etc. To get a clean and stable background panorama in the undersea environment, this paper proposes an undersea image-stitching method by introducing graph-based registration and blending procedures. Specifically, in the registration procedure, matching the features in each undersea image pair is formulated and solved by graph matching, to incorporate the structural information between features. In the blending procedure, an energy function on the indirect graph Markov random field is proposed, which takes both image consistency and neighboring consistency into consideration. Coincidentally, both graph matching and energy minimization can be mathematically formulated by integer quadratic programming problems with different constraints; the recently proposed graduated nonconvexity and concavity procedure is used to optimize both problems. Experiments on both synthetic images and real-world undersea images witness the effectiveness of the proposed method.
KW - Energy minimization
KW - Feature correspondence
KW - Graph matching
KW - Nonsubmodular function
KW - Undersea image stitching
UR - https://www.scopus.com/pages/publications/85066737738
U2 - 10.1017/S0263574719000699
DO - 10.1017/S0263574719000699
M3 - 文章
AN - SCOPUS:85066737738
SN - 0263-5747
VL - 38
SP - 396
EP - 409
JO - Robotica
JF - Robotica
IS - 3
ER -