Mixed Reality Depth Contour Occlusion Using Binocular Similarity
  Matching and Three-dimensional Contour Optimisation
  Mixed reality applications often require virtual objects that are partly
occluded by real objects. However, previous research and commercial products
have limitations in terms of performance and efficiency. To address these
challenges, we propose a novel depth contour occlusion (DCO) algorithm. The
proposed method is based on the sensitivity of contour occlusion and a
binocular stereoscopic vision device. In this method, a depth contour map is
combined with a sparse depth map obtained from a two-stage adaptive filter area
stereo matching algorithm and the depth contour information of the objects
extracted by a digital image stabilisation optical flow method. We also propose
a quadratic optimisation model with three constraints to generate an accurate
dense map of the depth contour for high-quality real-virtual occlusion. The
whole process is accelerated by GPU. To evaluate the effectiveness of the
algorithm, we demonstrate a time con-sumption statistical analysis for each
stage of the DCO algorithm execution. To verify the relia-bility of the
real-virtual occlusion effect, we conduct an experimental analysis on
single-sided, enclosed, and complex occlusions; subsequently, we compare it
with the occlusion method without quadratic optimisation. With our GPU
implementation for real-time DCO, the evaluation indicates that applying the
presented DCO algorithm can enhance the real-time performance and the visual
quality of real-virtual occlusion.
