Drift robust non-rigid optical flow enhancement for long sequences

Wenbin Li, Darren Cosker, Matthew Brown

OAI: oai:purehost.bath.ac.uk:publications/08ef047e-35a8-494f-b4fc-9397cd2e49e2 • DOI: https://doi.org/10.3233/JIFS-169099

It is hard to densely track a nonrigid object in long term, which is a fundamental research issue in the computer vision community. This task often relies on estimating pairwise correspondences between images over time where the error is accumulated and leads to a drift. In this paper, we introduce a novel optimisation framework with an Anchor Patch constraint. It is supposed to significantly reduce overall errors given long sequences containing nonrigidly deformable objects. Our framework can be applied to any dense tracking algorithm, e.g. optical flow. We demonstrate the success of our approach by showing significant error reduction on 6 popular optical flow algorithms applied to a range of realworld nonrigid benchmarks. We also provide quantitative analysis of our approach given synthetic occlusions and image noise.