[PDF][PDF] Good vibrations: A modal analysis approach for sequential non-rigid structure from motion

A Agudo, L Agapito, B Calvo… - Proceedings of the IEEE …, 2014 - cv-foundation.org
Proceedings of the IEEE Conference on computer vision and pattern …, 2014cv-foundation.org
We propose an online solution to non-rigid structure from motion that performs camera pose
and 3D shape estimation of highly deformable surfaces on a frame-by-frame basis. Our
method models non-rigid deformations as a linear combination of some mode shapes
obtained using modal analysis from continuum mechanics. The shape is first discretized into
linear elastic triangles, modelled by means of finite elements, which are used to pose the
force balance equations for an undamped free vibrations model. The shape basis …
Abstract
We propose an online solution to non-rigid structure from motion that performs camera pose and 3D shape estimation of highly deformable surfaces on a frame-by-frame basis. Our method models non-rigid deformations as a linear combination of some mode shapes obtained using modal analysis from continuum mechanics. The shape is first discretized into linear elastic triangles, modelled by means of finite elements, which are used to pose the force balance equations for an undamped free vibrations model. The shape basis computation comes down to solving an eigenvalue problem, without the requirement of a learning step. The camera pose and time varying weights that define the shape at each frame are then estimated on the fly, in an online fashion, using bundle adjustment over a sliding window of image frames. The result is a low computational cost method that can run sequentially in real-time. We show experimental results on synthetic sequences with ground truth 3D data and real videos for different scenarios ranging from sparse to dense scenes. Our system exhibits a good trade-off between accuracy and computational budget, it can handle missing data and performs favourably compared to competing methods.
cv-foundation.org
Showing the best result for this search. See all results