In:
Journal of WSCG, University of West Bohemia, Vol. 31, No. 1-2 ( 2023-07), p. 80-90
Abstract:
This paper presents a framework and mobile video editing app for interactive artistic augmentation of human motion in videos. While creating motion effects with industry-standard software is time-intensive and requires expertise, and popular video effect apps have limited customization options, our approach enables a multitude of art-directable, highly customizable motion effects. We propose a graph-based video processing framework that uses mobile-optimized machine learning models for human segmentation and pose estimation to augment RGB video data, enabling the rendering and animation of content-adaptive graphical elements that highlight and emphasize motion. Our modular framework architecture enables effect designers to create diverse motion effects that include body pose-based effects such as glow stick or light trail effects, silhouette-based effects such as halos and outlines, and layer-based effects that provide depth perception and enable interaction with virtual objects.
Type of Medium:
Online Resource
ISSN:
1213-6972
,
1213-6964
DOI:
10.24132/JWSCG.2023.9
Language:
Unknown
Publisher:
University of West Bohemia
Publication Date:
2023
detail.hit.zdb_id:
2666173-1
Permalink