Skip to Main content Skip to Navigation
Journal articles

Generative Model for Skeletal Human Movements Based on Conditional DC-GAN Applied to Pseudo-Images

Abstract : Generative models for images, audio, text, and other low-dimension data have achieved great success in recent years. Generating artificial human movements can also be useful for many applications, including improvement of data augmentation methods for human gesture recognition. The objective of this research is to develop a generative model for skeletal human movement, allowing to control the action type of generated motion while keeping the authenticity of the result and the natural style variability of gesture execution. We propose to use a conditional Deep Convolutional Generative Adversarial Network (DC-GAN) applied to pseudo-images representing skeletal pose sequences using tree structure skeleton image format. We evaluate our approach on the 3D skeletal data provided in the large NTU_RGB+D public dataset. Our generative model can output qualitatively correct skeletal human movements for any of the 60 action classes. We also quantitatively evaluate the performance of our model by computing Fréchet inception distances, which shows strong correlation to human judgement. To the best of our knowledge, our work is the first successful class-conditioned generative model for human skeletal motions based on pseudo-image representation of skeletal pose sequences.
Complete list of metadata

https://hal-mines-paristech.archives-ouvertes.fr/hal-03039879
Contributor : Fabien Moutarde Connect in order to contact the contributor
Submitted on : Friday, December 4, 2020 - 9:43:10 AM
Last modification on : Friday, December 11, 2020 - 3:14:19 AM
Long-term archiving on: : Friday, March 5, 2021 - 6:22:44 PM

File

algorithms-13-00319.pdf
Publisher files allowed on an open archive

Identifiers

`

Citation

Wang Xi, Guillaume Devineau, Fabien Moutarde, Jie Yang. Generative Model for Skeletal Human Movements Based on Conditional DC-GAN Applied to Pseudo-Images. Algorithms, MDPI, 2020, 13 (12), pp.319. ⟨10.3390/a13120319⟩. ⟨hal-03039879⟩

Share

Metrics

Record views

96

Files downloads

168