You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this work, we address the problem of predicting human motion based on observed past movements, known as Human Motion Prediction (HMP). Specifically, from a temporal sequence of human joint positions, we aim to forecast their evolution in subsequent frames.
We present SkeletonDiffusion, a latent diffusion model encoding this bias explicitly on both architecture and training.
79
+
First, we consider the skeleton structure and joint categories throughout the entire network, and build our architecture end-to-end on top of Graph Convolutional Networks
80
+
(GCNs). In contrast, existing SHMP approaches either ignore the skeleton’s graph structure or only
81
+
leverage it at intermediate stage.
82
+
<imgsrc="assets/nonisodiff.png">
83
+
84
+
<br>
85
+
Second, we replace the conventional isotropic
86
+
Gaussian diffusion training with a novel nonisotropicformulation that accounts for joint relations directly in the
87
+
generation process: the HMP problem is defined by the skeleton kinematic graph, and we exploit this knowledge to define a fixed non-diagonal noise covariance for the diffusion process
0 commit comments