Motion Capture Assisted Animation: Texturing and Synthesis

1. Motion Capture Assisted Animation: Texturing and Synthesis SIGGRAPH ’02 Speaker: Alvin Date:23 August 2004

2. Outline • Introduction • Framework • Results • Conclusions and Future Work Motion Capture Assisted Animation: Texturing and Synthesis

3. Introduction • Create a method that allows an artist low-level control of the motion • Combine the strengths of keyframe animation with those of mocap Motion Capture Assisted Animation: Texturing and Synthesis

4. Introduction (cont.) • “Sketch” an animation by keyframing • Animate only a few degrees of freedom • Set few keyframes • “Enhance” the result with mocap data • Synthesize missing degrees of freedom • Texture keyframed degrees of freedom Motion Capture Assisted Animation: Texturing and Synthesis

5. Keyframing vs. Mocap Advantages Disadvantages • Control • Intuitive • Detail hard • Many DOF Keyframing • No control • Not intuitive • Detail easy • All DOF Mocap Motion Capture Assisted Animation: Texturing and Synthesis

6. Keyframe vs. MoCap Motion Capture Assisted Animation: Texturing and Synthesis

7. Correlation Motion Capture Assisted Animation: Texturing and Synthesis

8. Framework • Choosing Matching Angles • Frequency Analysis • Segmentation • Matching • Path Finding • Joining Motion Capture Assisted Animation: Texturing and Synthesis

9. Choosing Matching Angles Root x trans Root y trans Root z trans Root x rot Root y rot Root z rot Spine1 x Spine1 y Spine1 z Spine2 x Spine2 y Spine2 z Spine3 x Spine3 y Spine3 z Neck x Neck y Neck z Head x Head y Head z Head Aim x Head Aim y Head Aim z Left Clavicle x Left Clavicle y Left Clavicle z Left Shoulder x Left Shoulder y Left Shoulder z Left Elbow x Left Elbow y Left Elbow z Left Wrist x Left Wrist y Left Wrist z Right Clavicle x Right Clavicle y Right Clavicle z Right Shoulder x Right Shoulder y Right Shoulder z Right Elbow x Right Elbow y Right Elbow z Right Wrist x Right Wrist y Right Wrist z Left Hip x Left Hip y Left Hip z Left Knee x Left Knee y Left Knee z Left Ankle x Left Ankle y Left Ankle z Left Ball x Left Ball y Left Ball z Right Hip x Right Hip y Right Hip z Right Knee x Right Knee y Right Knee z Right Ankle x Right Ankle y Right Ankle z Right Ball x Right Ball y Right Ball z Time Time Time Motion Capture Assisted Animation: Texturing and Synthesis

10. Frequency Analysis Laplacian Pyramid Decomposition Motion Capture Assisted Animation: Texturing and Synthesis

11. Segmentation Motion Capture Assisted Animation: Texturing and Synthesis

12. Matching Motion Capture Data Keyframed Fragment Motion Capture Assisted Animation: Texturing and Synthesis

13. Matching (cont.) Motion Capture Assisted Animation: Texturing and Synthesis

14. Matching (cont.) Hip Angle (Matching Angle) Spine Angle (For Synthesis) Motion Capture Assisted Animation: Texturing and Synthesis

15. Matching and Synthesis Low frequency hip angle data (a matching angle) Spine angle data to be synthesized Motion Capture Assisted Animation: Texturing and Synthesis

16. Path Finding Angle in degrees Time Motion Capture Assisted Animation: Texturing and Synthesis

17. Joining Angle in degrees Time Motion Capture Assisted Animation: Texturing and Synthesis

18. Path Finding Motion Capture Assisted Animation: Texturing and Synthesis

19. Joining Motion Capture Assisted Animation: Texturing and Synthesis

20. Smoothing Motion Capture Assisted Animation: Texturing and Synthesis

21. Smoothing (cont.) • Blend Function • The data s after smoothing is Motion Capture Assisted Animation: Texturing and Synthesis

22. Result • Watch the demo movie file. Motion Capture Assisted Animation: Texturing and Synthesis

23. Summary of the Method Sketch + Mocap Frequency Analysis Matching Matching Angles Keyframed data Keyframed Data Mocap Data Mocap Data Possible Synthetic Data Path Finding Joining Enhanced Animation Motion Capture Assisted Animation: Texturing and Synthesis

24. Conclusions and Future Work • Combine the advantages of both methods • Allow the user control an initial rough animation with keyframes • Fill in missing DOFs and detail using the information in motion capture data • Direct incorporation of hard constraints • Fundamental units of motion Motion Capture Assisted Animation: Texturing and Synthesis

25. Evaluation Form • 論文簡報部份 • 完整性介紹(4) • 系統性介紹(4) • 表達能力(3) • 投影片製作(4) • 論文審閱部分 • 瞭解論文內容(4) • 結果正確性與完整性 (4) • 原創性與重要性(4) • 讀後啟發與應用： The method using the correlative relationship of the joints to synthesis the other DOFs can be used in my research. Motion Capture Assisted Animation: Texturing and Synthesis