Break Dance 3D Pose Estimation and Action Classification

VIT Pose and Motion Bert based 3D Pose Estimator for break dance national project in Korea.

Project information

  • Category: Computer Vision
  • Type: National Institute Project
  • Desciption: This is a project of estimating 3D keypoint of dancer and classifying dance motion using motion BERT (top-rock, footwork, powermove, and freeze)
  • Assignment:
    • Utilizing YOLOv8 for detecting the human and use MIAP dataset to finetune it.
    • Finetuning the motion BERT and VIT Pose data using synthetic human from Omniverse and Character Creator.
    • Creating a data of dance classification using Youtube video and fine tune Motion Bert classificcation head.
    • Adding interpolation and optimization using TensorRT to meet the speed requirement
    • Achieve near 100% accuracy in closed environment test set
  • Presentation file: Click Here
  • Video: Click Here