code2-20240402-pose.mp4

In this session we cover:

• Review on how to examine variables in the console
• Discussion on Pose Detection and AI trained body tracking
• Javascript Callback Functions
• Capturing Video
• Using Pose Detection and ml5 to identify body parts and the 2 ways data is returned:
  • Key Points
  • Body part properties
• Creating the basics of a game that is controlled with your nose

Note: In prior semesters, we used a body tracking module called PoseNet which is described in the Module examples. In this week’s module, I made an effort to use a beta version body tracking module called BlazePose. In my video, I interchangeably use the words PoseNet and BlazePose.

It is recommended to use the following to make use of the newest features of BlazePose:

bodypose = ml5.bodypose("BlazePose");

Examining Variables and Objects in the Console

The BlazePose module returns data that is a little more complicated than what we have been used to in the past. As a review, you should play with data and see what it looks like when we log it to the Debug console in the P5 Editor

An example of creating a simple sketch that has a variety of different data types:

https://editor.p5js.org/des8963/sketches/ovDxklBgR