output20231108.mp4

In this session we cover:

• Review on how to examine variables in the console
• Discussion on Pose Detection and AI trained body tracking
• Javascript Callback Functions
• Capturing Video
• Using Pose Detection and ml5 to identify body parts and the 2 ways data is returned:
  • Key Points
  • Body part properties
• Creating the basics of a game that is controlled with your nose

Note: In prior semesters, we used a body tracking module called PoseNet. In this week’s module, I made an effort to use a beta version body tracking module called BlazePose. In my video, I interchangeably use the words PoseNet and BlazePose. Also in my video, I used the following bodypose = ml5.bodypose() instead of ml5.bodypose(”BlazePose”), which forced the bodypose to use the PoseNet module instead of BlazePose.

It is recommended to use the following to make use of the newest features of BlazePose:

bodypose = ml5.bodypose("BlazePose");

Examining Variables and Objects in the Console

The BlazePose module returns data that is a little more complicated than what we have been used to in the past. As a review, you should play with data and see what it looks like when we log it to the Debug console in the P5 Editor

An example of creating a simple sketch that has a variety of different data types: