MediaPipe Handpose + Blender Physics

Probhakar
Dec 17, 2021

Manipulating Blender objects with the 3D co-ordinates obtained from MediaPipe API

Create 2 square objects and name them “4” and “8”. These are the tips of the thumb and index finger obtained from MediaPipe hand pose API. Add rigid body constraint, make it passive and check the animated property. Add any object you want to play with and set it as an active rigid body.

The hand pose side code. It can be found here

Blender side code —

Redis is used for interprocess communication.

--

--