This project uses the MediaPipe Hands solution for adding hand tracking to the browser. The detected hand poses are used for rendering 3d hand models in a three.js scene.
When running in a WebXR enabled browser, the hand tracking solution of the device itself will be used.
In both cases, WebXR or non-WebXR, the same scene is displayed.
This is a quick introduction/demo for hand tracking in the browser.
npm install
npm start
This will start the demo in a new browser page. Wait for a few seconds for the video stream to start. In the control panel, you can pause the video stream to get a higher FPS in the three.js scene rendering.
Below are a few useful links for WebXR development