Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finger/Hand tracking input for OSC #148

Open
InsaneGrox opened this issue Nov 21, 2022 · 1 comment
Open

Finger/Hand tracking input for OSC #148

InsaneGrox opened this issue Nov 21, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@InsaneGrox
Copy link

InsaneGrox commented Nov 21, 2022

What's the idea?
Allow OSC to control hand positions and finger rotations, partially to give PC players a way of utilizing hand tracking if they have the hardware IE: Ultraleap/Leapmotion/Pimax hand trackers, Varjo Built-In handtracking, Quest hand tracking on PC through custom ALVR/ALXR builds, Proper skeletal input, Non-index finger tracking controllers such as etee, VR gloves that support splay, ect.

Is there another way?
Native Ultraleap SDK implementation, though this would limit hand tracking to only be usable for trackers from that vendor, which isn't remotely hardware agnostic, Same goes for proper skeletal input, the only hardware agnostic method aside from OSC I can think of is OpenXR's hand tracking, though that would require a switch to OpenXR, and would leave out desktop users who have hand tracking sensors.

Additional context
There's already hand-tracking on quest, and there's plans to add body tracking to quest via OSC, it doesn't seem like it'd be particularly difficult to add hand tracking to PC via OSC too.

For those who don't know what ultraleap/leapmotion is, https://youtu.be/Llvh4GBpnVA

@InsaneGrox InsaneGrox added the enhancement New feature or request label Nov 21, 2022
@InsaneGrox InsaneGrox changed the title Finger/Hand tracking endpoint for OSC Finger/Hand tracking input for OSC Nov 21, 2022
@ShayBox
Copy link

ShayBox commented Jun 9, 2023

This would be great, additionally adding virtual head/hmd tracking (by setting the head tracker position/rotation) would allow hmd-less (SteamVR w/o an HMD or Desktop/upcoming Mobile mode) FBT

I want this to create a mobile app/desktop program that virtualizes the HMD, hands, and trackers via OSC, creating universal locomotion for all avatars, even on desktop.

EDIT: One could also use this to make VRChat work like a VTuber program (VSeeFace) with the camera and optionally the green screen mask, but with multi-player in-world people, which sounds like a cool idea.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants