VRM Avatar — Point-to-Walk Companion Demo

[Peter-Pater]

VRM Avatar — Point-to-Walk Companion Demo

Adds a working VRM avatar demo to demos/vrm-avatar/ using @pixiv/three-vrm. Click or pinch a floor location and the avatar walks there, then returns to idle.

What's included:

• VRM loading via GLTFLoader + VRMLoaderPlugin (direct, not xb.ModelViewer — see below)
• Mixamo FBX animation retargeting onto the VRM humanoid skeleton with full MIXAMO_VRM_RIG_MAP
• Idle/walk crossfade via AnimationMixer
• Procedural eye blink via VRM expression manager
• Point-to-walk: raycasts against xb.core.depth.depthMesh on device, falls back to y=0 ground plane in simulator
• Spring bone physics active via vrm.update(delta)
• Works in the XRBlocks desktop simulator and WebXR

Why not xb.ModelViewer?
VRMLoaderPlugin must be registered on the GLTFLoader instance before the load call. xb.ModelViewer has no loader injection point, so direct loading is the only viable approach.

Assets:

• VRM model loaded from jsDelivr CDN (three-vrm sample model, no local file)
• animations/Idle.fbx and animations/Walking.fbx — free Mixamo downloads, included in repo

[dli7319]

Very neat! It's quite laggy on my device, but we can improve it later.

Dancing.fbx seems unused?

Do you know the license for the other two FBX files?
Would it be okay if I move them to another repo (proprietary-assets) to keep this repo lean?

[dli7319]

The reticle also isn't showing on the depth mesh in this demo which is odd.

[Peter-Pater]

Dancing.fbx is not used. The animations are from Mixamo, which allow for even commercial use, but I am not entirely familiar with the details.

[Peter-Pater]

Okay, I looked more into the Maximo terms, and looks like they are against redistributing the raw files, and having them in public repos probably counts. So I can remove the files and add a note in the readme about how to download them?

[dli7319]

Having some instructions isn't ideal but we can go with that for now if it's the only option.

Have you looked into how https://pixiv.github.io/three-vrm/packages/three-vrm/examples/humanoidAnimation/index.html works?

Do they have it hosted on a CDN somewhere?

[Peter-Pater]

I think this three-vrm example lets the user drop in a fdx animation file they download themselves instead of hosting in on a CDN. Maybe we can go with letting users download their own animation for now. I can find sometime to create animations myself (e.g., with mesh2motion) and update this demo in another iteration?

[dli7319]

Sgtm. Let me know when you want to merge the code.