Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

XR (AR) working with iOS and "Variant Launch" , no splat rendering with Android "DropInViewer" WebXR #376

Open
dindan23 opened this issue Nov 25, 2024 · 1 comment

Comments

@dindan23
Copy link

I'm currently implementing many features of GaussianSplats3D in my app meetwheels.
(DropInViewer, kSplat usage, WebXR Mode)

I managed to make the splats working on iOS with Variant Launch (https://launch.variant3d.com)
I'ts an app clips feature for iOS with threejs support.

It work's like out of the box with the DropInViewer.
Sample: https://cars.meet-wheels.com/?cpID=scan_1722236704203777_20706ae734e148ba95fc.cp&ar=true
(View in AR on top left)

Currently I can't manage to make the splat render with webxr on android and the DropInViewer.
The method with your GaussianSplats3D.Viewer and 'webXRMode': GaussianSplats3D.WebXRMode.AR is working.

May somehow it is possible to use DropInViewer in future with webxr or a sample where DropInViewer ist working in webxr.
It somehow works with this Variant Launcher out of the box but I don't know what they are doing to make this work.

Keep on mkkellogg!
You're doing a great job with this project.

@newguy123-creator
Copy link

How many splats in this file?
Also, what Android are you using to view?
Ignore the the AR part for now and see if the splat load and show on Android in the 1st place.
Unless you have only a handful of splats in the file, ie less than about 300K splats, you may be running into resource/performance issues. Splats are not ready for prime time on mobile in general, unless as I say, you have only a small amount of them in the scene.

If you confirm the splat loads and display on Android as is, then carry on with the AR part. You should not need to touch GaussianSplats3D.WebXRMode.AR, as I believe that is if you natively use the viewer as the xr provider.

Varient3D doesnt do anything special to the scene to make it work, its as you say just an app clip to enable XR on iOS as natively safari on mobile doesnt support it, unless you use their "Quick Look" functionality which loads a USDZ ( https://developer.apple.com/augmented-reality/quick-look/ ). Unlikely Quick Look will currently work for gaussian, as I dont know of a way to get it into a USDZ.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants