Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Any tips to get higher performance with splats? #358

Open
Patrick-van-Halm-360Fabriek opened this issue Oct 31, 2024 · 7 comments
Open

Any tips to get higher performance with splats? #358

Patrick-van-Halm-360Fabriek opened this issue Oct 31, 2024 · 7 comments

Comments

@Patrick-van-Halm-360Fabriek

Hey all,

We currently have a few splats but we seem to lose a lot of performance on mobile devices. When on PC's the issue also occurs when zooming in close to the objects. When at a distance we see a very much increase of FPS within THREE.

The splat in question has 1376673 splats. Its very dense and I am assuming the splat sorting algorithm might be the bottleneck.
image

Is there currently a way to get higher performance? Or is there a way to make the splat less dense whilst keeping the visual fidelity (this is very important to us).

We have trained this using Postshot + Reality Capture's dense pointcloud

@seppestaes
Copy link

Is that a splat (the shoe)? I see polygons, not a single outlier?

@Patrick-van-Halm-360Fabriek
Copy link
Author

It is a Splat yes, very high fidelity

@seppestaes
Copy link

Could you share the .splat? 1.3M doesn't seem like an overkill, as @mkkellogg mentions SHD optimizations up to 16M. Most of my scenes are about 1M i.e. 3Mb (.ksplat) runs very smoothly on mobile.

@Patrick-van-Halm-360Fabriek
Copy link
Author

I am making use of (.splat) which is 44Mb in size Splat file (Available 30 days)

@Patrick-van-Halm-360Fabriek
Copy link
Author

@seppestaes do you have any ideas?

@seppestaes
Copy link

Hi @Patrick-van-Halm-360Fabriek, i haven't used PostShot/Reality Capture yet. Converted it locally to .ksplat (@mkkellogg) which does seem to increase performance. Although counterintuitive, I'd try with a less dense pointcloud. On a different note, i'm pretty amazed with the details on the shoe (text etc.). Could you share your input images/video? I'll run it through my pipeline.

@notthesame23
Copy link

Could you share the .splat? 1.3M doesn't seem like an overkill, as @mkkellogg mentions SHD optimizations up to 16M. Most of my scenes are about 1M i.e. 3Mb (.ksplat) runs very smoothly on mobile.

Hello @seppestaes,
Is this a typo, or how do you achieve to compress 1 Million splats down to 3MB? I've tried to compressing down a ply file to ksplat with only around 1.6Million Splats and I'm still at 39 (!)Megabytes, even larger than the original playcanvas ply file. Of course also performace is realy subpar on older mobiles (iPhoneX) and it just crashes on an iPhone 6.
I'm thankfull for any tipps you might have that would help with performance and file size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants