Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question about the first pose #131

Open
mah-asd opened this issue Sep 9, 2024 · 6 comments
Open

question about the first pose #131

mah-asd opened this issue Sep 9, 2024 · 6 comments
Labels
question Further information is requested

Comments

@mah-asd
Copy link

mah-asd commented Sep 9, 2024

Hi, thank you for the great work.

I have a question about the first pose which should be identity, if I transform the first pose in dataset, then the splatam uses that first frame pose to do tracking for the rest of frame relative to that. But by changing the first frame to a non identity matrix, the result is very bad. I think I'm missing something here.

@Nik-V9
Copy link
Contributor

Nik-V9 commented Sep 13, 2024

Hi, Thanks for your interest in our work! Can you elaborate further?

I think this behavior might have to do with the stability of optimization world frame poses as opposed to relative poses.

@Nik-V9 Nik-V9 added the question Further information is requested label Sep 13, 2024
@mah-asd
Copy link
Author

mah-asd commented Sep 13, 2024

It seems like even if the relative_pose in dataset is set to False, the initialization for camera poses in params and also the gaussians translations and rotations are defined to have the first pose as identity. I manually changed them according to gt_pose for first frame, but I think some where in eval function also needs some adjustment.

@mah-asd
Copy link
Author

mah-asd commented Sep 30, 2024

0019

This is the result when I only change relative_pose variable in loading dataset to False

@Nik-V9
Copy link
Contributor

Nik-V9 commented Sep 30, 2024

Hi, I don't quite follow. This frame looks correct to me. Are you indicating that new gaussian aren't being added?

@mah-asd
Copy link
Author

mah-asd commented Sep 30, 2024

Thanks for your reply, how do you interpret the PSNR 16.22?

@mah-asd
Copy link
Author

mah-asd commented Oct 1, 2024

I mean how do I fix the poses for eval part? it seems like there is a transformation mismatch.
Am I missing any step to get a rendered image without that black frame?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants