Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Useful code for chairs #9

Open
ldlasso2 opened this issue Dec 16, 2020 · 3 comments
Open

Useful code for chairs #9

ldlasso2 opened this issue Dec 16, 2020 · 3 comments

Comments

@ldlasso2
Copy link

ldlasso2 commented Dec 16, 2020

Hello Cristopher, your code is amazing! I had a question and it is if it is possible to do 3D recreation with chairs or with cats, since in your examples there are only celebrities and cars. Do you have to make adjustments?

@christopher-beckham
Copy link
Owner

Hi,

Thank you! Yes it should be possible, assuming your datasets have a decent amount variation in both camera pose and object identity so that it can leverage the inductive bias of the model architecture (since you want to try and disentangle those two things). Of course, hyperparameter tuning will always need to be done on a case-by-case basis for each dataset.

With regard to hyperparameters, this may also be useful to you: #8

Thanks.

@juanescendales
Copy link

Hi Cristopher, I'm trying to replicate the results of the paper with chairs too with your nice code with this configuration:

--lamb=25.0 --angles="[0,0,-90,90,0,0]" --beta1=0.5 --beta2=0.999 --update_g_every=1 --ngf=512 --ndf=64

This configuration is the same that you had in the example of the cars so I take this one as my starting point, after training 200 epochs this was the result:

out.mp4

As you can tell, instead of the expected "yaw rotation", that was not achieved, I had that strange result. My data set had many .png 64x64 images of several different kinds of chairs in 8 poses among the horizontal axis, my question is if you consider that I need to have more poses of those chairs or there is something wrong in the configuration.

Thank you very much.

PD:
3
4
5
6
7
8
1
2

*This is an example of the poses of one chair, I also have these same poses with other 7000 chairs approx. :)

@christopher-beckham
Copy link
Owner

Hi,

Thanks for sharing! I am actually sort of seeing some rotation in the video, though it appears to be very piecewise. I think based on what you've said about the dataset, you probably do need more variability in the poses, yes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants