Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

watch_torch_model: only first training instance visible #3

Open
stocyr opened this issue Apr 22, 2020 · 1 comment
Open

watch_torch_model: only first training instance visible #3

stocyr opened this issue Apr 22, 2020 · 1 comment

Comments

@stocyr
Copy link

stocyr commented Apr 22, 2020

watch_torch_model() does not work entirely. For all images, I somehow only see the very first training instance the model encountered, though the distributions and also some stuff in the weights still seem to get updated.

Setup:

  • Windows 10
  • Deepkit Release 2020.1.5
  • Deepkit SDK 1.0.1
  • Running experiment on anything, from local script run, to local UI start to deployed docker run, eg. on pytorch/pytorch:1.4-cuda10.1-cudnn7-runtime
@marcj
Copy link
Member

marcj commented May 15, 2020

Yes, this is on purpose. It detects the very first input used and uses this for further debug layer extraction. It wouldn't make much sense to use for every debug extraction a different input as you could not easily compare with previous debug state. However, you can change the input easily, see the documentation. https://deepkit.ai/documentation/python-sdk/model-debugger see "Custom input to visualize"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants