Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pin torch nightly - Oct 1 #1008

Merged
merged 1 commit into from
Oct 4, 2024
Merged

Pin torch nightly - Oct 1 #1008

merged 1 commit into from
Oct 4, 2024

Conversation

jainapurva
Copy link
Contributor

Due to memory leak and other additional compile issues with latest torch-nightly, pinning it to last stable version torch==2.6.0.dev20241001+cu121

Copy link

pytorch-bot bot commented Oct 3, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/1008

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 4565a88 with merge base 9ce7ebb (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@jainapurva jainapurva requested a review from msaroufim October 3, 2024 23:22
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 3, 2024
@jainapurva jainapurva requested a review from jerryzh168 October 3, 2024 23:22
Copy link
Contributor

@jerryzh168 jerryzh168 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can land after CI is green

@jainapurva jainapurva marked this pull request as ready for review October 3, 2024 23:26
@jainapurva jainapurva force-pushed the version_fix_torch_nightly branch from 84a6753 to 4565a88 Compare October 4, 2024 01:42
@@ -188,6 +188,7 @@ def snr(ref, actual):
assert snr(inputs_ref.grad, inputs_int8mp.grad) > 20
assert snr(linear.weight.grad, linear_int8mp.weight.grad) > 20

@pytest.mark.skip('Flaky on CI')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should only skip if the version of pytorch is at least 2.6, the other tests seemed green

@msaroufim msaroufim self-requested a review October 4, 2024 02:41
Copy link
Member

@msaroufim msaroufim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jainapurva gonna merge this for now to unblock others from merging code but could you please open 2 separate issues

  1. Assign to @gau-nernst the bitnet training skip
  2. Another issue on the IMA error we're seeing

@msaroufim msaroufim merged commit 0ffbf85 into main Oct 4, 2024
17 checks passed
@msaroufim msaroufim deleted the version_fix_torch_nightly branch October 4, 2024 02:42
melvinebenezer pushed a commit to melvinebenezer/ao that referenced this pull request Oct 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants