Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

More FSDP optimizations #10

Merged
merged 9 commits into from
Apr 17, 2024
Merged

More FSDP optimizations #10

merged 9 commits into from
Apr 17, 2024

Commits on Apr 17, 2024

  1. profile training loop

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    40a91bd View commit details
    Browse the repository at this point in the history

  2. add --trace-output arg

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    42e5b10 View commit details
    Browse the repository at this point in the history

  3. skip norm for empty grads

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    8a434cb View commit details
    Browse the repository at this point in the history

  4. expand user

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    a033301 View commit details
    Browse the repository at this point in the history

  5. debug logging

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    8d916d3 View commit details
    Browse the repository at this point in the history

  6. post-backward final hook

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    6c451b0 View commit details
    Browse the repository at this point in the history

  7. better logging

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    51705b3 View commit details
    Browse the repository at this point in the history

  8. mark backward exec order finalized for children

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    9a4f473 View commit details
    Browse the repository at this point in the history

  9. fix lint

    @epwalsh
    epwalsh committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    56b1c27 View commit details
    Browse the repository at this point in the history