Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Hao pp #15

Draft
wants to merge 28 commits into
base: pp-staging
Choose a base branch
from
Draft

Hao pp #15

wants to merge 28 commits into from

Commits on Apr 27, 2024

  1. Pipeline Parallel 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    06609d9 View commit details
    Browse the repository at this point in the history

  2. Formatting 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed Apr 27, 2024
    Configuration menu
    Copy the full SHA
    fbb2b2e View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. Fixed testing errors 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    bd12e70 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. PyNCCL changes 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 1, 2024
    Configuration menu
    Copy the full SHA
    99bb187 View commit details
    Browse the repository at this point in the history

  2. Revert "PyNCCL changes" 

    This reverts commit 99bb187.
    @andoorve
    andoorve committed May 1, 2024
    Configuration menu
    Copy the full SHA
    1be32c8 View commit details
    Browse the repository at this point in the history

  3. Formatting 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 1, 2024
    Configuration menu
    Copy the full SHA
    daddc19 View commit details
    Browse the repository at this point in the history

  4. Simplify weight loading logic 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 1, 2024
    Configuration menu
    Copy the full SHA
    65a5300 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Format and test changes 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 2, 2024
    Configuration menu
    Copy the full SHA
    16a5aac View commit details
    Browse the repository at this point in the history

  2. Format and test changes 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 2, 2024
    Configuration menu
    Copy the full SHA
    9d698fa View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. Fixed bug with TP + PP execution 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 5, 2024
    Configuration menu
    Copy the full SHA
    526bade View commit details
    Browse the repository at this point in the history

  2. Change condition for prepare_input_tensors to broadcast 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 5, 2024
    Configuration menu
    Copy the full SHA
    04b5fe9 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. More test fixes 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    f784fda View commit details
    Browse the repository at this point in the history

  2. Assert out model architectures that are unsupported 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    a17fcfe View commit details
    Browse the repository at this point in the history

  3. Fix typo 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    2180531 View commit details
    Browse the repository at this point in the history

  4. Fix hangs 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    df9b0c4 View commit details
    Browse the repository at this point in the history

  5. Fix condition for PP support 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    ee86cd2 View commit details
    Browse the repository at this point in the history

  6. Formatting 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    016e256 View commit details
    Browse the repository at this point in the history

  7. Basic PP tests 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 7, 2024
    Configuration menu
    Copy the full SHA
    2091dd9 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Formatting 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 8, 2024
    Configuration menu
    Copy the full SHA
    7e99360 View commit details
    Browse the repository at this point in the history

  2. Refactoring and test fixes 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 8, 2024
    Configuration menu
    Copy the full SHA
    b60f7ea View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Test fix 

    Signed-off-by: Muralidhar Andoorveedu <[email protected]>
    @andoorve
    andoorve committed May 9, 2024
    Configuration menu
    Copy the full SHA
    39c6019 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2024

  1. [Model] Snowflake arctic model implementation (#4652) 

    Co-authored-by: Dash Desai <[email protected]>
Co-authored-by: Aurick Qiao <[email protected]>
Co-authored-by: Aurick Qiao <[email protected]>
Co-authored-by: Aurick Qiao <[email protected]>
Co-authored-by: Cody Yu <[email protected]>
    @sfc-gh-hazhang @iamontheinet
    @aurickq @sfc-gh-aqiao @comaniac
    6 people committed May 12, 2024
    Configuration menu
    Copy the full SHA
    a5fb6b5 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. support arctic

    @sfc-gh-hazhang
    sfc-gh-hazhang committed May 16, 2024
    Configuration menu
    Copy the full SHA
    aad6f9c View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. fix placement

    @sfc-gh-hazhang
    sfc-gh-hazhang committed May 21, 2024
    Configuration menu
    Copy the full SHA
    711bab1 View commit details
    Browse the repository at this point in the history

  2. add an online inference example script

    @sfc-gh-hazhang
    sfc-gh-hazhang committed May 21, 2024
    Configuration menu
    Copy the full SHA
    b6a72e9 View commit details
    Browse the repository at this point in the history

  3. add new benchmarking scripts

    @sfc-gh-hazhang
    sfc-gh-hazhang committed May 21, 2024
    Configuration menu
    Copy the full SHA
    0394498 View commit details
    Browse the repository at this point in the history

  4. adjust a bit

    @sfc-gh-hazhang
    sfc-gh-hazhang committed May 21, 2024
    Configuration menu
    Copy the full SHA
    adf24bf View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. add allgather pp communication

    @sfc-gh-yzhuang
    sfc-gh-yzhuang committed May 22, 2024
    Configuration menu
    Copy the full SHA
    173b752 View commit details
    Browse the repository at this point in the history