Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: triton generate support #675

Draft
wants to merge 19 commits into
base: main
Choose a base branch
from
Draft

feature: triton generate support #675

wants to merge 19 commits into from

Commits on Jun 5, 2024

  1. Revert "Changes to support Ensemble Top Level Response Caching (#560) (… 

    …#642)"

This reverts commit cc6a3b2.
    @ganeshku1 @nnshah1
    ganeshku1 authored and nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    c822917 View commit details
    Browse the repository at this point in the history

  2. Changes to support Ensemble Top Level Response Caching (#560)

    @lkomali @nnshah1
    lkomali authored and nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    fddba6d View commit details
    Browse the repository at this point in the history

  3. initial generate support

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    61ae566 View commit details
    Browse the repository at this point in the history

  4. removing service type - infer from endpoint type

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f1b4646 View commit details
    Browse the repository at this point in the history

  5. updated to remove unused variables

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    56e662c View commit details
    Browse the repository at this point in the history

  6. update with precommit run

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    5503c85 View commit details
    Browse the repository at this point in the history

  7. updating tests

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    bfc1c7a View commit details
    Browse the repository at this point in the history

  8. updating tests

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    d576d25 View commit details
    Browse the repository at this point in the history

  9. updated test to mark as potential failure

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    1f50b6e View commit details
    Browse the repository at this point in the history

  10. removing

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    8dcc53d View commit details
    Browse the repository at this point in the history

  11. updating comment

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    7f740a9 View commit details
    Browse the repository at this point in the history

  12. undo changes

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    73ffa08 View commit details
    Browse the repository at this point in the history

  13. removing unneeded change

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    056c099 View commit details
    Browse the repository at this point in the history

  14. updates for new model selection

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    e7b3e53 View commit details
    Browse the repository at this point in the history

  15. updating expected values

    @nnshah1
    nnshah1 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    0c7f5a1 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. Changes to indicate final response on DONE or http request completion

    @nnshah1
    nnshah1 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    1026361 View commit details
    Browse the repository at this point in the history

  2. updated comment to clarify behavior

    @nnshah1
    nnshah1 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    20a3c07 View commit details
    Browse the repository at this point in the history

  3. changing to be more explicit

    @nnshah1
    nnshah1 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    69480bd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'nnshah1-openai-finish-on-close' into nnshah1-triton-gen… 

    …erate
    @nnshah1
    nnshah1 committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    9f153f8 View commit details
    Browse the repository at this point in the history