Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move get_improvement_over_baseline to the BestPointMixin #3156

Closed
wants to merge 1 commit into from

Conversation

paschai
Copy link
Contributor

@paschai paschai commented Dec 9, 2024

Differential Revision: D66472613

@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Dec 9, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

@codecov-commenter
Copy link

codecov-commenter commented Dec 9, 2024

Codecov Report

Attention: Patch coverage is 98.78049% with 1 line in your changes missing coverage. Please review.

Project coverage is 95.82%. Comparing base (38f9741) to head (666df78).

Files with missing lines Patch % Lines
ax/service/utils/best_point_mixin.py 96.42% 1 Missing ⚠️
Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3156   +/-   ##
=======================================
  Coverage   95.82%   95.82%           
=======================================
  Files         502      503    +1     
  Lines       50811    50824   +13     
=======================================
+ Hits        48690    48703   +13     
  Misses       2121     2121           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

paschai added a commit to paschai/Ax that referenced this pull request Dec 9, 2024
Summary: Pull Request resolved: facebook#3156

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 9, 2024
Summary: Pull Request resolved: facebook#3156

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 10, 2024
Summary: Pull Request resolved: facebook#3156

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 10, 2024
Summary: Pull Request resolved: facebook#3156

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 11, 2024
Summary:

As titled - in this change we:

1. Move get_improvement_over_baseline to the BestPointMixin, and required an experiment and generation strategy
1. remove the required parameter of `baseline_arm_name` and utilize `select_baseline_arm()` if not provided
2. Introduce `best_point_utils.py` file to store `select_baseline_arm()`
3. Modified `select_baseline_arm()` to take in a dictionary of arm_names to Arms instead of a experiment df

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 12, 2024
Summary:

As titled - in this change we:

1. Move get_improvement_over_baseline to the BestPointMixin, and required an experiment and generation strategy
1. remove the required parameter of `baseline_arm_name` and utilize `select_baseline_arm()` if not provided
2. Introduce `best_point_utils.py` file to store `select_baseline_arm()`
3. Modified `select_baseline_arm()` to take in a dictionary of arm_names to Arms instead of a experiment df

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

paschai added a commit to paschai/Ax that referenced this pull request Dec 12, 2024
Summary:

As titled - in this change we:

1. Move get_improvement_over_baseline to the BestPointMixin, and required an experiment and generation strategy
1. remove the required parameter of `baseline_arm_name` and utilize `select_baseline_arm()` if not provided
2. Introduce `best_point_utils.py` file to store `select_baseline_arm()`
3. Modified `select_baseline_arm()` to take in a dictionary of arm_names to Arms instead of a experiment df

Differential Revision: D66472613
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

Summary:

As titled - in this change we:

1. Move get_improvement_over_baseline to the BestPointMixin, and required an experiment and generation strategy
1. remove the required parameter of `baseline_arm_name` and utilize `select_baseline_arm()` if not provided
2. Introduce `best_point_utils.py` file to store `select_baseline_arm()`
3. Modified `select_baseline_arm()` to take in a dictionary of arm_names to Arms instead of a experiment df

Reviewed By: lena-kashtelyan

Differential Revision: D66472613
Copy link

vercel bot commented Dec 13, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
ax-archive ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 13, 2024 1:25am

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66472613

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 7ea8402.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed Do not delete this pull request or issue due to inactivity. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants