Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Augment hyperposterior sampling by also sampling observed values #103

Open
kiudee opened this issue Oct 12, 2021 · 0 comments
Open

Augment hyperposterior sampling by also sampling observed values #103

kiudee opened this issue Oct 12, 2021 · 0 comments
Labels
enhancement New feature or request Priority: Medium

Comments

@kiudee
Copy link
Owner

kiudee commented Oct 12, 2021

In the current implementation, we sample the hyperparameters of the Gaussian process and average across those samples. The training data is fixed. In BoTorch, the hyperparameters are fixed and the observations y of the data points are sampled, and the acquisition function is averaged over those.

I think both ideas can be combined, allowing the user to request:

  • Holding both hyperparameters and observations fixed: This will yield the classical acquisition functions for the noiseless case.
  • Sampling only the observations y. This will yield the noisy acquisition function versions, assuming that the hyperparameters are accurate.
  • Sampling only the hyperparameters. This will yield the current behavior, where we are robust to model misspecification.
  • Sampling both the hyperparameters and the observations. Combining the strengths of both approaches.

The steps required are:

  • Implement a fast method for cloning the GP model using the same, or different hyperparameters.
  • Add the different methods for averaging to
    def evaluate_acquisitions(
@kiudee kiudee added enhancement New feature or request Priority: Medium labels Oct 12, 2021
@kiudee kiudee changed the title Augment hyperposterior sampling by also resampling observed values Augment hyperposterior sampling by also sampling observed values Oct 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Priority: Medium
Projects
None yet
Development

No branches or pull requests

1 participant