Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: enable polyglot otel config #287

Conversation

hmuthusamy
Copy link
Contributor

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted. Consult the CONTRIBUTING guide for submitting pull-requests.
Fix for nginx and java monitoring dashboards on EKS failing because of race condition deploying dashboards first before flux is deployed.
Also added polyglot monitoring for Rust,.Net monitoring using OTEL.

Motivation

More

  • [ Yes] Yes, I have tested the PR using my local account setup (Provide any test evidence report under Additional Notes)
  • [Yes ] Yes, I ran pre-commit run -a with this PR
  • [ Yes] Yes, I have added a new example under examples to support my PR (when applicable)
  • [ Yes] Yes, I have updated the Pages for this feature

Note: Not all the PRs required examples and docs.

For Moderators

  • E2E Test successfully complete before merge?

Additional Notes

elamaran11
elamaran11 previously approved these changes Oct 25, 2024
Copy link
Contributor

@elamaran11 elamaran11 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. This works great and tested. @bonclay7 Can you review and merge it. Need for RI Setup.

@bonclay7 bonclay7 self-requested a review October 28, 2024 10:59
Copy link
Member

@bonclay7 bonclay7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hmuthusamy
Copy link
Contributor Author

Looks good but tests are failing. Can you run pre-commit and commit changes @hmuthusamy https://github.com/aws-observability/terraform-aws-observability-accelerator/actions/runs/11522847911/job/32088304356?pr=287

@bonclay7 Ran the pre-commit and submitted for review. Please review and merge. Thanks

@hmuthusamy hmuthusamy requested a review from bonclay7 October 28, 2024 14:07
@elamaran11
Copy link
Contributor

@hmuthusamy Precommit is failing still. Lets fix it.

@hmuthusamy
Copy link
Contributor Author

Getting the below error on pr-commit. It runs fine when i ran the same PR locally.

Terraform docs...........................................................Failed

  • hook id: terraform_docs
  • files were modified by this hook

There are some problems with the CLI configuration:

│ Error: The specified plugin cache dir /home/runner/work/terraform-aws-observability-accelerator/terraform-aws-observability-accelerator/.terraform.d/plugin-cache cannot be opened: stat /home/runner/work/terraform-aws-observability-accelerator/terraform-aws-observability-accelerator/.terraform.d/plugin-cache: no such file or directory

As a result of the above problems, Terraform may not behave as intended.

@bonclay7 bonclay7 changed the title Feature/enable polyglot otel config feat: enable polyglot otel config Oct 28, 2024
Comment on lines +1391 to +1392
kubernetes_sd_configs:
- role: pod
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems a bit wide, as without any relabel config or port capture, it would capture any exposed metrics at the pod level unless i'm missing something. Can you make it more specific to what you are collecting?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bonclay7 Happy to discuss this on a call. We are going to setup .net, Rust,Go and other dashboards as part of the RI workshop. We opened up all the pods (defaulted to false and only explicitly set to true) for the usecase. Once we finalize all the metrics for all these languages/apps and understand what filters we need to apply we will apply them along with corresponding dashboards similar to how its implemented for Java.

@bonclay7
Copy link
Member

Fixed the tests, but I have one concern @hmuthusamy
FYI - @lewinkedrs

@elamaran11
Copy link
Contributor

@bonclay7 Pls merge this or let us know if you have questions. This is blocker for RI. We are having enable for polyglot flag so pod level metrics isnt going to be a problem. This flag willbe disabled by default

@hmuthusamy hmuthusamy closed this Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants