[IT-3975] Deploy opentelemetry collector

[BryanFauble]

Tasks before marking PR ready:

• Destroy CDK stacks for dev-sandbox
• Revert code for dev-sandbox

Problem:

1. An Opentelemetry collector needs to be deployed to ECS to support forwarding telemetry data for long-term storage and analysis.
2. A configuration file for the collector needs to be sourced from AWS secrets manager and injected into the Otel collector to configure the service.
3. Environment variables need to be updated in the schematic container to support configuring it to send telemetry data to the Otel collector.

Solution:

1. Deploying the otel collector contributor container to ECS. I had attempted to use the AWS otel collector, however, they do not support the Oauth2 extension that we will use to attached an Auth header on out-going requests: Add oauth2clientauthextension  aws-observability/aws-otel-collector#1492
2. Storing the otel config file in AWS Secret manager and injecting it into the Otel collector by overriding the docker CMD command on the container.
3. Setting environment variables on the schematic container to configure it sending telemetry data to the otel collector.

Testing:

1. TODO/IN-PROGRESS

Additional notes:

1. I had tried to get this extension on the collector working: https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/healthcheckextension - To configure container health checks, however, I couldn't get it working as every requests to the configured port/endpoint returned nothing. Because of this health checked I had configured were failing and killing the container. https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/healthcheckv2extension is a replacement extension, however, it's not included in the built images yet - Once available I'd like to use this extension.

[BryanFauble]

Moving to point at the base repo