Enhance Logging Infrastructure with Structured Logging and Correlation IDs

[monilpat]

Is your feature request related to a problem? Please describe.

Debugging and monitoring production issues is challenging due to inconsistent log formats and missing contextual information.

Describe the solution you'd like

Implement a structured logging framework that:

• Utilizes JSON format for all logs
• Includes standard fields such as timestamp, severity, correlation ID, and request context
• Supports context injection for additional metadata
• Offers different log levels (DEBUG, INFO, WARN, ERROR, FATAL)
• Allows for adding custom fields as needed
• Provides utilities for performance logging and distributed tracing

Describe alternatives you've considered

• Continuing to use plain text logs with manual parsing
• Implementing custom log formatting without a standardized approach
• Relying solely on Application Performance Monitoring (APM) tools

Additional context

The current logging setup lacks the necessary structure and context to effectively trace user actions and debug issues across distributed systems. By enhancing the logging infrastructure, we can improve observability, reduce mean time to resolution (MTTR) for incidents, and gain deeper insights into system behavior.