Implement Structured Logging with Correlation IDs

[monilpat]

Is your feature request related to a problem? Please describe.

The current logging setup lacks structured logging and correlation IDs, making it difficult to trace and debug issues across distributed systems effectively.

Describe the solution you'd like

Implement a structured logging framework that:

• Uses JSON format for all logs
• Includes standard fields such as timestamp, severity, and correlation ID
• Supports context injection for better traceability
• Provides different log levels (DEBUG, INFO, WARN, ERROR)
• Allows for custom fields to be added as needed

Additionally, integrate correlation IDs to track requests across different services, enhancing the observability and troubleshooting capabilities.

Describe alternatives you've considered

• Continuing with plain text logs and manual correlation
• Using external APM tools for distributed tracing

Additional context

This implementation will greatly improve the ability to diagnose and resolve issues quickly, especially in complex, multi-service environments. It aligns with modern logging best practices, ensuring logs are both informative and actionable.