Issue: Logging dashboard

[Lekhanrao]

Ticket Contents

To build a dashboard that shows every process of the request lifecycle with corresponding timestamps and usage of models with metrics.

Goals

Create a dashboard (Grafana/any custom simple react UI) which shows the whole lifecycle of a request coming into the system with metrics such as number of requests, latency, types of models at each service layer with appropriate timestamps.

Expected Outcome

The dashboard should be able to show different kinds of metrics at each service layer (api, channel, language, flow, retriever) for a given request.

Acceptance Criteria

1. The dashboard should be running as a separate service (like the other services in docker-compose.yaml)
2. The dashboard should be able to collect and show the data from each individual service.
3. The dashboard should have appropriate charts for data visualization of the requests coming into the system.

Implementation Details

Create a frontend UI dashboard and backend data storage service and map them to show the metrics in user/request level.

Mockups/Wireframes

Use R2R dashboard for reference implementation (https://github.com/SciPhi-AI/R2R-Application)

Product Name

Jugalbandi

Organisation Name

OpenNyAI

Domain

Legal

Tech Skills Needed

Python, React, SQL, Other

Mentor(s)

@Lekhanrao , @KaranrajM

Complexity

Medium

Category

Backend, Frontend

[Blacksujit]

@Lekhanrao assigne this to me i can try this

[Lekhanrao]

@Blacksujit, Have assigned this ticket to you.

[Amrit02102004]

@Blacksujit Are you still working on this ? I would like to know if I can work on it

[Blacksujit]

@Amrit02102004

Sorry i was busy in some other things please take it you can work on this

[Amrit02102004]

Ok I will be working on it

[Lekhanrao]

@Amrit02102004 , assigned ticket to you.

[Lekhanrao]

Assigned ticket to @ananyaagrawal23 and @Sunandhita

[MythicalMAxX]

Hey! Can I please get a chance?

[Lekhanrao]

@MythicalMAxX , Hi Vinamra, Thankyou for offering to work on this issue, but this ticket is already being worked by the team. So will request you to pick up something else that is open.

[Sunandhita]

The Logger service implementation in the backend is done . API service data is getting logged in the database successfully. Currently working on implementation for logging the Channel service data

[ananyaagrawal23]

Completed the implementation for the logging of channel service. Channel service data is getting logged in the database successfully. Currently working on implementation for logging the Language service.

[Sunandhita]

Completed the implementation for logging language and flow service. Currently working on implementation for logging the retriever service (last service to be logged).

[Sunandhita]

Completed the entire backend for logging dashboard

[Lekhanrao]

@Sunandhita, what are the next steps here? And when can we complete this ticket entirely?

[Sunandhita]

This is done from our end @Lekhanrao , it is under review by Arun and Karan .....yet to be approved