This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Refactor Prometheus and Add Request Level Metrics (#2316)#31

Closed

horheynm wants to merge 3 commits intomainfrom monitoring

+1,286-104

Commits on Feb 20, 2024

Refactor Prometheus and Add Request Level Metrics (vllm-project#2316 )

robertgshaw2-neuralmagic
authored and
horheynm
committed

Commits on Feb 22, 2024

add vllm:inference_request_success, vllm:inference_request_aborted
horheynm
committed

Commits on Mar 4, 2024

draft
horheynm
committed