Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commit

Permalink
Force-disable upstream tracking (#321)
Browse files Browse the repository at this point in the history
This PR force-disables upstream tracking by forcing `VLLM_DO_NOT_TRACK`
and `VLLM_NO_USAGE_STATS` to be `True` (disable data collection) rather
than inspecting the environment variable.

An alternative approach could be to update the definition of
`is_usage_stats_enabled` (in
[`vllm/usage/usage_lib.py:29`](https://github.com/neuralmagic/nm-vllm/blob/main/vllm/usage/usage_lib.py#L29))
to always return `False` and set the `global _USAGE_STATS_ENABLED` to be
`False`.
  • Loading branch information
dbarbuzzi authored Jun 22, 2024
1 parent d7aa99e commit d14c46e
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions vllm/envs.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,8 +18,8 @@
S3_ENDPOINT_URL: Optional[str] = None
VLLM_CONFIG_ROOT: str = ""
VLLM_USAGE_STATS_SERVER: str = "https://stats.vllm.ai"
VLLM_NO_USAGE_STATS: bool = False
VLLM_DO_NOT_TRACK: bool = False
VLLM_NO_USAGE_STATS: bool = True
VLLM_DO_NOT_TRACK: bool = True
VLLM_USAGE_SOURCE: str = ""
VLLM_CONFIGURE_LOGGING: int = 1
VLLM_LOGGING_LEVEL: str = "INFO"
Expand Down Expand Up @@ -162,11 +162,11 @@
# Usage stats collection
"VLLM_USAGE_STATS_SERVER":
lambda: os.environ.get("VLLM_USAGE_STATS_SERVER", "https://stats.vllm.ai"),
# UPSTREAM SYNC: following changes force tracking to be disabled
"VLLM_NO_USAGE_STATS":
lambda: os.environ.get("VLLM_NO_USAGE_STATS", "0") == "1",
lambda: True,
"VLLM_DO_NOT_TRACK":
lambda: (os.environ.get("VLLM_DO_NOT_TRACK", None) or os.environ.get(
"DO_NOT_TRACK", None) or "0") == "1",
lambda: True,
"VLLM_USAGE_SOURCE":
lambda: os.environ.get("VLLM_USAGE_SOURCE", "production"),

Expand Down

0 comments on commit d14c46e

Please sign in to comment.