Skip to content

Conversation

@xingliu14
Copy link
Collaborator

@xingliu14 xingliu14 commented Nov 14, 2025

Description

Centralizes environment variable access by routing following environment variable reads through the envs.py module.

  • JAX_PLATFORMS
  • TPU_ACCELERATOR_TYPE
  • TPU_NAME
  • TPU_WORKER_ID
  • TPU_MULTIHOST_BACKEND
  • PREFILL_SLICES
  • DECODE_SLICES

Addressing #1016.
cc @kyuyeunk

Tests

pytest

  • tests/core/test_disagg_utils.py
  • tests/distributed/test_tpu_connector.py
  • tests/test_tpu_info.py
  • tests/test_utils.py
  • tests/layers/jax/test_sharding.py
  • tests/models/jax/test_weight_loading.py
  • tests/core/test_init.py

Checklist

Before submitting this PR, please make sure:

  • I have performed a self-review of my code.
  • I have necessary comments in my code, particularly in hard-to-understand areas.
  • I have made or will make corresponding changes to any relevant documentation.

@xingliu14 xingliu14 force-pushed the env_var branch 3 times, most recently from 03b8668 to 2c04b01 Compare November 14, 2025 07:35
@xingliu14 xingliu14 changed the title Env var Centralizes environment variable access by routing variables reads through the envs.py module. Nov 14, 2025
@kyuyeunk
Copy link
Collaborator

kyuyeunk commented Nov 15, 2025

Is this currently in a review-able state? If not, can you convert it into draft? Also, all the unit tests fails should have been fixed by now, so please try again.

@xingliu14
Copy link
Collaborator Author

I rebased and verified all unit tests are passed. This is ready for review.

@kyuyeunk
Copy link
Collaborator

I rebased and verified all unit tests are passed. This is ready for review.

https://buildkite.com/tpu-commons/tpu-inference-ci/builds/5491

will review it once i'm available.

@xingliu14 xingliu14 force-pushed the env_var branch 2 times, most recently from 15ee8d3 to b6cfcc4 Compare November 17, 2025 20:14
@xingliu14 xingliu14 requested a review from kyuyeunk November 17, 2025 20:16
@kyuyeunk
Copy link
Collaborator

CI has been fixed. Can you update the branch so I can re-run the ci for this PR?

Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
Signed-off-by: Xing Liu <xingliu14@gmail.com>
@xingliu14
Copy link
Collaborator Author

Done!

@kyuyeunk
Copy link
Collaborator

Running. Please ping me when the ci finishes!: https://buildkite.com/tpu-commons/tpu-inference-ci/builds/5624

@kyuyeunk kyuyeunk merged commit 7a9a4ae into vllm-project:main Nov 19, 2025
3 checks passed
@xingliu14 xingliu14 deleted the env_var branch November 19, 2025 07:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants