Skip to content

engine caching for distributed#4211

Draft
apbose wants to merge 3 commits intomainfrom
abose/distributed_lock
Draft

engine caching for distributed#4211
apbose wants to merge 3 commits intomainfrom
abose/distributed_lock

Conversation

@apbose
Copy link
Copy Markdown
Collaborator

@apbose apbose commented Apr 24, 2026

No description provided.

@meta-cla meta-cla Bot added the cla signed label Apr 24, 2026
@github-actions github-actions Bot added component: tests Issues re: Tests component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths labels Apr 24, 2026
@github-actions github-actions Bot requested a review from cehongwang April 24, 2026 00:34
@apbose apbose marked this pull request as draft April 24, 2026 00:37
assert engine_cache is not None
assert hash_val is not None

_lock_path = _os.path.join(engine_cache.engine_cache_dir, f".{hash_val}.lock")
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should build a locking facility into the core BaseEngineCache class so that if someone uses some other method other than disk cache it still works the same. For DiskCache FileLocks might be the right choice but say you use S3 buckets, it might be something else

@narendasan narendasan requested a review from zewenli98 April 24, 2026 22:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants