Skip to content

MINOR: Document connections.max.idle.ms dependency on max.poll.interval.ms for Classic consumer#22752

Open
frankvicky wants to merge 3 commits into
apache:trunkfrom
frankvicky:ehance-consumer-doc
Open

MINOR: Document connections.max.idle.ms dependency on max.poll.interval.ms for Classic consumer#22752
frankvicky wants to merge 3 commits into
apache:trunkfrom
frankvicky:ehance-consumer-doc

Conversation

@frankvicky

@frankvicky frankvicky commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

In the Classic consumer, connections.max.idle.ms can cause the
coordinator connection to be reaped during a long rebalance if
max.poll.interval.ms is higher than it. When this happens, in-flight
JoinGroup requests are cancelled and the group cycles through
connection reaping, which prolongs or destabilizes the rebalance —
particularly in large consumer groups where the coordinator waits longer
for all members to rejoin.

Reviewers: Chia-Ping Tsai chia7712@gmail.com

@github-actions github-actions Bot added triage PRs from the community consumer clients small Small PRs labels Jul 3, 2026
}
long connectionsMaxIdleMs = getLong(CONNECTIONS_MAX_IDLE_MS_CONFIG);
int maxPollIntervalMs = getInt(MAX_POLL_INTERVAL_MS_CONFIG);
if (connectionsMaxIdleMs >= 0 && connectionsMaxIdleMs < maxPollIntervalMs) {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should the warning cover rebalance.timeout.ms?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. rebalance.timeout.ms isn't registered in ConsumerConfig — it's a Connect-only config.
I'm not sure if we should deal it in this PR.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or we could add similar log warnings to DistributedConfig?

@github-actions github-actions Bot removed the triage PRs from the community label Jul 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants