Skip to content

feat(core): make elasticsearch compatible with remote_task_log#62121

Draft
Owen-CH-Leung wants to merge 1 commit intoapache:mainfrom
Owen-CH-Leung:core/make-es-compatible-with-remote-log-io
Draft

feat(core): make elasticsearch compatible with remote_task_log#62121
Owen-CH-Leung wants to merge 1 commit intoapache:mainfrom
Owen-CH-Leung:core/make-es-compatible-with-remote-log-io

Conversation

@Owen-CH-Leung
Copy link
Contributor

fixes: #50349
Fixes: #51456

This PR is part of the solution to fix writing to elasticsearch feature. For details, see #53821

elif ELASTICSEARCH_HOST:
ELASTICSEARCH_END_OF_LOG_MARK: str = conf.get_mandatory_value("elasticsearch", "END_OF_LOG_MARK")
ELASTICSEARCH_FRONTEND: str = conf.get_mandatory_value("elasticsearch", "frontend")
from airflow.providers.elasticsearch.log.es_task_handler import ElasticsearchRemoteLogIO
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we need also min elastic version in

MIN_VERSION_OVERRIDE: dict[str, Version] = {

Because we know this won't work with older version of elastic provider

Need to verify with @potiuk this is the right way to proceed

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it depends on whether there is min version that will work here.

@jason810496 jason810496 self-requested a review February 18, 2026 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Logs are not integrating with elasticsearch airflow no writing logs to Elasticsearch

3 participants

Comments