Skip to content

feat(k8s): use Lakekeeper as the Iceberg Catalog in the Kubernetes deployment#4275

Open
mengw15 wants to merge 7 commits into
apache:mainfrom
mengw15:Lakekeeper-Kubernetes-deployment
Open

feat(k8s): use Lakekeeper as the Iceberg Catalog in the Kubernetes deployment#4275
mengw15 wants to merge 7 commits into
apache:mainfrom
mengw15:Lakekeeper-Kubernetes-deployment

Conversation

@mengw15
Copy link
Copy Markdown
Contributor

@mengw15 mengw15 commented Mar 9, 2026

What changes were proposed in this PR?

This PR adds the Kubernetes / Helm deployment for the Lakekeeper-based Result Service.

Files changed:

  • bin/k8s/Chart.yaml: added Lakekeeper Helm chart dependency (lakekeeper v0.9.0)
  • bin/k8s/values.yaml: added Lakekeeper and lakekeeperInit configuration (warehouse name, S3 bucket, region, default
    project)
  • bin/k8s/templates/lakekeeper-init-job.yaml (new): Kubernetes Job that bootstraps Lakekeeper — creates MinIO bucket,
    default project, and warehouse
  • bin/k8s/templates/external-names.yaml: added Lakekeeper ExternalName service for computing-unit-pool namespace access
  • bin/k8s/templates/workflow-computing-unit-manager-deployment.yaml: switched from Postgres catalog to REST catalog env
    vars; added wait-lakekeeper init container
  • bin/k8s/templates/webserver-deployment.yaml: added REST catalog env vars
  • bin/k8s/templates/postgresql-init-script-config.yaml: added Lakekeeper database initialization
  • bin/k8s/files/texera_lakekeeper.sql (new): symlink to sql/texera_lakekeeper.sql

Any related issues, documentation, discussions?

close #4610

How was this PR tested?

Manually tested

Was this PR authored or co-authored using generative AI tooling?

co-authored with claude

@github-actions github-actions Bot added ddl-change Changes to the TexeraDB DDL dev labels Mar 9, 2026
@mengw15 mengw15 self-assigned this Apr 6, 2026
@mengw15 mengw15 requested a review from bobbai00 May 1, 2026 13:07
@mengw15 mengw15 changed the title feat: introduce Result Service using Lakekeeper as REST catalog for Iceberg - Kubernetes deployment feat(k8s): use Lakekeeper as the Iceberg Catalog in the Kubernetes deployment May 1, 2026
@codecov-commenter
Copy link
Copy Markdown

codecov-commenter commented May 10, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 43.22%. Comparing base (c86dc15) to head (84c4ed4).

Additional details and impacted files
@@            Coverage Diff            @@
##               main    #4275   +/-   ##
=========================================
  Coverage     43.21%   43.22%           
- Complexity     2185     2186    +1     
=========================================
  Files          1035     1035           
  Lines         38843    38843           
  Branches       4061     4061           
=========================================
+ Hits          16785    16788    +3     
  Misses        21006    21006           
+ Partials       1052     1049    -3     
Flag Coverage Δ *Carryforward flag
access-control-service 39.53% <ø> (ø)
agent-service 33.72% <ø> (ø) Carriedforward from c86dc15
amber 43.23% <ø> (+0.01%) ⬆️
computing-unit-managing-service 0.00% <ø> (ø)
config-service 0.00% <ø> (ø)
file-service 32.18% <ø> (ø)
frontend 34.80% <ø> (ø) Carriedforward from c86dc15
python 88.84% <ø> (ø) Carriedforward from c86dc15
workflow-compiling-service 47.72% <ø> (ø)

*This pull request uses carry forward flags. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@bobbai00 bobbai00 removed the ddl-change Changes to the TexeraDB DDL label May 12, 2026
Copy link
Copy Markdown
Contributor

@bobbai00 bobbai00 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! But I would like to have more people to test it. Can @xuang7 test this branch?

@bobbai00 bobbai00 requested a review from xuang7 May 12, 2026 05:59
Copy link
Copy Markdown
Contributor

@xuang7 xuang7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Tested on local k8s, services work fine. This branch is behind main, please sync before merging.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Kubernetes / Helm deployment for Lakekeeper-based Result Service

4 participants