Skip to content

Bring the Apache Doris demo up to date - #1

Merged
gordonmurray merged 6 commits into
mainfrom
update-doris-demo
Nov 2, 2026
Merged

gordonmurray merged 6 commits into
mainfrom
update-doris-demo

Conversation

@gordonmurray

@gordonmurray gordonmurray commented Nov 2, 2026 •

Copy link
Copy Markdown
Owner

Bringing this 2023 experiment up to date with Doris 4.0.8, the release labelled Stable by Apache Doris, and Kafka 4.1.2.

The default setup now runs one frontend, one backend and Kafka. A separate Compose configuration keeps the three-frontend, three-backend experiment available with its own persistent volumes and three table replicas.

  • Replace the old alpha images with pinned releases and add readiness checks.
  • Provision Kafka, create the topic and Routine Load job, and load repeatable sample data.
  • Correct connection ports, network addresses, startup dependencies and configuration handling.
  • Replace hardcoded host storage paths with named volumes and document preservation and reset commands.
  • Resume the demo's paused ingestion job after services restart, retaining its Kafka offsets.
  • Add a smoke test for fresh Kafka ingestion and Actions checks for configuration, scripts and persistence.

Validation: GitHub Actions passes Compose validation for both configurations, Bash syntax, ShellCheck, fresh Kafka ingestion, and data persistence plus fresh ingestion after recreating containers. The larger cluster is configuration-checked; its runtime smoke test needs a machine with enough memory.

This creates a fresh demo. It does not migrate existing 2.0-alpha data.

@gordonmurray
gordonmurray marked this pull request as ready for review November 2, 2026 11:49
@gordonmurray
gordonmurray merged commit fb95af3 into main Nov 2, 2026
2 checks passed
@gordonmurray
gordonmurray deleted the update-doris-demo branch November 2, 2026 12:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant