Skip to content

feat(website): replace Typesense with static Pagefind search - #26191

Queued
pront wants to merge 11 commits into
masterfrom
pront-website-pagefind-prototype-master
Queued

feat(website): replace Typesense with static Pagefind search#26191
pront wants to merge 11 commits into
masterfrom
pront-website-pagefind-prototype-master

Conversation

@pront

@pront pront commented Aug 24, 2026

Copy link
Copy Markdown
Member

Summary

Motivation

Replace the hosted Typesense search service with a static, browser-side Pagefind index that can be tuned and deployed with the website itself. Easier development and we can remove Typesense related secrets.

Changes

  • Generate the Pagefind index in production, preview, and local website builds.
  • Make Pagefind the only search client and link every result to its canonical page URL.
  • Generate a small static exact-doc index for components and VRL functions.
  • Pin exact queries such as vector sink and encrypt_ip to their canonical component page or function anchor, followed by Pagefind's remaining ranked results.
  • Keep a matching subsection only as the result excerpt, so document searches show the document title rather than a subsection as the result title.
  • Remove the Typesense client, sync/index scripts, configuration, dependency exception, and service-specific build steps.

Vector configuration

N/A

How did you test this PR?

  • yarn tsc --noEmit
  • make cargo-data structured-data production-build (553 generated pages; 517 indexed by Pagefind)
  • make preview-build (553 generated pages; 517 indexed by Pagefind)
  • Verified encrypt_ip ranks /docs/reference/vrl/functions/#encrypt_ip first, followed by the remaining Pagefind results.
  • Verified vector sink ranks /docs/reference/configuration/sinks/vector/ first, followed by the remaining Pagefind results.
  • git diff --check

Change Type

  • New feature

Is this a breaking change?

  • Yes
  • No

Does this PR include user facing changes?

  • Yes. Please add a changelog fragment based on our guidelines.
  • No. A maintainer will apply the no-changelog label to this PR.

References

None.

@pront pront added no-changelog Changes in this PR do not need user-facing explanations in the release changelog preview: website Deploy a vector.dev preview site for this PR labels Aug 24, 2026
@github-actions

github-actions Bot commented Aug 24, 2026

Copy link
Copy Markdown
Contributor

Your preview sites will be ready in a few minutes, please allow time for them to build.

@pront
pront marked this pull request as ready for review August 28, 2026 16:48
@pront
pront requested a review from a team as a code owner August 28, 2026 16:48
@pront pront changed the title feat(website): prototype static Pagefind search feat(website): replace Typesense with static Pagefind search Aug 28, 2026

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 16ddbcb565

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/Makefile
Comment thread website/assets/js/search.tsx Outdated
Comment thread website/layouts/partials/javascript/search.html
Comment thread website/config.toml Outdated
@pront
pront force-pushed the pront-website-pagefind-prototype-master branch from 34536e4 to 6f05dfa Compare August 28, 2026 17:56

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bf173f409a

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/Makefile

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 37d980534d

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/layouts/partials/javascript/search.html Outdated
Comment thread website/Dockerfile Outdated
@pront pront added preview: website Deploy a vector.dev preview site for this PR and removed preview: website Deploy a vector.dev preview site for this PR labels Aug 28, 2026
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Aug 29, 2026

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review Completed 2026-08-31T20:57:25.219142Z 0e73e79 Manual request
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: cf735635d8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/Makefile Outdated
Comment thread website/Makefile Outdated

@thomasqueirozb thomasqueirozb left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking for encrypt_ip gets me the correct page as the first result. Looking for encrypt_ only though only shows me the VRL examples page instead with no match for the encrypt_ip function reference. Is it possible to make it so encrypt_ also gets a hit for the correct page?

This looks snappy in mobile too 🙂.

It is an improvement over Typesense and it's statically served over vector.dev with one less external dependency, so a nice improvement overall. Approving to unblock

Comment thread website/assets/js/search.tsx
@pront
pront requested a review from a team as a code owner August 31, 2026 18:43

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: ee55e16685

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/layouts/partials/content.html
Comment thread website/layouts/partials/meta.html

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: af243874a2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/assets/js/search.tsx Outdated
Comment thread website/assets/js/search.tsx Outdated

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0e73e792e2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread website/Makefile
@pront
pront added this pull request to the merge queue Aug 31, 2026
Any commits made after this event will not be merged.
@pront
pront removed this pull request from the merge queue due to a manual request Aug 31, 2026
@jeff-morgan-dd jeff-morgan-dd self-assigned this Aug 31, 2026
@pront

pront commented Aug 31, 2026

Copy link
Copy Markdown
Member Author

@codex is this ready to merge?

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Keep them coming!

Reviewed commit: 0e73e792e2

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@pront
pront added this pull request to the merge queue Aug 31, 2026
Any commits made after this event will not be merged.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

no-changelog Changes in this PR do not need user-facing explanations in the release changelog preview: website Deploy a vector.dev preview site for this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants