Skip to content

Add server mode with live reload (rdoc --server)#1620

Open
st0012 wants to merge 4 commits intomasterfrom
server-mode-retry
Open

Add server mode with live reload (rdoc --server)#1620
st0012 wants to merge 4 commits intomasterfrom
server-mode-retry

Conversation

@st0012
Copy link
Member

@st0012 st0012 commented Feb 21, 2026

A better attempt of #1151

Implement rdoc --server[=PORT] for previewing documentation with automatic browser refresh on source file changes. The server parses all sources on startup, serves pages from memory via the Aliki generator, and watches for file modifications, additions, and deletions — re-parsing only what changed.

rdoc-server-live-reload-demo.mp4

Changes

  • New RDoc::Server (lib/rdoc/server.rb) — minimal HTTP server using Ruby's built-in TCPServer (no WEBrick or external dependencies)
    • Thread-per-connection with Connection: close
    • Persistent Aliki generator instance rendering pages to strings
    • In-memory page cache and search index cache with full invalidation on changes
    • Live reload via inline JS polling /__status endpoint every 1 second
    • Background file watcher polling source file mtimes every 1 second
    • Incremental re-parse: only changed files are re-parsed, old data removed first
    • Detection of new and deleted source files
  • --server[=PORT] CLI option (default port 4000) and rdoc:server Rake task
  • RDoc::Store#remove_file — removes a file's entries from the store hashes
  • RDoc::Store#clear_file_contributions — surgically removes a file's methods, constants, comments, includes, extends, and aliases from its classes/modules, preserving classes that span multiple files
  • RDoc::RDoc#relative_path_for — extracted path normalization (against options.root and options.page_dir) shared by parse_file and the server
  • Darkfish#refresh_store_data — extracted for reuse by the server after re-parsing
  • RDoc::ServletRDoc::RI::Servlet — moved to clarify RI-specific usage

Security & robustness

  • Binds to 127.0.0.1 only (localhost)
  • Path traversal protection in asset serving (File.expand_path containment check)
  • Proper HTTP error responses: 400, 404, 405, 500
  • 5-second IO.select read timeout on client sockets
  • Mutex protects all store mutations, generator refresh, and cache invalidation atomically
  • Individual parse_file errors rescued so one failure doesn't block remaining files
  • Watcher thread uses @running flag with clean shutdown via Thread#join

Known limitations

  • Full cache invalidation: any file change clears all cached pages. Rendering is fast (~ms per page); parsing is the expensive part and is done incrementally.
  • Template/CSS changes: require server restart (only source files are watched).

@matzbot
Copy link
Collaborator

matzbot commented Feb 21, 2026

🚀 Preview deployment available at: https://a0f78dbf.rdoc-6cd.pages.dev (commit: 4d2eea3)

Adds a built-in HTTP server for previewing documentation while editing
source files. Parses all sources on startup, watches for file changes,
re-parses only changed files, and auto-refreshes the browser.

Server implementation (lib/rdoc/server.rb):
- Uses Ruby's built-in TCPServer (no WEBrick or external dependencies)
- Persistent Aliki generator instance rendering to strings
- Thread-per-connection with Connection: close (no keep-alive)
- Background watcher thread polls file mtimes every 1 second
- Live reload via inline JS polling /__status endpoint
- New --server[=PORT] option (default 4000) and rdoc:server Rake task
- Moved RDoc::Servlet to RDoc::RI::Servlet (server mode uses new class)

Security:
- Binds to 127.0.0.1 only (localhost)
- Path traversal protection in asset serving via expand_path containment
- Proper HTTP error responses (400, 404, 405, 500)
- 5-second read timeout on client sockets

Concurrency:
- Mutex protects all store mutations, generator refresh, and cache
  invalidation as a single atomic operation
- Thread-safe last_change_time reads for the status endpoint

Correctness:
- Clears file contributions (methods, constants, comments, etc.) before
  re-parsing to prevent duplication, without removing shared namespaces
- Individual parse_file errors caught so one failure doesn't block others
- Store#remove_file recursively cleans nested classes/modules and C vars
- Watcher thread uses @running flag with clean shutdown via join
@st0012 st0012 marked this pull request as ready for review February 21, 2026 17:58
Co-authored-by: Sutou Kouhei <kou@clear-code.com>
- Embed last_change_time into the live-reload script at render time
  so the browser's initial timestamp matches the page content. This
  fixes a race where a change between page generation and the first
  poll would be silently skipped.

- Call clear_file_contributions for removed files (not just changed
  files) and remove classes/modules from the store when no files
  contribute to them anymore. This correctly handles reopened classes
  across multiple files and improves file deletion behavior.
Move `relative_path_for` from a private method on RDoc::Server to a
public method on RDoc::RDoc, eliminating the duplication with the
inline logic in `parse_file`.

Move `clear_file_contributions` from RDoc::Server to RDoc::Store
where it naturally belongs — it operates entirely on store internals
(files_hash, classes_hash, modules_hash).

Add tests for Store#clear_file_contributions covering single-file
removal, multi-file preservation, per-file cleanup of methods/
constants/includes, and no-op for nonexistent files.
@st0012 st0012 requested review from kou and tompng February 28, 2026 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants