Skip to content

LLM05: add Markdown auto-render exfiltration to output handling guidance#9

Open
ottosulin wants to merge 1 commit intoGenAI-Security-Project:mainfrom
ottosulin:upgrade/LLM05-prevention-strategies
Open

LLM05: add Markdown auto-render exfiltration to output handling guidance#9
ottosulin wants to merge 1 commit intoGenAI-Security-Project:mainfrom
ottosulin:upgrade/LLM05-prevention-strategies

Conversation

@ottosulin
Copy link
Copy Markdown

@ottosulin ottosulin commented Apr 26, 2026

Adds prevention coverage for the Markdown image / link preview exfiltration pattern that has affected ChatGPT, Bing, Google Bard, NotebookLM, Writer.com, Amazon Q, GitHub Copilot Chat, Gemini, and Cursor.

CSP (current item 6) can mitigate this in browser-based UIs when img-src is properly used, but many LLM clients are not browsers (IDEs, native apps, terminal clients, email clients) and need application-layer controls at the renderer.

Adds:

  1. Impact condition (auto-fetched external resources in client renderers)
  2. Common example of the vulnerability (chat UI auto-renders Markdown images, exfil via URL)
  3. Prevention strategy (disable auto-render of Markdown images / link previews / iframes by default; allowlist or server-side image proxy when needed)
  4. Two references (Embrace The Red Copilot Chat writeup, Simon Willison Markdown exfiltration tracker)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant