[Feat] Add Indeed jobs scraper

[CREDO23]

Adds a platform-native Indeed scraper exposed as a single indeed.scrape verb.

• Warmed camoufox session (Cloudflare solve + homepage warm) with residential proxy rotation; parses jobs from embedded JSON.
• Search queries or start URLs → structured job items (title, company, salary, location, remote, dates, applyUrl); optional scrape_job_details.
• Full wiring: chat subagent, MCP tool, capability + INDEED_JOB billing unit, docs, env templates, README, and frontend catalog/marketing.

High-level PR Summary

This PR adds a complete Indeed jobs scraper as a new platform capability exposed through the indeed.scrape verb. The implementation includes a browser-based scraper that handles Cloudflare challenges with residential proxy rotation, parses jobs from Indeed's embedded JSON, and supports both search queries and direct URLs. The feature is fully wired with chat subagent integration, MCP tool exposure, billing infrastructure (INDEED_JOB unit), comprehensive test coverage, documentation, environment templates, and frontend marketing/catalog materials.

⏱️ Estimated Review Time: 30-90 minutes

💡 Review Order Suggestion

Order	File Path
1	README.md
2	README.es.md
3	README.hi.md
4	README.pt-BR.md
5	README.zh-CN.md
6	surfsense_backend/app/capabilities/indeed/scrape/schemas.py
7	surfsense_backend/app/proprietary/platforms/indeed_jobs/schemas.py
8	surfsense_backend/app/proprietary/platforms/indeed_jobs/url_resolver.py
9	surfsense_backend/app/proprietary/platforms/indeed_jobs/parsers.py
10	surfsense_backend/app/proprietary/platforms/indeed_jobs/fetch.py
11	surfsense_backend/app/proprietary/platforms/indeed_jobs/scraper.py
12	surfsense_backend/app/proprietary/platforms/indeed_jobs/__init__.py
13	surfsense_backend/app/capabilities/indeed/scrape/executor.py
14	surfsense_backend/app/capabilities/indeed/scrape/definition.py
15	surfsense_backend/app/capabilities/indeed/__init__.py
16	surfsense_backend/app/capabilities/core/types.py
17	surfsense_backend/app/capabilities/core/billing.py
18	surfsense_backend/app/config/__init__.py
19	surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/indeed/tools/index.py
20	surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/indeed/agent.py
21	surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/indeed/description.md
22	surfsense_backend/app/agents/chat/multi_agent_chat/subagents/builtins/indeed/system_prompt.md
23	surfsense_backend/app/agents/chat/multi_agent_chat/subagents/registry.py
24	surfsense_backend/app/agents/chat/multi_agent_chat/constants.py
25	surfsense_backend/app/routes/__init__.py
26	surfsense_mcp/mcp_server/features/scrapers/platforms/indeed.py
27	surfsense_mcp/mcp_server/features/scrapers/__init__.py
28	surfsense_mcp/mcp_server/server.py
29	surfsense_mcp/mcp_server/selfcheck.py
30	surfsense_web/lib/connectors-marketing/indeed.tsx
31	surfsense_web/lib/connectors-marketing/index.ts
32	surfsense_web/lib/playground/catalog.ts
33	surfsense_web/lib/playground/platform-icons.tsx
34	surfsense_web/public/connectors/indeed.svg
35	surfsense_web/content/docs/connectors/native/indeed.mdx
36	surfsense_web/content/docs/connectors/native/meta.json
37	surfsense_web/content/docs/connectors/native/index.mdx
38	surfsense_web/content/docs/connectors/index.mdx
39	surfsense_web/content/docs/how-to/mcp-server.mdx
40	surfsense_web/lib/auth-utils.ts
41	docker/.env.example
42	surfsense_backend/.env.example
43	surfsense_backend/tests/unit/platforms/indeed_jobs/test_parsers.py
44	surfsense_backend/tests/unit/platforms/indeed_jobs/test_url_resolver.py
45	surfsense_backend/tests/unit/platforms/indeed_jobs/test_fetch_resilience.py
46	surfsense_backend/tests/unit/platforms/indeed_jobs/test_scraper.py
47	surfsense_backend/tests/unit/capabilities/indeed/scrape/test_executor.py
48	surfsense_backend/tests/unit/capabilities/indeed/test_registry.py
49	surfsense_backend/tests/unit/platforms/indeed_jobs/fixtures/sample_jobcards.json
50	surfsense_backend/tests/unit/platforms/indeed_jobs/fixtures/sample_viewjob.html
51	surfsense_backend/scripts/e2e_indeed_scraper.py
52	surfsense_backend/tests/unit/agents/multi_agent_chat/test_subagent_composition.py
53	surfsense_backend/tests/unit/capabilities/google_maps/test_registry.py
54	surfsense_backend/tests/unit/capabilities/reddit/test_registry.py
55	surfsense_backend/tests/unit/capabilities/youtube/test_registry.py
56	surfsense_web/lib/connectors-marketing/google-maps.tsx
57	surfsense_web/lib/connectors-marketing/google-search.tsx
58	surfsense_web/lib/connectors-marketing/instagram.tsx
59	surfsense_web/lib/connectors-marketing/reddit.tsx
60	surfsense_web/lib/connectors-marketing/tiktok.tsx
61	surfsense_web/lib/connectors-marketing/web-crawl.tsx
62	surfsense_web/lib/connectors-marketing/youtube.tsx

[vercel]

@CREDO23 is attempting to deploy a commit to the Rohan Verma's projects Team on Vercel.

A member of the Team first needs to authorize it.

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: db734dbb-c720-4fde-a219-d2c72fee74bc

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}