SkippedRequestCallback receives only the URL string, so handlers can't access request metadata (notably user_data) for skipped requests:
SkippedRequestCallback = Callable[[str, SkippedReason], Awaitable[None]]
#1999 implements passing the Request in a backward-compatible way, but that requires dual-dispatching on the callback's parameter type annotation, which is fragile runtime inspection (see this comment). Since v2 allows breaking changes, do it there with a clean signature instead:
SkippedRequestCallback = Callable[[Request, SkippedReason], Awaitable[None]]
Related
SkippedRequestCallbackreceives only the URL string, so handlers can't access request metadata (notablyuser_data) for skipped requests:#1999 implements passing the
Requestin a backward-compatible way, but that requires dual-dispatching on the callback's parameter type annotation, which is fragile runtime inspection (see this comment). Since v2 allows breaking changes, do it there with a clean signature instead:Related
Requestinstance inonSkippedRequestcallback crawlee#3801