Skip to content

Adapt to Apify's "multiple storages" functionality #762

@janbuchar

Description

@janbuchar

This is a feature that should complement the unnamed non-default storages:

  1. Apify passes a JSON object with additional storage IDs to the Actor via environment - ACTOR_STORAGE_IDS - we should add this to the Configuration class. It is an object with three properties - datasets, keyValueStores and requestQueues. Each of these properties contains a name -> ID dictionary.
  2. We should extend the AliasResolver class to utilize this so that Dataset.open(alias="additional-dataset") just works (™️). If an unknown alias is requested, we can either fall back to the current logic (create it, put an ID into the default KV-store) or shout at the user.

See https://apify.slack.com/archives/C07ED56TA1K/p1770217755895989

Metadata

Metadata

Assignees

Labels

t-toolingIssues with this label are in the ownership of the tooling team.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions