-
Notifications
You must be signed in to change notification settings - Fork 426
Closed
Labels
debtCode quality improvement or decrease of technical debt.Code quality improvement or decrease of technical debt.t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.
Milestone
Description
New interface of the BaseStorageClient
- Propose & implement a new
BaseStorageClient
. - It should introduce a new interface, which does not have to be dependent on the
ApifyStorageClient
. Instead, we should implement an adapter for it. - The
MemoryStorageClient
should implement this interface.
The issues with the current MemoryStorageClient
- fix!: Refactor service usage to rely on
service_locator
#691 (comment)- it should accept just some smaller part of
Configuration
in theopen_storage
- it should accept just some smaller part of
- How to economize on RAM when starting a crawl with a large list of urls? #816
- there are problems with disk offloading
- Improve storage manager and merge it with
creation_management
module #147- there are problems with initialization
- There is probably no need to keep track of an
id
for each resource client - the memory storage deals with names only. However, we should consider that we will need to support some kind of an equivalent of Apify's non-default, unnamed storages.
Metadata
Metadata
Assignees
Labels
debtCode quality improvement or decrease of technical debt.Code quality improvement or decrease of technical debt.t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.