Skip to content

fix: Fix memory estimation not working on MacOS #1330

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 29, 2025

Conversation

Pijukatel
Copy link
Collaborator

Description

  • Use pss for memory estimation only on Linux.
  • Use rss for memory estimation only on MacOs.

Issues

@Pijukatel Pijukatel added the bug Something isn't working. label Jul 29, 2025
@github-actions github-actions bot added this to the 120th sprint - Tooling team milestone Jul 29, 2025
@github-actions github-actions bot added t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics. labels Jul 29, 2025
@Pijukatel Pijukatel marked this pull request as ready for review July 29, 2025 08:14
@Pijukatel
Copy link
Collaborator Author

Pijukatel commented Jul 29, 2025

Manually tested on MacOs. Thanks @vladfrangu

Two issues on MacOS in the original code before the PR:

  • memory_full_info available only for self process. But privileges error on other processes.
  • pss not available even in memory_full_info in MacOs

@Pijukatel Pijukatel requested a review from vdusek July 29, 2025 08:33
Copy link
Collaborator

@vdusek vdusek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Pijukatel Pijukatel merged commit ab020eb into master Jul 29, 2025
19 checks passed
@Pijukatel Pijukatel deleted the fix-memory-estimation-macos branch July 29, 2025 12:36
Mantisus pushed a commit to Mantisus/crawlee-python that referenced this pull request Jul 30, 2025
### Description
- Use `pss` for memory estimation only on Linux.
- Use `rss` for memory estimation only on MacOs.

### Issues

- Closes: apify#1329
Pijukatel added a commit that referenced this pull request Jul 30, 2025
### Description
- Use `pss` for memory estimation only on Linux.
- Use `rss` for memory estimation only on MacOs.

### Issues

- Closes: #1329
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working. t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Memory estimation problem on MacOS
3 participants