Skip to content

gh-74028: concurrent.futures.Executor.map: introduce buffersize param for lazier behavior #125663

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 45 commits into from
Mar 13, 2025
Merged

gh-74028: concurrent.futures.Executor.map: introduce buffersize param for lazier behavior #125663

Changes from 1 commit
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
45c3ec5
bpo-29842: concurrent.futures.Executor.map: add buffersize param for …
ebonnal Oct 12, 2024
bfb2c5c
test_map_buffersize: 1s sleep
ebonnal Oct 17, 2024
8539663
mention chunksize in ProcessPoolExecutor's buffersize docstring
ebonnal Oct 18, 2024
022b8c6
merge unittest into ExecutorTest
ebonnal Oct 18, 2024
7ced787
fix versionchanged
ebonnal Oct 18, 2024
cb5f26e
📜🤖 Added by blurb_it.
blurb-it[bot] Oct 18, 2024
f46ebe6
fix tests determinism
ebonnal Oct 18, 2024
eb26e86
add test_map_with_buffersize_on_empty_iterable
ebonnal Oct 18, 2024
0821f95
allow timeout + buffersize
ebonnal Oct 18, 2024
d95c55b
lint import
ebonnal Oct 18, 2024
c80f466
tests: polish
ebonnal Oct 18, 2024
90e6d7c
rephrase docstring
ebonnal Oct 25, 2024
ab91694
fix Doc/library/concurrent.futures.rst
ebonnal Dec 3, 2024
01b8adf
reorder imports
ebonnal Dec 3, 2024
2f8a63f
rephrase buffersize's ValueError
ebonnal Dec 3, 2024
1fb53a5
update 3.14.rst
ebonnal Dec 3, 2024
365c85d
edit docstring
ebonnal Dec 3, 2024
bf5f838
lint
ebonnal Dec 3, 2024
a0057f1
lint
ebonnal Dec 3, 2024
1aa1275
comment on weakref
ebonnal Dec 4, 2024
e0a9a9e
lint
ebonnal Dec 4, 2024
8d6ea97
test_map_with_buffersize_when_buffer_becomes_full: avoid using multip…
ebonnal Dec 4, 2024
6124868
lint
ebonnal Dec 4, 2024
c11276f
test_map_with_buffersize_and_timeout: avoid sleeping 0 seconds for win32
ebonnal Dec 4, 2024
ebb5337
remove test_map_with_buffersize_and_timeoutthat does not improve cove…
ebonnal Dec 4, 2024
602968c
extend unittesting to no and multiple input iterables
ebonnal Dec 5, 2024
b14e368
Update Lib/concurrent/futures/_base.py
ebonnal Dec 5, 2024
d37ce09
rename args_iter -> zipped_iterables
ebonnal Dec 5, 2024
cdf239c
remove period at end of error message
ebonnal Dec 10, 2024
0a49784
unit tests: merge into a single test method with test messages
ebonnal Dec 16, 2024
178d6fe
apply review on tests format
ebonnal Dec 16, 2024
516a94b
Update Misc/NEWS.d/next/Library/2024-10-18-10-27-54.gh-issue-74028.4d…
ebonnal Dec 16, 2024
ba4ac81
Update Doc/whatsnew/3.14.rst
ebonnal Dec 16, 2024
9588059
use assertListEqual
ebonnal Dec 16, 2024
0427bf1
test_map_buffersize_validation: test negative buffersize
ebonnal Dec 16, 2024
af88fdf
explicitly checks buffersize's type and add test_map_buffersize_type_…
ebonnal Dec 16, 2024
1fcf3fe
test_map_buffersize_on_infinite_iterable: fetch the first 4 elements
ebonnal Dec 18, 2024
0892b2b
add `test_map_buffersize_on_multiple_infinite_iterables`
ebonnal Dec 25, 2024
579ba31
doc: specify that it is the size of a buffer of tasks and not results
ebonnal Jan 10, 2025
332826a
Merge remote-tracking branch 'cpython/main' into fix-issue-29842
ebonnal Feb 24, 2025
ef814e5
Update Doc/whatsnew/3.14.rst
ebonnal Feb 24, 2025
26c8d8d
Merge branch 'main' into fix-issue-29842
encukou Mar 3, 2025
7b1d5f6
remove redundant `iter`
ebonnal Mar 3, 2025
8dac531
Merge remote-tracking branch 'cpython/main' into fix-issue-29842
ebonnal Mar 10, 2025
bb756f4
add new line in 3.14.rst
ebonnal Mar 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix versionchanged
  • Loading branch information
@ebonnal
ebonnal committed Jan 12, 2025
commit 7ced7877885438aff732e1d691de7b5c687caa00
2 changes: 1 addition & 1 deletion Doc/library/concurrent.futures.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ Executor Objects
.. versionchanged:: 3.5
Added the *chunksize* argument.

.. versionchanged:: 3.15
.. versionchanged:: 3.14
Added the *buffersize* argument.

.. method:: shutdown(wait=True, *, cancel_futures=False)
Expand Down