Changelog¶
1.2.1¶
(2021-04-22)
Updated some unittests and fixed some linting issues
Minor improvements in documentation
1.2.0¶
(2021-04-22)
Workers can be kept alive in between consecutive map calls
Setting CPU affinity is no longer restricted to Linux platforms
README updated to use RST format for better compatibility with PyPI.
Added classifiers to the setup file
1.1.3¶
(2020-09-03)
First public release on Github and PyPi
1.1.2¶
(2020-08-27)
Added missing typing information
Updated some docstrings
Added license
1.1.1¶
(2020-02-19)
Changed
collections.Iterable
tocollections.abc.Iterable
due to deprecation of the former.
1.1.0¶
(2019-10-31)
Removed custom progress bar support to fix Jupyter notebook support
New
progress_bar_position
parameter is now available to set the position of the progress bar when using nested worker poolsScreen resizing is now supported when using a progress bar
1.0.0¶
(2019-10-29)
Added the MPIRE dashboard
Added
threading
as a possible backendProgress bar handling now occurs in a separate process, instead of a thread, to improve responsiveness
Refactoring of code and small bug fixes in error handling
Removed deprecated functionality
0.9.0¶
(2019-03-11)
Added support for using different start methods (‘spawn’ and ‘forkserver’) instead of only the default method ‘fork’
Added optional support for using dill in multiprocessing by utilizing the multiprocess library
The
mpire.Worker
class is no longer directly available
0.8.1¶
(2019-02-06)
Fixed bug when process would hang when progress bar was set to
True
and an empty iterable was provided
0.8.0¶
(2018-11-01)
Added support for worker state
Chunking numpy arrays is now done using numpy slicing
mpire.WorkerPool.map()
now supports automatic concatenation of numpy array output
0.7.2¶
(2018-06-14)
Small bug fix when not passing on a boolean or
tqdm
object for theprogress_bar
parameter
0.7.1¶
(2017-12-20)
You can now pass on a dictionary as an argument which will be unpacked accordingly using the
**
-operator.New function
mpire.utils.make_single_arguments()
added which allows you to create an iterable of single argument tuples out of an iterable of single arguments.
0.7.0¶
(2017-12-11)
mpire.utils.chunk_tasks()
is now available as a public functionChunking in above function and map functions now accept a
n_splits
parameteriterable_of_args
in map functions can now contain single values instead of only iterablestqdm
is now available from the MPIRE package which automatically switches to the Jupyter/IPython notebook widget when availableSmall bugfix in cleaning up a worker pool when no map function was called
0.6.2¶
(2017-11-07)
Fixed a second bug where the main process could get unresponsive when an exception was raised
0.6.1¶
(2017-11-06)
Fixed bug where sometimes exceptions fail to pickle
Fixed a bug where the main process could get unresponsive when an exception was raised
Child processes are now cleaned up in parallel when an exception was raised
0.6.0¶
(2017-11-03)
restart_workers
parameter is now deprecated and will be removed from v1.0.0.Progress bar functionality added (using tqdm).
Improved error handling in user provided functions.
Fixed randomly occurring
BrokenPipeErrors
and deadlocks.
0.5.1¶
(2017-10-12)
Child processes can now also be pinned to a range of CPUs, instead of only a single one. You can also specify a single CPU or range of CPUs that have to be shared between all child processes.
0.5.0¶
(2017-10-06)
Added CPU pinning.
Default number of processes to spawn when using
n_jobs=None
is now set to the number of CPUs available, instead ofcpu_count() - 1
.
0.4.0¶
(2017-10-05)
Workers can now be started as normal child processes (non-deamon) such that nested
mpire.WorkerPool
s are possible.
0.3.0¶
(2017-09-15)
The worker ID can now be passed on the function to be executed by using the
mpire.WorkerPool.pass_on_worker_id()
function.Removed the use of
has_return_value_with_shared_objects
when usingmpire.WorkerPool.set_shared_objects()
. MPIRE now handles both cases out of the box.
0.2.0¶
(2017-06-27)
Added docs
0.1.0¶
First release