Changelog

1.1.2

(2020-08-27)

  • Added missing typing information

  • Updated some docstrings

  • Added license

1.1.1

(2020-02-19)

  • Changed collections.Iterable to collections.abc.Iterable due to deprecation of the former.

1.1.0

(2019-10-31)

  • Removed custom progress bar support to fix Jupyter notebook support

  • New progress_bar_position parameter is now available to set the position of the progress bar when using nested worker pools

  • Screen resizing is now supported when using a progress bar

1.0.0

(2019-10-29)

  • Added the MPIRE dashboard

  • Added threading as a possible backend

  • Progress bar handling now occurs in a separate process, instead of a thread, to improve responsiveness

  • Refactoring of code and small bug fixes in error handling

  • Removed deprecated functionality

0.9.0

(2019-03-11)

  • Added support for using different start methods (‘spawn’ and ‘forkserver’) instead of only the default method ‘fork’

  • Added optional support for using dill in multiprocessing by utilizing the multiprocess library

  • The mpire.Worker class is no longer directly available

0.8.1

(2019-02-06)

  • Fixed bug when process would hang when progress bar was set to True and an empty iterable was provided

0.8.0

(2018-11-01)

  • Added support for worker state

  • Chunking numpy arrays is now done using numpy slicing

  • mpire.WorkerPool.map() now supports automatic concatenation of numpy array output

0.7.2

(2018-06-14)

  • Small bug fix when not passing on a boolean or tqdm object for the progress_bar parameter

0.7.1

(2017-12-20)

  • You can now pass on a dictionary as an argument which will be unpacked accordingly using the **-operator.

  • New function mpire.utils.make_single_arguments() added which allows you to create an iterable of single argument tuples out of an iterable of single arguments.

0.7.0

(2017-12-11)

  • mpire.utils.chunk_tasks() is now available as a public function

  • Chunking in above function and map functions now accept a n_splits parameter

  • iterable_of_args in map functions can now contain single values instead of only iterables

  • tqdm is now available from the MPIRE package which automatically switches to the Jupyter/IPython notebook widget when available

  • Small bugfix in cleaning up a worker pool when no map function was called

0.6.2

(2017-11-07)

  • Fixed a second bug where the main process could get unresponsive when an exception was raised

0.6.1

(2017-11-06)

  • Fixed bug where sometimes exceptions fail to pickle

  • Fixed a bug where the main process could get unresponsive when an exception was raised

  • Child processes are now cleaned up in parallel when an exception was raised

0.6.0

(2017-11-03)

  • restart_workers parameter is now deprecated and will be removed from v1.0.0.

  • Progress bar functionality added (using tqdm).

  • Improved error handling in user provided functions.

  • Fixed randomly occurring BrokenPipeErrors and deadlocks.

0.5.1

(2017-10-12)

  • Child processes can now also be pinned to a range of CPUs, instead of only a single one. You can also specify a single CPU or range of CPUs that have to be shared between all child processes.

0.5.0

(2017-10-06)

  • Added CPU pinning.

  • Default number of processes to spawn when using n_jobs=None is now set to the number of CPUs available, instead of cpu_count() - 1.

0.4.0

(2017-10-05)

  • Workers can now be started as normal child processes (non-deamon) such that nested mpire.WorkerPool s are possible.

0.3.0

(2017-09-15)

0.2.0

(2017-06-27)

  • Added docs

0.1.0

First release