M42PL - Dispatchers

Core M42PL dispatchers.

M42PL dispatchers runs M42PL pipelines. They are the glue between a pipeline and an execution framework (single process, multiple processes, Celery, etc.).

Dispatchers list

Aliases	Class	Module	Description
local	LocalDispatcher	local.py	Run a pipeline
local_test	TestLocalDispatcher	local.py	Test a pipeline
local_repl	REPLLocalDisptcher	local.py	Run a pipeline
local_detached	DetachedLocalDispater	local.py	Run a pipeline in another process
mpi	MPI	mpi.py	Run pipelines on multiples processes

Installation

git clone https://github.com/jpclipffel/m42pl-dispatchers
pip install -e m42pl-dispatchers

Usage

One can select the dispatcher to use with the -d or --dispatcher parameter when calling m42pl.

Examples to use the mpi dispatcher:

• To run a pipeline: m42pl -d mpi run <path/to/pipeline.mpl>
• In a REPL: m42pl -d mpi repl

---