makeflow_mpi_starter(1)

mpi wrapper program for makeflow and workqueue

Section 1 coop-computing-tools bookworm source

Description

makeflow_mpi_starter

NAME

makeflow_mpi_starter - mpi wrapper program for makeflow and workqueue

SYNOPSIS

makeflow_mpi_starter [options]

DESCRIPTION

makeflow_mpi_starter is an MPI wrapper program that will start Makeflow and WorkQueue on the nodes allocated to it. It is intended as a simple, easy way for users to take advantage of MPI-based system while using Makeflow and WorkQueue. To use it, the user simply needs to call it as one would a regular MPI program. For the program to work, cctools needs to be configured with --with-mpi-path.

OPTIONS

When makeflow_mpi_starter is ran without arguments, it will attempt to execute the workflow specified by the Makeflow dagfile.

Commands

-m, --makeflow-arguments=<option>

Options to pass to makeflow, such as dagfile, etc

-p, --makeflow-port=<port>

The port for Makeflow to use when communicating with workers

-q, --workqueue-arguments=<option>

Options to pass to work_queue_worker

-c, --copy-out=<location>

Where to copy out all files produced

-d, --debug=<debugprefix>

Base Debug file name

-h, --help

Print out this help

EXIT STATUS

On success, returns zero. On failure, returns non-zero.

EXAMPLES

Run with debugging:

mpirun -np $NUM_PROC makeflow_mpi_starter -m "Makeflow.mf" -d mydebug

Run makeflow with custom port:

mpirun -np $NUM_PROC makeflow_mpi_starter -m "Makeflow.mf" -d mydebug -p 9001

Run makeflow with garbage collection

mpirun -np $NUM_PROC makeflow_mpi_starter -m "-gall Makeflow.mf" -d mydebug

Example SGE submission script

#!/bin/csh

#$ -pe mpi-* 120
#$ -q debug
#$ -N mpi_starter_example

module load ompi

mpirun -np $NSLOTS makeflow_mpi_starter -m "Makeflow.mf" -d mydebug

	•		Cooperative Computing Tools Documentation
	•		Makeflow User Manual
	•		makeflow(1) makeflow_monitor(1) makeflow_analyze(1) makeflow_viz(1) makeflow_graph_log(1) starch(1) makeflow_ec2_setup(1) makeflow_ec2_cleanup(1) makeflow_ec2_estimate(1)