MATLAB: Do I receive errors when starting a job manager or worker in MATLAB Parallel Server 1.0 (R14SP1+)

MATLAB Parallel ServerParallel Computing Toolbox

When I start a job manager or worker on my host host_name, where host_name is the name of my host, as follows:

./startjobmanager.sh -name MyJobManager (on UNIX)
startjobmanager -name MyJobManager (on Windows)

I receive errors such as ERROR: Could not find activation system. The cause of this problem is: ====================================================== Could not locate mdce service daemon at host: host_name.domain.com and port: 1098. ====================================================

Best Answer

This enhancement has been incorporated in Release 2007b (R2007b). For previous product releases, read below for any possible workarounds:

According to RFC 2396, RFC 952, and RFC 1123, the underscore (_) is not a valid character in a hostname . You need to change your hostname so that it does not contain an underscore (_). You can use a dash (-) instead of an underscore.

NOTE: Starting in R2019a the following name changes occurred:
MATLAB Distributed Computing Server was renamed to MATLAB Parallel Server
mdce_def was renamed to mjs_def
mdce binary was renamed to mjs

Related Solutions

MATLAB: Do I receive an error “Error encountered while adding AttachedFiles to MATLAB path” after submitting a job to the cluster

This error occurs when submitting a MATLAB Parallel Server job (parpool or batch) and there is insufficient space in the temporary directory. By default, any attached files will be copied over to /tmp on each compute node that is part of the job.

To workaround this issue, specify a different temporary directory via the TMP and TMPDIR environment variable. This environment variable can be placed into the communicatingSubmitFcn, independentSubmitFcn or into the $MATLAB/bin/worker script

NOTE: Starting in R2019a the following name changes occurred:

MATLAB Distributed Computing Server was renamed to MATLAB Parallel Server
mdce_def was renamed to mjs_def
mdce binary was renamed to mjs

MATLAB: How to start the MDCE in MATLAB 7.5 (R2007b) or later versions

Below is a sample M-script for starting up 4 workers on a local machine with the MATLAB Distributed Computing Engine installed.

%%This document assumes you have successfully installed the MDCE Toolbox
%%Install the MDCE
cd([matlabroot '\toolbox\distcomp\bin'] or (matlabroot '\toolbox\parallel\bin')(R2019b & later)
!mdce install
%%Start the MDCE
!mdce start
%%Start the MDCE and prepare for Distributed processing
% If you would like to see the status of the workers as they run, please
% set this to true
STATUS = true;
% Start a Job Manager
% -name the name of the Job Manager
!startjobmanager -name my_jobmanager
% Start 4 workers using the previously defined Job Manager
% -name           name of the worker
% -jobmanager     name of the Job Manager
% -jobmanagerhost name of the machine the manager is running on
!startworker -name worker_1 -jobmanager my_jobmanager -jobmanagerhost localhost
!startworker -name worker_2 -jobmanager my_jobmanager -jobmanagerhost localhost
!startworker -name worker_3 -jobmanager my_jobmanager -jobmanagerhost localhost
!startworker -name worker_4 -jobmanager my_jobmanager -jobmanagerhost localhost
if STATUS
% Output the status of the workers as they are running
!nodestatus
end
%%Run your code
% After the above has been started, you can run your code
% When you are done running your code execute the below cells of code
% to cleanly shut down the Workers, Job Manager and MDCE
%%Stop all the Workers, Job Manager and the MDCE
cd([matlabroot '\toolbox\distcomp\bin'])
% Stop the 4 workers previously started
!stopworker -name worker_1 -jobmanager my_jobmanager
!stopworker -name worker_2 -jobmanager my_jobmanager
!stopworker -name worker_3 -jobmanager my_jobmanager
!stopworker -name worker_4 -jobmanager my_jobmanager
% Stop the Job Manager
!stopjobmanager -name my_jobmanager
%%Stop the MDCE
!mdce stop
%%Uninstall the MDCE
!mdce uninstall

Best Answer

Related Solutions

MATLAB: Do I receive an error “Error encountered while adding AttachedFiles to MATLAB path” after submitting a job to the cluster

MATLAB: How to start the MDCE in MATLAB 7.5 (R2007b) or later versions

Related Question