MATLAB: HPC cluster

hpc

Kindly assist me with the following problems: 1) How does Matlab partition large matrices and what does the algorithm look like? 2) I intend to use configuration manager to setup job submission for a HPC cluster (with a head node (multicore), 5 compute nodes (multicore) and some client nodes). Please on which of the nodes do I need to install Matlab (with parallel toolbox)? Do I need to install parallel Matlab on all the nodes? On which of the node (matlab) do I setup the configuration manager? Answer to these questions will help me to know the number of licenses to buy.

Thank you.

Best Answer

The partitioning of distributed arrays is documented here, although you can choose the partition differently if you wish. (There's not often a good reason to do this).

You need to install MATLAB + Parallel Computing Toolbox on the nodes from which you wish to submit jobs. You also launch the configuration manager on that node.

You need to install MATLAB Distributed Computing Server on the worker nodes. If you're going to use the MathWorks jobmanager on the head-node, you need to install MDCS there too - but the jobmanager process does not consume any licences.

Related Solutions

MATLAB: Parallel Computing Toolbox – Concurrent Users

Yes, but those other computers will need to be licensed with the MATLAB Distributed Computing Server. Your Parallel Computing Toolbox allows you to submit jobs to MDCS which is running across multiple computers.

http://www.mathworks.com/products/distriben/

MATLAB: What are possible/necessary License manager configurations in a MDCS setup

I am assuming you already have a license manager setup for accessing MATLAB (client) from different machines. I have put in my answers inline.

Is it possible to manage the MDCS license with a license manager that is different from the license manager managing the clients that access MDCS?

Yes. MDCS license manager can be installed on a different machine other than the regular license manager (i.e. the license manager for MATLAB).

If the license manager is on a different server than MDCS, what do I need to do to ensure that the license manager can be reached by MDCS, e.g. what ports are used?

In general, MDCS license manager is installed on a machine called node ‘head node’. While installing the license manager for MDCS, a file called ‘license.dat’ is created which needs to be copied onto all the worker machine (i.e. where MDCS server is installed). This file will contain the information on how to contact the license manager.
Refer to the links below for more information on MDCS installation and setup:
https://www.mathworks.com/videos/setting-up-matlab-distributed-computing-server-with-matlab-job-scheduler-93403.html
https://www.mathworks.com/help/pdf_doc/mdce/mdce.pdf

Best Answer

Related Solutions

MATLAB: Parallel Computing Toolbox – Concurrent Users

MATLAB: What are possible/necessary License manager configurations in a MDCS setup

Related Question