MATLAB: Do I receive the error Unable to read file ‘‘. No such file or directory in MATLAB Workers

addattachedfilesdirectoryfilenoParallel Computing Toolboxparpool

I would like to load some MAT files and do some operations.

But, when I do it in parallel, I get the following error-

Unable to read file 'mockdata.mat'. No such file or directory.

How to fix this?

Best Answer

Use addAttachedFiles if you would like to access files from workers.

https://www.mathworks.com/help/distcomp/addattachedfiles.html

'addAttachedFiles' adds extra attached files to the specified parallel pool. These files are transferred to each worker and are treated exactly the same as if they had been set at the time the pool was opened — specified by the parallel profile or the 'AttachedFiles' argument of the parpool function.

Related Solutions

MATLAB: How to take advantage of useParallel option for a remote job running on workers in a MDCS cluster

1. In order to use parallel pool with the cluster, please consider using the 'batch' function procedure to submit the jobs into cluster:

https://www.mathworks.com/help/distcomp/batch.html

When using the 'batch' command, it has the option to specify the number of workers to be used in addition to the job itself. Please refer to the example below:

c=parcluster('profile');
j = batch(c,@scriptUseParallel, 'Pool', 2);
wait(j);
diary(j);
Y2=fetchOutputs(j);

2. In the cluster setup, please consider to configure each machine to have the same number of workers as the number of cores.

Therefore each core can be started with a MATLAB process and being utilized by the batch job.

MATLAB: How to determine number of workers

The number of workers in your batch parallel pool should not exceed the number of loop iterations, i.e. it is not useful to make M > N. However, if you have more loop iterations than workers, each worker will simply process multiple iterations. (This is exactly the same behaviour as when you create an interactive parallel pool using parpool(M)).

Best Answer

Related Solutions

MATLAB: How to take advantage of useParallel option for a remote job running on workers in a MDCS cluster

MATLAB: How to determine number of workers

Related Question