MATLAB: Trying to read text file inside parfor loop versus passing it as a parameter

parallel computingparforread file

I have a couple txt/csv files that contain upward to 5000 lines. Each line contains information that I intend to read in as input to a function inside parfor loop. Is it best if I read the text files as a matrix/struct/etc. and the parfor loop can access the information from said matrix/struct? Or is it better have the part that read files inside the parfor loop?

Best Answer

Hi Giang Le,

Assuming that you are trying to call a function with its parameters read from a file parallelly. However, using IO functions inside parfor loop can be slow. Hence as suggested by Sami, read the data before hand using readmatrix and then pass the content as parameters to function parallelly using parfor.

Hope this helps!

Related Solutions

MATLAB: GlobalSearch inside parfor loop

Take everything inside the parfor loop and refactor it to a local or separate file function. Parfor loops should be as simple as possible:

parfor ii = 1:10
    r(ii) = runGS(parameter(ii))
end

And

function r = runGS(param)
    % Call global search etc.
end

MATLAB: Are temporary variables eliminated at the end of each parfor loop on every single worker

Yes, as mentioned in the documentation https://www.mathworks.com/help/parallel-computing/temporary-variable.html temporary variables are never sent back to the client. There are two ways to get results out of a parfor loop: either use sliced output variables, or reduction output variables. These variable types are explained here https://www.mathworks.com/help/parallel-computing/troubleshoot-variables-in-parfor-loops.html .

Best Answer

Related Solutions

MATLAB: GlobalSearch inside parfor loop

MATLAB: Are temporary variables eliminated at the end of each parfor loop on every single worker

Related Question