How to access parts of distributed data on the workers/labs ?
I have a large timeseries data and want to run some functions on smaller chunks of it. Have a working parfor implementation.
Want to try it with distributed array/spmd, but don't know how to access the local data once I distribute the array.
matlabpool start 100; size(myMat) = 800000 x 2 myMatdb= distributed(myMat'); spmd chunk_of_data = myMatdb; [out_of_chunk] = objFun(params, chunk_of_data); end
Works but all the labs/workers have full data rather than a small chunk of it.
I would like to explore codistributed with codistributor1d option to have more control over the distribution. Still, how do I tell the worker to operate only on its local copy but not the total Composite.
For some strange reason, functions like getLocalPart,localPart etc., aren't available on my Matlab r2011b.
Best Answer