Hello everyone
I'm working with a large server which is running a large computation. I've been trying to speed this up using the parallel computation toolbox, which means we need to launch and connect to a parallel pool. We've tried several ways of calling this. Right now, it looks like this:
cluster=parcluster('local'); cluster.NumWorkers=parpool_size; parpool('local', parpool_size) p = gcp('nocreate'); % If no pool, do not create new one.
if isempty(p) a = 0 else a = p.NumWorkers end
The key line is the parpool command. The size is 32 right now, but we're hoping to scale it up to 200 or so if this works well.
Unfortunately, we cannot seem to get the parpool command to operate. It does not throw an error or crash, but is taking in excess of 4 hours to execute (at which point the job times out). Does anyone has any idea why this might be the case, or if there are any suggestions which can be taken to improve execution time?
If it is relevant, to improve speed, we are running this under the 2014b MATLAB compiler on a Linux based system (v83) but we see identical problems with 2015b as well (v90).
Best Answer