MATLAB: Enable multi-threading on a parfor loop

multi-threadingparforr2012b

Hi everyone,

I have a read a lot of stuff on multi-threading on Matlab but i am a bit lost between all the versions/revisions on this topic. I have a code that mostly runs a parfor loop. This sends to my workers work to do, in single-threaded mode as i can see on my task manager. My question is : despite the overlapping issues that may arise, is there a way in Matlab 2012b and higher to force the multi-thread mode on this parfor loop ?

Thanks in advance,

Alex

Best Answer

You can use the maxNumCompThreads function (from within an SPMD block for example) to control the number of threads used by the workers. (Yes, this function is deprecated, but unfortunately there is currently no alternative).

Related Solutions

MATLAB: Can the Parallel Computing Toolbox and the MATLAB Distributed Computing Server take advantage of nondistributed systems such as multi-CPU systems

For MATLAB R2016b onward, the Parallel Computing Toolbox (PCT) provides the ability to run up to 512 local MATLAB “workers” on the same machine to perform computations. These workers can potentially leverage the additional computing power available in multi-core and multi-processor machines. Note that these worker processes are associated with the session of MATLAB from which they were invoked as well as the user who invoked these processes. As a result, the worker processes can not be accessed by multiple users.

As of MATLAB R2016b, PCT workers can be run in multithreaded mode so you can increase the number of computational threads without increasing the number of workers. This is seen in the following MATLAB release notes:

http://www.mathworks.com/help/distcomp/release-notes.html#bvczl_g-1

MATLAB itself has no limit on the number of computational threads. However, it is important to note that it is recommended to not have more computational threads from all MATLAB processes on a system than the number of physical cores.

Therefore, let's say you have 2 CPUs, 8 cores/CPU and so there are 16 physical cores. This setup can be used by any one of the following:

• A single MATLAB client with 16 computational threads

• 16 PCT local workers, each running single-threaded

• 8 PCT local workers, each running with 2 computational threads

• 4 PCT local workers, each running with 4 computational threads

For more information, refer to the following MATLAB documentation: <http://www.mathworks.com/help/distcomp/discover-clusters-and-use-cluster-profiles.html#f5-16540>

For MATLAB R2016a and earlier, local MATLAB workers can only run in single-threaded mode.

For MATLAB R2013b and earlier, the number of local workers is limited to twelve.

Alternatively, the MATLAB Distributed Computing Server can be used to start up a job manager and multiple workers on a multi-core or multi-CPU system. Even in the case of computing clusters that contain a mix of single CPU and multiple CPU machines, workers can be utilized on a per-core or per-CPU basis. Refer to the Related Solution for some guidelines to help you determine how many worker sessions to run on one computer.

When executing parallel jobs, workers communicate using MPI even if they are running on the same physical computer. However, you can choose to use a version of MPI that is optimized for Shared-Memory Processor systems.

Refer to the documentation for the mpiLibConf function (enter the following at the MATLAB command prompt)

 web([docroot, '/toolbox/distcomp/mpilibconf.html'])

for information on using alternative versions of MPI instead of the build of MPICH2 that the MATLAB Distributed Computing Server uses by default.

MATLAB: Does MATLAB R2013a only use about 50% of a 4 core 8 threads CPU at most

INV will run on multiple threads in R2013a by default. However, currently the maximum number of threads that MATLAB will choose is equal to the maximum number of physical cores (instead of threads, or logical cores) of the CPU. Therefore, the code will only use 4 threads at most on a CPU with 4 cores 8 threads.

With a 4 cores 8 threads CPU, Windows displays it as having 8 logical cores in the Task Manager. The 4 threads from MATLAB will show up as occupying 4 logical cores in Windows Task Manager. Even the 4 MATLAB threads occupy the 4 logical cores 100% of the time , the CPU usage only shows 50% instead of 100% because only 4 out of 8 logical cores are used.

Some CPUs haves two logical cores assigned to one physical core is because this allows scheduling two threads to run on the same physical core simultaneously. This can offer potential speed gains, especially if each of the threads has some significant idle time in it.

Usually, using more number of threads than the number of physical cores provides little gain in speed, sometimes even results in reduction of speed because of the overhead involved in managing the extra threads. This is especially true if the code involved does not have significant CPU idle time.

Best Answer

Related Solutions

MATLAB: Can the Parallel Computing Toolbox and the MATLAB Distributed Computing Server take advantage of nondistributed systems such as multi-CPU systems

MATLAB: Does MATLAB R2013a only use about 50% of a 4 core 8 threads CPU at most

Related Question