Documentation for parallel.pool.DataQueue and parallel.pool.PollableDataQueue says next to nothing about how data is transferred between the client and workers. I have two questions in particular about this functionality, although any related details would be much appreciated.
- What can or can't be sent through the queue. During debugging I sent a daq session through the queue and although it appeared to transfer fine all the properties of the class were empty.
- My understanding is that workers and the client are in separate processes (with separate memory management). When sending data through a queue what sort of locking takes place to transfer data between the processes? For example, does the worker somehow lock the client's memory management system while sending a message to the client, and similarly, have to wait for that lock if the client is doing memory allocation?
Best Answer