Dear experts,
What is the default floating point precision when using mexcuda to compile a cuda project that enters from a mex file?
I am doing some image processing operations on the GPU, and the collected result differs in the order of 10^-5 per pixel when the pixel values are scaled between [0, 1]. I am trying to figure out if this could be due to (accumulating) floating point precision inaccuracy or if I need to try to spot some small bugs.
I do use doubles and not floats in my cuda kernels, but I have read that for some nvcc compiler settings the doubles might be silently cast to floats instead. What is the case with the default mexcuda settings?
I am using Matlab 2018a, Cuda Toolkit 9.0, Cuda driver 9.2 and compile with the command mexcuda -dynamic mexWrapper.cu.
Thankful for any input!
Best Answer