MATLAB: Discrete weights with neural network toolbox

annDeep Learning Toolboxneural networknntoolboxweights

Hello, I am building a custom neural network. In the application I am attempting to model it is only possible to have weights of discrete values [-2, -1, 0, 1, 2]. I want to use this network to perform the training using the built-in functions, but don't want to get weights back that are 1.24345932 and have to round it and sacrifice accuracy in the testing phase. I have found some documentation that you can use the command net.inputs{1}.exampleInput = […] but it doesn't realize that I want the values to be discrete and it resets the size of the inputs. Thank you!

Best Answer

Constraining network weights is not possible with the built-in Neural Network Toolbox functions as the training algorithms are all gradient-based. If you would like to implement your own training algorithm, consider using the intlinprog or ga functions which perform mixed-integer optimization.

Related Solutions

MATLAB: How to train a feedfordward neural network with error weights

 Use the command window
 help mse
 doc mse

Hope this helps.

Thank you for formally accepting my answer

Greg

MATLAB: Does train function return neural network with the weights of last epoch or the weights of the model with the smallest loss of all epochs

You can refer to Early Stopping & Improve Shallow Neural Network Generalization and Avoid Overfitting documentation.

According to it "When the validation error increases for a specified number of iterations (net.trainParam.max_fail), the training is stopped, and the weights and biases at the minimum of the validation error are returned."

For more information on the "net.trainParam.max_fail" parameter, enter the following in command window:

help nnparam.max_fail

Best Answer

Related Solutions

MATLAB: How to train a feedfordward neural network with error weights

MATLAB: Does train function return neural network with the weights of last epoch or the weights of the model with the smallest loss of all epochs

Related Question