MATLAB: Trying to load previously saved agent fails (Reinforcement Learning Toolbox)

agentMATLAB and Simulink Student Suitereinforcement learningReinforcement Learning Toolbox

Hello,

I have problems to load an agent, that I have trained before. When I try to open the preconfigured examples from Mathworks (e.g. the Watertank model) I can load the existing agent and everything works fine. However, when I train the model first, save the agent and then load this agent I get a warning saying: "Warning: Variable 'agent' not found."

This happens also for other models and I don´t understand why… Can somebody help me out on this?

Best Answer

Just managed to solve this problem by myself.

In case anyone else has the same problem:

In order to load your saved agent you have to use the following code snippet:

load('Agent123.mat','saved_agent');
agent = saved_agent;

Related Solutions

MATLAB: How to extract the trained actor network from the trained agent in Matlab environment? (Reinforcement Learning Toolbox)

You can collect the actor (or policy) from the trained agent with getActor. Then, you can use the actor to predict the best action from an observation wtih getAction.

% get actor representation
actor = getActor(agent);
% actor predicts an action given an observation
action = getAction(actor, observation)

If you want to go further, have a look at the Implement REINFORCE from scratch example

MATLAB: Invalid input argument type or size such as observation, reward, isdone or loggedSignals. (Reinforcement learning toolbox)

Hello,

It's challenging to reproduce this without having access to a reproduction model (including the environment definition).

I would recommend comparing your code with this example which is similar in nature (has multiple discrete actions) and particularly lines 237-248 in RocketLander.m. Make sure each element in your cell array has appropriate dimensions whether that's 1x2 or 2x1.

If this does not work, check the dimensions of the IsDone and reward signal as well and make sure these are scalars.

Best Answer

Related Solutions

MATLAB: How to extract the trained actor network from the trained agent in Matlab environment? (Reinforcement Learning Toolbox)

MATLAB: Invalid input argument type or size such as observation, reward, isdone or loggedSignals. (Reinforcement learning toolbox)

Related Question