MATLAB: How to implement multi-agent RL training with custom MATLAB environment function

multi agentreinforcement learningReinforcement Learning Toolboxsimulink

Hello everyone,

I have implemented one custom RL environment with MATLAB template environment class. I want to introduce multi-agents to the environment. I find all three examples provided for multi-agent RL are based on Simulink. My question is if it is at all possible to do the same with a MATLAB function? Or do I need to implement my custom RL environment in simulink to work with multi-agent RL?

Thanks.

Best Answer

Hello,

Currently multi-agent training is only supported in Simulink. If you have an environment created in MATLAB you could copy and paste the core parts like the reward and step function into a MATLAB Fcn block in Simulink as a workaround.

Related Solutions

MATLAB: How to extract a trained RL Agent’s network’s weights and biases

You can get the parameters from the trained's critic representation for DQN agent. In MATLAB R2020a, see getLearnableParameters and getCritic functions (function name changes a bit since R2019b). You can follow similar steps to get the actor's parameters from actor-based agent like DDPG or PPO.

critic = getCritic(agent);
criticParams = getLearnableParameters(critic);

MATLAB: Multi-agent deep reinforcement learning

Assuming you are training multiple agents in Simulink using the Reinforcement Learning Toolbox in R2020b:

The rewards are calculated by the environment, not the agent algorithm so they should not be affected unless the environment is changing them. When you compare rewards between single and multi-agents please ensure that the state-action pairs are the same. Rewards depend on states and actions and you may get different results for different state-action pairs.
In R2020b, the agent neural networks are updated independently.

Best Answer

Related Solutions

MATLAB: How to extract a trained RL Agent’s network’s weights and biases

MATLAB: Multi-agent deep reinforcement learning

Related Question