Multi-Agents For CPS Based Smart Building Control: Saurav Bhattarai Advisor: Prof. Marcelo Simões
Multi-Agents For CPS Based Smart Building Control: Saurav Bhattarai Advisor: Prof. Marcelo Simões
Communication
Constant communication between different systems
Legacy Systems
Existing buildings do not have all the infrastructure for being smart
Advantages
Distributed computing resources Failures are not system-wide Modular Parallelism
Decentralized Control
Proposed Structure
Multi-agent approach Three agents
Electrical Heating/Cooling Comfort
Controlling mechanism
Cost functions Agent Behavior Reduces redundancy between agents
Multi-Agent Structure
The proposed MAS structure includes 3 agents: Electrical, Heating/Cooling, and Comfort. All the agents have communication channels between them. This allows for the agents to work together to reach the global system goal. Agents are connected to the different physical systems, allowing them to perform actions on and sense the building environment
Error tolerance = 5% 50% reduction of expected utility per state change (=0.5) o Utility values settled in 6 iterations 30% reduction of expected utility per state change(=0.7) o Utility values settled in 12 iterations o More flexibility to move between states to maximize utility value
A scenario involving the comfort agent was selected o Temperature control Transition values (probabilities) assigned for actions Utility values of each state calculated using Value Iteration algorithm to solve Bellman update equation.
u t 1 ( s ) r ( s ) max T ( s, a, s ' )u t ( s ' )
a a'
Future Work
Use transition values obtained from studying a physical system to calculate realistic utility values Implement a communication scheme between multiple agents Define states using Fuzzy Logic Build full algorithm for calculating optimal policies for all agents