Optimizing Smart City Water Distribution Systems Using Deep Reinforcement Learning

Simple item page
dc.contributor.authorZaman, Mostafa
dc.contributor.authorTantawy, Ashraf
dc.contributor.authorAbdelwahed, Sherif
dc.date.accessioned2024-06-11T13:18:44Z
dc.date.available2024-06-11T13:18:44Z
dc.date.issued2023-12-04
dc.description.abstractInefficient scheduling in water distribution systems can lead to energy waste, costly overflows, and a system that cannot keep up with demand. Simultaneous real-time management of system components such as pumps and valves to optimize operation in response to demand variations is a challenging task. Recent advances in deep reinforcement learning provides an opportunity to overcome the state explosion problem using function approximation to generalize from a limited interaction with the environment. In this work, we train a Long Short-Term Memory (LSTM) based Reinforcement Learning (RL) agent to optimize the energy usage of a smart water distribution system while maintaining a safe operating envelope. We compare the performance of the RL agent to two agents based on human experience in the domain; a baseline controller that is based on simple operational logic, and a fuzzy logic controller that captures imprecise human requirements. We show that the RL agent outperforms the other agents in terms of energy usage and operational safety, indicating its potential benefits for large-scale smart city systems. Future research work will focus on prioritized large-scale system scheduling to cope with smart city emergency situations.
dc.funderOther external funder (please detail below)
dc.funder.otherCommonwealth Cyber Initiative (CCI), VA, USA
dc.identifier.citationZaman, M., Tantawy, A. and Abelwahed, S. (2023) Optimizing Smart City Water Distribution Systems Using Deep Reinforcement Learning. IEEE 20th International Conference on Smart Communities: Improving Quality of Life using AI, Robotics and IoT (HONET), Florida, December 2023.
dc.identifier.doihttps://doi.org/10.1109/honet59747.2023.10374894
dc.identifier.isbn9798350331110
dc.identifier.issn1949-4106
dc.identifier.urihttps://hdl.handle.net/2086/23854
dc.language.isoen
dc.peerreviewedYes
dc.publisherIEEE
dc.relation.ispartof2023 IEEE 20th International Conference on Smart Communities: Improving Quality of Life using AI, Robotics and IoT (HONET)
dc.researchinstituteInstitute of Artificial Intelligence (IAI)
dc.titleOptimizing Smart City Water Distribution Systems Using Deep Reinforcement Learning
dc.typeConference

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
OptimizingSmartCityWaterDistributionSystemsusingDeepReinforcementLearning.pdf
Size:
1.45 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

School of Computer Science and Informatics