This Software was developed under Research Sponsored by: Army Research Office, Army DEVCOM Office of Naval Research
Note: Only a few example papers come with code. If you have trouble making it work, please figure it out yourself. The methods are explained in the papers.
Journal Articles
2023
Inverse reinforcement Q-learning through expert imitation for discrete-time systems
Wenqian Xue, Bosen Lian, Jialu Fan, Patrik Kolaric, Tianyou Chai, and Frank L Lewis
IEEE Transactions on Neural Networks and Learning Systems, 2023
@article{xue2021inversf,title={Inverse reinforcement Q-learning through expert imitation for discrete-time systems},author={Xue, Wenqian and Lian, Bosen and Fan, Jialu and Kolaric, Patrik and Chai, Tianyou and Lewis, Frank L},journal={IEEE Transactions on Neural Networks and Learning Systems},volume={34},number={5},pages={2386-2399},year={2023},publisher={IEEE},}
Inverse reinforcement learning for adversarial apprentice games
Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
IEEE Transactions on Neural Networks and Learning Systems, 2023
@article{lian2021inverse,title={Inverse reinforcement learning for adversarial apprentice games},author={Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},journal={IEEE Transactions on Neural Networks and Learning Systems},volume={34},number={8},pages={4596-4609},year={2023},publisher={IEEE},}
Anomaly detection and correction of optimizing autonomous systems with inverse reinforcement learning
Bosen Lian, Yusuf Kartal, Frank L Lewis, Dariusz G Mikulski, Gregory R Hudas, Yan Wan, and Ali Davoudi
@article{lian2022anomaly,title={Anomaly detection and correction of optimizing autonomous systems with inverse reinforcement learning},author={Lian, Bosen and Kartal, Yusuf and Lewis, Frank L and Mikulski, Dariusz G and Hudas, Gregory R and Wan, Yan and Davoudi, Ali},journal={IEEE Transactions on Cybernetics},volume={53},number={7},year={2023},pages={4555-4566},publisher={IEEE},}
Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games
Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai, and Frank L Lewis
@article{xue2023data,title={Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games},author={Xue, Wenqian and Lian, Bosen and Fan, Jialu and Chai, Tianyou and Lewis, Frank L},journal={arXiv preprint arXiv:2301.01997},year={2023},}
Inverse Reinforcement Learning for Trajectory Imitation Using Static Output Feedback Control
Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai, and Frank L Lewis
@article{xue2023inverse,title={Inverse Reinforcement Learning for Trajectory Imitation Using Static Output Feedback Control},author={Xue, Wenqian and Lian, Bosen and Fan, Jialu and Chai, Tianyou and Lewis, Frank L},journal={IEEE Transactions on Cybernetics},year={2023},publisher={IEEE},}
Accelerated Reinforcement Learning Via Dynamic Mode Decomposition
Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
IEEE Transactions on Control of Network Systems, 2023
@article{donge2023accelerated,title={Accelerated Reinforcement Learning Via Dynamic Mode Decomposition},author={Donge, Vrushabh S and Lian, Bosen and Lewis, Frank L and Davoudi, Ali},journal={IEEE Transactions on Control of Network Systems},year={2023},publisher={IEEE},}
Off-policy inverse Q-learning for discrete-time antagonistic unknown systems
Bosen Lian, Wenqian Xue, Yijing Xie, Frank L Lewis, and Ali Davoudi
@article{lian2023off,title={Off-policy inverse Q-learning for discrete-time antagonistic unknown systems},author={Lian, Bosen and Xue, Wenqian and Xie, Yijing and Lewis, Frank L and Davoudi, Ali},journal={Automatica},volume={155},pages={111171},year={2023},publisher={Elsevier},}
2022
Distributed Kalman consensus filter for estimation with moving targets
Bosen Lian, Yan Wan, Ya Zhang, Mushuang Liu, Frank L Lewis, and Tianyou Chai
@article{lian2020distributed,title={Distributed Kalman consensus filter for estimation with moving targets},author={Lian, Bosen and Wan, Yan and Zhang, Ya and Liu, Mushuang and Lewis, Frank L and Chai, Tianyou},journal={IEEE Transactions on Cybernetics},volume={52},number={6},pages={5242--5254},year={2022},publisher={IEEE},}
Inverse reinforcement learning in tracking control based on inverse optimal control
Wenqian Xue, Patrik Kolaric, Jialu Fan, Bosen Lian, Tianyou Chai, and Frank L Lewis
@article{xue2021inverse,title={Inverse reinforcement learning in tracking control based on inverse optimal control},author={Xue, Wenqian and Kolaric, Patrik and Fan, Jialu and Lian, Bosen and Chai, Tianyou and Lewis, Frank L},journal={IEEE Transactions on Cybernetics},volume={52},number={10},pages={10570--10581},year={2022},publisher={IEEE},}
Directed graph clustering algorithms, topology, and weak links
Xiao Zhang, Bosen Lian, Frank L Lewis, Yan Wan, and Daizhan Cheng
IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022
@article{zhang2021directed,title={Directed graph clustering algorithms, topology, and weak links},author={Zhang, Xiao and Lian, Bosen and Lewis, Frank L and Wan, Yan and Cheng, Daizhan},journal={IEEE Transactions on Systems, Man, and Cybernetics: Systems},volume={52},number={6},pages={3995--4009},year={2022},publisher={IEEE},}
Robustness analysis of distributed Kalman filter for estimation in sensor networks
Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai
@article{lian2021robustness,title={Robustness analysis of distributed Kalman filter for estimation in sensor networks},author={Lian, Bosen and Lewis, Frank L and Hewer, Gary A and Estabridis, Katia and Chai, Tianyou},journal={IEEE Transactions on Cybernetics},volume={52},number={11},pages={12479--12490},year={2022},publisher={IEEE},}
Robust inverse Q-learning for continuous-time linear systems in adversarial environments
Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
@article{lian2021robust,title={Robust inverse Q-learning for continuous-time linear systems in adversarial environments},author={Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},journal={IEEE Transactions on Cybernetics},volume={52},number={12},pages={13083--13095},year={2022},publisher={IEEE},}
Online learning of minmax solutions for distributed estimation and tracking control of sensor networks in graphical games
Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai
IEEE Transactions on Control of Network Systems, 2022
@article{lian2022online,title={Online learning of minmax solutions for distributed estimation and tracking control of sensor networks in graphical games},author={Lian, Bosen and Lewis, Frank L and Hewer, Gary A and Estabridis, Katia and Chai, Tianyou},journal={IEEE Transactions on Control of Network Systems},volume={9},number={4},pages={1923--1936},year={2022},publisher={IEEE},}
Data-driven inverse reinforcement learning control for linear multiplayer games
Bosen Lian, Vrushabh S Donge, Frank L Lewis, Tianyou Chai, and Ali Davoudi
IEEE Transactions on Neural Networks and Learning Systems, 2022
@article{lian2022data,title={Data-driven inverse reinforcement learning control for linear multiplayer games},author={Lian, Bosen and Donge, Vrushabh S and Lewis, Frank L and Chai, Tianyou and Davoudi, Ali},journal={IEEE Transactions on Neural Networks and Learning Systems},year={2022},publisher={IEEE},}
Multi-Agent Graphical Games with Inverse Reinforcement Learning
Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
IEEE Transactions on Control of Network Systems, 2022
@article{donge2022multi,title={Multi-Agent Graphical Games with Inverse Reinforcement Learning},author={Donge, Vrushabh S and Lian, Bosen and Lewis, Frank L and Davoudi, Ali},journal={IEEE Transactions on Control of Network Systems},volume={10},number={2},pages={841-852},year={2022},publisher={IEEE},}
Distributed Minmax Strategy for Multiplayer Games: Stability, Robustness, and Algorithms
Bosen Lian, Vrushabh S Donge, Wenqian Xue, Frank L Lewis, and Ali Davoudi
IEEE Transactions on Neural Networks and Learning Systems, 2022
@article{lian2022distributed,title={Distributed Minmax Strategy for Multiplayer Games: Stability, Robustness, and Algorithms},author={Lian, Bosen and Donge, Vrushabh S and Xue, Wenqian and Lewis, Frank L and Davoudi, Ali},journal={IEEE Transactions on Neural Networks and Learning Systems},year={2022},publisher={IEEE},}
Inverse reinforcement learning for multi-player noncooperative apprentice games
Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
@article{lian2022inverse,title={Inverse reinforcement learning for multi-player noncooperative apprentice games},author={Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},journal={Automatica},volume={145},pages={110524},year={2022},publisher={Elsevier},}
2021
Online inverse reinforcement learning for nonlinear systems with adversarial attacks
Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
International Journal of Robust and Nonlinear Control, 2021
@article{lian2021online,title={Online inverse reinforcement learning for nonlinear systems with adversarial attacks},author={Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},journal={International Journal of Robust and Nonlinear Control},volume={31},number={14},pages={6646--6667},year={2021},publisher={Wiley Online Library},}
2018
Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction
@article{lian2018sliding,title={Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction},author={Lian, Bosen and Zhang, Qingling and Li, Jinna},journal={ISA transactions},volume={83},pages={1--12},year={2018},publisher={Elsevier},}
Integrated sliding mode control and neural networks based packet disordering prediction for nonlinear networked control systems
Bosen Lian, Qingling Zhang, and Jinna Li
IEEE transactions on neural networks and learning systems, 2018
@article{lian2018integrated,title={Integrated sliding mode control and neural networks based packet disordering prediction for nonlinear networked control systems},author={Lian, Bosen and Zhang, Qingling and Li, Jinna},journal={IEEE transactions on neural networks and learning systems},volume={30},number={8},pages={2324--2335},year={2018},publisher={IEEE},}
Conference Articles
2022
Inverse Reinforcement Learning Control for Linear Multiplayer Games
Bosen Lian, Vrushabh S Donge, Frank L Lewis, Tianyou Chai, and Ali Davoudi
In 2022 IEEE 61st Conference on Decision and Control (CDC), 2022
2021
Inverse reinforcement learning for multi-player apprentice games in continuous-time nonlinear systems
Bosen Lian, Wenqian Xue, Frank L Lewis, Tianyou Chai, and Ali Davoudi
In 2021 60th IEEE Conference on Decision and Control (CDC), 2021
2019
Distributed consensus-based Kalman filtering for estimation with multiple moving targets
Bosen Lian, Yan Wan, Ya Zhang, Mushuang Liu, Frank L Lewis, Alexandra Abad, Tina Setter, and 2 more authors
In 2019 IEEE 58th Conference on Decision and Control (CDC), 2019
Books
2023
Integral And Inverse Reinforcement Learning For Optimal Control Systems And Games
Bosen Lian, Wenqian Xue, Frank L Lewis, Hamidreza Modares, and Bahare Kiumarsi
