Publications

Please check the up-to-date list on Google Scholar.

This Software was developed under Research Sponsored by:
National Science Foundation (NSF)
Army Research Office (ARO)
Office of Naval Research (ONR)

Note: Only a few example papers come with code. If you have trouble making it work, please figure it out yourself. The methods are explained in the papers.

Note: Publications are listed by their publication dates unless they have not yet been published.

Books

2024

  1. book.png
    Integral and Inverse Reinforcement Learning for Optimal Control Systems and Games
    Bosen Lian, Wenqian Xue, Frank L Lewis, Hamidreza Modares, and Bahare Kiumarsi
    2024

Book Chapters

2026

  1. Encyclopedia.jpg
    Inverse Reinforcement Learning of Differential Games
    Bosen Lian, Wenqian Xue, and Frank L Lewis
    In Encyclopedia of Systems and Control, Sep 2026
  2. Encyclopedia.jpg
    Data-Driven Control and Multi-Agent Reinforcement Learning of Cyber-Physical Systems
    Shan Zuo, Bosen Lian, and Yi Zhang
    In Encyclopedia of Systems and Control, Sep 2026

Journal & Conference Publications

2026

  1. draw.png
    Inverse Reinforcement Learning for Disturbed Networked Nonlinear Systems With Data Dropouts
    Pengfei Shi, Wenqian Xue, Jialu Fan, Frank L Lewis, and Bosen Lian
    IEEE Transactions on Neural Networks and Learning Systems, Apr 2026
  2. turbine.png
    Data-Driven Inverse Reinforcement Learning for Markov Multiplayer Tidal Turbine Systems
    Jiacheng Wu, and Bosen Lian
    IEEE Transactions on Automation Science and Engineering, Apr 2026
  3. wufilter.png
    Distributed FilterNet Reinforcement Learning for Achieving Output Consensus in Heterogeneous Multiplayer Multiagent Systems
    Jiacheng Wu, Bosen Lian, Changyun Wen, and Yang Zhu
    IEEE Transactions on Neural Networks and Learning Systems, Feb 2026
  4. Initially.png
    Initially Excited Asynchronous Reinforcement Learning Control With Monotonicity and Stability
    Jiacheng Wu, Wenqian Xue, Frank L Lewis, and Bosen Lian
    IEEE Transactions on Systems, Man, and Cybernetics: Systems, Feb 2026
  5. nguyen.png
    Interactions of Time-Scale Separated Hybrid Adaptive Systems
    Nhan T Nguyen, and Bosen Lian
    In AIAA SCITECH 2026 Forum, Jan 2026

2025

  1. Global Nash Containment.png
    Distributed Global Nash Containment Control and Learning of Multiplayer Multiagent Systems
    Yizhong Zhang, Bosen Lian, Wenqian Xue, Dariusz G Mikulski, and Gregory R Hudas
    IEEE Transactions on Automation Science and Engineering, Nov 2025
  2. wustructure.png
    Data-driven weighted H-infinity control of persistent dwell time switched systems with optimal disturbance attenuation guaranteed
    Jiacheng Wu, Bosen Lian, Hongye Su, and Yang Zhu
    IEEE Transactions on Automation Science and Engineering, Oct 2025
  3. path.png
    Improved DV-Hop Localization With Optimized Anchor Selection in Anisotropic Networks
    Ruizhuo Song, Shi Xing, and Bosen Lian
    IEEE Transactions on Vehicular Technology, Oct 2025
  4. UAVcluster.png
    Distributed cluster containment control of swarms via differential game-theoretic learning
    Bosen Lian, Nhan T Nguyen, and Frank L Lewis
    Unmanned Systems, Oct 2025
  5. wuoverviw.png
    Reinforcement learning-based H-infinity control of 2-D Markov jump roesser systems with optimal disturbance attenuation
    Jiacheng Wu, Bosen Lian, Hongye Su, and Yang Zhu
    IEEE Transactions on Neural Networks and Learning Systems, Jul 2025
  6. wustructure2.png
    Data-Driven Optimization-Based Cost and Optimal Control Inference
    Jiacheng Wu, Wenqian Xue, Frank L Lewis, and Bosen Lian
    IEEE Control Systems Letters, Jul 2025
  7. certifiedIRL.png
    Certified data-driven inverse reinforcement learning of Markov jump systems
    Wenqian Xue, Frank L Lewis, and Bosen Lian
    Automatica, Jun 2025
  8. diagram.png
    Inverse value iteration and Q-learning: Algorithms, stability, and robustness
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Neural Networks and Learning Systems, Apr 2025
  9. Drawing1.png
    Inverse reinforcement learning for discrete-time systems with data dropouts
    Jialu Fan, Pengfei Shi, Wenqian Xue, Bosen Lian, Yunfang Cui, and Frank L Lewis
    IEEE Transactions on Cybernetics, Apr 2025
  10. P2.png
    Efficient Reward Shaping for Multiagent Systems
    Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Control of Network Systems, Mar 2025
  11. structure.png
    Nash-minmax strategy for multiplayer multiagent graphical games with reinforcement learning
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Control of Network Systems, Mar 2025

2024

  1. liu.png
    Dynamic Self-Triggered Parallel Control of Guidance Intercept Systems With Constrained Inputs via Adaptive Dynamic Programming
    Lu Liu, Ruizhuo Song, and Bosen Lian
    International Journal of Robust and Nonlinear Control, Oct 2024
  2. diagm.png
    Distributed dynamic clustering and consensus in multiagent systems
    Bosen Lian, Ahmet Taha Koru, Wenqian Xue, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Automatic Control, Sep 2024
  3. modelfreeHIRL.png
    Model-free inverse H-infinity control for imitation learning
    Wenqian Xue, Bosen Lian, Yusuf Kartal, Jialu Fan, Tianyou Chai, and Frank L Lewis
    IEEE Transactions on Automation Science and Engineering, Jul 2024
  4. distributedminmax.jpg
    Distributed Minmax Strategy for Multiplayer Games: Stability, Robustness, and Algorithms
    Bosen Lian, Vrushabh S Donge, Wenqian Xue, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Neural Networks and Learning Systems, Mar 2024
  5. xue2023trajectoryimation.jpg
    Inverse Reinforcement Learning for Trajectory Imitation Using Static Output Feedback Control
    Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai, and Frank L Lewis
    IEEE Transactions on Cybernetics, Mar 2024
  6. donedataefficient.png
    Data-efficient reinforcement learning for complex nonlinear systems
    Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Cybernetics, Mar 2024
  7. linearmultiplayerIRL.jpg
    Data-driven inverse reinforcement learning control for linear multiplayer games
    Bosen Lian, Vrushabh S Donge, Frank L Lewis, Tianyou Chai, and Ali Davoudi
    IEEE Transactions on Neural Networks and Learning Systems, Feb 2024
  8. dia.png
    Inverse Q-learning using input–output data
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Cybernetics, Feb 2024

2023

  1. donge2023acceleratedRL.jpg
    Accelerated Reinforcement Learning Via Dynamic Mode Decomposition
    Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Control of Network Systems, Dec 2023
  2. lian2023offinverseQ.jpg
    Off-policy inverse Q-learning for discrete-time antagonistic unknown systems
    Bosen Lian, Wenqian Xue, Yijing Xie, Frank L Lewis, and Ali Davoudi
    Automatica, Sep 2023
  3. irlaag.jpg
    Inverse reinforcement learning for adversarial apprentice games
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
    IEEE Transactions on Neural Networks and Learning Systems, Aug 2023
  4. anomalyspace1.png
    Anomaly detection and correction of optimizing autonomous systems with inverse reinforcement learning
    Bosen Lian, Yusuf Kartal, Frank L Lewis, Dariusz G Mikulski, Gregory R Hudas, Yan Wan, and Ali Davoudi
    IEEE Transactions on Cybernetics, Jul 2023
  5. donge2022multiIRL.jpg
    Multi-Agent Graphical Games with Inverse Reinforcement Learning
    Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi
    IEEE Transactions on Control of Network Systems, Jun 2023
  6. xue2021inverseQ.jpg
    Inverse reinforcement Q-learning through expert imitation for discrete-time systems
    Wenqian Xue, Bosen Lian, Jialu Fan, Patrik Kolaric, Tianyou Chai, and Frank L Lewis
    IEEE Transactions on Neural Networks and Learning Systems, May 2023

2022

  1. robust-inverseQ.jpg
    Robust inverse Q-learning for continuous-time linear systems in adversarial environments
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
    IEEE Transactions on Cybernetics, Dec 2022
  2. onlineminmax.jpg
    Online learning of minmax solutions for distributed estimation and tracking control of sensor networks in graphical games
    Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai
    IEEE Transactions on Control of Network Systems, Dec 2022
  3. IRLcdc2022.png
    Inverse Reinforcement Learning Control for Linear Multiplayer Games
    Bosen Lian, Vrushabh S Donge, Frank L Lewis, Tianyou Chai, and Ali Davoudi
    In 2022 IEEE 61st Conference on Decision and Control (CDC), Dec 2022
  4. DKCFrobustness.jpg
    Robustness analysis of distributed Kalman filter for estimation in sensor networks
    Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai
    IEEE Transactions on Cybernetics, Nov 2022
  5. multi-player noncooperative.jpg
    Inverse reinforcement learning for multi-player noncooperative apprentice games
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
    Automatica, Nov 2022
  6. irlioc.jpg
    Inverse reinforcement learning in tracking control based on inverse optimal control
    Wenqian Xue, Patrik Kolaric, Jialu Fan, Bosen Lian, Tianyou Chai, and Frank L Lewis
    IEEE Transactions on Cybernetics, Oct 2022
  7. DKCF.jpg
    Distributed Kalman consensus filter for estimation with moving targets
    Bosen Lian, Yan Wan, Ya Zhang, Mushuang Liu, Frank L Lewis, and Tianyou Chai
    IEEE Transactions on Cybernetics, Jun 2022
  8. weaklink.jpg
    Directed graph clustering algorithms, topology, and weak links
    Xiao Zhang, Bosen Lian, Frank L Lewis, Yan Wan, and Daizhan Cheng
    IEEE Transactions on Systems, Man, and Cybernetics: Systems, Jun 2022

2021

  1. IRLcdc2021.png
    Inverse reinforcement learning for multi-player apprentice games in continuous-time nonlinear systems
    Bosen Lian, Wenqian Xue, Frank L Lewis, Tianyou Chai, and Ali Davoudi
    In 2021 60th IEEE Conference on Decision and Control (CDC), Dec 2021
  2. onlineinverseattack.jpg
    Online inverse reinforcement learning for nonlinear systems with adversarial attacks
    Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai
    International Journal of Robust and Nonlinear Control, Jun 2021

2019

  1. dkcfcdc.png
    Distributed consensus-based Kalman filtering for estimation with multiple moving targets
    Bosen Lian, Yan Wan, Ya Zhang, Mushuang Liu, Frank L Lewis, Alexandra Abad, Tina Setter, and 2 more authors
    In 2019 IEEE 58th Conference on Decision and Control (CDC), Dec 2019

2018

  1. SMCNN.jpg
    Integrated sliding mode control and neural networks based packet disordering prediction for nonlinear networked control systems
    Bosen Lian, Qingling Zhang, and Jinna Li
    IEEE Transactions on Neural Networks and Learning Systems, Dec 2018
  2. SMCMDP.jpg
    Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction
    Bosen Lian, Qingling Zhang, and Jinna Li
    ISA transactions, Nov 2018

Copyright © 2026 Bosen Lian. All rights reserved.