Intelligent Learning and Control Lab

Bosen Lian

Assistant Professor at Auburn ECE

221 Broun Hall

341 War Eagle Way

Auburn, AL 36849

Email is the best way to reach me.

Our research efforts are in distributed estimation, distributed control, reinforcement learning, game theory, and their intersections in cyber-physical feedback systems. Our primary objective is to design safe, optimal, and resilient multiagent systems and games and to solve data-driven control solutions, supported by rigorous provable analysis. Furthermore, we maintain a keen interest in the practical application of robotic platforms, spanning robot arms, unmanned vehicles, sensor networks, and more.

I obtained my Ph.D. from the University of Texas at Arlington under the supervision of Prof. Frank L. Lewis in Dec. 2021. From Dec. 2021 to Aug. 2023, I continued my research as a postdoctoral researcher working with Prof. Lewis and Prof. Ali Davoudi. During the same time period, I was appointed as an adjunct professor teaching control engineering courses at UT Arlington. Since August 2023, I’ve been an assistant professor in the Electrical and Computer Engineering Department at Auburn University. For more about me, please see my CV.

News

Oct 23, 2023	Our paper “Distributed Dynamic Clustering and Consensus in Multi-Agent Systems” is conditionally accepted in IEEE Transactions on Automatic Control.
Oct 20, 2023	Our paper “Inverse Q-learning using input-output data” is conditionally accepted in IEEE Transactions on Cybernetics.
Oct 9, 2023	Our paper “Data-Efficient Reinforcement Learning for Complex Nonlinear Systems” is accepted in IEEE Transactions on Cybernetics.
Sep 29, 2023	Our new paper “Heterogeneous multi-player imitation learning” is published at Control Theory and Technology.
Sep 7, 2023	Invited to serve as Associate Editor in Transactions of the Institute of Measurement and Control.

Selected Publications

Journal Articles

2023

Inverse reinforcement Q-learning through expert imitation for discrete-time systems

Wenqian Xue, Bosen Lian, Jialu Fan, Patrik Kolaric, Tianyou Chai, and Frank L Lewis

IEEE Transactions on Neural Networks and Learning Systems, 2023

Bib HTML Code

@article{xue2021inversf,
  title = {Inverse reinforcement Q-learning through expert imitation for discrete-time systems},
  author = {Xue, Wenqian and Lian, Bosen and Fan, Jialu and Kolaric, Patrik and Chai, Tianyou and Lewis, Frank L},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  volume = {34},
  number = {5},
  pages = {2386-2399},
  year = {2023},
  publisher = {IEEE},
}

Inverse reinforcement learning for adversarial apprentice games

Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai

IEEE Transactions on Neural Networks and Learning Systems, 2023

Bib HTML

@article{lian2021inverse,
  title = {Inverse reinforcement learning for adversarial apprentice games},
  author = {Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  volume = {34},
  number = {8},
  pages = {4596-4609},
  year = {2023},
  publisher = {IEEE},
}

Anomaly detection and correction of optimizing autonomous systems with inverse reinforcement learning

Bosen Lian, Yusuf Kartal, Frank L Lewis, Dariusz G Mikulski, Gregory R Hudas, Yan Wan, and Ali Davoudi

IEEE Transactions on Cybernetics, 2023

Bib HTML

@article{lian2022anomaly,
  title = {Anomaly detection and correction of optimizing autonomous systems with inverse reinforcement learning},
  author = {Lian, Bosen and Kartal, Yusuf and Lewis, Frank L and Mikulski, Dariusz G and Hudas, Gregory R and Wan, Yan and Davoudi, Ali},
  journal = {IEEE Transactions on Cybernetics},
  volume = {53},
  number = {7},
  year = {2023},
  pages = {4555-4566},
  publisher = {IEEE},
}

Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games

Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai, and Frank L Lewis

arXiv preprint arXiv:2301.01997, 2023

Bib HTML

@article{xue2023data,
  title = {Data-Driven Inverse Reinforcement Learning for Expert-Learner Zero-Sum Games},
  author = {Xue, Wenqian and Lian, Bosen and Fan, Jialu and Chai, Tianyou and Lewis, Frank L},
  journal = {arXiv preprint arXiv:2301.01997},
  year = {2023},
}

Inverse Reinforcement Learning for Trajectory Imitation Using Static Output Feedback Control

Wenqian Xue, Bosen Lian, Jialu Fan, Tianyou Chai, and Frank L Lewis

IEEE Transactions on Cybernetics, 2023

Bib HTML

@article{xue2023inverse,
  title = {Inverse Reinforcement Learning for Trajectory Imitation Using Static Output Feedback Control},
  author = {Xue, Wenqian and Lian, Bosen and Fan, Jialu and Chai, Tianyou and Lewis, Frank L},
  journal = {IEEE Transactions on Cybernetics},
  year = {2023},
  publisher = {IEEE},
}

Accelerated Reinforcement Learning Via Dynamic Mode Decomposition

Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi

IEEE Transactions on Control of Network Systems, 2023

Bib HTML Code

@article{donge2023accelerated,
  title = {Accelerated Reinforcement Learning Via Dynamic Mode Decomposition},
  author = {Donge, Vrushabh S and Lian, Bosen and Lewis, Frank L and Davoudi, Ali},
  journal = {IEEE Transactions on Control of Network Systems},
  year = {2023},
  publisher = {IEEE},
}

Off-policy inverse Q-learning for discrete-time antagonistic unknown systems

Bosen Lian, Wenqian Xue, Yijing Xie, Frank L Lewis, and Ali Davoudi

Automatica, 2023

Bib HTML Code

@article{lian2023off,
  title = {Off-policy inverse Q-learning for discrete-time antagonistic unknown systems},
  author = {Lian, Bosen and Xue, Wenqian and Xie, Yijing and Lewis, Frank L and Davoudi, Ali},
  journal = {Automatica},
  volume = {155},
  pages = {111171},
  year = {2023},
  publisher = {Elsevier},
}

2022

Distributed Kalman consensus filter for estimation with moving targets

Bosen Lian, Yan Wan, Ya Zhang, Mushuang Liu, Frank L Lewis, and Tianyou Chai

IEEE Transactions on Cybernetics, 2022

Bib HTML

@article{lian2020distributed,
  title = {Distributed Kalman consensus filter for estimation with moving targets},
  author = {Lian, Bosen and Wan, Yan and Zhang, Ya and Liu, Mushuang and Lewis, Frank L and Chai, Tianyou},
  journal = {IEEE Transactions on Cybernetics},
  volume = {52},
  number = {6},
  pages = {5242--5254},
  year = {2022},
  publisher = {IEEE},
}

Inverse reinforcement learning in tracking control based on inverse optimal control

Wenqian Xue, Patrik Kolaric, Jialu Fan, Bosen Lian, Tianyou Chai, and Frank L Lewis

IEEE Transactions on Cybernetics, 2022

Bib HTML Code

@article{xue2021inverse,
  title = {Inverse reinforcement learning in tracking control based on inverse optimal control},
  author = {Xue, Wenqian and Kolaric, Patrik and Fan, Jialu and Lian, Bosen and Chai, Tianyou and Lewis, Frank L},
  journal = {IEEE Transactions on Cybernetics},
  volume = {52},
  number = {10},
  pages = {10570--10581},
  year = {2022},
  publisher = {IEEE},
}

Directed graph clustering algorithms, topology, and weak links

Xiao Zhang, Bosen Lian, Frank L Lewis, Yan Wan, and Daizhan Cheng

IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2022

Bib HTML

@article{zhang2021directed,
  title = {Directed graph clustering algorithms, topology, and weak links},
  author = {Zhang, Xiao and Lian, Bosen and Lewis, Frank L and Wan, Yan and Cheng, Daizhan},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  volume = {52},
  number = {6},
  pages = {3995--4009},
  year = {2022},
  publisher = {IEEE},
}

Robustness analysis of distributed Kalman filter for estimation in sensor networks

Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai

IEEE Transactions on Cybernetics, 2022

Bib HTML

@article{lian2021robustness,
  title = {Robustness analysis of distributed Kalman filter for estimation in sensor networks},
  author = {Lian, Bosen and Lewis, Frank L and Hewer, Gary A and Estabridis, Katia and Chai, Tianyou},
  journal = {IEEE Transactions on Cybernetics},
  volume = {52},
  number = {11},
  pages = {12479--12490},
  year = {2022},
  publisher = {IEEE},
}

Robust inverse Q-learning for continuous-time linear systems in adversarial environments

Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai

IEEE Transactions on Cybernetics, 2022

Bib HTML

@article{lian2021robust,
  title = {Robust inverse Q-learning for continuous-time linear systems in adversarial environments},
  author = {Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},
  journal = {IEEE Transactions on Cybernetics},
  volume = {52},
  number = {12},
  pages = {13083--13095},
  year = {2022},
  publisher = {IEEE},
}

Online learning of minmax solutions for distributed estimation and tracking control of sensor networks in graphical games

Bosen Lian, Frank L Lewis, Gary A Hewer, Katia Estabridis, and Tianyou Chai

IEEE Transactions on Control of Network Systems, 2022

Bib HTML

@article{lian2022online,
  title = {Online learning of minmax solutions for distributed estimation and tracking control of sensor networks in graphical games},
  author = {Lian, Bosen and Lewis, Frank L and Hewer, Gary A and Estabridis, Katia and Chai, Tianyou},
  journal = {IEEE Transactions on Control of Network Systems},
  volume = {9},
  number = {4},
  pages = {1923--1936},
  year = {2022},
  publisher = {IEEE},
}

Data-driven inverse reinforcement learning control for linear multiplayer games

Bosen Lian, Vrushabh S Donge, Frank L Lewis, Tianyou Chai, and Ali Davoudi

IEEE Transactions on Neural Networks and Learning Systems, 2022

Bib HTML Code

@article{lian2022data,
  title = {Data-driven inverse reinforcement learning control for linear multiplayer games},
  author = {Lian, Bosen and Donge, Vrushabh S and Lewis, Frank L and Chai, Tianyou and Davoudi, Ali},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2022},
  publisher = {IEEE},
}

Multi-Agent Graphical Games with Inverse Reinforcement Learning

Vrushabh S Donge, Bosen Lian, Frank L Lewis, and Ali Davoudi

IEEE Transactions on Control of Network Systems, 2022

Bib HTML

@article{donge2022multi,
  title = {Multi-Agent Graphical Games with Inverse Reinforcement Learning},
  author = {Donge, Vrushabh S and Lian, Bosen and Lewis, Frank L and Davoudi, Ali},
  journal = {IEEE Transactions on Control of Network Systems},
  volume = {10},
  number = {2},
  pages = {841-852},
  year = {2022},
  publisher = {IEEE},
}

Distributed Minmax Strategy for Multiplayer Games: Stability, Robustness, and Algorithms

Bosen Lian, Vrushabh S Donge, Wenqian Xue, Frank L Lewis, and Ali Davoudi

IEEE Transactions on Neural Networks and Learning Systems, 2022

Bib HTML Code

@article{lian2022distributed,
  title = {Distributed Minmax Strategy for Multiplayer Games: Stability, Robustness, and Algorithms},
  author = {Lian, Bosen and Donge, Vrushabh S and Xue, Wenqian and Lewis, Frank L and Davoudi, Ali},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2022},
  publisher = {IEEE},
}

Inverse reinforcement learning for multi-player noncooperative apprentice games

Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai

Automatica, 2022

Bib HTML

@article{lian2022inverse,
  title = {Inverse reinforcement learning for multi-player noncooperative apprentice games},
  author = {Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},
  journal = {Automatica},
  volume = {145},
  pages = {110524},
  year = {2022},
  publisher = {Elsevier},
}

2021

Online inverse reinforcement learning for nonlinear systems with adversarial attacks

Bosen Lian, Wenqian Xue, Frank L Lewis, and Tianyou Chai

International Journal of Robust and Nonlinear Control, 2021

Bib HTML

@article{lian2021online,
  title = {Online inverse reinforcement learning for nonlinear systems with adversarial attacks},
  author = {Lian, Bosen and Xue, Wenqian and Lewis, Frank L and Chai, Tianyou},
  journal = {International Journal of Robust and Nonlinear Control},
  volume = {31},
  number = {14},
  pages = {6646--6667},
  year = {2021},
  publisher = {Wiley Online Library},
}

2018

Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction

Bosen Lian, Qingling Zhang, and Jinna Li

ISA transactions, 2018

Bib HTML

@article{lian2018sliding,
  title = {Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction},
  author = {Lian, Bosen and Zhang, Qingling and Li, Jinna},
  journal = {ISA transactions},
  volume = {83},
  pages = {1--12},
  year = {2018},
  publisher = {Elsevier},
}

Integrated sliding mode control and neural networks based packet disordering prediction for nonlinear networked control systems

Bosen Lian, Qingling Zhang, and Jinna Li

IEEE transactions on neural networks and learning systems, 2018

Bib HTML

@article{lian2018integrated,
  title = {Integrated sliding mode control and neural networks based packet disordering prediction for nonlinear networked control systems},
  author = {Lian, Bosen and Zhang, Qingling and Li, Jinna},
  journal = {IEEE transactions on neural networks and learning systems},
  volume = {30},
  number = {8},
  pages = {2324--2335},
  year = {2018},
  publisher = {IEEE},
}