PKU College of Engineering · GLOBEX

AI-Enabled Control Engineering

A hands-on summer course connecting control theory and reinforcement learning through physical experimental platforms, including rotary inverted pendulums and quadrotor UAVs.

ROS2-Based Rotary Inverted Pendulum Experimental Platform: real-time angle acquisition, control command publishing, and dynamic response visualization.

7 hardware and control classes
5+ controller families
1 physical RIP platform
3 RL algorithms: DQN, PPO, TD3

Course overview

The course is organized around the full control engineering pipeline: modeling, sensing, embedded implementation, model-based control, observer design, reinforcement learning, deployment, and hybrid control.

Model-based control

LQR and MPC

Students derive and discretize a state-space model, implement LQR and MPC, and compare their hardware behavior under real constraints.

Learning-based control

DQN, PPO, and TD3

Students train reinforcement learning policies in simulation and then study the sim-to-real gap during hardware deployment.

Integrated control

Hybrid and adaptive ideas

The final module combines switching-based hybrid control and residual model correction for improved robustness.

Latest lecture materials

Slides and course code packages are provided as downloadable resources.

All slides