Overview
This project focused on bridging reinforcement learning with physical embedded hardware. I designed the CAD models, 3D printed the physical components, and built a custom Gymnasium training environment in MuJoCo.
After training the Proximal Policy Optimization (PPO) policy, I exported the neural network weights to a C++ header file and deployed the inference engine onto a custom ESP32 hardware setup for real-time balancing.