Intuitive Engineering as a Proxy Facilitates the Evolutionary Optimization of an Underactuated Robot Ball
In Workshop on Embodiment-Aware Robot Learning @ RSS 2024, 2024
Underactuation can enable low-cost, light-weight robotics. However, their design is challenging. While classical engineering intuition often leads to reasonable hardware and control choices that ensure basic functionality, the resulting performance is usually low. In contrast, purely data-driven co-evolution of hardware and software conventionally needs high computational effort to deliver meaningful results. We propose to leverage the advantages of both approaches by using classical intuitive controllers as proxies. As an example, we consider “Fizzy,” an underactuated robotic ball that leverages a unique single-motor configuration in combination with dynamic imbalance for movement. In a first optimization, an intuitive Virtual Model Control (VMC) proxy serves to quickly evaluate various design parameters like motor mass and axle positioning for a Covariance Matrix Adaptation Evolution Strategy (CMA-ES). The optimized configurations then serve as a foundation for training more sophisticated deep reinforcement learning (DRL) controllers. Our methodology underscores the potential of integrating intuitive proxies with evolutionary algorithms to enhance the performance and efficiency of underactuated robotic systems, paving the way for more adaptable and cost-effective robotic designs.