PhD Opening: Reinforcement Learning in Human Neuromusculoskeletal Models for Musculoskeletal Robot Control
This PhD position at the University of Twente offers an exciting opportunity to advance the field of human-inspired musculoskeletal robotics. The project focuses on developing sophisticated computer models of the human neuromusculoskeletal (NMS) system, integrating detailed musculoskeletal geometries, muscle-tendon models, and neural control pathways such as central pattern generators (CPG) and reflexive mechanisms. The successful candidate will design and implement novel reinforcement learning (RL) strategies to teach these NMS models to perform a wide range of movements, even in the presence of external disturbances. A key aspect of the research is the 'sim2real' transfer, where control policies learned in simulation are deployed on physical musculoskeletal robots, including robotic legs and arms for autonomous and prosthetic applications. The MyoSuite framework will be used for both simulation and real-world robotic control tasks. The position is based in the NeuBotics Lab, a multidisciplinary team at the forefront of neuromechanics and assistive robotics, bridging neuroscience, biomechanics, and robotics to develop real-time models and adaptive control strategies for wearable exoskeletons and bionic limbs. The lab provides a collaborative, innovative environment with access to state-of-the-art computational and robotics facilities. Applicants should have a strong background in Robotics, Computer Science, Computer Engineering, Control, Mechanical Engineering, Biomedical Engineering, or Electrical Engineering, and hands-on experience with reinforcement learning and neuromusculoskeletal modeling. Additional skills in real-time programming (C++, Python), communication systems (EtherCAT, CAN Bus), and closed-loop control of robotic systems are advantageous. The position offers a four-year full-time contract with a competitive salary, excellent benefits, and opportunities to collaborate with leading researchers across Europe. Applications are open until November 23, 2025, with interviews scheduled for early December and an expected start date no later than February 1, 2025. Candidates must submit a video, cover letter, CV, and references via the university's online application platform. For further information, contact Prof. Massimo Sartori at m.sartori@utwente.nl.