{"id":147,"date":"2026-09-08T12:19:01","date_gmt":"2026-09-08T12:19:01","guid":{"rendered":"https:\/\/lemursproject.udg.edu\/?p=147"},"modified":"2026-09-08T12:19:01","modified_gmt":"2026-09-08T12:19:01","slug":"automaton-conditioned-single-policy-reinforcement-learning-for-multi-stage-manipulation-tasks","status":"publish","type":"post","link":"https:\/\/lemursproject.udg.edu\/index.php\/2026\/09\/08\/automaton-conditioned-single-policy-reinforcement-learning-for-multi-stage-manipulation-tasks\/","title":{"rendered":"Automaton-Conditioned Single-Policy Reinforcement Learning for Multi-Stage Manipulation Tasks"},"content":{"rendered":"<p>Learning a robotic manipulation task often involves several actions that must be completed in the right order. This challenge becomes even more important underwater, where contact-rich tasks must be performed reliably and autonomously. We have developed a learning pipeline, currently under evaluation for publication, that enables a single AI policy to track each stage of a task and adapt its actions as the task progresses. Rather than requiring separate controllers for each step or relying on high-level controllers to simplify the action space, the method enables a single policy to learn the entire task directly at the joint level. The architecture can be applied to different manipulation scenarios. While we have started with a fixed-base, single-arm task, we aim to extend it to mobile-base, bimanual tasks. In simulated experiments, it has achieved success rates above 97%, supporting its potential for robust multi-stage underwater intervention.<\/p>\n<p><iframe title=\"Automaton-Conditioned Single-Policy Reinforcement Learning for Multi-Stage Manipulation Tasks\" width=\"800\" height=\"450\" src=\"https:\/\/www.youtube.com\/embed\/SPAcomIS18s?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learning a robotic manipulation task often involves several actions that must be completed in the right order. This challenge becomes even more important underwater, where contact-rich tasks must be performed reliably and autonomously. We have developed a learning pipeline, currently under evaluation for publication, that enables a single AI policy to track each stage of [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":148,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-147","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"_links":{"self":[{"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/posts\/147","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/comments?post=147"}],"version-history":[{"count":1,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/posts\/147\/revisions"}],"predecessor-version":[{"id":149,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/posts\/147\/revisions\/149"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/media\/148"}],"wp:attachment":[{"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/media?parent=147"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/categories?post=147"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lemursproject.udg.edu\/index.php\/wp-json\/wp\/v2\/tags?post=147"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}