2026-10-06T10:52:48Z https://api.figshare.com/v2/oai

oai:figshare.com:article/33959761 2026-09-21T19:37:52Z category_29167 category_26311 category_26779 category_26620 item_type_2 month_year_09_2026

Sample-Efficient Model-Based Reinforcement Learning for Autonomous Droplet Navigation via Controller Initialization Rajneesh Anand (25085341) Fatima Tanveer (25085394) Mayuresh V. Kothare (1645333) Reinforcement learning Chemical engineering design Mechanical engineering not elsewhere classified Fluid mechanics and thermal engineering not elsewhere classified Model-Based Reinforcement Learning droplet (< Agent-Based Systems <p dir="ltr">Model-based reinforcement learning (MBRL) is well suited to controlling physical systems that resist analytical modeling, but its reliance on real-world interaction makes data collection the dominant cost. This paper quantifies the effect of initialization choice on this cost, on a newly adapted robotic platform that guides a liquid droplet on a tilt-actuated Labyrinth using MBRL. Unlike rigid microrobots, liquid droplets exhibit deformability and pinning, rendering their response to actuation nonlinear and history-dependent. A closed-loop gain-tuned PID controller, individually optimized per geometry, succeeds in at most one of five trials. The control policy is learned directly on the physical system, with no simulator, and two schemes for seeding the world model are compared, namely random exploration and rollouts from the same tuned PID controller. PID initialization reaches the same terminal success as random initialization while reducing the number of physical training episodes by 30-50%. This repurposes a weak classical controller as a sample-efficient prior for hard-to-model systems on costly hardware.</p> 2026-09-21T19:37:52Z Dataset Media 10.6084/m9.figshare.33959761.v1 https://figshare.com/articles/media/Sample-Efficient_Model-Based_Reinforcement_Learning_for_Autonomous_Droplet_Navigation_via_Controller_Initialization/33959761 CC BY 4.0