2024 |
Bekris, K; Doerr, J; Meng, P; Tangirala, S The State of Robot Motion Generation Inproceedings International Symposium of Robotics Research (ISRR), Long Beach, California, 2024. Abstract | Links | BibTeX | Tags: Dynamics, Learning, Planning @inproceedings{Bekris:2024aa, title = {The State of Robot Motion Generation}, author = {K Bekris and J Doerr and P Meng and S Tangirala}, url = {https://arxiv.org/abs/2410.12172 https://pracsys.cs.rutgers.edu/papers/the-state-of-robot-motion-generation/}, year = {2024}, date = {2024-12-01}, booktitle = {International Symposium of Robotics Research (ISRR)}, address = {Long Beach, California}, abstract = {This paper first reviews the large spectrum of methods for generating robot motion proposed over the 50 years of robotics research culminating to recent developments. It crosses the boundaries of methodologies, which are typically not surveyed together, from those that operate over explicit models to those that learn implicit ones. The paper concludes with a discussion of the current state-of-the-art and the properties of the varying methodologies highlighting opportunities for integration.}, keywords = {Dynamics, Learning, Planning}, pubstate = {published}, tppubtype = {inproceedings} } This paper first reviews the large spectrum of methods for generating robot motion proposed over the 50 years of robotics research culminating to recent developments. It crosses the boundaries of methodologies, which are typically not surveyed together, from those that operate over explicit models to those that learn implicit ones. The paper concludes with a discussion of the current state-of-the-art and the properties of the varying methodologies highlighting opportunities for integration. |
Vieira, E; Sivaramakrishnan, A; Tangirala, S; Granados, E; Mischaikow, K; Bekris, K MORALS: Analysis of High-Dimensional Robot Controllers Via Topological Tools in a Latent Space Conference IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan (Nominated for Best Paper Award in Automation), 2024. Abstract | Links | BibTeX | Tags: Dynamics, Planning, Verification @conference{Vieira:2024aa, title = {MORALS: Analysis of High-Dimensional Robot Controllers Via Topological Tools in a Latent Space}, author = {E Vieira and A Sivaramakrishnan and S Tangirala and E Granados and K Mischaikow and K Bekris}, url = {https://arxiv.org/abs/2310.03246}, year = {2024}, date = {2024-05-01}, booktitle = {IEEE International Conference on Robotics and Automation (ICRA)}, address = {Yokohama, Japan (Nominated for Best Paper Award in Automation)}, abstract = {Estimating the region of attraction (πππ°) for a robotic system's controller is essential for safe application and controller composition. Many existing methods require access to a closed-form expression that limit applicability to data-driven controllers. Methods that operate only over trajectory rollouts tend to be data-hungry. In prior work, we have demonstrated that topological tools based on Morse Graphs offer data-efficient πππ° estimation without needing an analytical model. They struggle, however, with high-dimensional systems as they operate over a discretization of the state space. This paper presents Morse Graph-aided discovery of Regions of Attraction in a learned Latent Space (πΌπΎππ°π»π). The approach combines autoencoding neural networks with Morse Graphs. πΌπΎππ°π»π shows promising predictive capabilities in estimating attractors and their πππ°s for data-driven controllers operating over high-dimensional systems, including a 67-dim humanoid robot and a 96-dim 3-fingered manipulator. It first projects the dynamics of the controlled system into a learned latent space. Then, it constructs a reduced form of Morse Graphs representing the bistability of the underlying dynamics, i.e., detecting when the controller results in a desired versus an undesired behavior. The evaluation on high-dimensional robotic datasets indicates the data efficiency of the approach in πππ° estimation.}, keywords = {Dynamics, Planning, Verification}, pubstate = {published}, tppubtype = {conference} } Estimating the region of attraction (πππ°) for a robotic system's controller is essential for safe application and controller composition. Many existing methods require access to a closed-form expression that limit applicability to data-driven controllers. Methods that operate only over trajectory rollouts tend to be data-hungry. In prior work, we have demonstrated that topological tools based on Morse Graphs offer data-efficient πππ° estimation without needing an analytical model. They struggle, however, with high-dimensional systems as they operate over a discretization of the state space. This paper presents Morse Graph-aided discovery of Regions of Attraction in a learned Latent Space (πΌπΎππ°π»π). The approach combines autoencoding neural networks with Morse Graphs. πΌπΎππ°π»π shows promising predictive capabilities in estimating attractors and their πππ°s for data-driven controllers operating over high-dimensional systems, including a 67-dim humanoid robot and a 96-dim 3-fingered manipulator. It first projects the dynamics of the controlled system into a learned latent space. Then, it constructs a reduced form of Morse Graphs representing the bistability of the underlying dynamics, i.e., detecting when the controller results in a desired versus an undesired behavior. The evaluation on high-dimensional robotic datasets indicates the data efficiency of the approach in πππ° estimation. |
2023 |
Vieira, E; Sivaramakrishnan, A; Song, Y; Granados, E; Gameiro, M; Mischaikow, K; Hung, Y; Bekris, K Data-Efficient Characterization of the Global Dynamics of Robot Controllers with Confidence Guarantees Inproceedings IEEE International Conference on Robotics and Automation (ICRA), London, UK, 2023. Abstract | BibTeX | Tags: Dynamics, Verification @inproceedings{Vieira:2023aa, title = {Data-Efficient Characterization of the Global Dynamics of Robot Controllers with Confidence Guarantees}, author = {E Vieira and A Sivaramakrishnan and Y Song and E Granados and M Gameiro and K Mischaikow and Y Hung and K Bekris}, year = {2023}, date = {2023-05-01}, booktitle = {IEEE International Conference on Robotics and Automation (ICRA)}, address = {London, UK}, abstract = {This paper proposes an integration of surrogate modeling and topology to significantly reduce the amount of data required to describe the underlying global dynamics of robot controllers, including closed-box ones. A Gaussian Process (GP), trained with randomized short trajectories over the state-space, acts as a surrogate model for the underlying dynamical system. Then, a combinatorial representation is built and used to describe the dynamics in the form of a directed acyclic graph, known as it Morse graph. The Morse graph is able to describe the system's attractors and their corresponding regions of attraction (roa). Furthermore, a pointwise confidence level of the global dynamics estimation over the entire state space is provided. In contrast to alternatives, the framework does not require estimation of Lyapunov functions, alleviating the need for high prediction accuracy of the GP. The framework is suitable for data-driven controllers that do not expose an analytical model as long as Lipschitz-continuity is satisfied. The method is compared against established analytical and recent machine learning alternatives for estimating roa s, outperforming them in data efficiency without sacrificing accuracy.}, keywords = {Dynamics, Verification}, pubstate = {published}, tppubtype = {inproceedings} } This paper proposes an integration of surrogate modeling and topology to significantly reduce the amount of data required to describe the underlying global dynamics of robot controllers, including closed-box ones. A Gaussian Process (GP), trained with randomized short trajectories over the state-space, acts as a surrogate model for the underlying dynamical system. Then, a combinatorial representation is built and used to describe the dynamics in the form of a directed acyclic graph, known as it Morse graph. The Morse graph is able to describe the system's attractors and their corresponding regions of attraction (roa). Furthermore, a pointwise confidence level of the global dynamics estimation over the entire state space is provided. In contrast to alternatives, the framework does not require estimation of Lyapunov functions, alleviating the need for high prediction accuracy of the GP. The framework is suitable for data-driven controllers that do not expose an analytical model as long as Lipschitz-continuity is satisfied. The method is compared against established analytical and recent machine learning alternatives for estimating roa s, outperforming them in data efficiency without sacrificing accuracy. |
2022 |
Vieira, E; Granados, E; Sivaramakrishnan, A; Gameiro, M; Mischaikow, K; Bekris, K Morse Graphs: Topological Tools for Analyzing the Global Dynamics of Robot Controllers Inproceedings Workshop on the Algorithmic Foundations of Robotics (WAFR), 2022. Abstract | Links | BibTeX | Tags: Dynamics, Planning, Verification @inproceedings{Vieira:2022aa, title = {Morse Graphs: Topological Tools for Analyzing the Global Dynamics of Robot Controllers}, author = {E Vieira and E Granados and A Sivaramakrishnan and M Gameiro and K Mischaikow and K Bekris}, url = {https://arxiv.org/abs/2202.08383}, year = {2022}, date = {2022-06-01}, booktitle = {Workshop on the Algorithmic Foundations of Robotics (WAFR)}, abstract = {Understanding the global dynamics of a robot controller, such as identifying attractors and their regions of attraction (RoA), is important for safe deployment and synthesizing more effective hybrid controllers. This paper proposes a topological framework to analyze the global dynamics of robot controllers, even data-driven ones, in an effective and explainable way. It builds a combinatorial representation representing the underlying system's state space and non-linear dynamics, which is summarized in a directed acyclic graph, the Morse graph. The approach only probes the dynamics locally by forward propagating short trajectories over a state-space discretization, which needs to be a Lipschitz-continuous function. The framework is evaluated given either numerical or data-driven controllers for classical robotic benchmarks. It is compared against established analytical and recent machine learning alternatives for estimating the RoAs of such controllers. It is shown to outperform them in accuracy and efficiency. It also provides deeper insights as it describes the global dynamics up to the discretization's resolution. This allows to use the Morse graph to identify how to synthesize controllers to form improved hybrid solutions or how to identify the physical limitations of a robotic system.}, keywords = {Dynamics, Planning, Verification}, pubstate = {published}, tppubtype = {inproceedings} } Understanding the global dynamics of a robot controller, such as identifying attractors and their regions of attraction (RoA), is important for safe deployment and synthesizing more effective hybrid controllers. This paper proposes a topological framework to analyze the global dynamics of robot controllers, even data-driven ones, in an effective and explainable way. It builds a combinatorial representation representing the underlying system's state space and non-linear dynamics, which is summarized in a directed acyclic graph, the Morse graph. The approach only probes the dynamics locally by forward propagating short trajectories over a state-space discretization, which needs to be a Lipschitz-continuous function. The framework is evaluated given either numerical or data-driven controllers for classical robotic benchmarks. It is compared against established analytical and recent machine learning alternatives for estimating the RoAs of such controllers. It is shown to outperform them in accuracy and efficiency. It also provides deeper insights as it describes the global dynamics up to the discretization's resolution. This allows to use the Morse graph to identify how to synthesize controllers to form improved hybrid solutions or how to identify the physical limitations of a robotic system. |
Granados, E; Boularias, A; Bekris, K; Aanjaneya, M Model Identification and Control of a Mobile Robot with Omnidirectional Wheels Using Differentiable Physics Inproceedings IEEE International Conference on Robotics and Automation (ICRA), 2022. Abstract | Links | BibTeX | Tags: Dynamics, Planning @inproceedings{Granados:2022aa, title = {Model Identification and Control of a Mobile Robot with Omnidirectional Wheels Using Differentiable Physics}, author = {E Granados and A Boularias and K Bekris and M Aanjaneya}, url = {https://orionquest.github.io/papers/MICLCMR/paper.html}, year = {2022}, date = {2022-05-01}, booktitle = {IEEE International Conference on Robotics and Automation (ICRA)}, abstract = {We present a new data-driven technique for predicting the motion of a low-cost omnidirectional mobile robot under the influence of motor torques and friction forces. Our method utilizes a novel differentiable physics engine for analytically computing the gradient of the deviation between predicted motion trajectories and real-world trajectories. This allows to automatically learn and fine-tune the unknown friction coefficients on-the-fly, by minimizing a carefully designed loss function using gradient descent. Experiments show that the predicted trajectories are in excellent agreement with their real-world counterparts. Our proposed approach is computationally superior to existing black-box optimization methods, requiring very few real-world samples for accurate trajectory prediction compared to physics-agnostic techniques, such as neural networks. Experiments also demonstrate that the proposed method allows the robot to quickly adapt to changes in the terrain. Our proposed approach combines the data-efficiency of classical analytical models that are derived from first principles, with the flexibility of data-driven methods, which makes it appropriate for low-cost mobile robots.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {inproceedings} } We present a new data-driven technique for predicting the motion of a low-cost omnidirectional mobile robot under the influence of motor torques and friction forces. Our method utilizes a novel differentiable physics engine for analytically computing the gradient of the deviation between predicted motion trajectories and real-world trajectories. This allows to automatically learn and fine-tune the unknown friction coefficients on-the-fly, by minimizing a carefully designed loss function using gradient descent. Experiments show that the predicted trajectories are in excellent agreement with their real-world counterparts. Our proposed approach is computationally superior to existing black-box optimization methods, requiring very few real-world samples for accurate trajectory prediction compared to physics-agnostic techniques, such as neural networks. Experiments also demonstrate that the proposed method allows the robot to quickly adapt to changes in the terrain. Our proposed approach combines the data-efficiency of classical analytical models that are derived from first principles, with the flexibility of data-driven methods, which makes it appropriate for low-cost mobile robots. |
2021 |
Wang, K; Aanjaneya, M; Bekris, K Sim2Sim Evaluation of a Novel Data-Efficient Differentiable Physics Engine for Tensegrity Robots Inproceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. Abstract | Links | BibTeX | Tags: Dynamics, Learning, Soft-Robots @inproceedings{Wang:2021ab, title = {Sim2Sim Evaluation of a Novel Data-Efficient Differentiable Physics Engine for Tensegrity Robots}, author = {K Wang and M Aanjaneya and K Bekris}, url = {https://arxiv.org/abs/2011.04929}, year = {2021}, date = {2021-09-01}, booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)}, abstract = {Learning policies in simulation is promising for reducing human effort when training robot controllers. This is especially true for soft robots that are more adaptive and safe but also more difficult to accurately model and control. The sim2real gap is the main barrier to successfully transfer policies from simulation to a real robot. System identification can be applied to reduce this gap but traditional identification methods require a lot of manual tuning. Data-driven alternatives can tune dynamical models directly from data but are often data hungry, which also incorporates human effort in collecting data. This work proposes a data-driven, end-to-end differentiable simulator focused on the exciting but challenging domain of tensegrity robots. To the best of the authors' knowledge, this is the first differentiable physics engine for tensegrity robots that supports cable, contact, and actuation modeling. The aim is to develop a reasonably simplified, data-driven simulation, which can learn approximate dynamics with limited ground truth data. The dynamics must be accurate enough to generate policies that can be transferred back to the ground-truth system. As a first step in this direction, the current work demonstrates sim2sim transfer, where the unknown physical model of MuJoCo acts as a ground truth system. Two different tensegrity robots are used for evaluation and learning of locomotion policies, a 6-bar and a 3-bar tensegrity. The results indicate that only 0.25% of ground truth data are needed to train a policy that works on the ground truth system when the differentiable engine is used for training against training the policy directly on the ground truth system.}, keywords = {Dynamics, Learning, Soft-Robots}, pubstate = {published}, tppubtype = {inproceedings} } Learning policies in simulation is promising for reducing human effort when training robot controllers. This is especially true for soft robots that are more adaptive and safe but also more difficult to accurately model and control. The sim2real gap is the main barrier to successfully transfer policies from simulation to a real robot. System identification can be applied to reduce this gap but traditional identification methods require a lot of manual tuning. Data-driven alternatives can tune dynamical models directly from data but are often data hungry, which also incorporates human effort in collecting data. This work proposes a data-driven, end-to-end differentiable simulator focused on the exciting but challenging domain of tensegrity robots. To the best of the authors' knowledge, this is the first differentiable physics engine for tensegrity robots that supports cable, contact, and actuation modeling. The aim is to develop a reasonably simplified, data-driven simulation, which can learn approximate dynamics with limited ground truth data. The dynamics must be accurate enough to generate policies that can be transferred back to the ground-truth system. As a first step in this direction, the current work demonstrates sim2sim transfer, where the unknown physical model of MuJoCo acts as a ground truth system. Two different tensegrity robots are used for evaluation and learning of locomotion policies, a 6-bar and a 3-bar tensegrity. The results indicate that only 0.25% of ground truth data are needed to train a policy that works on the ground truth system when the differentiable engine is used for training against training the policy directly on the ground truth system. |
Sivaramakrishnan, A; Granados, E; Karten, S; McMahon, T; Bekris, K Improving Kinodynamic Planners for Vehicular Navigation with Learned Goal-Reaching Controllers Inproceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. Abstract | Links | BibTeX | Tags: Dynamics, Planning @inproceedings{Sivaramakrishnan:2021aa, title = {Improving Kinodynamic Planners for Vehicular Navigation with Learned Goal-Reaching Controllers}, author = {A Sivaramakrishnan and E Granados and S Karten and T McMahon and K Bekris}, url = {https://arxiv.org/pdf/2110.04238}, year = {2021}, date = {2021-09-01}, booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)}, abstract = {This paper aims to improve the path quality and computational efficiency of sampling-based kinodynamic planners for vehicular navigation. It proposes a learning framework for identifying promising controls during the expansion process of sampling-based planners. Given a dynamics model, a reinforcement learning process is trained offline to return a low-cost control that reaches a local goal state (i.e., a waypoint) in the absence of obstacles. By focusing on the system's dynamics and not knowing the environment, this process is data-efficient and takes place once for a robotic system. In this way, it can be reused in different environments. The planner generates online local goal states for the learned controller in an informed manner to bias towards the goal and consecutively in an exploratory, random manner. For the informed expansion, local goal states are generated either via (a) medial axis information in environments with obstacles, or (b) wavefront information for setups with traversability costs. The learning process and the resulting planning framework are evaluated for a first and second-order differential drive system, as well as a physically simulated Segway robot. The results show that the proposed integration of learning and planning can produce higher quality paths than sampling-based kinodynamic planning with random controls in fewer iterations and computation time.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {inproceedings} } This paper aims to improve the path quality and computational efficiency of sampling-based kinodynamic planners for vehicular navigation. It proposes a learning framework for identifying promising controls during the expansion process of sampling-based planners. Given a dynamics model, a reinforcement learning process is trained offline to return a low-cost control that reaches a local goal state (i.e., a waypoint) in the absence of obstacles. By focusing on the system's dynamics and not knowing the environment, this process is data-efficient and takes place once for a robotic system. In this way, it can be reused in different environments. The planner generates online local goal states for the learned controller in an informed manner to bias towards the goal and consecutively in an exploratory, random manner. For the informed expansion, local goal states are generated either via (a) medial axis information in environments with obstacles, or (b) wavefront information for setups with traversability costs. The learning process and the resulting planning framework are evaluated for a first and second-order differential drive system, as well as a physically simulated Segway robot. The results show that the proposed integration of learning and planning can produce higher quality paths than sampling-based kinodynamic planning with random controls in fewer iterations and computation time. |
2020 |
Sintov, A; Kimmel, A; Wen, B; Boularias, A; Bekris, K Tools for Data-Driven Modeling of Within-Hand Manipulation with Underactuated Adaptive Hands Conference Learning for Dynamics & Control (L4DC), Berkeley, CA, 2020. Abstract | Links | BibTeX | Tags: Dynamics @conference{Sintov:2020ab, title = {Tools for Data-Driven Modeling of Within-Hand Manipulation with Underactuated Adaptive Hands}, author = {A Sintov and A Kimmel and B Wen and A Boularias and K Bekris}, url = {https://proceedings.mlr.press/v120/sintov20a.html}, year = {2020}, date = {2020-06-01}, booktitle = {Learning for Dynamics & Control (L4DC)}, address = {Berkeley, CA}, abstract = {Precise in-hand manipulation is an important skill for a robot to perform tasks in human environments. Practical robotic hands must be low-cost, easy to control and capable. 3D-printed underactuated adaptive hands provide such properties as they are cheap to fabricate and adapt to objects of uncertain geometry with stable grasps. Challenges still remain, however, before such hands can attain human-like performance due to complex dynamics and contacts. In particular, useful models for planning, control or model-based reinforcement learning are still lacking. Recently, data-driven approaches for such models have shown promise. This work provides the first large public dataset of real within-hand manipulation that facilitates building such models, along with baseline data-driven modeling results. Furthermore, it contributes ROS-based physics-engine model of such hands for independent data collection, experimentation and sim-to-reality transfer work.}, keywords = {Dynamics}, pubstate = {published}, tppubtype = {conference} } Precise in-hand manipulation is an important skill for a robot to perform tasks in human environments. Practical robotic hands must be low-cost, easy to control and capable. 3D-printed underactuated adaptive hands provide such properties as they are cheap to fabricate and adapt to objects of uncertain geometry with stable grasps. Challenges still remain, however, before such hands can attain human-like performance due to complex dynamics and contacts. In particular, useful models for planning, control or model-based reinforcement learning are still lacking. Recently, data-driven approaches for such models have shown promise. This work provides the first large public dataset of real within-hand manipulation that facilitates building such models, along with baseline data-driven modeling results. Furthermore, it contributes ROS-based physics-engine model of such hands for independent data collection, experimentation and sim-to-reality transfer work. |
Littlefield, Z Efficient and Asymptotically Optimal Kinodynamic Motion Planning PhD Thesis Rutgers, the State University of New Jersey, 2020. Abstract | Links | BibTeX | Tags: Dynamics, Planning, Soft-Robots @phdthesis{Littlefield:2020aa, title = {Efficient and Asymptotically Optimal Kinodynamic Motion Planning}, author = {Z Littlefield}, url = {http://www.cs.rutgers.edu/~kb572/pubs/LittlefieldThesisMay2020.pdf}, year = {2020}, date = {2020-05-01}, volume = {PhD}, school = {Rutgers, the State University of New Jersey}, abstract = {This dissertation explores properties of motion planners that build tree data structures in a robottextquoterights state space. Sampling-based tree planners are especially useful for planning for systems with significant dynamics, due to the inherent forward search that is per- formed. This is in contrast to roadmap planners that require a steering local planner in order to make a graph containing multiple possible paths. This dissertation explores a family of motion planners for systems with significant dynamics, where a steering local planner may be computationally expensive or may not exist. These planners focus on providing practical path quality guarantees without prohibitive computational costs. These planners can be considered successors of each other, in that each sub- sequent algorithm addresses some drawback of its predecessor. The first algorithm, Sparse-RRT, addresses a drawback of the RRT method by considering path quality during the tree construction process. Sparse-RRT is proven to be probabilistically complete under mild conditions for the first time here, albeit with a poor convergence rate. The second algorithm presented, SST, provides probabilistic completeness and asymptotic near-optimality properties that are provable, but at the cost of additional algorithmic overhead. SST is shown to improve the convergence rate compared to Sparse-RRT. The third algorithm, DIRT, incorporates learned lessons from these two algorithms and their shortcomings, incorporates task space heuristics to further improve runtime performance, and simplifies the parameters to more user-friendly ones. DIRT is also shown to be probabilistically complete and asymptotically near-optimal. Application areas explored using this family of algorithms include evaluation of distance functions for planning in belief space, manipulation in cluttered environments, and locomotion planning for an icosahedral tensegrity-based rover prototype that requires a physics engine to simulate its motions.}, keywords = {Dynamics, Planning, Soft-Robots}, pubstate = {published}, tppubtype = {phdthesis} } This dissertation explores properties of motion planners that build tree data structures in a robottextquoterights state space. Sampling-based tree planners are especially useful for planning for systems with significant dynamics, due to the inherent forward search that is per- formed. This is in contrast to roadmap planners that require a steering local planner in order to make a graph containing multiple possible paths. This dissertation explores a family of motion planners for systems with significant dynamics, where a steering local planner may be computationally expensive or may not exist. These planners focus on providing practical path quality guarantees without prohibitive computational costs. These planners can be considered successors of each other, in that each sub- sequent algorithm addresses some drawback of its predecessor. The first algorithm, Sparse-RRT, addresses a drawback of the RRT method by considering path quality during the tree construction process. Sparse-RRT is proven to be probabilistically complete under mild conditions for the first time here, albeit with a poor convergence rate. The second algorithm presented, SST, provides probabilistic completeness and asymptotic near-optimality properties that are provable, but at the cost of additional algorithmic overhead. SST is shown to improve the convergence rate compared to Sparse-RRT. The third algorithm, DIRT, incorporates learned lessons from these two algorithms and their shortcomings, incorporates task space heuristics to further improve runtime performance, and simplifies the parameters to more user-friendly ones. DIRT is also shown to be probabilistically complete and asymptotically near-optimal. Application areas explored using this family of algorithms include evaluation of distance functions for planning in belief space, manipulation in cluttered environments, and locomotion planning for an icosahedral tensegrity-based rover prototype that requires a physics engine to simulate its motions. |
2019 |
Littlefield, Z; Surovik, D; Vespignani, M; Bruce, J; Wang, W; Bekris, K Kinodynamic Planning for Spherical Tensegrity Locomotion with Effective Gait Primitives Journal Article International Journal of Robotics Research (IJRR), 2019. Abstract | Links | BibTeX | Tags: Dynamics, Planning, Soft-Robots @article{Littlefield:2019aa, title = {Kinodynamic Planning for Spherical Tensegrity Locomotion with Effective Gait Primitives}, author = {Z Littlefield and D Surovik and M Vespignani and J Bruce and W Wang and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/kinodynamic_tensegrity.pdf}, year = {2019}, date = {2019-10-01}, journal = {International Journal of Robotics Research (IJRR)}, abstract = {Tensegrity-based robots can achieve locomotion through shape deformation and compliance. They are highly adaptable to their surroundings, have light weight, low cost and are physically robust. Their high dimensionality and strongly dynamic nature, however, complicate motion planning. Efforts to-date have primarily considered quasi-static reconfiguration and short-term dynamic motion of tensegrity robots, which do not fully exploit the underlying system dynamics in the long term. Longer-horizon planning has previously required costly search over the full space of valid control inputs. This work synthesizes new and existing approaches to produce dynamic long-term motion while balancing the computational demand. A numerical process based upon quasi-static assumptions is first applied to deform the system into an unstable configuration, causing forward motion. The dynamical characteristics of the result are then altered via a few simple parameters to produce a small but diverse set of useful behaviors. The proposed approach takes advantage of identified symmetries on the prototypical spherical tensegrity robot, which reduce the number of needed gaits but allow motion along different directions. These gaits are first combined with a standard search method to achieve long term planning in environments where the developed gaits are effective. For more complex environments, the various motion primitives are paired with the fall-back option of random valid actions and are used by an informed sampling-based kinodynamic motion planner with anytime properties. Evaluations using a physics-based model for the prototypical robot demonstrate that modest but efficiently-applied search effort can unlock the utility of dynamic tensegrity motion to produce high-quality solutions.}, keywords = {Dynamics, Planning, Soft-Robots}, pubstate = {published}, tppubtype = {article} } Tensegrity-based robots can achieve locomotion through shape deformation and compliance. They are highly adaptable to their surroundings, have light weight, low cost and are physically robust. Their high dimensionality and strongly dynamic nature, however, complicate motion planning. Efforts to-date have primarily considered quasi-static reconfiguration and short-term dynamic motion of tensegrity robots, which do not fully exploit the underlying system dynamics in the long term. Longer-horizon planning has previously required costly search over the full space of valid control inputs. This work synthesizes new and existing approaches to produce dynamic long-term motion while balancing the computational demand. A numerical process based upon quasi-static assumptions is first applied to deform the system into an unstable configuration, causing forward motion. The dynamical characteristics of the result are then altered via a few simple parameters to produce a small but diverse set of useful behaviors. The proposed approach takes advantage of identified symmetries on the prototypical spherical tensegrity robot, which reduce the number of needed gaits but allow motion along different directions. These gaits are first combined with a standard search method to achieve long term planning in environments where the developed gaits are effective. For more complex environments, the various motion primitives are paired with the fall-back option of random valid actions and are used by an informed sampling-based kinodynamic motion planner with anytime properties. Evaluations using a physics-based model for the prototypical robot demonstrate that modest but efficiently-applied search effort can unlock the utility of dynamic tensegrity motion to produce high-quality solutions. |
Sivaramakrishnan, A; Littlefield, Z; Bekris, K Towards Learning Efficient Maneuver Sets for Kinodynamic Motion Planning Technical Report 2019. Abstract | Links | BibTeX | Tags: Dynamics, Planning @techreport{Sivaramakrishnan:2019aa, title = {Towards Learning Efficient Maneuver Sets for Kinodynamic Motion Planning}, author = {A Sivaramakrishnan and Z Littlefield and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/Learning_Maneuver_Sets_PlanRob2019.pdf}, year = {2019}, date = {2019-07-01}, school = {PlanRob 2019 Workshop of ICAPS 2019}, abstract = {Planning for systems with dynamics is challenging as often there is no local planner available and the only primitive to explore the state space is forward propagation of controls. In this context, tree sampling-based planners have been developed, some of which achieve asymptotic optimality by propagating random controls during each iteration. While desirable for the analysis, random controls result in slow convergence to high quality trajectories in practice. This short position statement first argues that if a kinodynamic planner has access to local maneuvers that appropriately balance an exploitation-exploration trade-off, the plannertextquoterights per iteration performance is significantly improved. Furthermore, this work argues for the integration of modern machine learning frameworks with state-of-the-art, informed and asymptotically optimal kinodynamic planners. The proposed approach involves using using neural networks to infer local maneuvers for a robotic system with dynamics, which properly balance the above exploitation-exploration trade-off. Preliminary indications in simulated environments and systems are promising but also point to certain challenges that motivate further research in this direction.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {techreport} } Planning for systems with dynamics is challenging as often there is no local planner available and the only primitive to explore the state space is forward propagation of controls. In this context, tree sampling-based planners have been developed, some of which achieve asymptotic optimality by propagating random controls during each iteration. While desirable for the analysis, random controls result in slow convergence to high quality trajectories in practice. This short position statement first argues that if a kinodynamic planner has access to local maneuvers that appropriately balance an exploitation-exploration trade-off, the plannertextquoterights per iteration performance is significantly improved. Furthermore, this work argues for the integration of modern machine learning frameworks with state-of-the-art, informed and asymptotically optimal kinodynamic planners. The proposed approach involves using using neural networks to infer local maneuvers for a robotic system with dynamics, which properly balance the above exploitation-exploration trade-off. Preliminary indications in simulated environments and systems are promising but also point to certain challenges that motivate further research in this direction. |
Kleinbort, M; Solovey, K; Littlefield, Z; Bekris, K; Halperin, D Probabilistic Completeness of RRT for Geometric and Kinodynamic Planning with Forward Propagation Journal Article IEEE Robotics and Automation Letters (RA-L) (also appearing at IEEE ICRA 2019), 2019. Abstract | Links | BibTeX | Tags: Dynamics, Planning @article{Kleinbort:2019aa, title = {Probabilistic Completeness of RRT for Geometric and Kinodynamic Planning with Forward Propagation}, author = {M Kleinbort and K Solovey and Z Littlefield and K Bekris and D Halperin}, url = {https://www.cs.rutgers.edu/~kb572/pubs/prob_completeness_rrt.pdf}, year = {2019}, date = {2019-01-01}, journal = {IEEE Robotics and Automation Letters (RA-L) (also appearing at IEEE ICRA 2019)}, abstract = {The Rapidly-exploring Random Tree (RRT) algorithm has been one of the most prevalent and popular motion-planning techniques for two decades now. Surprisingly, in spite of its centrality, there has been an active debate under which conditions RRT is probabilistically complete. We provide two new proofs of probabilistic completeness (PC) of RRT with a reduced set of assumptions. The first one for the purely geometric setting, where we only require that the solution path has a certain clearance from the obstacles. For the kinodynamic case with forward propagation of random controls and duration, we only consider in addition mild Lipschitz-continuity conditions. These proofs fill a gap in the study of RRT itself. They also lay sound foundations for a variety of more recent and alternative sampling-based methods, whose PC property relies on that of RRT.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {article} } The Rapidly-exploring Random Tree (RRT) algorithm has been one of the most prevalent and popular motion-planning techniques for two decades now. Surprisingly, in spite of its centrality, there has been an active debate under which conditions RRT is probabilistically complete. We provide two new proofs of probabilistic completeness (PC) of RRT with a reduced set of assumptions. The first one for the purely geometric setting, where we only require that the solution path has a certain clearance from the obstacles. For the kinodynamic case with forward propagation of random controls and duration, we only consider in addition mild Lipschitz-continuity conditions. These proofs fill a gap in the study of RRT itself. They also lay sound foundations for a variety of more recent and alternative sampling-based methods, whose PC property relies on that of RRT. |
2018 |
Littlefield, Z; Bekris, K Efficient and Asymptotically Optimal Kinodynamic Motion Planning Via Dominance-Informed Regions Conference IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 2018. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Littlefield:2018aa, title = {Efficient and Asymptotically Optimal Kinodynamic Motion Planning Via Dominance-Informed Regions}, author = {Z Littlefield and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/iros_dirt.pdf}, year = {2018}, date = {2018-10-01}, booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)}, address = {Madrid, Spain}, abstract = {Motion planners have been recently developed that provide path quality guarantees for robots with dynamics. This work aims to improve upon their efficiency, while maintaining their properties. Inspired by informed search principles, one objective is to use heuristics. Nevertheless, comprehensive and fast spatial exploration of the state space is still important in robotics. For this reason, this work introduces Dominance- Informed Regions (DIR), which express both whether parts of the space are unexplored and whether they lie along a high quality path. Furthermore, to speed up the generation of a successful successor state, which involves collision checking or physics-based simulation, a proposed strategy generates the most promising successor in an informed way, while maintaing properties. Overall, this paper introduces a new informed and asymptotically optimal kinodynamic motion planner, the Dominance-Informed Region Tree (DIRT). The method balances exploration-exploitation tradeoffs without many explicit parameters. It is shown to outperform sampling-based and search-based methods for robots with significant dynamics}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } Motion planners have been recently developed that provide path quality guarantees for robots with dynamics. This work aims to improve upon their efficiency, while maintaining their properties. Inspired by informed search principles, one objective is to use heuristics. Nevertheless, comprehensive and fast spatial exploration of the state space is still important in robotics. For this reason, this work introduces Dominance- Informed Regions (DIR), which express both whether parts of the space are unexplored and whether they lie along a high quality path. Furthermore, to speed up the generation of a successful successor state, which involves collision checking or physics-based simulation, a proposed strategy generates the most promising successor in an informed way, while maintaing properties. Overall, this paper introduces a new informed and asymptotically optimal kinodynamic motion planner, the Dominance-Informed Region Tree (DIRT). The method balances exploration-exploitation tradeoffs without many explicit parameters. It is shown to outperform sampling-based and search-based methods for robots with significant dynamics |
Zhu, S; Kimmel, A; Bekris, K; Boularias, A Fast Model Identification Via Physics Engines for Data-Efficient Policy Search Conference International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, Sweden, 2018. Abstract | Links | BibTeX | Tags: Dynamics @conference{Zhu:2018ab, title = {Fast Model Identification Via Physics Engines for Data-Efficient Policy Search}, author = {S Zhu and A Kimmel and K Bekris and A Boularias}, url = {https://www.cs.rutgers.edu/~kb572/pubs/physics_model_id.pdf}, year = {2018}, date = {2018-07-01}, booktitle = {International Joint Conference on Artificial Intelligence (IJCAI)}, address = {Stockholm, Sweden}, abstract = {This paper presents a practical approach for identifying unknown mechanical parameters, such as mass and friction models of manipulated rigid objects or actuated robotic links, in a succinct manner that aims to improve the performance of policy search algorithms. Key features of this approach are the use of off-the-shelf physics engines and the adaptation of a black-box Bayesian optimization framework for this purpose. The physics engine is used to reproduce in simulation experiments that are performed on a real robot, and the mechanical parameters of the simulated system are automatically fine-tuned so that the simulated trajectories match with the real ones. The optimized model is then used for learning a policy in simulation, before safely deploying it on the real robot. Given the well-known limitations of physics engines in modeling real-world objects, it is generally not possible to find a mechanical model that reproduces in simulation the real trajectories exactly. Moreover, there are many scenarios where a near-optimal policy can be found without having a perfect knowledge of the system. Therefore, searching for a perfect model may not be worth the computational effort in practice. The proposed approach aims then to identify a model that is good enough to approximate the value of a locally optimal policy with a certain confidence, instead of spending all the computational resources on searching for the most accurate model. Empirical evaluations, performed in simulation and on a real robotic manipulation task, show that model identification via physics engines can significantly boost the performance of policy search algorithms that are popular in robotics, such as TRPO, PoWER and PILCO, with no additional real-world data.}, keywords = {Dynamics}, pubstate = {published}, tppubtype = {conference} } This paper presents a practical approach for identifying unknown mechanical parameters, such as mass and friction models of manipulated rigid objects or actuated robotic links, in a succinct manner that aims to improve the performance of policy search algorithms. Key features of this approach are the use of off-the-shelf physics engines and the adaptation of a black-box Bayesian optimization framework for this purpose. The physics engine is used to reproduce in simulation experiments that are performed on a real robot, and the mechanical parameters of the simulated system are automatically fine-tuned so that the simulated trajectories match with the real ones. The optimized model is then used for learning a policy in simulation, before safely deploying it on the real robot. Given the well-known limitations of physics engines in modeling real-world objects, it is generally not possible to find a mechanical model that reproduces in simulation the real trajectories exactly. Moreover, there are many scenarios where a near-optimal policy can be found without having a perfect knowledge of the system. Therefore, searching for a perfect model may not be worth the computational effort in practice. The proposed approach aims then to identify a model that is good enough to approximate the value of a locally optimal policy with a certain confidence, instead of spending all the computational resources on searching for the most accurate model. Empirical evaluations, performed in simulation and on a real robotic manipulation task, show that model identification via physics engines can significantly boost the performance of policy search algorithms that are popular in robotics, such as TRPO, PoWER and PILCO, with no additional real-world data. |
Rennie, C; Bekris, K Discovering a Library of Rhythmic Gaits for Spherical Tensegrity Locomotion Conference IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 2018. Abstract | Links | BibTeX | Tags: Dynamics, Soft-Robots @conference{Rennie:2018aa, title = {Discovering a Library of Rhythmic Gaits for Spherical Tensegrity Locomotion}, author = {C Rennie and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/gps_bo_svm_tensegrity.pdf}, year = {2018}, date = {2018-05-01}, booktitle = {IEEE International Conference on Robotics and Automation (ICRA)}, address = {Brisbane, Australia}, abstract = {Tensegrity robots, which combine both rigid and soft elements, provide exciting new locomotion capabilities but introduce significant control challenges given their high-dimensionality and non-linear nature. This work first defines an effective parameterization of a spherical tensegrity for generating rhythmic gaits based on Central Pattern Generators (CPG). This allows the definition of periodic and rhythmic control signals, while exposing only five gait parameters. Then, this work proposes a framework for optimizing such gaits by exploring the parameter space through Bayesian Optimization on an underlying Gaussian Process regression model. The objective is to provide gaits that allow the platform to move along different directions with high velocity. Additionally, kNN binary classifiers are trained to estimate whether a parameter sample will result in an effective gait. The classification biases the sampling toward subspaces likely to yield effective gaits. An asynchronous communication layer is defined between the optimization and classification processes. The proposed gait discovery process is shown to efficiently optimize the parameters of gaits defined given the novel CPG architecture and outperforms less holistic approaches and Monte Carlo sampling}, keywords = {Dynamics, Soft-Robots}, pubstate = {published}, tppubtype = {conference} } Tensegrity robots, which combine both rigid and soft elements, provide exciting new locomotion capabilities but introduce significant control challenges given their high-dimensionality and non-linear nature. This work first defines an effective parameterization of a spherical tensegrity for generating rhythmic gaits based on Central Pattern Generators (CPG). This allows the definition of periodic and rhythmic control signals, while exposing only five gait parameters. Then, this work proposes a framework for optimizing such gaits by exploring the parameter space through Bayesian Optimization on an underlying Gaussian Process regression model. The objective is to provide gaits that allow the platform to move along different directions with high velocity. Additionally, kNN binary classifiers are trained to estimate whether a parameter sample will result in an effective gait. The classification biases the sampling toward subspaces likely to yield effective gaits. An asynchronous communication layer is defined between the optimization and classification processes. The proposed gait discovery process is shown to efficiently optimize the parameters of gaits defined given the novel CPG architecture and outperforms less holistic approaches and Monte Carlo sampling |
Surovik, D; Bekris, K Symmetric Reduction of Tensegrity Rover Dynamics for Efficient Data-Driven Control Conference ASCE Earth and Space Conference, Symposium on "Tensegrity - Structural Concept and Applications", Cleveland, Ohio, 2018. Abstract | Links | BibTeX | Tags: Dynamics, Soft-Robots @conference{Surovik:2018ab, title = {Symmetric Reduction of Tensegrity Rover Dynamics for Efficient Data-Driven Control}, author = {D Surovik and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/asce_sym.pdf}, year = {2018}, date = {2018-04-01}, booktitle = {ASCE Earth and Space Conference, Symposium on "Tensegrity - Structural Concept and Applications"}, address = {Cleveland, Ohio}, abstract = {Tensegrity robots consist of disconnected rods suspended within a network of length-actuated cables, which gives them a high degree of compliance and adaptability suitable for traversing rugged terrain. These vehicles, however, undergo complex contact dynamics that prevent the use of traditional control techniques based on mathematical analyses of equations of motion. Data-driven approaches are thus an appropriate choice for controller design, but are themselves hindered by the high number of degrees of freedom and correspondingly large state spaces. This paper presents a scheme for exploiting the 24th-order symmetry of an icosahedral tensegrity robot to vastly reduce the breadth of the controller input space without loss of information. Symmetric properties and state reduction operations are detailed and placed in the context of a data-driven control pipeline. Results are illustrated by comparing the input and output of a locomotive controller in both raw and symmetry-reduced dynamical spaces. The findings suggest a strong relief of the data requirements for training locomotive controllers.}, keywords = {Dynamics, Soft-Robots}, pubstate = {published}, tppubtype = {conference} } Tensegrity robots consist of disconnected rods suspended within a network of length-actuated cables, which gives them a high degree of compliance and adaptability suitable for traversing rugged terrain. These vehicles, however, undergo complex contact dynamics that prevent the use of traditional control techniques based on mathematical analyses of equations of motion. Data-driven approaches are thus an appropriate choice for controller design, but are themselves hindered by the high number of degrees of freedom and correspondingly large state spaces. This paper presents a scheme for exploiting the 24th-order symmetry of an icosahedral tensegrity robot to vastly reduce the breadth of the controller input space without loss of information. Symmetric properties and state reduction operations are detailed and placed in the context of a data-driven control pipeline. Results are illustrated by comparing the input and output of a locomotive controller in both raw and symmetry-reduced dynamical spaces. The findings suggest a strong relief of the data requirements for training locomotive controllers. |
2017 |
Littlefield, Z; Bekris, K Informed Asymptotically Near-Optimal Planning for Field Robots with Dynamics Conference 11th Conference on Field and Service Robotics (FSR) 2017, Zurich, Switzerland, 2017. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Littlefield:2017ab, title = {Informed Asymptotically Near-Optimal Planning for Field Robots with Dynamics}, author = {Z Littlefield and K Bekris}, url = {https://www.cs.rutgers.edu/~kb572/pubs/fsr_isst.pdf}, year = {2017}, date = {2017-09-01}, booktitle = {11th Conference on Field and Service Robotics (FSR) 2017}, address = {Zurich, Switzerland}, abstract = {Recent progress in sampling-based planning has provided performance guarantees in terms of optimizing trajectory cost even in the presence of significant dynamics. The STABLE SPARSE RRT (SST) algorithm has these desirable path quality properties and achieves computational efficiency by maintaining a sparse set of state-space samples. The current paper focuses on field robotics, where workspace information can be used to effectively guide the search process of a planner, and improves the computational performance of SST by appropriately utilizing such information in the form of heuristics. The workspace information guides the exploration process of the planner and focuses it on the useful subset of the state space. The resulting Informed-SST is evaluated in several scenarios involving either ground vehicles or quadrotors. This includes testing for a physically-simulated vehicle over uneven terrain, which is a computationally expensive challenge.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } Recent progress in sampling-based planning has provided performance guarantees in terms of optimizing trajectory cost even in the presence of significant dynamics. The STABLE SPARSE RRT (SST) algorithm has these desirable path quality properties and achieves computational efficiency by maintaining a sparse set of state-space samples. The current paper focuses on field robotics, where workspace information can be used to effectively guide the search process of a planner, and improves the computational performance of SST by appropriately utilizing such information in the form of heuristics. The workspace information guides the exploration process of the planner and focuses it on the useful subset of the state space. The resulting Informed-SST is evaluated in several scenarios involving either ground vehicles or quadrotors. This includes testing for a physically-simulated vehicle over uneven terrain, which is a computationally expensive challenge. |
2014 |
Li, Y; Littlefield, Z; Bekris, K Sparse Methods for Efficient Asymptotically Optimal Kinodynamic Planning Conference Workshop on the Algorithmic Foundations of Robotics (WAFR), Istanbul, Turkey, 2014. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Li:2014aa, title = {Sparse Methods for Efficient Asymptotically Optimal Kinodynamic Planning}, author = {Y Li and Z Littlefield and K Bekris}, url = {https://link.springer.com/chapter/10.1007/978-3-319-16595-0_16}, year = {2014}, date = {2014-08-01}, booktitle = {Workshop on the Algorithmic Foundations of Robotics (WAFR)}, pages = {263--282}, address = {Istanbul, Turkey}, abstract = {This work describes SST, an algorithm that (a) provides asymptotic (near-)optimality for kinodynamic planning without access to a steering function, (b) maintains only a sparse set of samples, (c) converges fast to high-quality paths and (d) achieves competitive running time to RRT, which provides only probabilistic completeness. This algorithm addresses the limitation of RRT*, which requires a steering function for asymptotic optimality. This issue has motivated recent variations of RRT*, which either work for a limiting set of systems or exhibit increased computational cost. This paper provides formal arguments for the properties of the proposed algorithm. To the best of the authorstextquoteright knowledge, this is the first sparse data structure that provides such desirable guarantees for a wide set of systems under a reasonable set of assumptions. Simulations for a variety of standard benchmarks, including using a physics engine, confirm the argued properties of the approach.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } This work describes SST, an algorithm that (a) provides asymptotic (near-)optimality for kinodynamic planning without access to a steering function, (b) maintains only a sparse set of samples, (c) converges fast to high-quality paths and (d) achieves competitive running time to RRT, which provides only probabilistic completeness. This algorithm addresses the limitation of RRT*, which requires a steering function for asymptotic optimality. This issue has motivated recent variations of RRT*, which either work for a limiting set of systems or exhibit increased computational cost. This paper provides formal arguments for the properties of the proposed algorithm. To the best of the authorstextquoteright knowledge, this is the first sparse data structure that provides such desirable guarantees for a wide set of systems under a reasonable set of assumptions. Simulations for a variety of standard benchmarks, including using a physics engine, confirm the argued properties of the approach. |
2013 |
Littlefield, Z; Li, Y; Bekris, K IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo Big Sight, Japan, 2013. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Littlefield:2013aa, title = {Efficient Sampling-Based Motion Planning with Asymptotic Near-Optimality Guarantees for Systems with Dynamics}, author = {Z Littlefield and Y Li and K Bekris}, url = {http://www.cs.rutgers.edu/~kb572/pubs/sparse_rrt_iros13.pdf}, year = {2013}, date = {2013-11-01}, booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)}, address = {Tokyo Big Sight, Japan}, abstract = {Recent significant progress has provided sampling-based motion planners, such as RRT*, that asymptotically converge to optimal solutions. The basic variant of such methods requires a local planner, which connects two states with a trajectory. For systems with dynamics, the local planner needs to solve a two-point boundary value problem (BVP) for differential equations. Such a solver is not always available for state update equations of interesting systems with dynamics. Furthermore, asymptotically optimal solutions tend to impose increased computational requirements in practice relative to alternatives, such as RRT, that focus on feasibility, state-space exploration speed and which do not require a local planner. This paper describes a sampling-based motion planning solution with the following desirable properties: a) it does not require a BVP solver but only uses a forward propagation model, b) it employs a single propagation per iteration similar to RRT, making it very efficient, c) it is asymptotically near-optimal, and d) provides a sparse data structure for answering path queries, which further improves computational performance. Simulations on prototypical dynamical systems show the method is able to improve the quality of feasible solutions over time and that it is computationally efficient.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } Recent significant progress has provided sampling-based motion planners, such as RRT*, that asymptotically converge to optimal solutions. The basic variant of such methods requires a local planner, which connects two states with a trajectory. For systems with dynamics, the local planner needs to solve a two-point boundary value problem (BVP) for differential equations. Such a solver is not always available for state update equations of interesting systems with dynamics. Furthermore, asymptotically optimal solutions tend to impose increased computational requirements in practice relative to alternatives, such as RRT, that focus on feasibility, state-space exploration speed and which do not require a local planner. This paper describes a sampling-based motion planning solution with the following desirable properties: a) it does not require a BVP solver but only uses a forward propagation model, b) it employs a single propagation per iteration similar to RRT, making it very efficient, c) it is asymptotically near-optimal, and d) provides a sparse data structure for answering path queries, which further improves computational performance. Simulations on prototypical dynamical systems show the method is able to improve the quality of feasible solutions over time and that it is computationally efficient. |
2012 |
Krontiris, A; Sajid, Q; Bekris, K Towards Using Discrete Multiagent Pathfinding to Address Continuous Problems Inproceedings Multiagent Pathfinding, Papers from the 2012 AAAI Workshop, MAPF@AAAI 2012, Toronto, Ontario, Canada, July 22, 2012., 2012. Abstract | Links | BibTeX | Tags: Dynamics @inproceedings{Krontiris:2012ab, title = {Towards Using Discrete Multiagent Pathfinding to Address Continuous Problems}, author = {A Krontiris and Q Sajid and K Bekris}, url = {http://www.aaai.org/ocs/index.php/WS/AAAIW12/paper/view/5328}, year = {2012}, date = {2012-01-01}, booktitle = {Multiagent Pathfinding, Papers from the 2012 AAAI Workshop, MAPF@AAAI 2012, Toronto, Ontario, Canada, July 22, 2012.}, crossref = {DBLP:conf/aaai/2012mapf}, abstract = {Motivated by efficient algorithms for solving combina- torial and discrete instances of the multi-agent pathfind- ing problem, this report investigates ways to utilize such solutions to solve similar problems in the con- tinuous domain. While a simple discretization of the space which allows the direct application of combina- torial algorithms seems like a straightforward solution, there are additional constraints that such a discretiza- tion needs to satisfy in order to be able to provide some form of completeness guarantees in general configura- tion spaces. This report reviews ideas on how to uti- lize combinatorial algorithms to solve continuous multi- agent pathfinding problems. It aims to collect feedback from the community regarding the importance and the complexity of this challenge, as well as the appropriate- ness of the solutions considered here.}, keywords = {Dynamics}, pubstate = {published}, tppubtype = {inproceedings} } Motivated by efficient algorithms for solving combina- torial and discrete instances of the multi-agent pathfind- ing problem, this report investigates ways to utilize such solutions to solve similar problems in the con- tinuous domain. While a simple discretization of the space which allows the direct application of combina- torial algorithms seems like a straightforward solution, there are additional constraints that such a discretiza- tion needs to satisfy in order to be able to provide some form of completeness guarantees in general configura- tion spaces. This report reviews ideas on how to uti- lize combinatorial algorithms to solve continuous multi- agent pathfinding problems. It aims to collect feedback from the community regarding the importance and the complexity of this challenge, as well as the appropriate- ness of the solutions considered here. |
2010 |
Krontiris, A; Louis, S; Bekris, K Simulating Formations of Non-Holonomic Systems with Control Limits along Curvilinear Coordinates Inproceedings Third International Conference on Motion in Games, pp. 121β133, 2010. Abstract | Links | BibTeX | Tags: Dynamics @inproceedings{Krontiris:2010aa, title = {Simulating Formations of Non-Holonomic Systems with Control Limits along Curvilinear Coordinates}, author = {A Krontiris and S Louis and K Bekris}, url = {https://doi.org/10.1007/978-3-642-16958-8_13}, doi = {10.1007/978-3-642-16958-8_13}, year = {2010}, date = {2010-01-01}, booktitle = {Third International Conference on Motion in Games}, pages = {121--133}, crossref = {DBLP:conf/mig/2010}, abstract = {Many games require a method for simulating formations of systems with non-trivial motion constraints, such as aircraft and boats. This paper describes a computationally efficient method for this objective, inspired by solutions in robotics, and describes how to guarantee the satisfaction of the physical constraints. The approach allows a human player to select almost an arbitrary geometric configuration for the formation and to control the aircraft as a single entity. The formation is fixed along curvilinear coordinates, defined by the curvature of the reference trajectory, resulting in naturally looking paths. Moreover, the approach supports dynamic formations and transitions from one desired shape to another. Experiments with a game engine confirm that the proposed method achieves the desired objectives.}, keywords = {Dynamics}, pubstate = {published}, tppubtype = {inproceedings} } Many games require a method for simulating formations of systems with non-trivial motion constraints, such as aircraft and boats. This paper describes a computationally efficient method for this objective, inspired by solutions in robotics, and describes how to guarantee the satisfaction of the physical constraints. The approach allows a human player to select almost an arbitrary geometric configuration for the formation and to control the aircraft as a single entity. The formation is fixed along curvilinear coordinates, defined by the curvature of the reference trajectory, resulting in naturally looking paths. Moreover, the approach supports dynamic formations and transitions from one desired shape to another. Experiments with a game engine confirm that the proposed method achieves the desired objectives. |
2009 |
Bekris, K Informed Planning and Safe Distributed Replanning under Physical Constraints PhD Thesis Rice University (Ph.D Thesis), 2009. Abstract | Links | BibTeX | Tags: Dynamics, Planning @phdthesis{Bekris:2009aa, title = {Informed Planning and Safe Distributed Replanning under Physical Constraints}, author = {K Bekris}, url = {http://www.cs.rutgers.edu/~kb572/pubs/bekris_thesis.pdf}, year = {2009}, date = {2009-01-01}, volume = {PhD Thesis.}, pages = {148}, address = {Houston, TX}, school = {Rice University (Ph.D Thesis)}, abstract = {Motion planning is a fundamental algorithmic problem that attracts attention because of its importance in many exciting applications, such as controlling robots or virtual agents in simulations and computer games. While there has been great progress over the last decades in solving high-dimensional geometric problems there are still many challenges that limit the capabilities of existing solutions. In particular, it is important to effectively model and plan for systems with complex dynamics and significant drift (kinodynamic planning). An additional requirement is that realistic systems and agents must safely operate in a real-time fashion (replanning), with partial knowledge of their surroundings (partial observability) and despite the presence or in collaboration with other moving agents (distributed planning). This thesis describes techniques that address challenges related to real-time motion planning while focusing on systems with non-trivial dynamics. The first contribution is a new kinodynamic planner, termed Informed Subdivision Tree (IST), that incorporates heuristics to solve motion planning queries more effectively while achieving the theoretical guarantee of probabilistic completeness. The thesis proposes also a general methodology to construct heuristics for kinodynamic planning based on configuration space knowledge through a roadmap-based approach. Then this thesis investigates replanning problems, where a planner is called periodically given a predefined amount of time. In this scenario, safety concerns arise by the presence of both dynamic motion constraints and time limitations. The thesis proposes the framework of Short-Term Safety Replanning (STSR), which achieves safety guarantees in this context while minimizing computational overhead. The final contribution corresponds to an extension of the STSR framework in distributed planning, where multiple agents communicate to safely avoid collisions despite their dynamic constraints. The proposed algorithms are tested on simulated systems with interesting dynamics, including physically simulated systems. Such experiments correspond to the state-of-the-art in terms of system modeling for motion planning. The experiments show that the proposed techniques outperform existing alternatives, where available, and emphasize their computational advantages.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {phdthesis} } Motion planning is a fundamental algorithmic problem that attracts attention because of its importance in many exciting applications, such as controlling robots or virtual agents in simulations and computer games. While there has been great progress over the last decades in solving high-dimensional geometric problems there are still many challenges that limit the capabilities of existing solutions. In particular, it is important to effectively model and plan for systems with complex dynamics and significant drift (kinodynamic planning). An additional requirement is that realistic systems and agents must safely operate in a real-time fashion (replanning), with partial knowledge of their surroundings (partial observability) and despite the presence or in collaboration with other moving agents (distributed planning). This thesis describes techniques that address challenges related to real-time motion planning while focusing on systems with non-trivial dynamics. The first contribution is a new kinodynamic planner, termed Informed Subdivision Tree (IST), that incorporates heuristics to solve motion planning queries more effectively while achieving the theoretical guarantee of probabilistic completeness. The thesis proposes also a general methodology to construct heuristics for kinodynamic planning based on configuration space knowledge through a roadmap-based approach. Then this thesis investigates replanning problems, where a planner is called periodically given a predefined amount of time. In this scenario, safety concerns arise by the presence of both dynamic motion constraints and time limitations. The thesis proposes the framework of Short-Term Safety Replanning (STSR), which achieves safety guarantees in this context while minimizing computational overhead. The final contribution corresponds to an extension of the STSR framework in distributed planning, where multiple agents communicate to safely avoid collisions despite their dynamic constraints. The proposed algorithms are tested on simulated systems with interesting dynamics, including physically simulated systems. Such experiments correspond to the state-of-the-art in terms of system modeling for motion planning. The experiments show that the proposed techniques outperform existing alternatives, where available, and emphasize their computational advantages. |
2007 |
Bekris, K; Tsianos, K; Kavraki, L IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS07), San Diego, CA, 2007. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Bekris:2007aa, title = {A Decentralized Planner That Guarantees the Safety of Communicating Vehicles with Complex Dynamics That Replan Online}, author = {K Bekris and K Tsianos and L Kavraki}, url = {http://www.cs.rutgers.edu/~kb572/pubs/decentralized_safety_communication.pdf}, year = {2007}, date = {2007-10-01}, booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS07)}, address = {San Diego, CA}, abstract = {This paper considers the problem of coordinating multiple vehicles with kinodynamic constraints that operate in the same partially-known environment. The vehicles are able to communicate within limited range. Their objective is to avoid collisions between them and with the obstacles, while the vehicles move towards their goals. An important issue of real-time planning for systems with bounded acceleration is that inevitable collision states must also be avoided. The focus of this paper is to guarantee safety despite the dynamic constraints with a decentralized motion planning technique that employs only local information. We propose a coordination framework that allows vehicles to generate and select compatible sets of valid trajectories and prove that this scheme guarantees collision-avoidance in the specified setup. The theoretical results have been also experimentally confirmed with a distributed simulator where each vehicle replans online with a sampling-based, kinodynamic motion planner and uses message-passing to communicate with neighboring agents.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } This paper considers the problem of coordinating multiple vehicles with kinodynamic constraints that operate in the same partially-known environment. The vehicles are able to communicate within limited range. Their objective is to avoid collisions between them and with the obstacles, while the vehicles move towards their goals. An important issue of real-time planning for systems with bounded acceleration is that inevitable collision states must also be avoided. The focus of this paper is to guarantee safety despite the dynamic constraints with a decentralized motion planning technique that employs only local information. We propose a coordination framework that allows vehicles to generate and select compatible sets of valid trajectories and prove that this scheme guarantees collision-avoidance in the specified setup. The theoretical results have been also experimentally confirmed with a distributed simulator where each vehicle replans online with a sampling-based, kinodynamic motion planner and uses message-passing to communicate with neighboring agents. |
Bekris, K; Tsianos, K; Kavraki, L First International Conference on Robot Communication and Coordination (ROBOCOMM 2007), Athens, Greece, 2007. Abstract | Links | BibTeX | Tags: Dynamics, Planning @conference{Bekris:2007ab, title = {A Distributed Protocol for Safe Real-Time Planning of Communicating Vehicles with Second-Order Dynamics}, author = {K Bekris and K Tsianos and L Kavraki}, url = {http://www.cs.rutgers.edu/~kb572/pubs/distributed_safety_communication.pdf}, year = {2007}, date = {2007-10-01}, booktitle = {First International Conference on Robot Communication and Coordination (ROBOCOMM 2007)}, address = {Athens, Greece}, abstract = {This work deals with the problem of planning in real-time, collision-free motions for multiple communicating vehicles that operate in the same, partially-observable environment. A challenging aspect of this problem is how to utilize communication so that vehicles do not reach states from which collisions cannot be avoided due to second-order motion constraints. This paper provides a distributed communication protocol for real-time planning that guarantees collision avoidance with obstacles and between vehicles. It can also allow the retainment of a communication network when the vehicles operate as a networked team. The algorithm is a novel integration of sampling-based motion planners with message-passing protocols for distributed constraint optimization. Each vehicle uses the motion planner to generate candidate feasible trajectories and the message-passing protocol for selecting a safe and compatible trajectory. The existence of such trajectories is guaranteed by the overall approach. Experiments on a distributed simulator built on a cluster of processors confirm the safety properties of the approach in applications such as coordinated exploration. Furthermore, the distributed protocol has better scalability properties when compared against typical priority-based schemes.}, keywords = {Dynamics, Planning}, pubstate = {published}, tppubtype = {conference} } This work deals with the problem of planning in real-time, collision-free motions for multiple communicating vehicles that operate in the same, partially-observable environment. A challenging aspect of this problem is how to utilize communication so that vehicles do not reach states from which collisions cannot be avoided due to second-order motion constraints. This paper provides a distributed communication protocol for real-time planning that guarantees collision avoidance with obstacles and between vehicles. It can also allow the retainment of a communication network when the vehicles operate as a networked team. The algorithm is a novel integration of sampling-based motion planners with message-passing protocols for distributed constraint optimization. Each vehicle uses the motion planner to generate candidate feasible trajectories and the message-passing protocol for selecting a safe and compatible trajectory. The existence of such trajectories is guaranteed by the overall approach. Experiments on a distributed simulator built on a cluster of processors confirm the safety properties of the approach in applications such as coordinated exploration. Furthermore, the distributed protocol has better scalability properties when compared against typical priority-based schemes. |
2024 |
The State of Robot Motion Generation Inproceedings International Symposium of Robotics Research (ISRR), Long Beach, California, 2024. |
MORALS: Analysis of High-Dimensional Robot Controllers Via Topological Tools in a Latent Space Conference IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan (Nominated for Best Paper Award in Automation), 2024. |
2023 |
Data-Efficient Characterization of the Global Dynamics of Robot Controllers with Confidence Guarantees Inproceedings IEEE International Conference on Robotics and Automation (ICRA), London, UK, 2023. |
2022 |
Morse Graphs: Topological Tools for Analyzing the Global Dynamics of Robot Controllers Inproceedings Workshop on the Algorithmic Foundations of Robotics (WAFR), 2022. |
Model Identification and Control of a Mobile Robot with Omnidirectional Wheels Using Differentiable Physics Inproceedings IEEE International Conference on Robotics and Automation (ICRA), 2022. |
2021 |
Sim2Sim Evaluation of a Novel Data-Efficient Differentiable Physics Engine for Tensegrity Robots Inproceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. |
Improving Kinodynamic Planners for Vehicular Navigation with Learned Goal-Reaching Controllers Inproceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021. |
2020 |
Tools for Data-Driven Modeling of Within-Hand Manipulation with Underactuated Adaptive Hands Conference Learning for Dynamics & Control (L4DC), Berkeley, CA, 2020. |
Efficient and Asymptotically Optimal Kinodynamic Motion Planning PhD Thesis Rutgers, the State University of New Jersey, 2020. |
2019 |
Kinodynamic Planning for Spherical Tensegrity Locomotion with Effective Gait Primitives Journal Article International Journal of Robotics Research (IJRR), 2019. |
Towards Learning Efficient Maneuver Sets for Kinodynamic Motion Planning Technical Report 2019. |
Probabilistic Completeness of RRT for Geometric and Kinodynamic Planning with Forward Propagation Journal Article IEEE Robotics and Automation Letters (RA-L) (also appearing at IEEE ICRA 2019), 2019. |
2018 |
Efficient and Asymptotically Optimal Kinodynamic Motion Planning Via Dominance-Informed Regions Conference IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 2018. |
Fast Model Identification Via Physics Engines for Data-Efficient Policy Search Conference International Joint Conference on Artificial Intelligence (IJCAI), Stockholm, Sweden, 2018. |
Discovering a Library of Rhythmic Gaits for Spherical Tensegrity Locomotion Conference IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 2018. |
Symmetric Reduction of Tensegrity Rover Dynamics for Efficient Data-Driven Control Conference ASCE Earth and Space Conference, Symposium on "Tensegrity - Structural Concept and Applications", Cleveland, Ohio, 2018. |
2017 |
Informed Asymptotically Near-Optimal Planning for Field Robots with Dynamics Conference 11th Conference on Field and Service Robotics (FSR) 2017, Zurich, Switzerland, 2017. |
2014 |
Sparse Methods for Efficient Asymptotically Optimal Kinodynamic Planning Conference Workshop on the Algorithmic Foundations of Robotics (WAFR), Istanbul, Turkey, 2014. |
2013 |
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo Big Sight, Japan, 2013. |
2012 |
Towards Using Discrete Multiagent Pathfinding to Address Continuous Problems Inproceedings Multiagent Pathfinding, Papers from the 2012 AAAI Workshop, MAPF@AAAI 2012, Toronto, Ontario, Canada, July 22, 2012., 2012. |
2010 |
Simulating Formations of Non-Holonomic Systems with Control Limits along Curvilinear Coordinates Inproceedings Third International Conference on Motion in Games, pp. 121β133, 2010. |
2009 |
Informed Planning and Safe Distributed Replanning under Physical Constraints PhD Thesis Rice University (Ph.D Thesis), 2009. |
2007 |
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS07), San Diego, CA, 2007. |
First International Conference on Robot Communication and Coordination (ROBOCOMM 2007), Athens, Greece, 2007. |