2025 |
Granados, E; Tangirala, S; Bekris, K Kinodynamic Trajectory Following with STELA: Simultaneous Trajectory Estimation & Local Adaptation Conference Proceedings of Robotics: Science and Systems (RSS), 2025. Abstract | Links | BibTeX | Tags: Dynamics, Estimation @conference{granados2025kinodynamic, title = {Kinodynamic Trajectory Following with STELA: Simultaneous Trajectory Estimation & Local Adaptation}, author = {E Granados and S Tangirala and K Bekris}, url = {https://prx-kinodynamic.github.io/projects/stela}, year = {2025}, date = {2025-06-21}, booktitle = {Proceedings of Robotics: Science and Systems (RSS)}, abstract = {State estimation and control are often addressed separately, leading to unsafe execution due to sensing noise, execution errors, and discrepancies between the planning model and reality. Simultaneous control and trajectory estimation using probabilistic graphical models has been proposed as a unified solution to these challenges. Previous work, however, relies heavily on appropriate Gaussian priors and is limited to holonomic robots with linear time-varying models. The current research extends graphical optimization methods to vehicles with arbitrary dynamical models via Simultaneous Trajectory Estimation and Local Adaptation (STELA). The overall approach initializes feasible trajectories using a kinodynamic, sampling-based motion planner. Then, it simultaneously: (i) estimates the past trajectory based on noisy observations, and (ii) adapts the controls to be executed to minimize deviations from the planned, feasible trajectory, while avoiding collisions. The proposed factor graph representation of trajectories in STELA can be applied for any dynamical system given access to first or second-order state update equations, and introduces the duration of execution between two states in the trajectory discretization as an optimization variable. These features provide both generalization and flexibility in trajectory following. In addition to targeting computational efficiency, the proposed strategy performs incremental updates of the factor graph using the iSAM algorithm and introduces a time-window mechanism. This mechanism allows the factor graph to be dynamically updated to operate over a limited history and forward horizon of the planned trajectory. This enables online updates of controls at a minimum of 10Hz. Experiments demonstrate that STELA achieves at least comparable performance to previous frameworks on idealized vehicles with linear dynamics. STELA also directly applies to and successfully solves trajectory following problems for more complex dynamical models. Beyond generalization, simulations assess STELA's robustness under varying levels of sensing and execution noise, while ablation studies highlight the importance of different components of STELA. Real-world experiments validate STELA's practical applicability on a low-cost MuSHR robot, which exhibits high noise and non-trivial dynamics.}, keywords = {Dynamics, Estimation}, pubstate = {published}, tppubtype = {conference} } State estimation and control are often addressed separately, leading to unsafe execution due to sensing noise, execution errors, and discrepancies between the planning model and reality. Simultaneous control and trajectory estimation using probabilistic graphical models has been proposed as a unified solution to these challenges. Previous work, however, relies heavily on appropriate Gaussian priors and is limited to holonomic robots with linear time-varying models. The current research extends graphical optimization methods to vehicles with arbitrary dynamical models via Simultaneous Trajectory Estimation and Local Adaptation (STELA). The overall approach initializes feasible trajectories using a kinodynamic, sampling-based motion planner. Then, it simultaneously: (i) estimates the past trajectory based on noisy observations, and (ii) adapts the controls to be executed to minimize deviations from the planned, feasible trajectory, while avoiding collisions. The proposed factor graph representation of trajectories in STELA can be applied for any dynamical system given access to first or second-order state update equations, and introduces the duration of execution between two states in the trajectory discretization as an optimization variable. These features provide both generalization and flexibility in trajectory following. In addition to targeting computational efficiency, the proposed strategy performs incremental updates of the factor graph using the iSAM algorithm and introduces a time-window mechanism. This mechanism allows the factor graph to be dynamically updated to operate over a limited history and forward horizon of the planned trajectory. This enables online updates of controls at a minimum of 10Hz. Experiments demonstrate that STELA achieves at least comparable performance to previous frameworks on idealized vehicles with linear dynamics. STELA also directly applies to and successfully solves trajectory following problems for more complex dynamical models. Beyond generalization, simulations assess STELA's robustness under varying levels of sensing and execution noise, while ablation studies highlight the importance of different components of STELA. Real-world experiments validate STELA's practical applicability on a low-cost MuSHR robot, which exhibits high noise and non-trivial dynamics. |
2012 |
Apostolopoulos, I; Fallah, N; Folmer, E; Bekris, K Integrated Online Localization and Navigation for People with Visual Impairments Using Smart Phones Conference IEEE International Conference on Robotics and Automation (ICRA), Minnesota, MN, 2012. Abstract | Links | BibTeX | Tags: Estimation @conference{Apostolopoulos:2012aa, title = {Integrated Online Localization and Navigation for People with Visual Impairments Using Smart Phones}, author = {I Apostolopoulos and N Fallah and E Folmer and K Bekris}, url = {http://www.cs.rutgers.edu/~kb572/pubs/ICRA12_1454_FI.pdf}, year = {2012}, date = {2012-05-01}, booktitle = {IEEE International Conference on Robotics and Automation (ICRA)}, address = {Minnesota, MN}, abstract = {Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work de- scribes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the usertextquoterights location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the usertextquoterights step length. The current work investigates different schemes for automatically computing the usertextquoterights step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators.}, keywords = {Estimation}, pubstate = {published}, tppubtype = {conference} } Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work de- scribes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the usertextquoterights location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the usertextquoterights step length. The current work investigates different schemes for automatically computing the usertextquoterights step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators. |
2011 |
Apostolopoulos, I Integrating Minimalistic Localization and Navigation for People with Visual Impairments Masters Thesis University of Nevada, Reno, 2011. Abstract | Links | BibTeX | Tags: Estimation, Planning @mastersthesis{Apostolopoulos:2011aa, title = {Integrating Minimalistic Localization and Navigation for People with Visual Impairments}, author = {I Apostolopoulos}, url = {http://www.cs.rutgers.edu/~kb572/pubs/Apostolopoulos_MS_2011.pdf}, year = {2011}, date = {2011-04-01}, volume = {MS Thesis.}, school = {University of Nevada, Reno}, abstract = {Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. This ap- proach introduces some challenges due to the limited computational power of the portable devices and the highly erroneous sensors. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the location of the user in real time and uses it to provide audio instructions on how to reach the desired destination. A first set of experiments suggested that the accuracy of the localization depends on the type of directions provided and the availability of good transition and observation models that describe the user's behavior. During this initial set of experiments, the system was not executed in real time so the approach had to be improved. Towards an improved version of the method, a significant amount of computation was transferred offline in order to speed up the system's online execution. Inspired by results in multi-model estimation, this work employs multiple particle filters, where each one uses a different assumption for the user's average step length. This helps to adaptively estimate the value of this pa- rameter on the fly. The system simultaneously estimates the step length of the user, as it varies between different people, from path to path, and during the execution of the path. Experiments are presented that evaluate the accuracy of the location estimation process and of the integrated direction provision method. Sighted people, that were blindfolded, participated in these experiments.}, keywords = {Estimation, Planning}, pubstate = {published}, tppubtype = {mastersthesis} } Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. This ap- proach introduces some challenges due to the limited computational power of the portable devices and the highly erroneous sensors. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the location of the user in real time and uses it to provide audio instructions on how to reach the desired destination. A first set of experiments suggested that the accuracy of the localization depends on the type of directions provided and the availability of good transition and observation models that describe the user's behavior. During this initial set of experiments, the system was not executed in real time so the approach had to be improved. Towards an improved version of the method, a significant amount of computation was transferred offline in order to speed up the system's online execution. Inspired by results in multi-model estimation, this work employs multiple particle filters, where each one uses a different assumption for the user's average step length. This helps to adaptively estimate the value of this pa- rameter on the fly. The system simultaneously estimates the step length of the user, as it varies between different people, from path to path, and during the execution of the path. Experiments are presented that evaluate the accuracy of the location estimation process and of the integrated direction provision method. Sighted people, that were blindfolded, participated in these experiments. |
2005 |
Ladd, A; Bekris, K; Rudys, A; Kavraki, L; Wallach, D Robotics-Based Location Sensing Using Wireless Ethernet Journal Article Wirel. Networks, 11 (1-2), pp. 189–204, 2005. Abstract | Links | BibTeX | Tags: Estimation @article{DBLP:journals/winet/LaddBRKW05, title = {Robotics-Based Location Sensing Using Wireless Ethernet}, author = {A Ladd and K Bekris and A Rudys and L Kavraki and D Wallach}, url = {https://doi.org/10.1007/s11276-004-4755-8}, doi = {10.1007/S11276-004-4755-8}, year = {2005}, date = {2005-01-01}, journal = {Wirel. Networks}, volume = {11}, number = {1-2}, pages = {189--204}, abstract = {A key subproblem in the construction of location-aware systems is the determination of the position of a mobile device. This article describes the design, implementation and analysis of a system for determining position inside a building from measured RF signal strengths of packets on an IEEE 802.11b wireless Ethernet network. Previous approaches to location-awareness with RF signals have been severely hampered by non-Gaussian signals, noise, and complex correlations due to multi-path effects, interference and absorption. The design of our system begins with the observation that determining position from complex, noisy and non-Gaussian signals is a well-studied problem in the field of robotics. Using only off-the-shelf hardware, we achieve robust position estimation to within a meter in our experimental context and after adequate training of our system. We can also coarsely determine our orientation and can track our position as we move. Our results show that we can localize a stationary device to within 1.5 meters over 80% of the time and track a moving device to within 1 meter over 50% of the time. Both localization and tracking run in real-time. By applying recent advances in probabilistic inference of position and sensor fusion from noisy signals, we show that the RF emissions from base stations as measured by off-the-shelf wireless Ethernet cards are sufficiently rich in information to permit a mobile device to reliably track its location.}, keywords = {Estimation}, pubstate = {published}, tppubtype = {article} } A key subproblem in the construction of location-aware systems is the determination of the position of a mobile device. This article describes the design, implementation and analysis of a system for determining position inside a building from measured RF signal strengths of packets on an IEEE 802.11b wireless Ethernet network. Previous approaches to location-awareness with RF signals have been severely hampered by non-Gaussian signals, noise, and complex correlations due to multi-path effects, interference and absorption. The design of our system begins with the observation that determining position from complex, noisy and non-Gaussian signals is a well-studied problem in the field of robotics. Using only off-the-shelf hardware, we achieve robust position estimation to within a meter in our experimental context and after adequate training of our system. We can also coarsely determine our orientation and can track our position as we move. Our results show that we can localize a stationary device to within 1.5 meters over 80% of the time and track a moving device to within 1 meter over 50% of the time. Both localization and tracking run in real-time. By applying recent advances in probabilistic inference of position and sensor fusion from noisy signals, we show that the RF emissions from base stations as measured by off-the-shelf wireless Ethernet cards are sufficiently rich in information to permit a mobile device to reliably track its location. |
2004 |
Ladd, A; Bekris, K; Rudys, A; Kavraki, L; Wallach, D On the Feasibility of Using Wireless Ethernet for Indoor Localization Journal Article IEEE Transactions on Robotics and Automation (TRA), 20 (3), 2004. Abstract | Links | BibTeX | Tags: Estimation @article{Ladd:2004aa, title = {On the Feasibility of Using Wireless Ethernet for Indoor Localization}, author = {A Ladd and K Bekris and A Rudys and L Kavraki and D Wallach}, url = {http://www.cs.rutgers.edu/~kb572/pubs/wireless_localization_feasibility.pdf}, year = {2004}, date = {2004-06-01}, journal = {IEEE Transactions on Robotics and Automation (TRA)}, volume = {20}, number = {3}, chapter = {555-559}, abstract = {IEEE 802.11b wireless Ethernet is becoming the standard for indoor wireless communication. This paper proposes the use of measured signal strength of Ethernet packets as a sensor for a localization system. We demonstrate that off-the-shelf hardware can accurately be used for location sensing and real-time tracking by applying a Bayesian localization framework.}, keywords = {Estimation}, pubstate = {published}, tppubtype = {article} } IEEE 802.11b wireless Ethernet is becoming the standard for indoor wireless communication. This paper proposes the use of measured signal strength of Ethernet packets as a sensor for a localization system. We demonstrate that off-the-shelf hardware can accurately be used for location sensing and real-time tracking by applying a Bayesian localization framework. |
2002 |
Ladd, A; Bekris, K; Marceau, G; Rudys, A; Kavraki, L; Wallach, D Using Wireless Ethernet for Localization Conference IEEE/RJS International Conference on Intelligent Robots and Systems (IROS02), Lausanne, Switzerland, 2002. Abstract | Links | BibTeX | Tags: Estimation @conference{Ladd:2002aa, title = {Using Wireless Ethernet for Localization}, author = {A Ladd and K Bekris and G Marceau and A Rudys and L Kavraki and D Wallach}, url = {https://ieeexplore.ieee.org/document/1041423}, year = {2002}, date = {2002-09-01}, booktitle = {IEEE/RJS International Conference on Intelligent Robots and Systems (IROS02)}, address = {Lausanne, Switzerland}, abstract = {IEEE 802.11b wireless Ethernet is rapidly becoming the standard for in-building and short-range wireless communication. Many mobile devices such as mobile robots, laptops and PDAs already use this protocol for wireless communication. Many wireless Ethernet cards measure the signal strength of incoming packets. This paper investigates the feasibility of implementing a localization system using this sensor. Using a Bayesian localization framework, we show experiments demonstrating that off-the-shelf wireless hardware can accurately be used for location sensing and tracking with about one meter precision in a wireless-enabled office building.}, keywords = {Estimation}, pubstate = {published}, tppubtype = {conference} } IEEE 802.11b wireless Ethernet is rapidly becoming the standard for in-building and short-range wireless communication. Many mobile devices such as mobile robots, laptops and PDAs already use this protocol for wireless communication. Many wireless Ethernet cards measure the signal strength of incoming packets. This paper investigates the feasibility of implementing a localization system using this sensor. Using a Bayesian localization framework, we show experiments demonstrating that off-the-shelf wireless hardware can accurately be used for location sensing and tracking with about one meter precision in a wireless-enabled office building. |
Ladd, A; Bekris, K; Rudys, A; Kavraki, L; Wallach, D; Marceau, G Robotics-Based Location Sensing Using Wireless Ethernet Inproceedings Eighth Annual International Conference on Mobile Computing and Networking (MOBICOM), pp. 227–238, Atlanta, Georgia, USA, 2002. Abstract | Links | BibTeX | Tags: Estimation @inproceedings{DBLP:conf/mobicom/LaddBRKWM02, title = {Robotics-Based Location Sensing Using Wireless Ethernet}, author = {A Ladd and K Bekris and A Rudys and L Kavraki and D Wallach and G Marceau}, url = {http://doi.acm.org/10.1145/570645.570674}, doi = {10.1145/570645.570674}, year = {2002}, date = {2002-09-01}, booktitle = {Eighth Annual International Conference on Mobile Computing and Networking (MOBICOM)}, pages = {227--238}, address = {Atlanta, Georgia, USA}, crossref = {DBLP:conf/mobicom/2002}, abstract = {A key subproblem in the construction of location-aware systems is the determination of the position of a mobile device. This paper describes the design, implementation and analysis of a system for determining position inside a building from measured RF signal strengths of packets on an IEEE 802.11b wireless Ethernet network. Previous approaches to location awareness with RF signals have been severely hampered by non-linearity, noise and complex correlations due to multi-path effects, interference and absorption. The design of our system begins with the observation that determining position from complex, noisy and non-linear signals is a well-studied problem in the field of robotics. Using only off-the-shelf hardware, we achieve robust position estimation to within a meter in our experimental context and after adequate training of our system. We can also coarsely determine our orientation and can track our position as we move. By applying recent advances in probabilistic inference of position and sensor fusion from noisy signals, we show that the RF emissions from base stations as measured by off-the-shelf wireless Ethernet cards are sufficiently rich in information to permit a mobile device to reliably track its location.}, keywords = {Estimation}, pubstate = {published}, tppubtype = {inproceedings} } A key subproblem in the construction of location-aware systems is the determination of the position of a mobile device. This paper describes the design, implementation and analysis of a system for determining position inside a building from measured RF signal strengths of packets on an IEEE 802.11b wireless Ethernet network. Previous approaches to location awareness with RF signals have been severely hampered by non-linearity, noise and complex correlations due to multi-path effects, interference and absorption. The design of our system begins with the observation that determining position from complex, noisy and non-linear signals is a well-studied problem in the field of robotics. Using only off-the-shelf hardware, we achieve robust position estimation to within a meter in our experimental context and after adequate training of our system. We can also coarsely determine our orientation and can track our position as we move. By applying recent advances in probabilistic inference of position and sensor fusion from noisy signals, we show that the RF emissions from base stations as measured by off-the-shelf wireless Ethernet cards are sufficiently rich in information to permit a mobile device to reliably track its location. |
2025 |
Kinodynamic Trajectory Following with STELA: Simultaneous Trajectory Estimation & Local Adaptation Conference Proceedings of Robotics: Science and Systems (RSS), 2025. |
2012 |
Integrated Online Localization and Navigation for People with Visual Impairments Using Smart Phones Conference IEEE International Conference on Robotics and Automation (ICRA), Minnesota, MN, 2012. |
2011 |
Integrating Minimalistic Localization and Navigation for People with Visual Impairments Masters Thesis University of Nevada, Reno, 2011. |
2005 |
Robotics-Based Location Sensing Using Wireless Ethernet Journal Article Wirel. Networks, 11 (1-2), pp. 189–204, 2005. |
2004 |
On the Feasibility of Using Wireless Ethernet for Indoor Localization Journal Article IEEE Transactions on Robotics and Automation (TRA), 20 (3), 2004. |
2002 |
Using Wireless Ethernet for Localization Conference IEEE/RJS International Conference on Intelligent Robots and Systems (IROS02), Lausanne, Switzerland, 2002. |
Robotics-Based Location Sensing Using Wireless Ethernet Inproceedings Eighth Annual International Conference on Mobile Computing and Networking (MOBICOM), pp. 227–238, Atlanta, Georgia, USA, 2002. |