Autosoft Journal

Online Manuscript Access

Path Navigation For Indoor Robot With Q-Learning



A Q-learning based path navigation method is proposed and validated in this paper for solving the moving control along specified path of real indoor mobile robot. A grid and topological indoor corridor environment map is employed and characterized by a set of geometrical scale invariant key-points. The navigation strategy is composed of on-line and off-line stages with the same components redefinitions or definitions of Q-learning. During the off-line learning stage, the personal computer records the optimal path after computer learning simulation, and then the path is sent to the robot through wireless data radio with RS232. At the on-line navigation stage, the robot calculates the relative positions between the locations along this optimal path, and then navigates the environment autonomously. The experiments on computer simulation and an actual robot have been verified the superior effectiveness and applicability of the proposed strategy.



Total Pages: 7
Pages: 317-323


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways

Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Volume: 22
Issue: 2
Year: 2016

Cite this document


Abdessemed F. International Journal of Advanced Robotic Systems

Aung, Kathy Thi, and Takayasu Fuchida. "A Comparison of Learning Performance in Two-Dimensional Q-Learning by the Difference of Q-Values Alignment." Artificial Life and Robotics 16.4 (2012): 473-477. Crossref. Web.

Chang, Ya‐Chun, and Yoshio Yamamoto. "On‐line Path Planning Strategy Integrated with Collision and Dead‐lock Avoidance Schemes for Wheeled Mobile Robot in Indoor Environments." Ed. Jeff Franks. Industrial Robot: An International Journal 35.5 (2008): 421-434. Crossref. Web.

Cho, Seungkeun, Jaehyun Park, and Jangmyung Lee. "A Dynamic Localization Algorithm for a High-Speed Mobile Robot Using Indoor GPS." Robotica 30.04 (2011): 681-690. Crossref. Web.

Courbon, Jonathan, Youcef Mezouar, and Philippe Martinet. "Indoor Navigation of a Non-Holonomic Mobile Robot Using a Visual Memory." Autonomous Robots 25.3 (2008): 253-266. Crossref. Web.

Huang, Hsin-Hsiung, Juing-Huei Su, and Chyi-Shyong Lee. "A Contest-Oriented Project for Learning Intelligent Mobile Robots." IEEE Transactions on Education 56.1 (2013): 88-97. Crossref. Web.

Huang L. Advances in Information Sciences and Service Sciences

Kim, Seong Jin, and Byung Kook Kim. "Dynamic Ultrasonic Hybrid Localization System for Indoor Mobile Robots." IEEE Transactions on Industrial Electronics 60.10 (2013): 4562-4573. Crossref. Web.

Konar, Amit et al. "A Deterministic Improved Q-Learning for Path Planning of a Mobile Robot." IEEE Transactions on Systems, Man, and Cybernetics: Systems 43.5 (2013): 1141-1153. Crossref. Web.

Louchene, A. Journal of Intelligent and Robotic Systems 37.2 (2003): 163-175. Crossref. Web.

Maaref, H., and C. Barret. "Sensor-Based Navigation of a Mobile Robot in an Indoor Environment." Robotics and Autonomous Systems 38.1 (2002): 1-18. Crossref. Web.

Peters, Jan, and Stefan Schaal. "Learning to Control in Operational Space." The International Journal of Robotics Research 27.2 (2008): 197-212. Crossref. Web.

Santos, Matilde et al. "Dyna-: A Heuristic Planning Reinforcement Learning Algorithm Applied to Role-Playing Game Strategy Decision Systems." Knowledge-Based Systems 32 (2012): 28-36. Crossref. Web.

Seder, Marija, Petar Mostarac, and Ivan Petrović. "Hierarchical Path Planning of Mobile Robots in Complex Indoor Environments." Transactions of the Institute of Measurement and Control 33.3-4 (2010): 332-358. Crossref. Web.

Thrun, Sebastian. "Learning Metric-Topological Maps for Indoor Mobile Robot Navigation." Artificial Intelligence 99.1 (1998): 21-71. Crossref. Web.

Zhu, Yi et al. "A Hybrid Navigation Strategy for Multiple Mobile Robots." Robotics and Computer-Integrated Manufacturing 29.4 (2013): 129-141. Crossref. Web.


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048