Autosoft Journal

Online Manuscript Access


Path Navigation For Indoor Robot With Q-Learning


Authors



Abstract

A Q-learning based path navigation method is proposed and validated in this paper for solving the moving control along specified path of real indoor mobile robot. A grid and topological indoor corridor environment map is employed and characterized by a set of geometrical scale invariant key-points. The navigation strategy is composed of on-line and off-line stages with the same components redefinitions or definitions of Q-learning. During the off-line learning stage, the personal computer records the optimal path after computer learning simulation, and then the path is sent to the robot through wireless data radio with RS232. At the on-line navigation stage, the robot calculates the relative positions between the locations along this optimal path, and then navigates the environment autonomously. The experiments on computer simulation and an actual robot have been verified the superior effectiveness and applicability of the proposed strategy.


Keywords


Pages

Total Pages: 7
Pages: 317-323

DOI
10.1080/10798587.2015.1095485


Manuscript ViewPdf Subscription required to access this document

Obtain access this manuscript in one of the following ways


Already subscribed?

Need information on obtaining a subscription? Personal and institutional subscriptions are available.

Already an author? Have access via email address?


Published

Volume: 22
Issue: 2
Year: 2016

Cite this document


References

Abdessemed F. International Journal of Advanced Robotic Systems https://doi.org/10.5772/57434

Aung, Kathy Thi, and Takayasu Fuchida. "A Comparison of Learning Performance in Two-Dimensional Q-Learning by the Difference of Q-Values Alignment." Artificial Life and Robotics 16.4 (2012): 473-477. Crossref. Web. https://doi.org/10.1007/s10015-011-0961-5

https://doi.org/10.5614/itbj.eng.sci.2012.44.2.4

Chang, Ya‐Chun, and Yoshio Yamamoto. "On‐line Path Planning Strategy Integrated with Collision and Dead‐lock Avoidance Schemes for Wheeled Mobile Robot in Indoor Environments." Ed. Jeff Franks. Industrial Robot: An International Journal 35.5 (2008): 421-434. Crossref. Web. https://doi.org/10.1108/01439910810893590

Cho, Seungkeun, Jaehyun Park, and Jangmyung Lee. "A Dynamic Localization Algorithm for a High-Speed Mobile Robot Using Indoor GPS." Robotica 30.04 (2011): 681-690. Crossref. Web. https://doi.org/10.1017/S0263574711000907

Courbon, Jonathan, Youcef Mezouar, and Philippe Martinet. "Indoor Navigation of a Non-Holonomic Mobile Robot Using a Visual Memory." Autonomous Robots 25.3 (2008): 253-266. Crossref. Web. https://doi.org/10.1007/s10514-008-9093-8

Huang, Hsin-Hsiung, Juing-Huei Su, and Chyi-Shyong Lee. "A Contest-Oriented Project for Learning Intelligent Mobile Robots." IEEE Transactions on Education 56.1 (2013): 88-97. Crossref. Web. https://doi.org/10.1109/TE.2012.2215328

Huang L. Advances in Information Sciences and Service Sciences

Kim, Seong Jin, and Byung Kook Kim. "Dynamic Ultrasonic Hybrid Localization System for Indoor Mobile Robots." IEEE Transactions on Industrial Electronics 60.10 (2013): 4562-4573. Crossref. Web. https://doi.org/10.1109/TIE.2012.2216235

Konar, Amit et al. "A Deterministic Improved Q-Learning for Path Planning of a Mobile Robot." IEEE Transactions on Systems, Man, and Cybernetics: Systems 43.5 (2013): 1141-1153. Crossref. Web. https://doi.org/10.1109/TSMCA.2012.2227719

Louchene, A. Journal of Intelligent and Robotic Systems 37.2 (2003): 163-175. Crossref. Web. https://doi.org/10.1023/A:1024104922437

Maaref, H., and C. Barret. "Sensor-Based Navigation of a Mobile Robot in an Indoor Environment." Robotics and Autonomous Systems 38.1 (2002): 1-18. Crossref. Web. https://doi.org/10.1016/S0921-8890(01)00165-8

Peters, Jan, and Stefan Schaal. "Learning to Control in Operational Space." The International Journal of Robotics Research 27.2 (2008): 197-212. Crossref. Web. https://doi.org/10.1177/0278364907087548

Santos, Matilde et al. "Dyna-: A Heuristic Planning Reinforcement Learning Algorithm Applied to Role-Playing Game Strategy Decision Systems." Knowledge-Based Systems 32 (2012): 28-36. Crossref. Web. https://doi.org/10.1016/j.knosys.2011.09.008

Seder, Marija, Petar Mostarac, and Ivan Petrović. "Hierarchical Path Planning of Mobile Robots in Complex Indoor Environments." Transactions of the Institute of Measurement and Control 33.3-4 (2010): 332-358. Crossref. Web. https://doi.org/10.1177/0142331208100107

Thrun, Sebastian. "Learning Metric-Topological Maps for Indoor Mobile Robot Navigation." Artificial Intelligence 99.1 (1998): 21-71. Crossref. Web. https://doi.org/10.1016/S0004-3702(97)00078-7

Zhu, Yi et al. "A Hybrid Navigation Strategy for Multiple Mobile Robots." Robotics and Computer-Integrated Manufacturing 29.4 (2013): 129-141. Crossref. Web. https://doi.org/10.1016/j.rcim.2012.11.007

JOURNAL INFORMATION


ISSN PRINT: 1079-8587
ISSN ONLINE: 2326-005X
DOI PREFIX: 10.31209
10.1080/10798587 with T&F
IMPACT FACTOR: 0.652 (2017/2018)
Journal: 1995-Present




CONTACT INFORMATION


TSI Press
18015 Bullis Hill
San Antonio, TX 78258 USA
PH: 210 479 1022
FAX: 210 479 1048
EMAIL: tsiepress@gmail.com
WEB: http://www.wacong.org/tsi/