Color-Based Image Processing for Autonomous Human Following Trolley Robot Navigation with Camera Vision

Budi Artono(1), Widya Nugroho(2), Rizki Wahyudi(3),


(1) State Polytechnic of Madiun
(2) State Polytechnic of Madiun
(3) Universitas Amikom Purwokerto

Abstract


The rapid advancements in the field of robotics have spurred intensive research, particularly in the industrial sector, aiming to develop robots that can assist in simplifying daily human tasks. One emerging area of research involves the design of a cargo-carrying robot trolley. This trolley robot has the capability to follow a person carrying items by recognizing the color of the clothes worn by that person through image processing. The objective of this research is to facilitate the transportation of goods, especially in airport environments, by enabling the robot to identify and follow human objects with a minimum distance of 30 centimeters and a maximum distance of over 3 meters. The design system of this robot trolley utilizes a camera sensor to detect the object to be followed through image processing using OpenCV on the Microsoft Visual Studio 2012 platform. The image processing results in PWM values sent to the Arduino to drive DC motors. Additionally, ultrasonic sensors are employed to restrict the robot's movement in its surroundings, preventing collisions. The robot's speed can adjust according to the walking speed of a person. If the robot is moving too fast, it will be stopped by the ultrasonic sensor when the distance between the robot and the person being followed is less than 30 cm, avoiding collisions between the robot and the person.

Keywords


Image Processing; Robotics; Trolley Robot;

Full Text:

PDF

References


Shahria MT, Sunny MSH, Zarif MII, Ghommam J, Ahamed SI, Rahman MH. A Comprehensive Review of Vision-Based Robotic Applications: Current State, Components, Approaches, Barriers, and Potential Solutions. Robotics. 2022; 11(6):139. https://doi.org/10.3390/robotics11060139.

M. Lovita and R. Mukhaiyar, “Rancang Bangun Troli Otomatis Berbasis Computer Vision”, JTEIN, vol. 3, no. 2, pp. 399-406, Aug. 2022. https://doi.org/10.24036/jtein.v3i2.265

M. . Akbar Suprobo, S. . Hariyadi, and W. . Suryono, “Smart Electric Trolley Menggunakan Sistem Pengereman Otomatis Berbasis Wemos D1R1”, SNITP, vol. 5, no. 1, Jul. 2022.

G. Ananda, C. Wahyuni, E. Sania, and S. Sukardi, “Design of An Automatic Follower Shopping Trolley Based on Image Processing”, Teknomekanik, vol. 2, no. 2, pp. 48-54, Dec. 2019. https://doi.org/10.24036/tm.v2i1.3472

Ambikapathy, A., et al. "Analysis of Object Following Robot Module Using Android, Arduino and Open CV, Raspberry Pi with OpenCV and Color Based Vision Recognition." Advances in Power Systems and Energy Management: Select Proceedings of ETAEERE 2020. Springer Singapore, 2021. https://doi.org/10.1007/978-981-15-7504-4_35

G. R. Poornima, J. L. Avinash, S. Palle, S. Santosh Kumar, K. N. Sunil Kumar and P. Rajendra Prasad, "Image Processing Based Human Pursuing Robot," 2020 International Conference on Recent Trends on Electronics, Information, Communication & Technology (RTEICT), Bangalore, India, 2020, pp. 408-412, doi: 10.1109/RTEICT49044.2020.9315662

Hugeng Hugeng, Ivan Darrius, Meirista Wulandari; Design of automatic trolley based on microcontroller. AIP Conf. Proc. 7 December 2023; 2680 (1): 020042. https://doi.org/10.1063/5.0126127

X. Zhang, Q. Xu, B. Li and L. Liu, "Design and Implementation of Supermarket Shopping Robot," 2021 3rd International Conference on Artificial Intelligence and Advanced Manufacture (AIAM), Manchester, United Kingdom, 2021, pp. 233-236, doi: 10.1109/AIAM54119.2021.00055.

N. N. Azimi, A. S. Arman Sabri, N. H. Shamsul, And N. A. Ahmad, “Auto Following Trolley”, MARI, vol. 4, no. 2, pp. 303–310, Jan. 2023.

A. Imron and I. Anshory, “Design And Build Electric Trolly To Accelerate The Distribution Of Goods In The Warehouse”, PELS, vol. 3, Dec. 2022. https://doi.org/10.21070/pels.v3i0.1366

M. Sanap, P. Chimurkar and N. Bhagat, "SMART-Smart Mobile Autonomous Robotic Trolley," 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2020, pp. 430-437, doi: 10.1109/ICICCS48265.2020.9120972

Azis, Abdul, Emidiana Emidiana, and Fathir Azukruf. "Perancangan Prototipe Robot Pembawa Barang Otomatis Berbasis Arduino Uno DIP dengan Sensor Ultrasonic." Elektrika 15.1 (2023): 29-38. http://dx.doi.org/10.26623/elektrika.v15i1.5924

Xiao, Anxing, et al. "Robotic autonomous trolley collection with progressive perception and nonlinear model predictive control." 2022 International Conference on Robotics and Automation (ICRA). IEEE, 2022. https://doi.org/10.1016/j.procir.2020.03.097

Keshmiry A, Hassani S, Mousavi M, Dackermann U. Effects of Environmental and Operational Conditions on Structural Health Monitoring and Non-Destructive Testing: A Systematic Review. Buildings. 2023; 13(4):918. https://doi.org/10.3390/buildings13040918

Hassani S, Dackermann U. A Systematic Review of Advanced Sensor Technologies for Non-Destructive Testing and Structural Health Monitoring. Sensors. 2023; 23(4):2204. https://doi.org/10.3390/s23042204

P. Rajak, A. Ganguly, S. Adhikary, and S. Bhattacharya, “Internet of Things and smart sensors in agriculture: Scopes and challenges,” Journal of Agriculture and Food Research, vol. 14. Elsevier BV, p. 100776, Dec. 2023. doi: 10.1016/j.jafr.2023.100776


Refbacks

  • There are currently no refbacks.


Journal of Computer Science and Engineering (JCSE)
ISSN 2721-0251 (online)
Published by : ICSE (Institute of Computer Sciences and Engineering)
Website : http://icsejournal.com/index.php/JCSE/
Email: jcse@icsejournal.com

Creative Commons License is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.