INTEGRATION OF AI WITH PLC IN A MECHANICAL ARM WITH IMAGE RECOGNITION
PDF (Portuguese (Brazil))
XML (Portuguese (Brazil))

Keywords

Industrial automation
Artificial intelligence
Computer vision
Programmable logic controller
Robotics

How to Cite

Santos, B. M. M. de A., Pedroso, V. H. D. P. J., Faustino, F. F., & Ribeiro, J. S. V. (2026). INTEGRATION OF AI WITH PLC IN A MECHANICAL ARM WITH IMAGE RECOGNITION. Journal of Interdisciplinary Debates, 7(04), 38-53. https://doi.org/10.51249/jid.v7i04.3281

Abstract

Objective: to develop and verify an integration architecture combining artificial intelligence, computer vision, a programmable logic controller, and a robotic manipulator to recognize a chessboard state, select a move, and coordinate its physical execution. Method: an applied technological development study was conducted in 2026 and organized into five functional layers: perception by an industrial vision sensor, integration through a Python application, decision-making by the Stockfish engine, coordination and safety by a Siemens S7-1200 programmable logic controller, and actuation by an embedded controller and a SCARA manipulator. Verification focused on software logic, communication protocols, fault handling, and integrated simulation. Results: all 72 automated tests of the integration application passed, as did the 25- and 61-test sets for the cell program and bench software; the motion core was also verified by 37 tests. Communication timeout control reduced a blocked wait from 5.0 s to less than 1.5 s. In integrated simulation, engine lockup was handled in 4.3 s and a stalled main loop was detected in 4.0 s, while the game state was preserved after restart. Conclusion: the results support the functional consistency and recovery capability of the architecture in software and simulation while keeping the industrial controller responsible for coordination and safety. Physical evaluation of vision, positioning, response time, and complete games is still required to characterize overall cell performance.

PDF (Portuguese (Brazil))
XML (Portuguese (Brazil))

References

GAO, R. X. et al. Artificial intelligence in manufacturing: state of the art, perspectives, and future directions. CIRP Annals, v. 73, n. 2, p. 723–749, 2024. DOI:

10.1016/j.cirp.2024.04.101. Disponível em: https://doi.org/10.1016/j.cirp.2024.04.101. Acesso em: 6 out. 2026.

OKS, S. J. et al. Cyber-physical systems in the context of Industry 4.0: a review, categorization and outlook. Information Systems Frontiers, v. 26, p. 1731–1772, 2024. DOI:

10.1007/s10796-022-10252-x. Disponível em: https://doi.org/10.1007/s10796-022-10252-x. Acesso em: 6 out. 2026.

PIVOTO, D. G. S. et al. Cyber-physical systems architectures for industrial internet of things applications in Industry 4.0: a literature review. Journal of Manufacturing Systems, v.

58, p. 176–192, 2021. DOI: 10.1016/j.jmsy.2020.11.017. Disponível em: https://doi.org/10.1016/j.jmsy.2020.11.017. Acesso em: 6 out. 2026.

RAKHOLIA, R. et al. Advancing manufacturing through artificial intelligence: current landscape, perspectives, best practices, challenges, and future direction. IEEE Access, v. 12, p.

131621–131637, 2024. DOI: 10.1109/ACCESS.2024.3458830. Disponível em: https://doi.org/10.1109/ACCESS.2024.3458830. Acesso em: 6 out. 2026.

DAFFLON, B.; MOALLA, N.; OUZROUT, Y. The challenges, approaches, and used techniques of CPS for manufacturing in Industry 4.0: a literature review. The International Journal of Advanced Manufacturing Technology, v. 113, p. 2395–2412, 2021. DOI:

10.1007/s00170-020-06572-4. Disponível em: https://doi.org/10.1007/s00170-020-06572-4. Acesso em: 6 out. 2026.

MELLADO, J.; NÚÑEZ, F. Design of an IoT-PLC: a containerized programmable logical controller for the Industry 4.0. Journal of Industrial Information Integration, v. 25, art.

100250, 2022. DOI: 10.1016/j.jii.2021.100250. Disponível em: https://doi.org/10.1016/j.jii.2021.100250. Acesso em: 6 out. 2026.

MAJUMDER, M.; SHAKIL, M.; ZOITL, A. Evaluation of PLC4X based middleware as integrator of brownfield systems into industrial cyber-physical systems. IFAC-PapersOnLine, v. 55, n. 2, p. 427–432, 2022. DOI: 10.1016/j.ifacol.2022.04.231. Disponível em: https://doi.org/10.1016/j.ifacol.2022.04.231. Acesso em: 6 out. 2026.

BONCI, A. et al. Human-robot perception in industrial environments: a survey. Sensors, v.

21, n. 5, art. 1571, 2021. DOI: 10.3390/s21051571. Disponível em: https://doi.org/10.3390/s21051571. Acesso em: 6 out. 2026.

DE KETELAERE, B. et al. A fresh look at computer vision for industrial quality control.

Quality Engineering, v. 34, n. 1, p. 152–158, 2022. DOI: 10.1080/08982112.2021.2001828. Disponível em: https://doi.org/10.1080/08982112.2021.2001828. Acesso em: 6 out. 2026.

GAO, Y. et al. A review on recent advances in vision-based defect recognition towards industrial intelligence. Journal of Manufacturing Systems, v. 62, p. 753–766, 2022. DOI: 10.1016/j.jmsy.2021.05.008. Disponível em: https://doi.org/10.1016/j.jmsy.2021.05.008. Acesso em: 6 out. 2026.

DZEDZICKIS, A. et al. Advanced applications of industrial robotics: new trends and possibilities. Applied Sciences, v. 12, n. 1, art. 135, 2022. DOI: 10.3390/app12010135. Disponível em: https://doi.org/10.3390/app12010135. Acesso em: 6 out. 2026.

JAVAID, M. et al. Substantial capabilities of robotics in enhancing Industry 4.0 implementation. Cognitive Robotics, v. 1, p. 58–75, 2021. DOI: 10.1016/j.cogr.2021.06.001. Disponível em: https://doi.org/10.1016/j.cogr.2021.06.001. Acesso em: 6 out. 2026.

ALKHATIB, M. et al. Automated chess gameplay with computer vision and a robotic arm. Engineering Reports, v. 8, n. 2, e70607, 2026. DOI: 10.1002/eng2.70607. Disponível em: https://doi.org/10.1002/eng2.70607. Acesso em: 6 out. 2026.

PHUC, T. D.; SON, B. C. Development of an autonomous chess robot system using computer vision and deep learning. Results in Engineering, v. 25, art. 104091, 2025. DOI:

10.1016/j.rineng.2025.104091. Disponível em: https://doi.org/10.1016/j.rineng.2025.104091. Acesso em: 6 out. 2026.

SZELISKI, R. Computer vision: algorithms and applications. 2. ed. Cham: Springer, 2022.

RUSSELL, S. J.; NORVIG, P. Artificial intelligence: a modern approach. 4. ed. Harlow: Pearson, 2021.

CORKE, P. Robotics, vision and control: fundamental algorithms in MATLAB. 2. ed. Cham: Springer, 2017.

SEONG, J. et al. Enhancing industrial communication with Ethernet/Internet Protocol: a study and analysis of real-time cooperative robot communication and automation via Transmission Control Protocol/Internet Protocol. Sensors, v. 23, n. 20, art. 8580, 2023. DOI:

10.3390/s23208580. Disponível em: https://doi.org/10.3390/s23208580. Acesso em: 6 out. 2026.

INTERNATIONAL ELECTROTECHNICAL COMMISSION. IEC 60204-1:2016: safety of machinery - electrical equipment of machines - Part 1: general requirements. Geneva: IEC, 2016.

REN, Z. et al. State of the art in defect detection based on machine vision. International Journal of Precision Engineering and Manufacturing-Green Technology, v. 9, n. 2, p. 661– 691, 2022. DOI: 10.1007/s40684-021-00343-6. Disponível em: https://doi.org/10.1007/s40684-021-00343-6. Acesso em: 6 out. 2026.

15 10

Downloads

Download data is not yet available.