Skip to content

Automated Inspection in Robotic Additive Manufacturing Using Deep Learning for Layer Deformation Detection (2020-10)

10.1007/s10845-020-01684-w

 Davtalab Omid,  Kazemian Ali, Yuan Xiao,  Khoshnevis Behrokh
Journal Article - Journal of Intelligent Manufacturing, Vol. 33, Iss. 3, pp. 771-784

Abstract

In this paper, an automated layer defect detection system for construction 3D printing is proposed. Initially, a step-by-step procedure is implemented to develop a deep convolutional neural network that receives images as input and is able to distinguish concrete layers from other surrounding objects through semantic pixel-wise segmentation. Using data augmentation techniques, 1M labeled images are generated and used to train and test the CNN model. Then, a defect detection module is developed which is able to detect deformations in the printed concrete layers extracted from the images using the CNN model. The evaluation results based on metrics such as accuracy, F1 score, and miss rate verify the acceptable performance of the developed system.

18 References

  1. Craveiro Flávio, Duarte José, Bártolo Helena, Bartolo Paulo (2019-04)
    Additive Manufacturing as an Enabling Technology for Digital Construction:
    A Perspective on Construction 4.0
  2. Davtalab Omid, Kazemian Ali, Khoshnevis Behrokh (2018-01)
    Perspectives on a BIM-Integrated Software Platform for Robotic Construction through Contour Crafting
  3. Ding Lieyun, Wei Ran, Che Haichao (2014-12)
    Development of a BIM-Based Automated Construction System
  4. Ghaffar Seyed, Corker Jorge, Fan Mizi (2018-05)
    Additive Manufacturing Technology and Its Implementation in Construction as an Eco-Innovative Solution
  5. Kazemian Ali, Yuan Xiao, Cochran Evan, Khoshnevis Behrokh (2017-04)
    Cementitious Materials for Construction-Scale 3D Printing:
    Laboratory Testing of Fresh Printing Mixture
  6. Kazemian Ali, Yuan Xiao, Davtalab Omid, Khoshnevis Behrokh (2019-01)
    Computer-Vision for Real-Time Extrusion-Quality-Monitoring and Control in Robotic Construction
  7. Khoshnevis Behrokh, Yuan Xiao, Zahiri Behnam, Zhang Jing et al. (2015-09)
    Deformation-Analysis of Sulfur-Concrete Structures Made by Contour Crafting
  8. Khoshnevis Behrokh, Yuan Xiao, Zahiri Behnam, Zhang Jing et al. (2016-08)
    Construction by Contour Crafting Using Sulfur-Concrete with Planetary Applications
  9. Mechtcherine Viktor, Nerella Venkatesh, Will Frank, Näther Mathias et al. (2019-08)
    Large-Scale Digital Concrete Construction:
    CONPrint3D Concept for On-Site, Monolithic 3D Printing
  10. Perrot Arnaud, Rangeard Damien, Pierre Alexandre (2015-02)
    Structural Build-Up of Cement-Based Materials Used for 3D Printing-Extrusion-Techniques
  11. Putten Jolien, Deprez Maxim, Cnudde Veerle, Schutter Geert et al. (2019-09)
    Microstructural Characterization of 3D Printed Cementitious Materials
  12. Roussel Nicolas (2018-05)
    Rheological Requirements for Printable Concretes
  13. Teizer Jochen, Blickle Alexander, King Tobias, Leitzbach Olaf et al. (2018-10)
    BIM for 3D Printing in Construction
  14. Wolfs Robert, Bos Freek, Salet Theo (2018-02)
    Early-Age Mechanical Behaviour of 3D Printed Concrete:
    Numerical Modelling and Experimental Testing
  15. Wolfs Robert, Bos Freek, Salet Theo (2019-06)
    Triaxial Compression Testing on Early-Age Concrete for Numerical Analysis of 3D Concrete Printing
  16. Wu Peng, Wang Jun, Wang Xiangyu (2016-04)
    A Critical Review of the Use of 3D Printing in the Construction Industry
  17. Zhang Jing, Khoshnevis Behrokh (2012-09)
    Optimal Machine Operation Planning for Construction by Contour Crafting
  18. Zhu Binrong, Pan Jinlong, Nematollahi Behzad, Zhou Zhenxin et al. (2019-07)
    Development of 3D Printable Engineered Cementitious Composites with Ultra-High Tensile Ductility for Digital Construction

43 Citations

  1. Ding Yao, Liu Yifan, Yang Bo, Liu Jiepeng et al. (2026-01)
    Application of Artificial Intelligence Technology in 3D Concrete Printing Quality Inspection and Control:
    A State-of-the-Art Review
  2. Kamhawi Abdallah, Lin Yuxin, Watson Christopher, Barton Kira et al. (2025-12)
    A Framework for Process Anomaly Detection in 3D Concrete Printing
  3. Deetman Arjen, Bos Derk, Lucas Sandra, Salet Theo et al. (2025-12)
    A Database Framework for 3D Concrete Printing
  4. Wang Hailong, Shi Yiqing, Sun Xiaoyan, Lin Xiqiang et al. (2025-12)
    Design, Multi-Scale Structural Analysis, and Construction of Modular Prefabricated 3D-Printed Concrete Residence
  5. Haripan Vislavath, Senthilnathan Shanmugaraj, Santhanam Manu, Raphael Benny (2025-10)
    Printability Assessment of Concrete 3D Printed Elements with Recycled Fine Aggregate
  6. Kim Yoon-Chul, Han Tong-Seok (2025-10)
    Buildability Analysis in 3D Concrete Printing Using Computer Vision and Automated Annotation
  7. Mawas Karam, Maboudi Mehdi, Gerke Markus (2025-09)
    A Review on Geometry and Surface Inspection in 3D Concrete Printing
  8. Cai Yilin, Hartell Julie, Aryal Ashrant (2025-07)
    Real-Time Multimodal Sensing System for Additive Construction by Extrusion:
    Integrating Thermal, Depth and RGB Data
  9. Peralta Patricia, Al-Zuriqat Thamer, Noufal Mahmoud, Smarsly Kay (2025-07)
    Automated Defect Detection in Clay Printing
  10. Zafar Muhammad, Javadnejad Farid, Hojati Maryam (2025-07)
    Optimizing Rheological Properties of 3D Printed Cementitious Materials via Ensemble Machine Learning
  11. Versteege Jelle, Wolfs Robert, Salet Theo (2025-06)
    Data-Driven Additive Manufacturing with Concrete - Enhancing In-Line Sensory Data with Domain Knowledge:
    Part II: Moisture and Heat
  12. Rojas Jorge, Hasanzadeh Sognad (2025-05)
    An Integrated BIM Planning Workflow for 3D Concrete Printing Projects
  13. Liu Wenliang, Ji Dongsheng, Cui Weijiu, Shi Xinyu et al. (2025-05)
    Research Progress on Quality Control Method of Concrete 3D Printing Based on Computer Vision
  14. Cui Weijiu, Liu Wenliang, Guo Ruyi, Da Wan et al. (2025-02)
    Geometrical Quality Inspection in 3D Concrete Printing Using AI-Assisted Computer Vision
  15. Versteege Jelle, Wolfs Robert, Salet Theo (2025-02)
    Data-Driven Additive Manufacturing with Concrete - Enhancing In-Line Sensory Data with Domain Knowledge:
    Part I: Geometry
  16. Senthilnathan Shanmugaraj, Raphael Benny (2025-02)
    Predicting Buildability Using the Surface Texture of 3D Printed Concrete Elements
  17. Zhao Hongyu, Sun Junbo, Wang Xiangyu, Wang Yufei et al. (2024-12)
    Real-Time and High-Accuracy Defect Monitoring for 3D Concrete Printing Using Transformer Networks
  18. Lin Yuxin, Meibodi Mania (2024-11)
    Integrated Sensing Printhead:
    In-line Data Collection for Non-Planar 3D Concrete Printing
  19. An Ning, Wang Huai, Le Liu, Li Shuo et al. (2024-10)
    Real-Time Monitoring of Extrudability and Buildability in 3D Concrete Printing Based on Target Detection Method
  20. Martin Michael, Banijamali Kasra, Gilbert Hunter, Mascarenas David et al. (2024-09)
    LiDAR-Based Real-Time Geometrical Inspection for Large-Scale Additive Manufacturing
  21. Haripan Vislavath, Senthilnathan Shanmugaraj, Gettu Ravindra, Santhanam Manu et al. (2024-09)
    Open-Time and Extrudability-Performance-Analysis of 3D Printed Concrete with Recycled Concrete Fine Aggregates Using Rheological- and Computer-Vision-Techniques
  22. Wolfs Robert, Bos Derk, Caron Jean-François, Gerke Markus et al. (2024-08)
    On-Line and In-Line Quality-Assessment Across All Scale Levels of 3D Concrete Printing
  23. Farrokhsiar Paniz, Gürsoy Benay, Duarte José (2024-08)
    A Comprehensive Review on Integrating Vision-Based Sensing in Extrusion-Based 3D Printing Processes:
    Toward Geometric Monitoring of Extrusion-Based 3D Concrete Printing
  24. Zuo Zibo, Corte Wouter, Huang Yulin, Chen Xiaoming et al. (2024-05)
    Strategies Towards Large-Scale 3D Printing Without Size-Constraints
  25. Zhao Hongyu, Wang Xiangyu, Sun Junbo, Wang Yufei et al. (2024-04)
    Artificial Intelligence Powered Real-Time Quality Monitoring for Additive Manufacturing in Construction
  26. Zhang Hanghua, Tan Yanke, Hao Lucen, Zheng Shipeng et al. (2024-02)
    Intelligent Real-Time Quality-Control for 3D Printed Concrete with Near-Nozzle Secondary-Mixing
  27. Sedghi Reza, Rashidi Kourosh, Hojati Maryam (2024-01)
    Large-Scale 3D Wall Printing:
    From Concept to Reality
  28. Yang Xinrui, Lakhal Othman, Belarouci Abdelkader, Merzouki Rochdi (2023-09)
    Automatic Detection and Isolation of Filament-Width-Deviation During 3D Printing of Recycled Construction-Material
  29. Živković Milijana, Žujović Maša, Milošević Jelena (2023-09)
    Architectural 3D Printed Structures Created Using Artificial Intelligence:
    A Review of Techniques and Applications
  30. Mawas Karam, Maboudi Mehdi, Gerke Markus (2023-09)
    Filament Extraction in 3D Printing of Shotcrete Walls from Terrestrial Laser Scanner Data
  31. Nguyen Ho, Thach Nguyen, Le Quang, Anh Yonghan (2023-07)
    A Review of Current Progress and Application of Machine Learning on 3D Printed Concrete
  32. Senthilnathan Shanmugaraj, Raphael Benny (2023-07)
    Quality Monitoring of Concrete 3D Printed Elements Using Computer-Vision-Based Texture Extraction Technique
  33. Martin Michael, Banijamali Kasra, Kazemian Ali (2023-06)
    Reality-Capture Technologies for Automated Quality-Control During Construction 3D Printing
  34. Yang Xinrui, Lakhal Othman, Belarouci Abdelkader, Youcef-Toumi Kamal et al. (2023-06)
    Experimental Workflow Implementation for Automatic Detection of Filament-Deviation in 3D Robotic Printing Process
  35. Kazemian Ali, Seylabi Elnaz, Ekenel Mahmut (2023-03)
    Concrete 3D Printing:
    Challenges and Opportunities for the Construction Industry
  36. Quah Tan, Tay Yi, Lim Jian, Tan Ming et al. (2023-03)
    Concrete 3D Printing:
    Process-Parameters for Process-Control, Monitoring and Diagnosis in Automation and Construction
  37. Parisi Fabio, Sangiorgio Valentino, Parisi Nicola, Mangini Agostino et al. (2023-01)
    A New Concept for Large Additive Manufacturing in Construction:
    Tower-Crane-Based 3D Printing Controlled by Deep-Reinforcement-Learning
  38. Senthilnathan Shanmugaraj, Raphael Benny (2022-11)
    Using Computer-Vision for Monitoring the Quality of 3D Printed Concrete Structures
  39. García Rodrigo, Dokladalova Eva, Dokládal Petr, Caron Jean-François et al. (2022-09)
    In-Line Monitoring of 3D Concrete Printing Using Computer-Vision
  40. Chang Ze, Wan Zhi, Xu Yading, Schlangen Erik et al. (2022-06)
    Convolutional Neural Network for Predicting Crack-Pattern and Stress-Crack-Width Curve of Air-Void Structure in 3D Printed Concrete
  41. Mechtcherine Viktor, Tittelboom Kim, Kazemian Ali, Kreiger Eric et al. (2022-04)
    A Roadmap for Quality-Control of Hardening and Hardened Printed Concrete
  42. Miryousefi Ata Sara, Kazemian Ali, Jafari Amirhosein (2022-03)
    Application of Concrete 3D Printing for Bridge Construction:
    Current Challenges and Future Directions
  43. Villacrés Juan, Guamán-Rivera Robert, Menéndez Oswaldo, Cheein Fernando (2021-10)
    3D Printing Deformation Estimation Using Artificial Vision-Strategies for Smart-Construction

BibTeX
@article{davt_kaze_yuan_khos.2022.AIiRAMUDLfLDD,
  author            = "Omid Davtalab and Ali Kazemian and Xiao Yuan and Behrokh Khoshnevis",
  title             = "Automated Inspection in Robotic Additive Manufacturing Using Deep Learning for Layer Deformation Detection",
  doi               = "10.1007/s10845-020-01684-w",
  year              = "2022",
  journal           = "Journal of Intelligent Manufacturing",
  volume            = "33",
  number            = "3",
  pages             = "771--784",
}
Formatted Citation

O. Davtalab, A. Kazemian, X. Yuan and B. Khoshnevis, “Automated Inspection in Robotic Additive Manufacturing Using Deep Learning for Layer Deformation Detection”, Journal of Intelligent Manufacturing, vol. 33, no. 3, pp. 771–784, 2022, doi: 10.1007/s10845-020-01684-w.

Davtalab, Omid, Ali Kazemian, Xiao Yuan, and Behrokh Khoshnevis. “Automated Inspection in Robotic Additive Manufacturing Using Deep Learning for Layer Deformation Detection”. Journal of Intelligent Manufacturing 33, no. 3 (2022): 771–84. https://doi.org/10.1007/s10845-020-01684-w.