This paper presents an approach to automating bricklaying processes by integrating robotics and computer vision technology in the scale of brick units. The aim is to address the challenges associated with nonuniform bricks and real-time calculations for accurate and efficient operation. The proposed system synchronizes computer vision, surface design, and robotic pick and place operations in a single workflow. This paper contributes to the advancement of automated bricklaying focusing on the complexities of detecting bricks and surfaces with unconventional curves. The generalized solution improves the bricklaying’s efficiency, accuracy, and potential sustainability. Finally, this research advances automation in the sustainable construction industry, specifically masonry, to overcome future challenges in using salvaged materials.IoT to store, visualize, and analyze the data.