Skip to main content
SpringerLink
Log in

A low-cost pipeline surface 3D detection method used on robots

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper presents a low-cost pipeline surface 3D detection method based on line structured light. The method adds 3D detection to the robot at a meager cost and change. The optical flow method is used to derive the motion information of the robot to replace the motion closed loop. Finally, the depth data for the entire surface are generated automatically only from the camera and the line laser projector, without using other devices. In addition, a novel spot centroid extraction algorithm based on the color region of interest and an adaptive threshold is presented. This method can accurately detect the laser centroid in the pipeline surface. We conducted experiments with a quadruped robot and validated algorithms. The experimental results show that the proposed method achieves 3D detection on a trackless robot at a meager cost and is superior to standard depth sensors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

Data availability

All data are original for this study, and none has been published elsewhere.

References

  1. Wang, T., Tan, L., Xie, S., et al.: Development and applications of common utility tunnels in China. Tunn. Undergr. Space Technol. 76, 92–106 (2018)

    Article  Google Scholar 

  2. Zhou, R., Fang, W., Wu, J.: A risk assessment model of a sewer pipeline in an underground utility tunnel based on a Bayesian network. Tunn. Undergr. Space Technol. 103, 103473 (2020)

    Article  Google Scholar 

  3. Shang, Z., Shen, Z.: Single-pass inline pipeline 3D reconstruction using depth camera array. Autom. Constr. 138, 104231 (2022)

    Article  Google Scholar 

  4. Li, Y., Wang, H., Dang, L.M., et al.: A robust instance segmentation framework for underground sewer defect detection. Measurement 190, 110727 (2022)

    Article  Google Scholar 

  5. Halfawy, M.R., Hengmeechai, J.: Efficient algorithm for crack detection in sewer images from closed-circuit television inspections. J. Infrastruct. Syst. 20(2), 04013014 (2014)

    Article  Google Scholar 

  6. Laga, H., Jospin, L.V., Boussaid, F., et al.: A survey on deep learning techniques for stereo-based depth estimation. IEEE Trans. Pattern Anal. Mach. Intell. (2020). https://doi.org/10.1109/TPAMI.2020.3032602

    Article  Google Scholar 

  7. Poggi, M., Tosi, F., Batsos, K., et al.: On the synergies between machine learning and binocular stereo for depth estimation from images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 44(9), 5314–5334 (2021)

    Google Scholar 

  8. Mansour, M., Davidson, P., Stepanov, O., et al.: Relative importance of binocular disparity and motion parallax for depth estimation: a computer vision approach. Remote Sens. 11(17), 1990 (2019)

    Article  Google Scholar 

  9. Priya, L., Anand, S.: Object recognition and 3D reconstruction of occluded objects using binocular stereo. Cluster Comput. 21(1), 29–38 (2018)

    Article  Google Scholar 

  10. Van der Jeught, S., Dirckx, J.J.J.: Real-time structured light profilometry: a review. Opt. Lasers Eng. 87, 18–31 (2016)

    Article  Google Scholar 

  11. Yang, L., Liu, Y., Peng, J.: Advances techniques of the structured light sensing in intelligent welding robots: a review. The Int. J. Adv. Manuf. Technol. 110(3), 1027–1046 (2020)

    Article  Google Scholar 

  12. Xu, X., Fei, Z., Yang, J., et al.: Line structured light calibration method and centerline extraction: a review. Res. Phys. 19, 103637 (2020)

    Google Scholar 

  13. Liang, J., Gu, X.: Development and application of a non-destructive pavement testing system based on line structured light three-dimensional measurement. Constr. Build. Mater. 260, 119919 (2020)

    Article  Google Scholar 

  14. Yu, H., Huang, Y., Zheng, D., et al.: Three-dimensional shape measurement technique for large-scale objects based on line structured light combined with industrial robot. Optik 202, 163656 (2020)

    Article  Google Scholar 

  15. Shang, Z., Wang, J., Zhao, L., et al.: Measurement of gear tooth profiles using incoherent line structured light. Measurement 189, 110450 (2022)

    Article  Google Scholar 

  16. Sipiran, I., Bustos, B.: Harris 3D: a robust extension of the Harris operator for interest point detection on 3D meshes. Visual Comput. 11(27), 963–976 (2011)

    Article  Google Scholar 

  17. Baker, S., Matthews, I.: Lucas-kanade 20 years on: a unifying framework[J]. Int. J. Comput. Vision 56(3), 221–255 (2004)

    Article  Google Scholar 

  18. RICHO.: Imaging performance without compromise. https://www.ricoh-imaging.co.jp/english/products/gr-3/feature/, 2019

  19. Intel.: Tech Specs, https://www.intelrealsense.com/depth-camera-d455/, 2020

Download references

Funding

The authors did not receive support from any organization for the submitted work.

Author information

Authors and Affiliations

  1. School of Control and Engineering, North China Electric Power University, Beijing, 102206, China

    Tianxiang Lan & Guotian Yang

Authors
  1. Tianxiang Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guotian Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

T.L. did most of the work and wrote the main manuscript; G.Y. set up the experimental environment and modified the manuscript. All authors reviewed the manuscript.

Corresponding author

Correspondence to Tianxiang Lan.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Informed consent

No conflict of interest exists in the submission of this manuscript, and all authors approve the manuscript for publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lan, T., Yang, G. A low-cost pipeline surface 3D detection method used on robots. SIViP 18, 3915–3924 (2024). https://doi.org/10.1007/s11760-024-03052-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-024-03052-0

Keywords

Search

Navigation