Diagnosis of complex engineering systems requires the use of multiple sensor sources to acquire information. In this paper we present a survey of multimodal data acquisition systems for nondestructive testing (NDT) and engineering analysis. We begin with a summary of the relative strengths and weaknesses of individual NDT modalities. Thereafter we present existing multimodal inspection hardware systems that use complementary NDT sensors. The advantages of such multimodal data acquisition over conventional single modality sensors in inspection and analysis are highlighted. Possible approaches to fuse complementary multimodal sensor data are discussed. We conclude with possible directions for the future development of multimodal inspection systems.
Issue Section:
Technology Review
1.
Davis
, J.
, et al., 1989, ASM Handbook, Non-Destructive Evaluation and Quality Control
. ASM International
, Materials Park, OH.2.
Horn
, D.
, and Mayo
, W.
, 2000, “NDE Reliability Gains from Combining Eddy-Current and Ultrasonic Testing
,” NDT & E Int.
0963-8695, 33
, pp. 351
–362
.3.
Shen
, T.
, Huang
, J.
, and Menq
, C.
, 2000, “Multiple-Sensor Integration for Rapid and High-Precision Coordinate Metrology
,” IEEE/ASME Trans. Mechatron.
1083-4435, 5
, pp. 110
–121
.4.
Shen
, T.
, Huang
, J.
, and Menq
, C.
, 2001, “Multiple-Sensor Planning and Information Integration for Automatic Coordinate Metrology
,” J. Comput. Inf. Sci. Eng.
1530-9827, 1
, pp. 167
–179
.5.
Gautier
, S.
, Idier
, J.
, Djafari
, A.
, and Lavayssiere
, B.
, 1998, “X-Ray and Ultrasound Data Fusion
,” Proceedings International Conference on Image Processing
.6.
Gros
, X.
, Strachan
, P.
, and Lowden
, D.
, 1995, “Fusion of Multiprobe NDT Data for ROV Inspection
,” MTS∕IEEE OCEANS, San Diego, CA, Oct. 9–12.7.
Optical Gauging Products, Inc., 2006, “
Smartscope Quest Systems
,” http://www.ogpnet.comhttp://www.ogpnet.com.8.
Werth Messtechnik, 2005, “
Multisensor Coordinate Measurement Machines
,” http://www.werthmesstechnik.de/http://www.werthmesstechnik.de/.9.
Fries Research and Technology, 2006, “
Microglider
,” http://www.frtofamerica.comhttp://www.frtofamerica.com.10.
Hall
, D.
, and Llinas
, J.
, 1997, “An Introduction to Multisensor Data Fusion
,” Proc. IEEE
0018-9219, 85
, pp. 6
–23
.11.
Varshney
, P.
, 1997, “Multisensor Data Fusion
,” Electronics & Communication Engineering Journal
, 9
, pp. 245
–253
.12.
Dasarathy
, B.
, 2000, “Industrial Applications of Multi-Sensor Multi-Source Information Fusion
,” Proceedings of IEEE International Conference on Industrial Technology
, January 19–22.13.
Dromigny Badin
, A.
, Rossato
, S.
, and Zhu
, Y.
, 1997, “Radioscopic and Ultrasonic Data Fusion via the Evidence Theory
,” Trait. Signal
0765-0019, 14
, pp. 499
–510
.14.
Gros
, X.
, Bousigue
, J.
, and Takahashi
, K.
, 1999, “NDT Data Fusion at the Pixel Level
,” NDT & E Int.
0963-8695, 32
, pp. 283
–292
.15.
Xiang
, Y.
, and Shi
, X.
, 1999, “Application of Information Fusion on Flaw Detection of Concrete Structures
,” Proceedings 2nd International Conference on Information Fusion
, Sunnyvale, CA, July.16.
Miracle
, D.
, and Donaldson
, S.
, 2001, ASM Handbook, Composites
, ASM International
, Materials Park, OH.17.
Gros
, X.
, 1997, NDT Data Fusion
, Elsevier
, New York
.18.
Gros
, X.
, 2001, Applications of NDT Data Fusion
, Kluwer Academic
, Dordrech, Netherlands
.19.
Gunatilake
, P.
, Siegel
, P.
, Jordan
, A.
, and Podnar
, G.
, 1997, “Image Understanding Algorithms for Remote Visual Inspection of Aircraft Surfaces
,” Proceedings SPIE Machine Vision Applications in Industrial Inspection
, San Jose, CA, February, pp. 2
–13
.20.
Zitová
, B.
, and Flusser
, J.
, 2003, “Image Registration Methods: A Survey
,” Image Vis. Comput.
0262-8856, 21
, pp. 977
–1000
.21.
McNamara
, J.
, Lanza di Scalea
, F.
, and Fateh
, M.
, 2004, “Automatic Defect Classification in Long-Range Ultrasonic Rail Inspection Using a Support Vector Machine-Based Smart System
,” Insight
1060-135X, 46
(6
), pp. 47
–55
.22.
Lee
, K.
, and Estivill-Castro
, V.
, 2003, “Classification of Ultrasonic Shaft Inspection Data Using Discrete Wavelet Transform
,” Proceedings 3rd International Conference on Artifical Intelligence and Applications
, Benalmadena, Spain, September 8–10, pp. 673
–678
.23.
Lingvall
, F.
, and Stepinski
, T.
, 2000, “Automatic Detecting and Classifying Defects During Eddy Current Inspection of Riveted Lap-Joints
,” NDT & E Int.
0963-8695, 33
(1
), pp. 47
–55
.24.
Joubert
, P.
, Le Bihan
, Y.
, and Placko
, D.
, 2002, “Localization of Defects in Steam Generator Tubes Using a Multi-Coil Eddy Current Probe Dedicated to High Speed Inspection
,” NDT & E Int.
0963-8695, 35
(1
), pp. 53
–59
.25.
Horn
, B.
, 1984, “Extended Gaussian Images
,” Proc. IEEE
0018-9219, 72
, pp. 1671
–1686
.26.
Ritter
, G.
, and Wilson
, J.
, 2001, Handbook of Computer Vision Algorithms in Image Algebra
, CRC
, Boca Raton, FL
.27.
Wolfson
, H.
, and Rigoutsos
, I.
, 1997, “Geometric Hashing: An Overview
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 14
, pp. 125
–145
.28.
Besl
, P.
, and McKay
, H.
, 1992, “A Method for Registration of 3-D Shapes
,” IEEE Trans. Pattern Anal. Mach. Intell.
0162-8828, 14
, pp. 239
–256
.29.
Zhang
, Z.
, 1994, “Iterative Point Matching for Registration of Free-Form Curves and Surfaces
,” Int. J. Comput. Vis.
0920-5691, 13
, pp. 119
–152
.30.
Rusinkiewicz
, R.
, and Levoy
, M.
, 2001, “Efficient Variants of the ICP Algorithm
,” Proceedings 3rd International Conference on 3D Digital Imaging and Modeling (3DIM)
.31.
Krishnamurthy
, V.
, and Levoy
, M.
, 1996, “Fitting Smooth Surfaces to Dense Polygon Meshes
,” Proceedings of ACM Siggraph
, New Orleans, Louisiana, August 4–9.32.
Geomagic, 2006, “
Geomagic Studio
,” http://www.geomagic.comhttp://www.geomagic.com.33.
Polyworks, 2006, “
Polyworks/Modeler
,” http://www.innovmetric.comhttp://www.innovmetric.com.34.
Eck
, M.
, and Hoppe
, H.
, 1996, “Automatic Reconstruction of B-Spline Surfaces of Arbitrary Topological Type
,” Proceedings of ACM Siggraph, New Orleans, Louisiana, August 4–9.35.
Marsan
, A.
, and Dutta
, D.
, 1997, “Survey of Process Planning Techniques for Layered Manufacturing
,” Proceedings of the the 1997 ASME Design Engineering Technical Conferences
, Sacramento, CA, September 14–17.Copyright © 2007
by American Society of Mechanical Engineers
You do not currently have access to this content.
