Next Article in Journal
Segmentation of Gait Sequences in Sensor-Based Movement Analysis: A Comparison of Methods in Parkinson’s Disease
Next Article in Special Issue
Research on Geometric Calibration of Spaceborne Linear Array Whiskbroom Camera
Previous Article in Journal
Fast Alignment of SINS for Marching Vehicles Based on Multi-Vectors of Velocity Aided by GPS and Odometer
Previous Article in Special Issue
High-Speed Focus Inspection System Using a Position-Sensitive Detector
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Distance Calibration between Reference Plane and Screen in Direct Phase Measuring Deflectometry

1
School of Mechanical Engineering, Hebei University of Technology, Tianjin 300130, China
2
Centre for Precision Technologies, University of Huddersfield, Huddersfield HD1 3DH, UK
*
Author to whom correspondence should be addressed.
Sensors 2018, 18(1), 144; https://doi.org/10.3390/s18010144
Submission received: 17 November 2017 / Revised: 2 January 2018 / Accepted: 2 January 2018 / Published: 6 January 2018
(This article belongs to the Special Issue Charge-Coupled Device (CCD) Sensors)

Abstract

:
The recently developed direct phase measuring deflectometry (DPMD) method can directly measure the three-dimensional (3D) shape of specular objects with discontinuous surfaces, but requires a calibrated distance between a reference plane and liquid crystal display screen. Because the plane and screen are different distances from the imaging device, they cannot be clearly captured given the limited depth of field (DOF) of the lens. Therefore, existing machine vision-based methods cannot be used to effectively calibrate a DPMD system. In this paper, a new distance calibration method that uses a mirror with a hollow ring matrix pattern and a mobile stage is presented. The direction of the mobile stage in the camera coordinate system is determined by the mirror’s pattern at several positions in the camera’s DOF so that the reference position outside of the DOF can be calculated. The screen’s position can also be calibrated by displaying patterns at a known scale. Therefore, the required distance is accurately obtained in the camera coordinate system. Evaluation results show that the maximum value of the absolute error is less than 0.031 mm. The experimental results on an artificial stepped mirror and a reflected diamond distribution surface demonstrate the accuracy and practicality of the proposed method.

1. Introduction

Optical three-dimensional (3D) shape measurement techniques have been widely applied in many fields such as reverse engineering, biological recognition, and the digitalization of cultural relics. Among them, structured light pattern projection is a popular method because of its advantages of full-field acquisition, fast and automatic data processing, noncontact operation, and high accuracy [1,2,3,4,5]. However, most of the existing techniques can only be used to measure objects with a diffuse surface. With the advent of intelligent manufacturing, there are many specular objects in actual industrial applications. The research of shape measurement for these objects is still at an early stage. The main methods of measuring the 3D shape of specular objects use a coordinate measuring machine or change the surface characteristics using spray paint, which destroys the surface properties and is unacceptable in many fields. Therefore, it is important to study optical 3D full-field shape measurement methods for objects with a specular surface.
Phase measuring deflectometry (PMD), or the fringe reflection technique, has been widely studied for measuring specular free-form surfaces because of its advantages of noncontact operation, full-field measurement, fast acquisition, high precision, and automatic data processing [6,7]. PMD has been applied to measure aspheric mirrors and dynamic specular surfaces, detect subsurface cracks, and has been used on specular surfaces from micro-scale to large scales [8,9,10,11,12,13]. For example, aspherical and spherical mirrors, silicon wafers and ball grid array, automobile industry (automotive glass, car body) [14]. This technique must display straight sinusoidal fringe patterns on a liquid crystal display (LCD) screen or project a structured pattern onto ground glass. From a different viewpoint, the fringe patterns reflected on the measured surface appear deformed with respect to the slope variation of the specular surface. The modulated fringe patterns can then be captured by an imaging device such as a charge-coupled device (CCD) camera. The phase information in the deformed fringe patterns is then demodulated to obtain the slope of the measured specular surface and the 3D shape of the tested surface can then be reconstructed by integrating the gradients [15,16,17].
Lee et al. used the Ronchi test to measure the aspheric surfaces [18]. The Ronchi test provided information about the surface but the ronchigrams represented slope errors. Su et al. applied the developed PMD method called software configurable optical test system (SCOTS) to measure an X-ray mirror with a precision and accuracy better than 100 nrad (RMS) and ~200 nrad (RMS), respectively [19]. Fang et al. have reviewed current research on manufacturing and measuring freeform optics [20]. Häusler et al. introduced a novel microdeflectometry technique to measure the microtopography of specular surfaces by using a micro-objective [9]. The lateral resolution was better than 1 µm and the height resolution was in the range of 1 nm. Krey et al. presented a fast optical scanning deflectometer to measure the topography of large silicon wafers [21]. Skydan et al. applied the non-full-field reflective technique to measure automotive side glass to speed up and ensure product development and manufacturing quality [22]. Höfling et al. presented a new method for measuring reflective objects by using phase information and applied it to detect shape defects on car body sheets [23]. The surface curvature and then the discrimination of defects were directly calculated from the phase data. Quantitative height information could also be derived from the surface curvature by using two integration steps. Owing to the integration procedure, complicated specular components with isolated and/or discontinuous surfaces cannot be obtained from the measured phase data. The above PMD methods therefore only measure the local slope instead of the actual 3D shape of smooth surfaces.
To solve the above problem of measuring complicated specular surfaces, the direct PMD (DPMD) method has recently been developed to obtain the full-field 3D shape of specular objects with isolated and/or discontinuous surfaces [24,25]. This method directly determines the relationship between the absolute phase and depth information. To measure accurate 3D shape data, it is an important step for PMD to calibrate the system parameters, including the distance d between the reference plane and an LCD screen and the distance between the reference plane and a CCD camera [26,27]. Among them, d is an important parameter for the 3D shape measurement of specular objects. However, the existing calibration methods cannot calibrate d accurately. In DPMD, a mirror with a hollow ring matrix pattern is used as the reference plane position. The mirror and LCD screen cannot be clearly imaged by the CCD camera simultaneously because they are different distances to the CCD camera and the imaging lens has a limited depth of field (DOF), which means that one of them will be out of the DOF of the imaging lens. Some researchers used an infinite focus measurement machine (IFM) to obtain dataset at a high depth of focus [28,29]. IFM is based on the focus-variation technique, which combines the traditional surface metrology and the microcoordinate measurement technology. Therefore, existing methods cannot calibrate d accurately [25].
This paper presents a novel distance calibration method to determine parameter d between the reference plane and LCD screen with the aid of an accurate moving stage. In this method, the mirror with the hollow ring matrix pattern is placed on the stage and can be accurately translated to different positions. Within the camera lens DOF, the mirror is moved to several known positions and the hollow ring matrix pattern is clearly captured by the CCD camera at each position. The center of each hollow ring marker on the mirror can be extracted from these captured images. The moving direction of the stage in the camera coordinate system is determined using the extracted markers and internal parameters of the CCD camera. Therefore, the orientation of the mirror can be accurately determined in the camera coordinate system, even when it is out of the DOF of the CCD camera. Meanwhile, the position of the LCD screen can be calibrated in the camera coordinate system by generating known-size patterns using software, for example, checkerboard or hollow ring matrix patterns, on the LCD screen. Therefore, the distance d between the mirror at the reference position and the LCD screen can be accurately determined in the same camera coordinate system. The experimental results of direct and indirect measurements show that the proposed calibration method can accurately obtain the distance between the reference position and LCD screen. The proposed calibration method yields an accurate distance so that the DPMD system can accurately measure the 3D shape of specular objects with isolated and/or discontinuous surfaces.
In the rest of this paper, Section 2 describes the principle of the proposed distance calibration method, including a brief introduction to the DPMD system, calculation of the direction of the moving stage, and distance calculation. Section 3 shows some experimental results with respect to error analysis and the actual 3D measurement of specular objects with multiple isolated and/or discontinuous surfaces. The conclusions and remarks regarding future work are given in Section 4.

2. Principle

The proposed distance calibration method consists of several steps, as shown in Figure 1. Section 2.2 describes the details of each step. The direct relationship between absolute phase and depth is first briefly described in Section 2.1, so that this paper is self-contained.

2.1. Direct Relationship between Absolute Phase and Depth

A schematic diagram of the process to measure specular objects with isolated and/or discontinuous surfaces is shown in Figure 2. There are two LCD screens called LCD1 and LCD2, a CCD camera, and a plate beam splitter (BS). The BS implements a parallel design with the two LCD screens and thus avoids the need to mechanically move a screen to two positions during the calibration and measurement procedures. As illustrated in Figure 2, two rays of light are displayed and reflected into the CCD camera via the measured surface and mirror at the reference position. The two incident rays correspond to the same reflected light. The absolute phases of the two incident rays are denoted φ r 1 (or φ r 1 ) and φ r 2 on the reference plane and φ m 1 (or φ m 1 ) and φ m 2 on the measured specular surface. Angles θ and θ + Φ are the angles between the incident ray and normal vectors of the reference and measured specular surfaces, respectively. The period of the displayed fringe pattern on the LCD screen is denoted by q. Moreover, ∆l is the distance on LCD1′ between the two incident rays because of the height and gradient of the measured surface. Parameter h stands for the height of the measured specular surface with respect to the reference plane. Finally, ∆d and d are the distance between LCD1′ and LCD2 and the distance between the reference plane and LCD1′, respectively. The geometric relationship in Figure 2 gives the relations
( φ r 1 φ r 2 ) q / 2 π = Δ d · tan θ
( φ m 1 φ m 2 ) q / 2 π = Δ d · tan ( θ + Φ )
( d   +   h ) tan θ + Δ l = ( d h ) tan ( θ + Φ )
( φ r 1 φ m 1 ) q / 2 π = Δ l
From Equations (1)–(4), the height h of the measured specular surface is
h = Δ d ( φ m 1   φ r 1 ) d [ ( φ r 1   φ r 2 ) ( φ m 1   φ m 2 )   ]   ( φ m 1   φ m 2 ) + ( φ r 1   φ r 2 )
Equation (5) clearly shows that height information can be directly calculated from the captured fringe patterns on the measured specular surface only if the two parameters d and ∆d and phase information on the reference plane are known beforehand. If the optimum three-fringe number selection method [30] is used to calculate the absolute phase pixel by pixel, specular objects with isolated and/or discontinuous surfaces can be measured.
According to the derived mathematical model expressed as Equation (5), the parameters of ∆d and d need to be determined accurately beforehand to obtain the 3D shape data of specular objects. Two accurate plane mirrors denoted as M1 and M2 are used to calibrate the two distances [24,25]. Mirror M1 has an ideal plane surface while M2 has a hollow ring matrix pattern with a known separation between the neighboring ring-shaped markers on the surface. Mirror M1 is fixed on an accurate moving stage and moved to a known position ∆h along the normal direction of the two LCD screens. At each mirror position, fringe pattern sets with the optimum fringe numbers are generated and displayed on LCD2 and LCD1. The displayed fringe patterns are reflected by M1 and captured by the CCD camera. Using the phase information from the captured fringe patterns and several known positions, parameter ∆d is calibrated.
To calibrate the distance d between the reference plane and LCD1, mirror M2 is positioned parallel to the LCD screen and its surface is chosen as the reference plane. After calibrating the internal parameters of the CCD camera [31,32,33], the orientation of M2 is determined in the camera coordinate system using the hollow ring matrix pattern on the surface of M2 [34,35]. The same hollow ring matrix pattern is generated by software and displayed on LCD1 so that the CCD camera can view and capture the hollow ring matrix pattern at position LCD1″ (the virtual image of LCD1′) reflected by the surface of M2. The orientation of LCD1″ (LCD1′) is therefore obtained in the camera coordinate system using the hollow ring matrix pattern on LCD1. Distance d can be calculated using the obtained orientation of M2 and LCD1 in the same camera coordinate system. However, the hollow ring matrix pattern on mirror M2 (which is chosen as reference plane) and the LCD1 screen have different distances to the CCD camera, and hence they cannot be both clearly imaged and captured by the camera because of the limited DOF of the imaging lens. To solve this problem, the following section describes a new method for obtaining distance d.

2.2. Distance Calibration

To simplify the principle of distance calibration, only the screen of LCD1′ is shown in the schematic diagram in Figure 3.

2.2.1. Calibration of Internal Parameters

To apply machine vision-based methods to determine distance d by a CCD camera, the internal parameters need to be calibrated using the following equation,
λ [ u v 1 ] = A [ R T ] [ X w Y w Z w 1 ]
where R is a matrix representing the three rotation angles and T = [tx, ty, tz] is a vector representing the three linear translations. Vector [Xw, Yw, Zw] is the coordinate vector of a point in the world coordinate system, while [u, v] is the coordinate vector of the corresponding point in the pixel coordinate system and λ is an arbitrary scaling factor. Matrix A consists of the CCD camera internal parameters: two focal lengths (Fu and Fv), two principal point coordinates (Pu and Pv), and four image radial and tangential distortion coefficients (K1, K2, K3, and K4). The eight internal parameters need to be calibrated beforehand and Zhang’s camera calibration method is used to obtain their values using a checkerboard at different positions [31,32,33].

2.2.2. Stage Moving Direction in the Camera Coordinate System

The orientation of the mirror in the camera coordinate system is determined from the obtained internal parameters of the CCD camera and the known distance between the hollow ring markers. When the mirror is moved to several known positions within the DOF of the camera lens on the stage, the direction of its movement can be obtained in the camera coordinate system. At each mirror position, the hollow ring matrix is clearly imaged and captured by the CCD camera. The center position of each hollow ring on the mirror can be extracted from these captured images. Therefore, the direction of stage movement in the camera coordinate system is determined from the extracted markers and obtained internal parameters of the CCD camera.
Figure 3 is a schematic diagram of the process to determine the stage moving direction in the camera coordinate system. Mirror M2 is the mirror with the hollow ring matrix pattern on the surface. When M2 is located at two positions (1 and 2) in the DOF of the imaging lens, the camera can clearly image and capture the hollow ring markers on the mirror surface. After extracting all the center positions of the hollow ring markers from the captured images, the orientation of the mirror in the camera coordinate system is determined by the following equations:
A 0 = R 1 × A 1 + T 1  
A 0 = R 2 × A 2 + T 2
where R1 and T1 are the rotation matrix and translation vector, respectively, when the mirror is at position 1. In addition, R2 and T2 are the rotation matrix and the translation vector, respectively, when the mirror is at position 2. Vector A0 is the 3D coordinate vector of one point in the camera coordinate system, and A1 and A2 are the 3D coordinate vectors of the corresponding points in the mirror coordinate system when the mirror is at positions 1 and 2, respectively.
According to the obtained external parameters of R1, T1, and T2, the direction of the moving stage can be denoted as a vector T21 and deduced as
T 21 = R 1 1 × ( T 2 T 1 )
T 21 = Δ L 1
  { α = T 21 ( 1 ) Δ L 1 β = T 21 ( 2 ) Δ L 1 γ = T 21 ( 3 ) Δ L 1  
where ∆L1 is the moving distance of the stage, and α, β, and γ represent the proportion of the translation vector in the x, y, and z directions, respectively.
More hollow ring matrix images for different mirror positions in the DOF of the lens can be captured and used to accurately calculate the moving stage direction in the camera coordinate system.

2.2.3. Distance Determination

When the mirror is moved to a new position 3 outside of the DOF of the camera lens, as illustrated in Figure 3, the CCD camera cannot clearly capture the hollow ring matrix pattern. In this case, the orientation of the mirror in the camera coordinate system is inaccurately determined by the machine vision-based method. However, if the mirror is moved to a known distance by the stage, the orientation of the mirror in the camera coordinate system can be calculated from the obtained stage’s moving direction.
Assuming the mirror is moved a distance ΔL2 to the reference position by the moving stage, the orientation of the mirror in the camera coordinate system can be obtained using the obtained R2, T2, α, β, γ, and ∆L2 as
R 3 = R 2
T 3 = T 2 + R 2 × T 32
{ T 32 ( 1 ) = α × Δ L 2 T 32 ( 2 ) = β × Δ L 2 T 32 ( 3 ) = γ × Δ L 2
where T3 and R3 are the translation vector and rotation matrix at mirror position 3 in the camera coordinate system, respectively, and T32 is the translation vector of the mirror at its second position to the CCD camera. Because the mirror is fixed on the translation stage, Equation (12) holds when it is moved from position 2 to position 3.
When the mirror is located at position 3 (the reference plane), the virtual image LCD’ of the LCD screen reflected by the mirror is imaged in the DOF of the imaging lens. A virtual checkerboard image displayed on the LCD screen is clearly imaged and captured by the CCD camera. Because the mirror is located out of the DOF of the lens, the hollow ring matrix pattern on the mirror surface cannot be clearly imaged and captured by the CCD camera. Therefore, the phase calculation during the calibration procedure is not affected by the hollow ring matrix pattern on the mirror surface. The rotation matrix R4 and translation vector T4 of the LCD screen with respect to the CCD camera can be expressed as
R 4 = R 2
T 4 = A 0 R 4 × A 4
where, A4 represents the 3D coordinate vector of the corresponding point on the LCD screen in the screen coordinate system when the mirror is at position 3. The relative orientation between the mirror and the LCD screen has been adjusted to be parallel. The parallelism is established by repeating adjustment of the relative orientations of the three components (the two LCD screens and the mirror at reference plane) and generating pre-distorted fringe patterns for compensation. Therefore, Equation (15) holds.
Combining Equations (13) and (16), the following relationship can be deduced:
T 34 = R 4 1 × ( T 3 T 4 )
where T34 is the translation vector between the mirror at position 3 and the virtual image of the LCD screen. Therefore, distance d is
d = T 34
The obtained distance d can be applied to Equation (5) to calculate the 3D shape of specular surfaces.

3. Experiments and Results

3.1. Hardware System

To test the proposed distance calibration method, an experimental system was setup, as illustrated in Figure 4. The system consists of two 24.64 cm LCD screens with a physical resolution of 1536 × 2048 (for calibration, only was LCD1 used), a BS, a white board, a mirror with a hollow ring marker matrix pattern on the surface, an industrial CCD camera with a 1296 × 964 resolution, an automatic moving stage with an accuracy of 1 µm, and a PC. The BS was used to distinguish two screens; the white board is just the reflected background for capturing the hollow ring pattern on the mirror. The computer is connected to the camera and the LCD screens by a gigabit ethernet cable and HDMI (high definition multimedia interface), respectively. The computer is also used to generate and display a checkerboard pattern on the LCD1 screen. The CCD camera is used to capture the images of the hollow ring matrix pattern on the reference mirror and generated checkerboard displayed on the LCD1 screen. The LCD1 screen displays the checkerboard pattern and generated fringe patterns. The moving stage moves the mirror to several known positions for determining the orientation of the mirror in the camera coordinate system. The mirror is used to calibrate the stage moving direction in the camera coordinate system and reflect the checkerboard pattern displayed on the LCD1 screen. LCD2 is used to obtain data during the object measurement; it is not necessary during distance calibration.
It is assumed that the mirror is parallel to the LCD screens in the experimental system. This assumption can be satisfied using a software-based method as follows. First, the intrinsic parameters of the CCD camera are calibrated by imaging a checkerboard from several viewpoints. Then, a picture of the checkerboard is generated by software, displayed on the LCD screen, and captured by the CCD camera. The size of the checkerboard can be obtained because the unit pixel size of the LCD is known. Finally, the external parameters (R and T matrices) of the camera coordinate system and angle between the camera and target surface of the camera in the x, y, and z directions can also be determined. Therefore, they provide a basis for the parallel adjustment.

3.2. Experimental Process and Results

A checkerboard with 9 × 12 checkers and a mirror with a matrix pattern of hollow ring markers on the surface were designed and manufactured by Ti-Times [36] and Giai Photonics Co., Ltd. [37], respectively, as illustrated in Figure 5. The checker size along the row and column directions has the same value of 6 mm. The distance between the adjacent hollow ring markers along horizontal and vertical directions is 6 mm. To accurately determine the internal parameters of the CCD camera, the checkerboard was positioned at 28 random positions and orientations with a large angle between the imaging axis and the board’s normal. At each position, the CCD camera captured the board image. Using the known checker size in the eighteen captured images, the internal parameters of the CCD camera were obtained by the Camera Calibration Toolbox for MATLAB [32]. The radial and tangential distortions of the following captured images were corrected by the obtained internal parameters. The average reprojection errors in the x and y directions are 0.150 pixels and 0.230 pixels, respectively, as illustrated in Figure 6.
After determining the internal parameters of the CCD camera, distance d was calibrated using the proposed method. First, the mirror with the hollow ring matrix pattern was fixed on the stage and adjusted so that the surface was perpendicular to the moving direction. The initial position of the mirror was in the DOF of the camera lens. The CCD camera clearly captured the hollow ring matrix pattern. Second, the mirror was moved 12.001 mm by the moving stage. This position was still within the DOF of the camera lens and the hollow ring matrix pattern was clearly captured by the camera. The moving direction of the stage in the camera coordinate system was calculated using the method proposed in Section 2.2.2. Third, the stage moved the mirror 128.000 mm to a new position, which was out of the DOF of the camera lens. In this situation, the hollow ring matrix pattern is out of focus and cannot be clearly captured by the camera. The orientation of the mirror was calculated by the known moved distance and calculated moving direction. Fourth, a checkerboard image was generated and displayed on the LCD1 screen. The virtual checkerboard reflected by the mirror was located in the DOF and captured by the CCD camera. Because the mirror was out of the DOF of the imaging lens, the captured virtual checkerboard image reflected by the mirror clearly shows the checker without the hollow ring matrix pattern, as illustrated in Figure 7. The orientation of the LCD1 screen was calculated using the checker size and obtained internal parameters of the CCD camera. Finally, the distance between the mirror at the reference position and the LCD1 screen was obtained as 136.742 mm in the established DPMD system because the two components are parallel in the same camera coordinate system.

3.3. Performance Analysis

To evaluate the proposed method, two techniques were applied to verify the accuracy of the calibrated distance. One directly relates to a known distance moved by the moving stage; the other performs indirect verification by measuring an artificial step in the established DPMD system. Because the distance the mirror is moved by the stage is accurately known beforehand, it can be directly used to verify the calibrated distance. The accuracy can be acquired by comparing the distance moved with the distance calibrated by the proposed method, as shown in Table 1. The maximum value of the absolute error is less than 0.030 mm.
An artificial stepped mirror was designed and manufactured to indirectly verify the accuracy of the calibrated distance, as illustrated in Figure 8. This step was measured by reflecting the fringe patterns and captured by the CCD camera, as shown in Figure 8b. Figure 8c, d illustrates shading display and profile of the measured depth data from the calibrated system. The actual and measured distance between the neighboring steps as well as absolute error (absolute difference between the measured average distance and actual distance) are listed in Table 2. The maximum absolute error is 0.031 mm.
A reflected diamond distribution surface (DDS) object was also measured by the developed 3D measurement system, as illustrated in Figure 9.
Twelve sinusoidal fringe patterns having optimum fringe numbers of 100, 99 and 90 were generated by software and sequentially displayed on the two LCD screens. Fringe patterns reflected by the specular surface of the DDS object were deformed and captured by the triggered CCD camera from another viewpoint, as illustrated in Figure 9b. Using four-step phase-shifting algorithm, three wrapped phase maps were calculated for the measured specular object, as shown in Figure 10a–c. The absolute phase of each pixel was determined using the optimum three-fringe number selection method, as shown in Figure 10d.
Using the calibrated parameters ∆d and d, the reconstruction of DDS data was obtained, as shown in Figure 11. The results show that the proposed method can directly measure a specular object having isolated and/or discontinuous surfaces.

4. Conclusions

This paper presented a novel method for calibrating the distance d between a mirror at the reference plane and the LCD screen for the DPMD system. The mirror and the LCD screen cannot be clearly captured given the limited depth of field (DOF) of an imaging lens because of their large depth distance along optical axis. To solve the problem caused by the limited DOF of the imaging lens, a novel calibration method by using an automatic moving stage has been presented to determine the orientation of the mirror in the camera coordinate system. Mathematical derivation procedure was deliberated to obtain the distance d. As a result, the distance between the mirror and the LCD screen was accurately calibrated for the DPMD system. The experimental results obtained using direct and indirect measurements show that the proposed method can accurately obtain this distance. The maximum value of the absolute error is less than 0.031 mm by using the proposed method. In fact, the proposed method solves two problems. One problem is the limited DOF of the imaging lens, which means that the hollow ring matrix pattern on the mirror surface cannot always be clearly imaged, causing the calibrated distance value to be inaccurate. In the proposed method, d can accurately be determined. The other is the effect of the hollow ring matrix pattern on the identification of the checker corners and calibration of the DPMD system. Because the mirror is out of the DOF of the camera lens, the hollow ring matrix pattern is not visible in the reflected virtual checkerboard image captured by the CCD camera. Therefore, the mirror with the hollow ring matrix pattern can also be used as a common mirror without any markers on the surface.
The proposed calibration method is implemented in the lab because of the usage of a translating stage. Therefore, a simple and flexible calibration method needs to be developed in the near future. The other challenging problems in PMD or DPMD are measuring dynamic specular surface, some components having specular and non-specular parts on the same object surface, and so on. A possible solution is to combine interferometry into deflectometry to significantly improve the precision with a large dynamic range.

Acknowledgments

The authors would like to thank the National Key R&D Program of China (under grant 2017YFF0106404), National Natural Science Foundation of China (under grant 51675160), Key Basic Research Project of Applied Basic Research Programs Supported by Hebei Province (under grant 15961701D), Research Project for High-Level Talents in Hebei University (under grant GCC2014049), Talents Project Training Funds in Hebei Province (under grant A201500503), and “Innovative and Entrepreneurial Talent” Project Supported by Jiangsu Province (under grant 2016A377). This project is also funded by European Horizon 2020 through the Marie Sklodowska-Curie Fellowship Scheme (under grant 707466-3DRM), and the UK’s Engineering and Physical Sciences Research Council (EPSRC) funding of Future Advanced Metrology Hub (under grant EP/P006930/1).

Author Contributions

Shujun Huang, Yue Liu, and Nan Gao performed the simulations, designed the experiments, and analyzed the data under the guidance of Zonghua Zhang, Feng Gao, and Xiangqian Jiang. Shujun Huang, Zonghua Zhang, and Feng Gao wrote the paper.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Xu, J.; Liu, S.L.; Wan, A.; Gao, B.T.; Yi, Q.; Zhao, D.P.; Luo, R.K.; Chen, K. An absolute phase technique for 3D profile measurement using four-step structured light pattern. Opt. Lasers Eng. 2012, 50, 1274–1280. [Google Scholar] [CrossRef]
  2. Zuo, C.; Chen, Q.; Gu, G.; Feng, S.; Feng, F. High-speed three-dimensional profilometry for multiple objects with complex shapes. Opt. Express 2012, 20, 19493–19510. [Google Scholar] [CrossRef] [PubMed]
  3. Cai, Z.W.; Liu, X.L.; Peng, X.; Yin, Y.K.; Wu, J.C.; Gao, Z. Structured light field 3D imaging. Opt. Express 2016, 24, 20324–20334. [Google Scholar] [CrossRef] [PubMed]
  4. Zuo, C.; Huang, L.; Zhang, M.; Chen, Q.; Asundi, A. Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative review. Opt. Laser Eng. 2016, 85, 84–103. [Google Scholar] [CrossRef]
  5. Liu, X.L.; Peng, X.; Chen, H.L.; He, D.; Gao, Z. Strategy for automatic and complete three-dimensional optical digitization. Opt. Lett. 2012, 37, 3126–3128. [Google Scholar] [CrossRef] [PubMed]
  6. Knauer, M.; Kaminski, J.; Hausler, G. Phase measuring deflectometry: A new approach to measure specular free-form surfaces. Proc. SPIE 2004, 5457, 366–376. [Google Scholar]
  7. Huang, L.; Xue, J.P.; Gao, B.; Mcpherson, C.; Beverage, J.; Idir, M. Modal phase measuring deflectometry. Opt. Express. 2016, 24, 24649–24664. [Google Scholar] [CrossRef] [PubMed]
  8. Chan, F. Reflective fringe pattern technique for subsurface crack detection. NDT E Int. 2008, 41, 602–610. [Google Scholar] [CrossRef]
  9. Häusler, G.; Richter, C.; Leitz, K.; Knauer, M. Microdeflectometry—A novel tool to acquire three-dimensional microtopography with nanometer height resolution. Opt. Lett. 2008, 33, 396–398. [Google Scholar] [CrossRef] [PubMed]
  10. Zhang, H.; Han, S.; Liu, S.; Li, S.; Ji, L.; Zhang, X. 3D shape reconstruction of large specular surface. Appl. Opt. 2012, 51, 7616–7625. [Google Scholar] [CrossRef] [PubMed]
  11. Tang, Y.; Su, X.; Wu, F.; Liu, Y. A novel phase measuring deflectometry for aspheric mirror test. Opt. Express 2009, 17, 19778–19784. [Google Scholar] [CrossRef] [PubMed]
  12. Huang, L.; Ng, C.; Asundi, A. Dynamic three-dimensional sensing for specular surface with monoscopic fringe reflectometry. Opt. Express 2011, 19, 12809–12814. [Google Scholar] [CrossRef] [PubMed]
  13. Feng, S.; Chen, Q.; Zuo, C.; Asundi, A. Fast three-dimensional measurements for dynamic scenes with shiny surfaces. Opt. Commun. 2017, 382, 18–27. [Google Scholar] [CrossRef]
  14. Zhang, Z.; Wang, Y.; Huang, S.; Liu, Y.; Ghang, C.; Gao, F.; Jiang, X. Three-dimensional shape measurements of specular objects using Phase-Measuring deflectometry. Sensors 2017, 17, 2835. [Google Scholar] [CrossRef] [PubMed]
  15. Guo, H.; Feng, P.; Tao, T. Specular surface measurement by using least squares light tracking technique. Opt. Laser Eng. 2010, 48, 166–171. [Google Scholar] [CrossRef]
  16. Liu, Y.; Olesch, E.; Yang, Z.; Häusler, G. Fast and accurate deflectometry with crossed fringes. Adv. Opt. Technol. 2014, 3, 441–445. [Google Scholar] [CrossRef]
  17. Huang, L.; Idir, M.; Zuo, C.; Kaznatcheev, K.; Zhou, L.; Asundi, A. Shape reconstruction from gradient data in an arbitrarily-shaped aperture by iterative discrete cosine transforms in Southwell configuration. Opt. Lasers Eng. 2015, 67, 176–181. [Google Scholar] [CrossRef]
  18. Lee, H.; Kim, S. Precision profile measurement of aspheric surfaces by improved Ronchi test. Opt. Eng. 1999, 38, 1041–1047. [Google Scholar] [CrossRef]
  19. Su, P.; Wang, Y.; Burge, J.; Kaznatcheev, K.; Idir, M. Non-null full field X-ray mirror metrology using SCOTS: A reflection deflectometry approach. Opt. Express 2012, 20, 12393–12406. [Google Scholar] [CrossRef] [PubMed]
  20. Fang, F.; Zhang, X.; Weckenmann, A.; Zhang, G.; Evans, C. Manufacturing and measurement of freeform optics. CIRP Ann.-Manuf. Technol. 2013, 62, 823–846. [Google Scholar] [CrossRef]
  21. Krey, S.; van Amstel, W.D.; Szwedowicz, K.; Campos, J.; Moreno, A.; Lous, E. A fast optical scanning deflectometer for measuring the topography of large silicon wafers. In Proceedings of the Current Developments in Lens Design and Optical Engineering V, Denver, CO, USA, 2–6 August 2004; pp. 110–121. [Google Scholar]
  22. Skydan, O.; Lalor, M.; Burton, D. Three-dimensional shape measurement of non-full-field reflective surfaces. Appl. Opt. 2005, 44, 4745–4752. [Google Scholar] [CrossRef] [PubMed]
  23. Höfling, R.; Aswendt, P.; Neugebauer, R. Phase reflection—A new solution for the detection of shape defects on car body sheets. Opt. Eng. 2000, 39, 175–182. [Google Scholar] [CrossRef]
  24. Zhang, Z.; Liu, Y.; Huang, S.; Niu, Z.; Guo, J.; Gao, N. Full-field 3D shape measurement of specular surfaces by direct phase to depth relationship. Proc. SPIE 2016, 10023, 100230X. [Google Scholar]
  25. Liu, Y.; Huang, S.; Zhang, Z.; Gao, N.; Gao, F.; Jiang, X. Full-field 3D shape measurement of discontinuous specular objects by direct phase measuring deflectometry. Sci. Rep. 2017, 7, 10293. [Google Scholar] [CrossRef] [PubMed]
  26. Häusler, G.; Faber, C.; Olesch, E.; Ettl, S. Deflectometry vs. Interferometry. Proc. SPIE 2013, 8788, 87881C. [Google Scholar]
  27. Xiao, Y.; Su, X.; Chen, W. Flexible geometrical calibration for fringe-reflection 3D measurement. Opt. Lett. 2012, 37, 620–622. [Google Scholar] [CrossRef] [PubMed]
  28. Nieslony, P.; Krolczyk, G.; Zak, K.; Maruda, R.; Legutko, S. Comparative assessment of the mechanical and electromagnetic surfaces of explosively clad Ti-steel plates after drilling process. Precis. Eng. 2017, 47, 104–110. [Google Scholar] [CrossRef]
  29. Krolczyk, G.; Maruda, R.; Nieslony, P.; Wieczorowski, M. Surface morphology analysis of Duplex Stainless Steel (DSS) in Clean Production using the Power Spectral Density. Measurement 2016, 94, 464–470. [Google Scholar] [CrossRef]
  30. Zhang, Z.; Towers, C.; Towers, D. Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency selection. Opt. Express 2006, 14, 6444–6455. [Google Scholar] [CrossRef] [PubMed]
  31. Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334. [Google Scholar] [CrossRef]
  32. Camera Calibration Toolbox for Matlab. Available online: http://www.vision.caltech.edu/bouguetj/calib doc/htmls/example.html (accessed on 17 November 2017).
  33. Xu, G.; Zheng, A.; Li, X.; Su, J. Position and orientation measurement adopting camera calibrated by projection geometry of Plücker matrices of three-dimensional lines. Sci. Rep. 2017, 7, 44092. [Google Scholar] [CrossRef] [PubMed]
  34. Fitzgibbon, A.; Pilu, M.; Fisher, R.B. Direct least square fitting of ellipses. IEEE Trans. Pattern Anal. Mach. Intell. 1999, 21, 476–480. [Google Scholar] [CrossRef]
  35. Zhang, Z.H.; Huang, S.J.; Meng, S.S.; Gao, F.; Jiang, X.Q. A simple, flexible and automatic 3D calibration method for a phase calculation-based fringe projection imaging system. Opt. Express 2013, 21, 12218–12227. [Google Scholar] [CrossRef] [PubMed]
  36. TI-TIMES. Available online: http://www.ti-times.com/ (accessed on 17 November 2017).
  37. Giai Photonics Co., Ltd. Available online: http://www.giaiphotonics.com/aboutus.html (accessed on 17 November 2017).
Figure 1. Flowchart of distance calibration using a moving stage in the direct phase measuring deflectometry (DPMD) system.
Figure 1. Flowchart of distance calibration using a moving stage in the direct phase measuring deflectometry (DPMD) system.
Sensors 18 00144 g001
Figure 2. Schematic of the 3D measurement system based on DPMD.
Figure 2. Schematic of the 3D measurement system based on DPMD.
Sensors 18 00144 g002
Figure 3. Schematic diagram for determining the stage movement direction and the distance d between the reference plane and the liquid crystal display (LCD) screen.
Figure 3. Schematic diagram for determining the stage movement direction and the distance d between the reference plane and the liquid crystal display (LCD) screen.
Sensors 18 00144 g003
Figure 4. Panorama of DPMD hardware system.
Figure 4. Panorama of DPMD hardware system.
Sensors 18 00144 g004
Figure 5. Photo of the calibration targets. (a) Checkerboard; (b) mirror with a hollow ring matrix pattern on its surface.
Figure 5. Photo of the calibration targets. (a) Checkerboard; (b) mirror with a hollow ring matrix pattern on its surface.
Sensors 18 00144 g005
Figure 6. Reprojection error of the calibrated camera.
Figure 6. Reprojection error of the calibrated camera.
Sensors 18 00144 g006
Figure 7. Captured virtual checkerboard image reflected by the mirror.
Figure 7. Captured virtual checkerboard image reflected by the mirror.
Sensors 18 00144 g007
Figure 8. Illustration of the designed step-shaped mirror with step numbers and measured depths. (a) The designed steps; (b) image of the fringe pattern reflected by the stepped surface; (c) shaded display of the measured depth; (d) the profile of the measured mirror step. The X- and Y-axes represent the pixel positions.
Figure 8. Illustration of the designed step-shaped mirror with step numbers and measured depths. (a) The designed steps; (b) image of the fringe pattern reflected by the stepped surface; (c) shaded display of the measured depth; (d) the profile of the measured mirror step. The X- and Y-axes represent the pixel positions.
Sensors 18 00144 g008aSensors 18 00144 g008b
Figure 9. The reflected diamond distribution surface object. (a) The photo of the object; (b) image of the fringe pattern reflected by the diamond distribution surface object.
Figure 9. The reflected diamond distribution surface object. (a) The photo of the object; (b) image of the fringe pattern reflected by the diamond distribution surface object.
Sensors 18 00144 g009
Figure 10. Phase maps of the reflected diamond distribution surface object. (ac) are three wrapped phase maps having fringe numbers of 100, 99 and 90, (d) is the absolute phase map.
Figure 10. Phase maps of the reflected diamond distribution surface object. (ac) are three wrapped phase maps having fringe numbers of 100, 99 and 90, (d) is the absolute phase map.
Sensors 18 00144 g010
Figure 11. Reconstruction of the reflected diamond distribution surface object.
Figure 11. Reconstruction of the reflected diamond distribution surface object.
Sensors 18 00144 g011
Table 1. Direct test of the calibrated distance using the moving stage at the positions of 8 mm, 8.5 mm, 10 mm 11.5 mm, and 12 mm (Unit: mm).
Table 1. Direct test of the calibrated distance using the moving stage at the positions of 8 mm, 8.5 mm, 10 mm 11.5 mm, and 12 mm (Unit: mm).
Position88.51011.512
Moved distance278.783279.249280.485281.854282.324
Calibrated distance278.762279.219280.512281.879282.352
Absolute error0.0210.0300.0270.0250.028
Table 2. Experimental results on the mirror step artifact (Unit: mm).
Table 2. Experimental results on the mirror step artifact (Unit: mm).
DepthStep DistanceMeasured DistanceAbsolute ErrorRMS
step 1 to 23.9874.0180.0310.030
step 2 to 37.0257.0460.0210.013
step 3 to 45.0064.9860.0200.023
step 4 to 56.0996.0750.0240.020

Share and Cite

MDPI and ACS Style

Huang, S.; Liu, Y.; Gao, N.; Zhang, Z.; Gao, F.; Jiang, X. Distance Calibration between Reference Plane and Screen in Direct Phase Measuring Deflectometry. Sensors 2018, 18, 144. https://doi.org/10.3390/s18010144

AMA Style

Huang S, Liu Y, Gao N, Zhang Z, Gao F, Jiang X. Distance Calibration between Reference Plane and Screen in Direct Phase Measuring Deflectometry. Sensors. 2018; 18(1):144. https://doi.org/10.3390/s18010144

Chicago/Turabian Style

Huang, Shujun, Yue Liu, Nan Gao, Zonghua Zhang, Feng Gao, and Xiangqian Jiang. 2018. "Distance Calibration between Reference Plane and Screen in Direct Phase Measuring Deflectometry" Sensors 18, no. 1: 144. https://doi.org/10.3390/s18010144

APA Style

Huang, S., Liu, Y., Gao, N., Zhang, Z., Gao, F., & Jiang, X. (2018). Distance Calibration between Reference Plane and Screen in Direct Phase Measuring Deflectometry. Sensors, 18(1), 144. https://doi.org/10.3390/s18010144

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop