Next Article in Journal
Ripeness Prediction of Postharvest Kiwifruit Using a MOS E-Nose Combined with Chemometrics
Next Article in Special Issue
Three-Dimensional Face Reconstruction Using Multi-View-Based Bilinear Model
Previous Article in Journal
Robust Kalman Filter Aided GEO/IGSO/GPS Raw-PPP/INS Tight Integration
Previous Article in Special Issue
Graph Cut-Based Human Body Segmentation in Color Images Using Skeleton Information from the Depth Sensor
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Combining Non-Uniform Time Slice and Finite Difference to Improve 3D Ghost Imaging

1
School of optics and photonics, Beijing Institute of Technology, Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, Beijing 100081, China
2
NUS Suzhou Research Institute (NUSRI), Suzhou Industrial Park, Suzhou 215123, China
*
Authors to whom correspondence should be addressed.
Sensors 2019, 19(2), 418; https://doi.org/10.3390/s19020418
Submission received: 29 November 2018 / Revised: 15 January 2019 / Accepted: 18 January 2019 / Published: 21 January 2019
(This article belongs to the Special Issue Depth Sensors and 3D Vision)

Abstract

:
Three-dimensional ghost imaging (3DGI) using a detector is widely used in many applications. The performance of 3DGI based on a uniform time slice is difficult to improve because obtaining an accurate time-slice position remains a challenge. This paper reports a novel structure based on non-uniform time slice combined with finite difference. In this approach, finite difference is beneficial to improving sensitivity of zero crossing to accurately obtain the position of the target in the field of view. Simultaneously, non-uniform time slice is used to quickly obtain 3DGI on an interesting target. Results show that better performances of 3DGI are obtained by our proposed method compared to the traditional method. Moreover, the relation between time slice and the signal-noise-ratio of 3DGI is discussed, and the optimal differential distance is obtained, thus motivating the development of a high-performance 3DGI.

1. Introduction

Three-dimensional (3D) light detection and ranging (lidar) based on the principle of time of flight (TOF) is widely used in various fields, such as remote sensing [1], machine vision [2], and target detection and recognition [3], because of its active long-range detection and high resolution. Traditional 3D lidar methods are classified into scanning and non-scanning types [4]. Compared with TOF-based lidar, ghost imaging (GI) lidar, as a novel approach based on a single detector, is noteworthy because of its high performances, including speed, detection efficiency [5], no Rayleigh limitation [6], and signal-to-noise ratio (SNR) [7]. Compared with traditional scanning TOF-based lidar, GI lidar has easily recognizable compacted size and high speed [8] because GI does not need any scanning devices. Additionally, scanning TOF-based lidar is limited by the Rayleigh limitation of the emitting lens aperture. GI lidar also obtains the target image even without a lens [9]. Compared with non-scanning TOF-based lidar, such as that based on an avalanche photodiode (APD) array, GI lidar obtains higher detecting sensitivity because echo signal power from the target focusing on a single APD is stronger than on an APD array illuminated by floodlight illumination [10,11].Therefore, GI lidar obtains higher SNR than non-scanning TOF-based lidar [12].
In early GI research, researchers mainly focused on two-dimensional GI (2DGI) [13]. With the development of light source and computational imaging, 3DGI has gained the interest of researchers because it provides numerous target details. For example, four single-pixel detectors in different locations are employed to construct a 3D computational image [14]. In this experiment, a 2D image is obtained by each single-pixel detector, and then a 3D image is reconstructed by combining the shading information of surface gradient in each 2D image. However, the computational process to reconstruct a 3D image is time consuming [15]. Conversely, the time-slice method is used to construct 3DGI [16,17,18], which can overcome the backscatter brought by obscurants, camouflage, and water. Therefore, 3DGI based on this method is more suitable for long-range detection. A method was proposed using this structure. Some studies have investigated this method based on imaging efficiency [8,19], accuracy [17], and resolution [18] through simulations and experiments. However, a common feature of 3DGI in previous studies was their basis on the uniform time-slice method (UTSM), which results in low efficiency and unfavorable performances in the reconstruction of 3D imaging. In most situations, however, we merely want to clearly observe the interesting part rather than the whole field of view (FOV), e.g., target recognition or tracking, so a non-uniform sampling method has been studied in a space domain [20,21] in 2D imaging and has obtained a favorable performance. Different from 2D imaging, the depth information of 3DGI lidar is based on each time-slice position on an echo signal, which are full-waveform signal from scenes, and the accuracy of the position of the time slice on echo signal is important to improve the 3DGI performance [17]. Although previous studies on 3DGI applied a non-uniform time-slice method (NUTSM), to the best of our knowledge, the relationship between the accuracy of time slice and the performance of 3DGI has not been studied according to the target of interest [22]. Different from reference [22], we not only study the relationship between the position of time slice and GI, but also report a finite difference instead of peak detection to improve accuracy of time slice for the situation of imaging with high resolution and real time, e.g., target tracking. NUTSM is more suitable than UTSM because of larger redundant data in the latter. Meanwhile, UNTSM is based on the peak of echo signal, which is beneficial in order to obtain the salient feature in the scene [23], especially for a large depth field of view, because UTSM with high resolution results in too large data to reconstruction for high efficiency. Therefore, on the basis of the echo signal detected by a single-pixel detector, we proposed a NUTSM combined with finite differential in time domain to improve the performance of 3DGI. The rest of the paper is organized as follows. The method of NUTSM with finite difference is studied in Section 2. Based on that, modelling verification and comparative results are obtained through systematic simulations in Section 3. The optimal parameter and related issue on NUTSM are discussed in Section 4.

2. Method

2.1. Combining NUTSM with Finite Difference

Figure 1 shows the difference between UTSM and NUTSM. Figure 1a shows multiple targets (A, B, and C) in the scene. The feature of UTSM has the same time interval (△t) between adjacent sampling units (Figure 1b). Such a method results in numerous calculations in real-time tasks because high-resolution GI requires large acquisition data. Meanwhile, in NUTSM, the time intervals between adjacent sampling units are different (Figure 1c). Specifically, the position of time slices is determined by the peaks in echo signal. However, the peak position is easily affected by pulse broadening and pulse distortion under long-range detection [24]. Hence, accurately extracting the peak position becomes difficult and results in a low accuracy of 3DGI for the targets of interest.
The principle of 3DGI based on NUTSM combined with finite difference method is shown in Figure 2. The pulsed laser diode is triggered by a signal-controlling module. The transmitting beam goes through an expander and is divided into two parts. One part is used to produce a start signal by using a fast photodiode. The other part is an illuminating digital micromirror device (DMD) that produces random speckles to illuminate the target through a half-reflective mirror. Then, the reflected or scattered beams from the targets travel to the half-reflective mirror, a reflective mirror, and a convergent lens, and illuminate time-resolved bucket detectors. The echo signals are delayed (d/c) and (−d/c), where d differential distance, and then it is subtracted between each other to produce zero crossing in the time domain (Figure 3b). Meanwhile, the signals from the time-resolved bucket detector used to correlate with the speckle patterns produced by DMD. To obtain 3DGI, we use a time-resolved bucket detector to receive the intensity of the target at the different time slices. In the system, the speckle patterns, such as the reference arm, can be pre-computed by controlling the DMD. On the basis of Figure 2, the three targets are reflected by peaks in echo signals (Figure 3a) but such a position is difficult to extract when the pulse width is broadened [25], specifically for long distance due to background noise [26]. Meanwhile, the accuracy of the extracting peak becomes poor because of the peak’s low sensitivity, i.e., the low gradient of the peak, shown in the red dot-dash line (Figure 3a). Therefore, we introduce the finite difference method to transfer the peak into a zero crossing (Figure 3b). The effects from the pulse broadening and low sensitivity are thus mitigated remarkably [27].

2.2. Theory

The proposed method includes two steps as follows:
Step I: The depth information of the targets is extracted to determine the number of targets in FOV (Figure 4). Thus, all the elements of DMD are in “ON” status during the process, that is, DMD is viewed as a mirror. After this step, the accurate position of each target is obtained and then used to produce non-uniform time slices in the next step.
Step II: 3DGI is constructed. Based on step I, the random speckle patterns are produced by DMD, and the 2DGI is obtained by correlating the light field and the intensity of the time-resolved bucket detector. Therefore, 3DGI is constructed by combining 2DGI according to the depths of non-uniform time slices, shown in Figure 5.
The pulsed laser is approximately viewed as a time-space domain Gaussian function, which is written as [28]
{ P ( x , y , z , t ) = P 0 τ 2 π exp [ ( t z / c ) 2 2 τ 2 ] 1 π W ( z ) 2 exp [ x 2 + y 2 W ( z ) 2 ] W ( z ) = W 0 [ 1 + ( λ z π W 0 ) 2 ]
where P0 is the pulse energy, τ is the transmitting pulse width, W0 is the waist radius of the laser source, W(z) is the beam radius at the distance of z from the laser source, c is the light speed, λ is the wavelength, and x and y are the coordinates of the z plane. The pulsed laser illuminates the targets in FOV, and the intensity of the echo signal is expressed as
{ P r ( t ) = n = 1 N T a 2 T 0 P 0 η D 2 π τ r n exp [ 1 2 τ r n 2 ( t 2 R n c ) 2 ] 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] ρ r n ( x , y ) cos φ d x d y + P B φ = a r c tan ( x 2 + y 2 R n ) P B = ρ r n ( x , y ) h s u n T 0 A r sin ( α / 2 ) 2 Δ λ d x d y τ r n = τ + tan 2 ( θ n ) W ( R n ) 2 c 2
where N is the total number of targets in the FOV illuminated by the pulsed laser, Ta is the one-way atmospheric transmission, To is the optical efficiency, Rn is the distance between the optical system and the n-th target, c is the light speed, ηD is the quantum efficiency, ρrn (x,y) is the reflectivity with respect to the coordinate (x,y) of the n-th target plane, φ is the solid angle between the target point and detector, W(Rn) is the beam radius of the n-th target plane at the distance of Rn, PB is the intensity of the background [29], hsun is the background solar irradiance, Ar is the area of the receiver, α is the FOV of system, △λ is the optical bandwidth, and τr is the receiving pulse width, which is related to the angle of the target [25,30]. Given that the depth information is merely determined by the echo signal of the time domain, let
Ψ n = 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] ρ r n ( x , y ) d x d y
where Ψn belongs to the space domain, and Pr(t) is transformed into
P r ( t ) = n = 1 N Ψ n T a 2 T 0 P 0 η D 2 π τ r exp [ 1 2 τ r 2 ( t 2 R n c ) 2 ] + P B
According to Equation (2), the intensity of the differential echo signal is written as
P r d ( t ) = n = 1 N Ψ n T a 2 T 0 P 0 η D 2 π τ r { exp [ 1 2 τ r 2 ( t 2 R n d c ) 2 ] exp [ 1 2 τ r 2 ( t 2 R n + d c ) 2 ] }
where d is the differential distance (Figure 2). From Equation (5), we find that the effects from the background are suppressed effectively, and the peak is transformed into a zero crossing (Figure 3b), which is beneficial for obtaining a considerably higher sensitivity than that of the peak. Therefore, depth information is extracted accurately by using the position of the zero crossing. After Step I, the time slice is determined by the depth information of each target in FOV.
As shown in Figure 2c, multiple zero crossings mean multiple targets in FOV. The depth information of each target are obtained based on finite difference (i.e., tn (n = 1, 2,…, N)). Therefore, the GI based on each time slice of each target is constructed by using the correlation between the random light field from DMD and the intensity of the time-resolved bucket detector and is written as
G n ( x , y ) = P 1 n ( x , y ) P 2 n P 1 n ( x , y ) P 2 n
where P1n is the intensity distribution of light field for the n-th time slice (i.e., n-th target), P2n is the corresponding intensity of time-resolved bucket detector with respect to the n-th time slice, and < . > is the ensemble average. To simplify the theory, the working frequency of DMD is assumed to be the same as the laser source, and the laser intensity after modulating by DMD is written as
P D M D ( x , y , t ) = P 0 τ 2 π exp [ ( t L / c ) 2 2 τ 2 ] 1 π W ( L ) 2 exp [ x 2 + y 2 W ( L ) 2 ] I ( x , y )
where L is the distance between the laser and the DMD, and I(x,y) is the modulated function of DMD. The depth information of each target is obtained by step I, that is, tn is determined after Step I. Therefore, we obtain the following:
P 1 n ( x , y , t ) = T a P 0 τ 2 π exp [ ( t t n ) 2 2 τ 2 ] 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] I ( W ( L ) W ( R n ) x , W ( L ) W ( R n ) y )
The distribution of reflective intensity from the n-th target is written as
P r n ( x , y , t ) = P 1 n ( x , y , t ) ρ r n ( x , y )
Therefore, the intensity of the echo signal from a single time-resolved bucket detector is written as
P 2 n ( t ) = T a 2 T 0 P 0 τ r 2 π exp [ ( t t n ) 2 2 τ 2 ] 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] I ( W ( L ) W ( R n ) x , W ( L ) W ( R n ) y ) ρ r n ( x , y ) d x d y
According to Equations (8) and (10), the distributions of light field and the intensity of echo signal of the n-th targets P1n(x,y) and P2n are written as
{ P 1 n ( x , y ) = T a P 0 τ 2 π 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] I ( W ( L ) W ( R n ) x , W ( L ) W ( R n ) y ) P 2 n = T a 2 T 0 P 0 τ r 2 π 1 π W ( R n ) 2 exp [ x 2 + y 2 W ( R n ) 2 ] I ( W ( L ) W ( R n ) x , W ( L ) W ( R n ) y ) ρ r n ( x , y ) d x d y
Equation (11) shows the theory on 2DGI. Based on Equation (11), 3DGI is obtained by combining all 2DGI on different time slices.

3. Simulations and Results

3.1. Simulation Setup

Numerical simulations are performed based on the above theory to verify the models. As shown in Figure 6, the simulation scene includes a hexagon, square, triangle, circle, and pentagram, and the corresponding feature sizes are 0.16, 0.2, 0.2, 0.2, and 0.07 m, respectively. In addition, the parameters of the pulsed laser are set as follows: Pulse energy is 1 nJ, wavelength is 1550 nm, and the initial pulse width and beam radius are 1 ns and 0.4 m, respectively. The simulations are executed on an Intel Core [email protected] GHz computer with 8 GB of RAM memory and Windows 10 as the operating system. The width of the time slice is set to 0.2τr. The noise conforms to Poisson’s distribution. We used the Matlab® built-in function ‘poissrnd(I, n)’ to simulate the environment noise of the echo signal. In the function ‘poissrnd(I, n)’, n is the sampling number which is 400 in the simulation process and I is the mean of the Poisson distribution of random numbers which is 1 × 10−11 in the simulation.

3.2. Modeling Verification

The 3D images of the targets are constructed with the measurement number at 10,000. The simulation parameters are set as follows: Bandwidth of the receiver is 1 ns, differential distance is 0.06 m, target reflectivity is 0.5, one-way transmission of the laser in the atmosphere is 0.8, and the diameter of the receiver detector is 0.04 m. From the profiles of echo signal based on finite difference, as shown in Figure 7a, five zero crossing are present, indicating the five targets in the scene. Therefore, five time slices are used to obtain 2D images via the corresponding intensity of each target. As shown in Figure 7b–f, each target is clearly constructed. Note that Figure 7b and c includes the hexagon and square information because of the extremely close distance between the two targets. Meanwhile, the peak position fluctuated more than that of the zero crossing, as shown in the rectangular zone, demonstrating that the proposed method is more sensitive than the peak point. By combining all 2D images, we obtain 3DGI (Figure 7g), in which the depth information of each target is obtained by calculating the TOF of each slice.

3.3. Comparative Results

To illustrate the advantages of the proposed method, we compare the simulations from two respects. First, we compare 3DGI based on UTSM and NUTSM. Second, under the condition of a non-uniform time slice, we compare 3DGI based on finite difference and a traditional single detector. In the simulation of comparing 3DGI based on UTSM and NUTSM, the parameters are the same as above. Compared with A (Figure 8a) and A’ (Figure 8b) in 3DGI, the target of the triangle is missing because the triangle is not collected by UTSM. From Figure 8c, point A is not located in the target plane, but point A’ is the target position. Similar comparative results are shown in parts B (Figure 8a) and B’ (Figure 8b), in which the speckle noise in part B is more serious than that in part B’.
To obtain the loss information of the target, we also add enough uniform time slices in the traditional 3DGI. The results are shown in Figure 9, in which the time slice is increased from 5 to 29. Therefore, the loss information is obtained in 2DGI, as shown in Figure 9c ④. However, compared with the 3D reconstruction between Figure 9b and Figure 7g, the 3D imaging quality of Figure 7g is better because more speckle noise is introduced by more time slices in the traditional method. Although the loss information of the target is obtained, as shown in Figure 9c ②, ⑤, and ⑦, the performance of the 3D image is sacrificed, an issue that becomes more serious as time slices increase.
Moreover, we compare the quality of two methods under different time slices intuitively. For example, Figure 10c,e are obviously better than Figure 10d,f. Especially for Figure 10f, there is so much speckle noise which affects the performance of the 3DGI. Meanwhile, from the comparative results, we find that more time slices are used in UTSM than NUTSM, which means that more time consumption is cost for UTSM. For example, NUTSM uses 5 time slices, but UTSM uses 8 time slices, which indicates that NTUSM decreases 37.5% of time consumption of GI.
The results of the comparative simulation based on finite difference and peak detection are shown in Figure 11. The parameters of the pulsed laser are set as follows. The pulse energy is 1nJ; the wavelength is 1550 nm; the initial pulse width and beam radius are 1ns and 0.4 m at 500 m. The parameters of the target include that the shape is a pentagram; the feature size is 0.3 m; the reflectivity is 0.5. The transmission rate of one-way of atmosphere is 0.8. We compared the root-mean-square error (RMSE) between the time slice and the target versus the distance of the target based on finite difference and peak detection (Figure 11a), and each RMSE was obtained by 500 measurements at the same distance. The RMSE of finite difference is better than that of peak detection. For example, under the situation that the target distance is at 500 m, the RMSE of peak detection decreases from 0.28 m to 0.05 m, shown in points A and B in Figure 11a. Figure 11b shows the relation of SNR vs. the relative position because we want to further compare the two methods from the aspect of SNR, which is another important index of ghost imaging [6]. The ideal time-slice position is located on the target position, which obtains the highest SNR. However, it is hardly to achieve best SNR by the use of peak detection or finite difference method. Compared with the two methods, the SNR of peak detection is 1.1 (point A of Figure 11b), but finite difference obtains the SNR of 3.98 (point B of Figure 11b). Therefore, the quality of GI increases as the relative position between the time slice and the target decreases, and the method of finite difference can reduce the relative position to improve the quality of the reconstructed image.

4. Discussion

4.1. Optimal Differential Distance

From the comparative results above, the performance of 3DGI based on NUTSM combined with finite difference is better than that of the traditional method. The remarkable feature of finite difference which is the key parameter for determining the sensitivity of the zero crossing, results in the relative position error between the time slice and the object. Therefore, the performance of 3DGI versus differential distance should be discussed to obtain the optimal differential distance. Theoretically, the differential signal for a target can be expressed as
P r d ( t ) = T a 2 T 0 P 0 η D 2 π τ r exp [ 1 2 τ r 2 ( t 2 R + d c ) 2 ] T a 2 T 0 P 0 η D 2 π τ r exp [ 1 2 τ r 2 ( t 2 R d c ) 2 ]
The changing rate of differential signal vs. time is
k = T a 2 T 0 P 0 η D 2 π τ r 3 { ( t 2 R + d c ) exp [ 1 2 τ r 2 ( t 2 R + d c ) 2 ] + ( t 2 R d c ) exp [ 1 2 τ r 2 ( t 2 R d c ) 2 ] }
where k is sensitivity of differential signal at time t. Specifically, the sensitivity of differential signal at zero crossing is
k | t = 2 R c = T a 2 T 0 P 0 η D 2 π τ r 3 2 d c exp [ 1 2 τ r 2 ( d c ) 2 ]
The changing rate between k | t = 2 R c and d is
d ( k | t = 2 R c ) d ( d ) = T a 2 T 0 P 0 η D 2 π τ r 3 2 c exp [ 1 2 τ r 2 ( d c ) 2 ] T a 2 T 0 P 0 η D 2 π τ r 3 2 d c exp [ 1 2 τ r 2 ( d c ) 2 ] 1 τ r 2 c ( d c )
Let d ( k | t = 2 R c ) d ( d )   =   0 , we obtain d = cτ, which achieves the highest of zero crossing sensitivity.
Based on the discussion above, we carry out simulations to study the zero crossing sensitivity affected by the differential distance. In Figure 12a, we find that zero crossing sensitivity is variant to different differential distance. According to Figure 12b, d = r is obtained to achieve the highest zero crossing sensitivity. For example, compared with zero crossing sensitivity at differential distance of r/2 and r, zero crossing sensitivity increases from 0.07 to 0.11.

4.2. Issue on Non Zero Crossing

For the issue on not exact zero when taking the signal difference, actually, zero crossing may be not exact zero rather than a very small value. The key of finite difference is to solve the low accuracy of the peak, and to improve the accuracy of determining target position. In order to clarify this, we carry out simulations based on the parameters of Section 3.1, and the results are shown in Figure 13. In Figure 13a, the blue curve is the echo signal of the depth of field of view, and the five peaks in the scene, the red curve is the difference signal through the finite difference. From the zooming plot (Figure 13b), we find that the crossing point is not zero, but very small. In the region of no signal, there are many fluctuations which means that Poisson random noise affect echo signal based on the finite difference, even the fluctuations in the peak area results in it being difficult to determine which one is the ‘stop’ moment, e.g., points A or B. But there is only one zero crossing, e.g., point C, which is beneficial to obtaining the ‘stop’ moment accurately. Meanwhile, comparing with points A, B and C, the slop of C is obviously larger than A and B, which means the sensitivity of C is higher than A and B, due to the change rate of the echo signal with time at the peak being near zero. Therefore, we can more accurately find the salient target position no matter if the crossing point is zero or not.

5. Conclusions

A novel approach based on non-uniform time slice combined with finite difference is proposed to improve the performance of 3DGI. Compared with traditional peak detection combined uniform time-slice method, finite difference obtains differential full-waveform signal, resulting in high sensitivity in the zero crossing and decreasing the effect from background noise. Therefore, the position of the target is more accurate than the traditional peak detection. Meanwhile, NUTSM is suitable for quickly obtaining 3DGI on salient features in the field of view. We studied the relationship between 3DGI performance and the position of the time slice to obtain the optimum differential distance, which achieved the highest zero-crossing sensitivity. Compared with the traditional USTM, NUTSM combined with finite difference shows better performance of 3DGI, which is beneficial for balancing the high resolution and real-time applications.

Author Contributions

Q.H. and J.C. initiated the research; F.Z. conceived the three-dimensional ghost imaging theory; K.Z. and Y.C. designed the prototype and the experiments; Y.W. and Y.F. performed the experiments and analyzed the data; F.Z. wrote the paper.

Funding

The work was supported by National Natural Science Foundation of China (61875012, 61605008, 61871031); Beijing Natural Science Foundation (4182058); Natural Science Foundation of Jiangsu Province (BK20160375); National Key Foundation for Exploring Scientific Instrument (2014YQ350461).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Vu, T.T.; Ban, Y.; Qin, Y.; Niu, Z. Range determination for generating point clouds from airborne small footprint LiDAR waveforms. Opt. Express 2012, 20, 25935–25947. [Google Scholar]
  2. Foix, S.; Alenya, G.; Torras, C. Lock-in Time-of-Flight (ToF) Cameras: A Survey. IEEE Sens. J. 2011, 11, 1917–1926. [Google Scholar] [CrossRef] [Green Version]
  3. Guo, Y.; Bennamoun, M.; Sohel, F.; Lu, M.; Wan, J. An Integrated Framework for 3-D Modeling, Object Detection, and Pose Estimation From Point-Clouds. IEEE Trans. Instrum. Meas. 2015, 64, 683–693. [Google Scholar]
  4. Molebny, V.; Mcmanamon, P.; Steinvall, O.; Kobayashi, T.; Chen, W. Laser radar: Historical prospective—From the East to the West. Opt. Eng. 2016, 56, 031220. [Google Scholar] [CrossRef]
  5. Li, X.; Liang, Y. Surface characteristics modeling and performance evaluation of urban building materials using LiDAR data. Appl. Opt. 2015, 54, 4750–4759. [Google Scholar] [CrossRef] [PubMed]
  6. Zhao, C.; Gong, W.; Chen, M.; Li, E. Ghost imaging lidar via sparsity constraints. Appl. Phys. Lett. 2012, 101, 141123. [Google Scholar] [CrossRef] [Green Version]
  7. Xu, B.; Jiang, H.; Zhao, H.; Li, X.; Zhu, S. Projector-defocusing rectification for Fourier single-pixel imaging. Opt. Express 2018, 26, 5005–5017. [Google Scholar] [CrossRef] [PubMed]
  8. Xu, Z.H.; Chen, W.; Penuelas, J.; Padgett, M.; Sun, M.J. 1000 fps computational ghost imaging using LED-based structured illumination. Opt. Express 2018, 26, 2427–2434. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Basano, L.; Ottonello, P. Experiment in lensless ghost imaging with thermal light. Appl. Phys. Lett. 2006, 89, 061106. [Google Scholar] [CrossRef]
  10. Howland, G.A.; Lum, D.J.; Ware, M.R.; Howell, J.C. Photon counting compressive depth mapping. Opt. Express 2013, 21, 23822–23837. [Google Scholar] [CrossRef]
  11. Richmond, R.D. Direct-Detection LADAR Systems; SPIE Press: Bellingham, WA, USA, 2010. [Google Scholar]
  12. Gong, W.; Zhao, C.; Hong, Y.; Chen, M.; Xu, W.; Han, S. Three-dimensional ghost imaging lidar via sparsity constraint. Sci. Rep. 2016, 6, 26133. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Strekalov, D.V.; Sergienko, A.V.; Klyshko, D.N.; Shih, Y.H. Observation of two-photon “ghost” interference and diffraction. Phys. Rev. Lett. 1995, 74, 3600–3603. [Google Scholar] [CrossRef] [PubMed]
  14. Sun, B.; Edgar, M.P.; Bowman, R.; Vittert, L.E.; Welsh, S.; Bowman, A.; Padgett, M.J. 3D computational imaging with single-pixel detectors. Science 2013, 340, 844–847. [Google Scholar] [CrossRef] [PubMed]
  15. Faccio, D.; Leach, J. Ghost Imaging in Three Dimensions. Science 2013, 340, 821–822. [Google Scholar] [CrossRef] [PubMed]
  16. Li, L.; Wu, L.; Wang, X.; Dang, E. Gated viewing laser imaging with compressive sensing. Appl. Opt. 2012, 51, 2706–2712. [Google Scholar] [CrossRef] [PubMed]
  17. Yang, X.; Zhang, Y.; Xu, L.; Yang, C.; Wang, Q.; Liu, Y.; Zhao, Y. Increasing the range accuracy of three-dimensional ghost imaging ladar using optimum slicing number method. Chin. Phys. B 2015, 24, 319–324. [Google Scholar] [CrossRef]
  18. Li, E.; Yu, H.; Han, S.; Gong, W. Structured image reconstruction for three-dimensional ghost imaging lidar. Opt. Express 2015, 23, 14541–14551. [Google Scholar]
  19. Zhang, Z.; Liu, S.; Peng, J.; Yao, M.; Zheng, G.; Zhong, J. Simultaneous spatial, spectral, and 3D compressive imaging via efficient Fourier single-pixel measurements. Optica 2018, 5, 315–319. [Google Scholar] [CrossRef]
  20. Jiang, H.; Zhu, S.; Zhao, H.; Xu, B.; Li, X. Adaptive regional single-pixel imaging based on the Fourier slice theorem. Opt. Express 2017, 25, 15118–15130. [Google Scholar] [CrossRef]
  21. Phillips, D.B.; Sun, M.J.; Taylor, J.M.; Edgar, M.P.; Barnett, S.M.; Gibson, G.M.; Padgett, M.J. Adaptive foveated single-pixel imaging with dynamic supersampling. Sci. Adv. 2016, 3, e1601782. [Google Scholar] [CrossRef]
  22. Howland, G.A.; Howell, J.C.; Dixon, P.B. Photon-counting compressive sensing laser radar for 3D imaging. Appl. Opt. 2011, 50, 5917–5920. [Google Scholar] [CrossRef] [PubMed]
  23. Budge, S.; Leishman, B.; Pack, R. Simulation and modeling of return waveforms from a ladar beam footprint in USU LadarSIM. Proc. SPIE 2006, 55, 308–312. [Google Scholar]
  24. Banakh, V.A.; Razenkov, I.A.; Smalikho, I.N. Laser echo signal amplification in a turbulent atmosphere. Appl. Opt. 2015, 54, 7301–7307. [Google Scholar] [CrossRef] [PubMed]
  25. Johnson, S.E. Effect of target surface orientation on the range precision of laser detection and ranging systems. J. Appl. Remote Sens. 2009, 3, 2527–2532. [Google Scholar] [CrossRef]
  26. Wang, F.; Zhao, Y.; Zhang, Y.; Sun, X. Range accuracy limitation of pulse ranging systems based on Geiger mode single-photon detectors. Appl. Opt. 2010, 49, 5561–5566. [Google Scholar] [CrossRef] [PubMed]
  27. Cheng, Y.; Cao, J.; Hao, Q.; Xiao, Y.; Zhang, F.; Xia, W.; Zhang, K.; Yu, H. A Novel De-Noising Method for Improving the Performance of Full-Waveform LiDAR Using Differential Optical Path. Remote Sens. 2017, 9, 1109. [Google Scholar] [CrossRef]
  28. Marquès, J.R.; Geindre, J.P.; Amiranoff, F.; Audebert, P.; Gauthier, J.C.; Antonetti, A.; Grillon, G. Temporal and spatial measurements of the electron density perturbation produced in the wake of an ultrashort laser pulse. Phys. Rev. Lett. 1996, 76, 3566–3569. [Google Scholar] [CrossRef] [PubMed]
  29. Der, S.; Redman, B.; Chellappa, R. Simulation of error in optical radar range measurements. Appl. Opt. 1997, 36, 6869–6874. [Google Scholar] [CrossRef]
  30. Li, Y.; Wu, Z. Targets recognition using subnanosecond pulse laser range profiles. Opt. Express 2010, 18, 16788–16796. [Google Scholar] [CrossRef]
Figure 1. Comparison between uniform and non-uniform time-slice sequences. (a) Multiple targets are illuminated by pulsed laser. (b) Traditional uniform time-slice method (UTSM), and the interval between neighbor time slices is uniform. (c) Non-uniform time-slice method (NUTSM), and time slice are located on peak positions.
Figure 1. Comparison between uniform and non-uniform time-slice sequences. (a) Multiple targets are illuminated by pulsed laser. (b) Traditional uniform time-slice method (UTSM), and the interval between neighbor time slices is uniform. (c) Non-uniform time-slice method (NUTSM), and time slice are located on peak positions.
Sensors 19 00418 g001
Figure 2. Principle of 3D ghost imaging (GI) based on non-uniform time-slice method (NUTSM) combined with finite difference.
Figure 2. Principle of 3D ghost imaging (GI) based on non-uniform time-slice method (NUTSM) combined with finite difference.
Sensors 19 00418 g002
Figure 3. Echo signal comparison between peak and zero crossing. (a) Peak position by single time-resolved bucket detector. (b) Zero crossing by finite difference.
Figure 3. Echo signal comparison between peak and zero crossing. (a) Peak position by single time-resolved bucket detector. (b) Zero crossing by finite difference.
Sensors 19 00418 g003
Figure 4. Step I: Depth information of targets is extracted based on finite difference.
Figure 4. Step I: Depth information of targets is extracted based on finite difference.
Sensors 19 00418 g004
Figure 5. Step II: 3DGI is constructed by using non-uniform time slices.
Figure 5. Step II: 3DGI is constructed by using non-uniform time slices.
Sensors 19 00418 g005
Figure 6. 3D target models: (a) Perspective view and (b) side view.
Figure 6. 3D target models: (a) Perspective view and (b) side view.
Sensors 19 00418 g006
Figure 7. Results of echo signal based on finite difference, 2D, and 3DGI: (a) Echo signals based on a single detector and finite difference, (b)–(f) 2D images under different distances (500–508 m), and (g) 3DGI obtained by combining 2DGI. All the above results are without any post-processing.
Figure 7. Results of echo signal based on finite difference, 2D, and 3DGI: (a) Echo signals based on a single detector and finite difference, (b)–(f) 2D images under different distances (500–508 m), and (g) 3DGI obtained by combining 2DGI. All the above results are without any post-processing.
Sensors 19 00418 g007
Figure 8. Comparative results: (a) And (b) are 3DGI based on uniform time-slice method (UTSM) and NUTSM, respectively; (c) echo signals based on UTSM, with points A and B representing the corresponding positions of the time slices; and (d) echo signals based on NUTSM, with points A’ and B’ representing the corresponding positions of the time slices.
Figure 8. Comparative results: (a) And (b) are 3DGI based on uniform time-slice method (UTSM) and NUTSM, respectively; (c) echo signals based on UTSM, with points A and B representing the corresponding positions of the time slices; and (d) echo signals based on NUTSM, with points A’ and B’ representing the corresponding positions of the time slices.
Sensors 19 00418 g008
Figure 9. 3DGI and 2DGI based on UTSM: (a) Echo signal based on a single detector, (b) 3DGI via combining 2DGI, and (c) corresponding 2D images under different time slices in (a).
Figure 9. 3DGI and 2DGI based on UTSM: (a) Echo signal based on a single detector, (b) 3DGI via combining 2DGI, and (c) corresponding 2D images under different time slices in (a).
Sensors 19 00418 g009
Figure 10. Comparative results based on NUTSM and UTSM. (a) is based on NUTSM and (b) is based on UTSM. (c) And (e) are the ghost image under the positions of ③ and ④ corresponding to (a). (d) And (f) are the ghost image under the positions of ⑤ and ⑦ corresponding to (b).
Figure 10. Comparative results based on NUTSM and UTSM. (a) is based on NUTSM and (b) is based on UTSM. (c) And (e) are the ghost image under the positions of ③ and ④ corresponding to (a). (d) And (f) are the ghost image under the positions of ⑤ and ⑦ corresponding to (b).
Sensors 19 00418 g010aSensors 19 00418 g010b
Figure 11. Comparative results based on finite difference and peak detection: (a) Root-mean-square errors (RMSEs) based on finite difference and peak detection, and (b) Relationship between relative position and signal-to-noise ratio (SNR)
Figure 11. Comparative results based on finite difference and peak detection: (a) Root-mean-square errors (RMSEs) based on finite difference and peak detection, and (b) Relationship between relative position and signal-to-noise ratio (SNR)
Sensors 19 00418 g011
Figure 12. The performance of the time slice under different differential optical paths. (a) Echo signal power vs. time. (b) Sensitivity vs. differential distance.
Figure 12. The performance of the time slice under different differential optical paths. (a) Echo signal power vs. time. (b) Sensitivity vs. differential distance.
Sensors 19 00418 g012
Figure 13. Example of the issue on not exact zero when taking the signal difference. (a) The echo signal from the depth of field of view. (b) Zooming area for the black rectangle of (a).
Figure 13. Example of the issue on not exact zero when taking the signal difference. (a) The echo signal from the depth of field of view. (b) Zooming area for the black rectangle of (a).
Sensors 19 00418 g013

Share and Cite

MDPI and ACS Style

Zhang, F.; Cao, J.; Hao, Q.; Zhang, K.; Cheng, Y.; Wang, Y.; Feng, Y. Combining Non-Uniform Time Slice and Finite Difference to Improve 3D Ghost Imaging. Sensors 2019, 19, 418. https://doi.org/10.3390/s19020418

AMA Style

Zhang F, Cao J, Hao Q, Zhang K, Cheng Y, Wang Y, Feng Y. Combining Non-Uniform Time Slice and Finite Difference to Improve 3D Ghost Imaging. Sensors. 2019; 19(2):418. https://doi.org/10.3390/s19020418

Chicago/Turabian Style

Zhang, Fanghua, Jie Cao, Qun Hao, Kaiyu Zhang, Yang Cheng, Yingbo Wang, and Yongchao Feng. 2019. "Combining Non-Uniform Time Slice and Finite Difference to Improve 3D Ghost Imaging" Sensors 19, no. 2: 418. https://doi.org/10.3390/s19020418

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop