Next Article in Journal
Water Stress Index and Stomatal Conductance under Different Irrigation Regimes with Thermal Sensors in Rice Fields on the Northern Coast of Peru
Previous Article in Journal
Automating Ground Control Point Detection in Drone Imagery: From Computer Vision to Deep Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

Untrained Metamaterial-Based Coded Aperture Imaging Optimization Model Based on Modified U-Net

College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2024, 16(5), 795; https://doi.org/10.3390/rs16050795
Submission received: 9 December 2023 / Revised: 16 February 2024 / Accepted: 21 February 2024 / Published: 24 February 2024

Abstract

:
Metamaterial-based coded aperture imaging (MCAI) is a forward-looking radar imaging technique based on wavefront modulation. The scattering coefficients of the target can resolve as an ill-posed inverse problem. Data-based deep-learning methods provide an efficient, but expensive, way for target reconstruction. To address the difficulty in collecting paired training data, an untrained deep radar-echo-prior-based MCAI (DMCAI) optimization model is proposed. DMCAI combines the MCAI model with a modified U-Net for predicting radar echo. A joint loss function based on deep-radar echo prior and total variation is utilized to optimize network weights through back-propagation. A target reconstruction strategy by alternatively using the imaginary and real part of the radar echo signal (STAIR) is proposed to solve the DMCAI. It makes the target reconstruction task turn into an estimation from an input image by the U-Net. Then, the optimized weights serve as a parametrization that bridges the input image and the target. The simulation and experimental results demonstrate the effectiveness of the proposed approach under different SNRs or compression measurements.

1. Introduction

The radar system is capable of all-day and all-weather active detection and imaging. However, the azimuth resolution of the radar system is mainly limited by the physical antenna aperture, as defined by the Rayleigh diffraction limit. Generally, there are two approaches to enhance the azimuth resolution of radar systems. The synthetic aperture radar (SAR) system [1] utilizes the relative motion between the radar system and the target to accumulate the aperture, but it cannot achieve forward-looking imaging. The phased array radar (PAR) system [2] forms a narrow beam by increasing the number of antenna array elements, but it also increases the system costs and complexity.
Electromagnetic metamaterials [3,4] are artificially structured materials composed of sub-wavelength units that possess significant electromagnetic properties not found in conventional materials. Programmable metamaterials, in particular, allow for real-time controllable modulation of electromagnetic waves. Benefiting from the recent advances in digital metamaterials, the coded aperture imaging technique based on wavefront modulation provides a novel strategy for achieving high-resolution forward-looking radar imaging. The metamaterial-based coded aperture imaging (MCAI) radar system utilizes a digital metamaterial array antenna to modulate the radar signal wavefront. This system produces a spatiotemporal-independent radiation field over the target area. The receiver captures the radar echo reflected by the target. For the target reconstruction, the scattering coefficients of the target can be resolved as an inverse problem by using the pseudo randomness of the radar echo signals.
However, the radiation field cannot achieve complete spatiotemporal independence when each unit of the array antenna is independently modulated. As a result, extensive measurements are required to ensure high-resolution imaging, which, in turn, leads to increased time consumption. To address this issue, reconstruction algorithms based on the compressive sensing (CS) theory have been proposed to improve the imaging efficiency. Both the orthogonal matching pursuit (OMP) algorithm [5,6] and the sparse Bayesian learning (SBL) algorithm [7,8] make use of the sparsity of the target image as a prior for image reconstruction. However, the imaging results in the high-frequency band exhibit dense scattering centers, which cannot satisfy the sparsity prior. The Tikhonov regularization algorithm can be applied to address ill-posed problems in imaging reconstruction by constructing an optimization objective function with penalty terms (i.e., the L2 term) [9], but it is susceptible to noise interference.
Recently, neural-network-based methods have been utilized for target reconstruction [10,11,12], leveraging their inherent robustness to noise. Researchers have applied them to the field of radar imaging to enhance reconstruction results. A generative adversarial network (GAN) can effectively improve the reconstruction quality of degraded signals for MCAI after training by massive paired echo-image training data [13]. However, the acquisition of a sufficient number of target images for network training is often challenging, hindering progress in this field. Although some methods use generated training data to reduce the reliance on real training data, their performance is greatly affected by the generated scene [14,15,16].
To address this issue, training-free neural network-based methods are needed for target reconstruction. Ulyanov et al. proposed the untrained deep image prior (DIP) framework [17], which effectively captures a substantial amount of low-level statistical information from images to tackle standard inverse problems [18] such as denoising [19] and super resolution [20]. The most significant advantage of the DIP framework is that it eliminates the requirement for a large dataset for training the neural network. DIP has been applied in radar imaging for SAR image denoising and inpainting [21,22]. However, these applications are still limited to image-to-image tasks.
In this paper, an untrained deep radar-echo-prior-based MCAI (DMCAI) optimization model is proposed to reconstruct the scattering coefficients of the target with different sparsity. It combines the MCAI model with a modified U-Net and utilizes the deep neural network as a handcrafted prior, thereby eliminating the need for a large dataset while achieving high-resolution reconstruction. The joint loss function is composed of deep-radar echo prior and total variation. On top of that, we propose a target reconstruction strategy by alternatively using the imaginary and real part of the radar echo signal (STAIR) to solve the DMCAI. We update the U-Net weights with the Adam optimizer [23] by calculating the gradient of the loss function for each weight in the U-Nets. The optimal weights serve as a mapping from a randomly generated image to the target image. STAIR reduces the utilization of echo data by half in each iteration, enhancing the efficiency of the optimization process. The simulation and experimental results demonstrate that the proposed method outperforms traditional approaches under different SNRs and compression measurement scenarios.
The structure of this article is outlined as follows. Section 2 proposes a modified U-Net based untrained optimization model named as DMCAI. Then, a STAIR algorithm is proposed to solve DMCAI. Section 3 and Section 4 present the simulation and experimental results, respectively, to demonstrate the superiority of the proposed method. Section 5 draws the conclusion.

2. Theoretical Analysis

2.1. MCAI System Structure and Imaging Model

The structure of the MCAI system is shown in Figure 1. According to the research in [24], a 1-bit programmable meta-surface is utilized to randomly modulate the phase of the transmitted signal by either 0 ° or 180 ° . This modulation enables the formation of a spatially and temporally independent radiation field distribution in the target area. The target region is segmented into grid cells, with the scattering centers of the target being represented by the grid center points.
The imaging plane is divided into M grid cells. In this system, the stepped-frequency waveform (SFW) is transmitted from the Tx, and the transmitted pulse signal is a group of N pulse trains, where the carrier frequency of each pulse train is as follows:
f n = f 0 + n Δ f ,   n = 0 , 1 , N 1 .
Each pulse width is t p , and the pulse repetition period is T P . Therefore, the bandwidth of the pulse trains that composed of N pulses is:
B = ( N 1 ) Δ f .
In a pulse train cycle, the radar signal can be expressed as:
S t ( t , f n ) = A exp ( j 2 π f n t ) ,   n T p t n T p + t p ,
where S t ( t ) is the transmitted signal of the radar system, f n is the center frequency of the n th pulse, and A is the amplitude of the signal. The transmitted signal propagates freely to the surface of metamaterials through space. The metamaterial array has an I coding unit. The electromagnetic wave signal reaching the i th coding unit can be expressed as:
S t ( t , f n , code i ) = A exp [ j 2 π f n ( t d T x , code i c ) ] ,
where code i represents the i th ( i = 1 , 2 , I ) coding unit of the meta-surface. d T x , code i represents the signal propagation distance from transmitter to the code i . After modulation by metamaterial antenna array, the radiation field signal at the m th ( m = 1 , 2 , M ) target grid cell is:
S t ( t , f n , m ) = i = 1 I S t ( t d code i , m c , f n , code i ) exp ( j φ n , code i ) = i = 1 I exp [ j 2 π f n ( t d T x , code i + d code i , m c ) ] exp ( j φ n , code i ) ,
where φ n , code i is the phase modulation factor of the carrier frequency f n , corresponding to the i th coding unit of the meta-surface, and its value is randomly taken as 0 or π . d code i , m represents the signal propagation distance from the i th coding unit to the m th target grid cell.
After scattering by the target, the echo signal can be expressed as:
S r ( t , f n ) = m = 1 M S t ( t d m , R c c , f n , m ) β m ,
where β m represents the scattering coefficient corresponding to the m th grid. d m , R c represents the signal propagation distance from the m th target grid cell to the receiver. Then, the echo signal can be expressed in detail as:
S r ( t , f n ) = m = 1 M { i = 1 I exp [ j 2 π f n ( t d T x , code i + d code i , m + d m , R c c ) ] exp ( j φ n , code i ) β m } .
If each pulse is sampled at the t s time after it has transmitted, then the sampled signal is:
S r ( t s , f n ) = m = 1 M { i = 1 I exp [ j 2 π f n ( t s d T x , code i + d code i , m + d m , R c c ) ] exp ( j φ n , code i ) β m } .
As a result, at the sampling time, the electromagnetic wave signal at β m is:
S ( t s , f n , m ) = i = 1 I exp [ j 2 π f n ( t s d T x , code i + d code i , m + d m , R c c ) ] exp ( j φ n , code i ) .
After N times of sampling and receiving, the mathematical model of MCAI can be expressed as:
[ S r ( t s , f 0 ) S r ( t s , f 1 ) S r ( t s , f N 1 ) ] = [ S ( t s , f 0 , 1 ) S ( t s , f 0 , 2 ) S ( t s , f 0 , M ) S ( t s , f 1 , 1 ) S ( t s , f 1 , 2 ) S ( t s , f 1 , M ) S ( t s , f N 1 , 1 ) S ( t s , f N 1 , 2 ) S ( t s , f N 1 , M ) ] [ β 1 β 2 β M ] + [ ω 1 ω 2 ω N ] .
The above formula can be abbreviated as:
S r = S β + ω ,
where S r = [ S r ( t s , f 0 ) , S r ( t s , f 1 ) , , S r ( t s , f n ) , , S r ( t s , f N ) ] T , β = [ β 1 , β 2 , , β m , β M ] T , and ω = [ ω 1 , ω 2 , , ω n , , ω N ] T denote the echo signal vector, the target scattering coefficient vector, and the additive noise, respectively. Therefore, the reference matrix S in the imaging mathematical model is:
S = [ S ( t s , f 0 , 1 ) S ( t s , f 0 , 2 ) S ( t s , f 0 , M ) S ( t s , f 1 , 1 ) S ( t s , f 1 , 2 ) S ( t s , f 1 , M ) S ( t s , f N 1 , 1 ) S ( t s , f N 1 , 2 ) S ( t s , f N 1 , M ) ] .

2.2. DMCAI Optimization Model

A classical approach to solving the target reconstruction problem involves converting the inverse problem into a constrained optimization problem [25], which can be expressed as:
β ˜ = arg min β 1   subject   to S r S β 2 2 < ε 2 ,
where ε 2 is the variance of noise. In practical situations, statistical methods can be used to estimate the level of noise. The L1 norm constraint on β means that Equation (13) has the property of a convex function, which can ensure the global optimal solution is obtained. Then, the problem becomes a basis pursuit denoise (BPDN) problem. When solving BPDN problems with constraints, the constrained formulation can be relaxed to an unconstrained one by using a loss function:
β ˜ = arg min β S r S β 2 2 + λ β 1 ,
where λ is a parameter that balances between the constraints and target prior.
In addition, with the popularity of deep learning, end-to-end neural network-based (EENN) algorithms are proposed to solve the problem by establishing the relationship between the echo signal and the target image [26]. Thus, the target β can be estimated directly from the echo signal S r by a well-trained neural-network N θ :
β ˜ = N θ ( S r ) ,
where N θ is a deep network with parameters θ . Both the classic method and the EENN algorithm have limitations. The classic method’s performance is impacted by the generic prior of the target, and the EENN algorithm requires a large amount of echo-target paired data to train the neural network.
Compared with the training-based EENN algorithm, the DIP framework utilizes a randomly initialized neural network to adapt a single degraded image. By bridging the gap between training-based methods and training-free methods that utilize handcrafted priors, DIP exhibits potential applications in radar imaging. It utilizes the deep network architecture to implicitly capture the image prior [17] and seems to have excellent results in standard inverse problems, which can be abstracted as a type of energy minimization problem:
x * = min x E ( x ; x 0 ) + R ( x ) ,
where E ( x ; x 0 ) is a task-dependent data term, x 0 is a degraded image, and R ( x ) is a regularizing term. The choice of E ( x ; x 0 ) is determined by the application scenario. Additionally, choosing a regularizing term is often challenging because it needs to capture generic priors on natural images. Therefore, the DIP replaces the regularizing term with the implicit prior captured by a neural network. Reference [20] has proved that the DIP framework has advantages in ghost imaging (GI). Therefore, we argue that the proposed DMCAI optimization model has the potential to enhance the performance of target reconstruction. The objective function of the DMCAI changed from Equation (14) to the following:
N θ * = arg min θ E ( S N θ ( β 0 ) S r 2 ) + R ( N θ ( β 0 ) ) ,
where N θ represents a modified U-Net defined by a set of weights θ , and β 0 is a randomly generated image. U-Net is shown to be a classical network of image processing and has been widely used [27]; its visualization structure is shown in Figure 2. In image processing, a total variation (TV) regularization [28] term can be used as a penalty term in the loss function to smooth the generated image. Thus, we choose the TV term as a regularizing term R ( ) . As a result, the proposed DMCAI optimization model can be expressed as follows:
min θ E ( S ˜ r S r 2 ) + λ TV TV ( N θ ( β 0 ) ) subject   to   S ˜ r = S β ˜ , β ˜ = N θ ( β 0 ) ,
where TV ( ) represents two-dimensional total variation and λ TV stands for its strength. The goal of DMCAI is to recover a reconstruction image β ˜ from a randomly generated image β 0 , which means obtaining a well-estimated image β ˜ from the U-Net after substituting the minimizer of Equation (18). Therefore, the predicted echo signal S ˜ r of the MCAI system will be the best approximation of the actual echo signal S r based on the DMCAI optimization criterion.

2.3. Modified U-Net Architecture

The U-Net was developed for biomedical image processing and cell detection, but has since become a widely used image-processing network structure. In order to match the target reconstruction task of MCAI, we have made some modifications to the classical U-Net architecture. To demonstrate the ability of DMCAI to recover targets from any image, we typically choose randomly generated images as inputs. At this point, the input image contains no information about the target, and an excessive introduction of image priors will affect the imaging quality. Therefore, we did not use the skip connection in the advanced U-Net structure.
The modified U-Net consists of a down-sampling path and an up-sampling path, and the operations for every feature map have been marked in Figure 2. Significantly, in processing feature maps with 3 × 3 convolutional kernels and rectified linear units (ReLU), padding is applied to ensure the output feature maps maintain their original size. The connections between the feature maps that have the same size can integrate the information of features in different depths. As a parametrization of reconstructing a target from the input image, the U-Net architecture is robust enough to retain all target information in radar echoes.

2.4. Solution of the Proposed Model

The complete process of target reconstruction is shown in Figure 3. Initially, a random image β 0 is generated as an input of the U-Net to obtain a processed image. Subsequently, the mathematical model abstracted from the MCAI model is combined with the modified U-Net. With the inputs of the reference matrix and the processed image out of the U-Net, the MCAI module outputs a predicted echo signal. The loss function based on DMCAI is set as follows:
β ˜ = N θ ( β 0 ) , S ˜ r = S β ˜ , L θ * = argmin θ S ˜ r S r 2 + λ TV TV ( N θ ( β 0 ) ) ,
With the update of U-Net weights, the reconstructed image that makes the predicted echo signal the best approximation of the actual echo signal is searched in the observation space. This means the optimal weights of the modified U-Net are found based on the DMCAI optimization criterion.
Next, we consider solving the DMCAI model. According to the Equation (19), β updated in step k can be expressed as:
β k = N θ k 1 ( β 0 ) ,
where N θ k 1 represents the modified U-Net after the k 1 th update, and the weight of the network is θ k 1 . Specifically, β k , k = 1 , 2 , , K is obtained by the modified U-Net. So, the predicted echo signal S ˜ r can be acquired by:
S ˜ r = S β k .
Based on the constructed loss function, we update the network weights by the Adam [23] algorithm. Finally, when the weights converge to a satisfactory value, the target can be reconstructed by the following equation:
β DMCAI = N θ K ( β 0 ) .
In this process, the network weights serve as a parametrization of the target reconstruction task. We found that the measurements N greatly affect the speed of network convergence to the optimal weight. The complex radar echo signal can be expressed as:
S r = A e j φ = S r real + j S r imag .
The target information is contained in both the real and imaginary parts of the complex signal. However, the two parts of the signal have very low correlation because of the phase difference. This conclusion has been proved by using the Monte Carlo method, as shown in Figure 4. If the two parts of the signal are stacked to solve the inverse problem, the amount of the radar signal data will be twice the number of the measurements N = 2 N . To reduce the calculation time, the STAIR algorithm is proposed to solve the DMCAI optimization model, which is summarized in Algorithm 1.
Algorithm 1 STAIR algorithm
Parameters: Iterations: K , Learning rate: α , Adam ( θ k , α ,   β 1 ,   β 2 ), η : 100
Input: Reference Matrix S , echo signal S r
1: Initialize: Random initialization U-Net weights θ ,   randomly   generated   image   β 0
2: for step  k = 1 , 2 , , K  do
3:       if   k   mod   2 = =1 then
4:          S r = S r real , S = S real
5:       else
6:          S r = S r imag , S = S imag
7:       end if
8:       β k = N θ k 1 ( β 0 ) , S ˜ r = S β k , L θ k = MSE ( S r S ˜ r ) + λ TV TV ( N θ k ( β 0 ) )
9:       θ k = ( L θ k ) // calculate the gradient of the loss function
10:     θ k = Adam ( θ k , α , β 1 , β 2 )
10:     α = α γ k / η
11: end for
Output: High-resolution imaging results β DMCAI = N θ K ( β 0 )

3. Simulation Results

The simulation results are carried out in this section to verify the superiority of the proposed method with different imaging conditions. The setup is shown in Figure 1 and the system parameters are given in Table 1. In this simulation, four 2-D projections of planes and cars are selected as the extended target dataset and each image is set as 64 × 64 . Center binarization and edge weakening are used for the target due to its dense scattering center in the high-frequency band. Two typical reconstruction algorithms, the TVAL3 algorithm [28] and the SBL algorithm [8], were chosen to compete with the proposed method. The quality of reconstructed images can be assessed by calculating the mean squared error (MSE) and structural similarity (SSIM) index.
As is known, a smaller MSE indicates better image quality. The SSIM is a human perception-based measure that compares the image content by separating the contributions of luminance, contrast, and structure [29]. The two indexes can quantify the error and the similarity between reconstructed and ground-truth images, respectively.
Each index in the simulation quantitative analyses represents the average results of 50 Monte Carlo trials for a single target due to the random initialization of modified U-Net weights.
In the simulation, we first consider image reconstruction tasks for four different aircraft and vehicle targets. The imaging results are shown in Figure 5. The results show that the proposed method can effectively recover the target scattering coefficients for different targets and targets with different scattering distributions.
Benefiting from the data visualization advantages of deep learning, the output of U-Net during the iteration process is observable at all times. In the task of the simulation experiments shown in Figure 6, K = 300 is a reasonable setting. As it should be, for reconstruction tasks of different sizes of targets, the number of iterations can be adjusted dynamically. At the same time, we set an iterative interruption condition for the deep radar echo prior to the loss function, which means interrupting the iteration when S ˜ r S r 2 < 0.01 .
To evaluate the effectiveness of the STAIR algorithm, we conducted a comparative experiment with the proposed STAIR algorithm. Additional target reconstruction by using the real-part signal, imaginary-part signal, and the overall signal respectively is performed. Table 2 shows the MSE, SSIM, and time results of the compared methods on the plane target with 50 Monte Carlo trials. The results indicate that the proposed STAIR algorithm improves computational efficiency by reducing data usage during the iterative process while guaranteeing the reconstruction accuracy of the targets.
To investigate the effect of noise on the performance of the proposed method, the SNRs from −5 to 20 dB with 5 dB intervals were taken into consideration in the simulations with the measurements N = 0.5 M. The reconstruction results of the SBL algorithm, TVAL3 algorithm, and DMCAI are shown in Figure 7. The results show that the proposed method outperforms SBL and TVAL3 in terms of reconstruction performance, with lower MSE and higher structural similarity in different SNRs. The main reason for this is that parametrization presents a high impedance to noise. As a result, the proposed algorithm has better reconstruction performance with a handcrafted prior across all SNRs.
We also examine the reconstruction performance of DMCAI under compression measurements. The reconstruction results of the SBL algorithm, TVAL3 algorithm, and DMCAI are shown in Figure 8a with the SNR set as 20 dB. The target can be successfully recovered with the measurements of 0.1 M. The performance of the reconstruction results is improved with the increase of measurements. According to the results in Figure 8b,c, the proposed method has better reconstruction performance under compression measurement. In particular, it excels in recovering details of the aircraft target, including the tail and wings.

4. Experimental Results

To further verify the superiority of the DMCAI, an experiment was performed with an actual MCAI radar system. The experimental setup is shown in Figure 9. The metamaterial antenna works in the Ka frequency band and contains 32 × 32 metamaterial units. The setting for the experiment was prepared to match the simulation scene. The parameters of the metamaterial antenna and imaging plane are listed in Table 3.
The imaging distance is set to 2 m, and the target plane is divided into grid cells with a size of 0.1   m × 0.1   m . The target is shown on the right side of Figure 9. It consists of sparse iron sheets with a size of 0.5   m × 0.5   m . Since the target has only 6 × 6 pixels, the modified U-Net’s dimension can be simplified to enhance the processing speed and reduce complexity.
For the MCAI radar system, the reference matrix is always precise in the simulation. However, it is not always the case in experiments. System errors can impact the accuracy of the reference matrix. As a result, a reference matrix S with errors and system noises will affect the DMCAI optimization model, causing the reconstructed image domain to deviate from the target domain, as depicted in Figure 10. Distortion will occur between the actual image and the reconstructed image. Therefore, the accuracy of the reference matrix is required in solving the DMCAI optimization model.
Despite the gap between the approximated optimization model and the real one, the network structure is adequate enough to capture a significant amount of low-level statistical information from the radar echo. The experimental results of the proposed method utilizing an optimized reference matrix based on equivalent measurement of radiation fields [30] are depicted in Figure 11.
Sparseness measures are used to determine how much energy of a vector is concentrated in just a few of its components. The sparseness criterion [31] of the target is defined as the given vector:
Sparseness ( β ) = M ( | β m | ) / | β m | 2 M 1
The sparseness of the targets in the experiment is 0.8536, 0.3056, 0.2835, 0.0511. Compared with the traditional method, DMCAI has better reconstruction performance with lower MSE for targets with different sparseness than SBL and TVAL3. According to the experimental results, the DMCAI optimization model can achieve a high-quality reconstruction of the targets with different sparsity, and the connection between the random image (input image) and each target is established.

5. Discussion

When reconstructing the target, the image information contained in the deep radar echo prior is solidified in the parameterized structure of the network. Although neural networks have natural noise resistance, the noise will gradually appear on the output image as the predicted echo approaches the actual echo during the iteration, as shown in Figure 12. As a result, the mean square error between the output image and the actual image shows a trend of decreasing and then increasing during the iteration process. This will make the selection of iteration times a challenge.
The DMCAI optimization model, combined with imaging models, eliminates the requirement for training data. However, further research is needed to address the issues of imaging performance degradation and the selection of iteration times caused by a decrease in SNR.
The loss function in Equation (19) based on DMCAI has a balance parameter λ TV , which should be tuned for each task. It can be adjusted according to the imaging results.
Table 4 shows the results of reconstructing the plane target for different values of λ TV with N = 0.5 M. Each index in the simulation quantitative analyses represents an average result of 50 Monte Carlo trials for the plane target. The results did not show that MSE and SSIM have a significant correlation with λ TV . Even when reconstructing the same target under different SNR conditions, the optimal parameter λ TV differs. As a consequence, to achieve satisfactory performance in practice, the parameter λ TV still needs to be tuned instead of selecting an arbitrary value.

6. Conclusions

In this paper, an imaging mathematical model is established according to the MCAI system structure. Based on the deep radar echo prior, an untrained DMCAI optimization model is proposed to achieve a high-quality reconstruction of targets with different sparsity. Then, a STAIR algorithm is designed to solve the proposed model. The method is systematically analyzed by numerical simulation, and the effectiveness of the method is verified by experiments. The results show that the method could recover the target image from the random image under the DMCAI optimization criterion, and that it has advantages in solving the ill-posed inverse problem under compression measurement.

Author Contributions

Conceptualization, Y.C.; methodology, Y.C.; software, Y.C. and H.Z.; validation, Y.C.; formal analysis, Y.C.; investigation, Y.C.; resources, Y.C. and C.L. (Chuanying Liang); data curation, Y.C. and C.L. (Chuanying Liang); writing—original draft preparation, Y.C.; writing—review and editing, Y.C. and C.L. (Chenggao Luo); visualization, Y.C.; supervision, Y.C. and C.L. (Chenggao Luo); project administration, C.L. (Chenggao Luo) and H.W.; funding acquisition, C.L. (Chenggao Luo), Q.Y. and H.W. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (grant number 61971427, grant number 62035014, grant number 61921001, grant number 62201591, and grant number 62322122) and the National Key R&D Program of China (grant number 2018YFB2202500, and grant number 2022YFB3902400).

Data Availability Statement

Data underlying the results presented in this paper are not publicly available at this time, but may be obtained from the authors upon reasonable request. The data are not publicly available due to privacy restrictions.

Acknowledgments

We would like to thank the reviewers for their valuable comments.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Huang, Y.; Wen, C.; Chen, Z.; Chen, J.; Liu, Y.; Li, J.; Hong, W. HRWS SAR Narrowband Interference Mitigation Using Low-Rank Recovery and Image-Domain Sparse Regularization. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5217914. [Google Scholar] [CrossRef]
  2. Kim, K.H.; Kim, H.; Kim, D.Y.; Kim, S.K.; Chun, S.H.; Park, S.J.; Jang, S.M.; Chong, M.K.; Jin, H.S. Development of planar active phased array antenna for detecting and tracking radar. In Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA, 23–27 April 2018; pp. 0100–0103. [Google Scholar]
  3. Cui, T.; Qi, M.; Wan, X.; Zhao, J.; Cheng, Q. Coding metamaterials, digital metamaterials and programmable metamaterials. Light Sci. Appl. 2014, 3, e218. [Google Scholar] [CrossRef]
  4. Lan, F.; Wang, L.; Zeng, H.; Liang, S.; Song, T.; Liu, W.; Mazumder, P.; Yang, Z.; Zhang, Y.; Mittleman, D.M. Real-time programmable metasurface for terahertz multifunctional wave front engineering. Light Sci. Appl. 2023, 12, e191. [Google Scholar] [CrossRef] [PubMed]
  5. Tropp, J.A.; Gilbert, A.C. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans. Inf. Theory 2007, 53, 4655–4666. [Google Scholar] [CrossRef]
  6. Wang, D.; Yan, Y.; Liu, Y.; Ding, J. Model recovery for Hammerstein systems using the hierarchical orthogonal matching pursuit method. J. Comput. Appl. Math. 2019, 345, 135–145. [Google Scholar] [CrossRef]
  7. Cheng, L.; Yin, F.; Theodoridis, S.; Chatzis, S.; Chang, T.-H. Rethinking Bayesian Learning for Data Analysis: The art of prior and inference in sparsity-aware modeling. IEEE Signal Process. Mag. 2022, 39, 18–52. [Google Scholar] [CrossRef]
  8. Wipf, D.P.; Rao, B.D. Sparse Bayesian Learning for Basis Selection. IEEE Trans. Signal Process. 2004, 52, 2153–2164. [Google Scholar] [CrossRef]
  9. Tikhonov, A. Solution of incorrectly formulated problems and the regularization method. Soviet Math 1963, 4, 1035–1038. [Google Scholar]
  10. Lefkimmiatis, S. Non-local color image denoising with convolutional neural networks. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 5882–5891. [Google Scholar]
  11. Ledig, C.; Theis, L.; Huszar, F.; Caballero, J.; Cunningham, A.; Acosta, A.; Aitken, A.; Tejani, A.; Totz, J.; Wang, Z.; et al. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 105–114. [Google Scholar]
  12. Tai, Y.; Yang, J.; Liu, X. Image super-resolution via deep recursive residual network. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017; pp. 2790–2798. [Google Scholar]
  13. Gan, F.; Luo, C.; Wang, H.; Deng, B. Robust Compressive Terahertz Coded Aperture Imaging Using Deep Priors. IEEE Geosci. Remote Sens. Lett. 2022, 19, 3511205. [Google Scholar] [CrossRef]
  14. Gao, J.; Deng, B.; Qin, Y.; Wang, H.; Li, X. Enhanced Radar Imaging Using a Complex-Valued Convolutional Neural Network. IEEE Geosci. Remote Sens. Lett. 2019, 16, 35–39. [Google Scholar] [CrossRef]
  15. Zhao, D.; Guo, G.; Ni, Z.K.; Pan, J.; Yan, K.; Fang, G. WAEGAN: A GANs-Based Data Augmentation Method for GPR Data. IEEE Geosci. Remote Sens. Lett. 2023, 20, 3509005. [Google Scholar] [CrossRef]
  16. Ishak, K.; Appenrodt, N.; Dickmann, J.; Waldschmidt, C. Human Motion Training Data Generation for Radar Based Deep Learning Applications. In Proceedings of the 2018 IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM), Munich, Germany, 15–17 April 2018; pp. 1–4. [Google Scholar]
  17. Ulyanov, D.; Vedaldi, A.; Lempitsky, V. Deep image prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–23 June 2018; pp. 9446–9454. [Google Scholar]
  18. Qiao, M.; Yuan, X. Coded aperture compressive temporal imaging using complementary codes and untrained neural networks for high-quality reconstruction. Opt. Lett. 2023, 48, 109–112. [Google Scholar] [CrossRef]
  19. Wang, W.; Wen, F.; Yan, Z.; Liu, P. Optimal transport for unsupervised denoising learning. IEEE Trans. Pattern Anal. Mach. Intell. 2023, 45, 2104–2118. [Google Scholar] [CrossRef]
  20. Wang, F.; Wang, C.; Chen, M.; Gong, W.; Zhang, Y.; Han, S.; Situ, G. Far-field super-resolution ghost imaging with a deep neural network constraint. Light Sci. Appl. 2022, 11, 1. [Google Scholar] [CrossRef]
  21. Lin, H.; Zhuang, Y.; Huang, Y.; Ding, X. Self-Supervised SAR Despeckling Powered by Implicit Deep Denoiser Prior. IEEE Geosci. Remote Sens. Lett. 2022, 19, 5504205. [Google Scholar] [CrossRef]
  22. Cannas, E.D.; Mandelli, S.; Bestagini, P.; Tubaro, S.; Delp, E.J. Deep Image Prior Amplitude SAR Image Anonymization. Remote Sens. 2023, 15, 3750. [Google Scholar] [CrossRef]
  23. Kingma, D.P.; Ba, J.L. ADAM: A method for stochastic optimization. arXiv 2015, arXiv:1412.6980. [Google Scholar]
  24. Chen, S.; Luo, C.; Deng, B.; Qin, Y.; Wang, H. Study on coding strategies for radar coded-aperture imaging in terahertz band. J. Electron. Imaging 2017, 26, 053022. [Google Scholar] [CrossRef]
  25. Needell, D.; Tropp, J.A. CoSaMP: Iterative signal recovery from incomplete and inaccurate samples. Appl. Comput. Harmon. Anal. 2009, 26, 301–321. [Google Scholar] [CrossRef]
  26. Wang, F.; Wang, H.; Wang, H.; Li, G.; Situ, G. Learning from simulation: An end-to-end deep-learning approach for computational ghost imaging. Opt. Express 2019, 27, 25560–25572. [Google Scholar] [CrossRef]
  27. Falk, T.; Mai, D.; Bensch, R.; Çiçek, Ö.; Abdulkadir, A.; Marrakchi, Y.; Böhm, A.; Deubner, J.; Jäckel, Z.; Seiwald, K.; et al. U-Net: Deep learning for cell counting, detection, and morphometry. Nat. Methods 2019, 16, 67–70. [Google Scholar] [CrossRef] [PubMed]
  28. Li, C.; Yin, W.; Jiang, H.; Zhang, Y. An efficient augmented Lagrangian method with applications to total variation minimization. Comput. Optim. Appl. 2013, 56, 507–530. [Google Scholar] [CrossRef]
  29. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [PubMed]
  30. Gan, F.; Liang, C.; Luo, C.; Wang, H. A Method Based on Equivalent Measurement of Radiation Fields for Coded-Aperture Imaging with System Errors. IEEE Geosci. Remote Sens. Lett. 2023. accepted. [Google Scholar] [CrossRef]
  31. Hoyer, P.O. Nonnegative matrix factorization with sparseness constraints. J. Mach. Learn. Res. 2004, 5, 1457–1469. [Google Scholar]
Figure 1. The structure of the MCAI system.
Figure 1. The structure of the MCAI system.
Remotesensing 16 00795 g001
Figure 2. The modified U-Net architecture.
Figure 2. The modified U-Net architecture.
Remotesensing 16 00795 g002
Figure 3. Image reconstruction using DMCAI.
Figure 3. Image reconstruction using DMCAI.
Remotesensing 16 00795 g003
Figure 4. Correlation of the real part and imaginary part of radar echo.
Figure 4. Correlation of the real part and imaginary part of radar echo.
Remotesensing 16 00795 g004
Figure 5. Reconstruction results for targets with SNR = 20 dB and N = 0.5 M.
Figure 5. Reconstruction results for targets with SNR = 20 dB and N = 0.5 M.
Remotesensing 16 00795 g005
Figure 6. Reconstruction results for targets during iteration with SNR = 20 dB and N = 0.5 M.
Figure 6. Reconstruction results for targets during iteration with SNR = 20 dB and N = 0.5 M.
Remotesensing 16 00795 g006
Figure 7. Results of MCAI when measurements N = 0.5 M, (a) comparison of reconstruction results of TVAL3 and MCAI, (b) MSE under different SNRs, (c) SSIM under different SNRs.
Figure 7. Results of MCAI when measurements N = 0.5 M, (a) comparison of reconstruction results of TVAL3 and MCAI, (b) MSE under different SNRs, (c) SSIM under different SNRs.
Remotesensing 16 00795 g007
Figure 8. Results of MCAI when SNR = 20 dB, (a) comparison of reconstruction results of TVAL3 and MCAI, (b) MSE under different measurements, (c) SSIM under different measurements.
Figure 8. Results of MCAI when SNR = 20 dB, (a) comparison of reconstruction results of TVAL3 and MCAI, (b) MSE under different measurements, (c) SSIM under different measurements.
Remotesensing 16 00795 g008
Figure 9. Experimental setup.
Figure 9. Experimental setup.
Remotesensing 16 00795 g009
Figure 10. Image reconstruction with deep radar echo as a prior.
Figure 10. Image reconstruction with deep radar echo as a prior.
Remotesensing 16 00795 g010
Figure 11. Reconstruction results for targets in experiments.
Figure 11. Reconstruction results for targets in experiments.
Remotesensing 16 00795 g011
Figure 12. Reconstruction results for targets during iteration with SNR = 5 dB and N = 0.5 M.
Figure 12. Reconstruction results for targets during iteration with SNR = 5 dB and N = 0.5 M.
Remotesensing 16 00795 g012
Table 1. Parameters used in the MCAI simulation experiment.
Table 1. Parameters used in the MCAI simulation experiment.
ParametersValue
Center frequency f c 340 GHz
Bandwidth20 GHz
Size of metamaterial antenna array 0.128   m × 0.128   m
Size of imaging plane 0.448   m × 0.448   m
Imaging distance 2   m
Number of metamaterial coding unit 64 × 64
Number of grid cells in the imaging plane 64 × 64
Sample numbers2001
Table 2. Quantitative comparison with different data uses.
Table 2. Quantitative comparison with different data uses.
Data Use S r real S r imag S r S r & STAIR
MSE0.002990.002790.002070.00198
SSIM0.6950.7630.8810.877
Time (s)73.16771.667123.81770.764
Table 3. Parameters used in the experiment.
Table 3. Parameters used in the experiment.
Parameters Value
Center frequency f c 28 GHz
Bandwidth2 GHz
Size of metamaterial antenna array 0.176   m × 0.176   m
Size of imaging plane 0.6   m × 0.6   m
Imaging distance 2   m
Number of metamaterial coding unit 32 × 32
Number of grid cells in the imaging plane 6 × 6
Sample numbers401
Table 4. Results of our method for different values of λ TV with N = 0.5 M.
Table 4. Results of our method for different values of λ TV with N = 0.5 M.
λ TV 0 1 0 6 1 0 5 2 × 1 0 5 5 × 1 0 5 1 0 4
SNR = 20 dBMSE0.00370.00340.00290.00300.00320.0033
SSIM0.78320.79660.83610.85550.86840.8585
SNR = 5 dBMSE0.03260.03260.02460.01950.01230.0084
SSIM0.20710.20890.23640.25770.36570.6586
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Cheng, Y.; Luo, C.; Zhang, H.; Liang, C.; Wang, H.; Yang, Q. Untrained Metamaterial-Based Coded Aperture Imaging Optimization Model Based on Modified U-Net. Remote Sens. 2024, 16, 795. https://doi.org/10.3390/rs16050795

AMA Style

Cheng Y, Luo C, Zhang H, Liang C, Wang H, Yang Q. Untrained Metamaterial-Based Coded Aperture Imaging Optimization Model Based on Modified U-Net. Remote Sensing. 2024; 16(5):795. https://doi.org/10.3390/rs16050795

Chicago/Turabian Style

Cheng, Yunhan, Chenggao Luo, Heng Zhang, Chuanying Liang, Hongqiang Wang, and Qi Yang. 2024. "Untrained Metamaterial-Based Coded Aperture Imaging Optimization Model Based on Modified U-Net" Remote Sensing 16, no. 5: 795. https://doi.org/10.3390/rs16050795

APA Style

Cheng, Y., Luo, C., Zhang, H., Liang, C., Wang, H., & Yang, Q. (2024). Untrained Metamaterial-Based Coded Aperture Imaging Optimization Model Based on Modified U-Net. Remote Sensing, 16(5), 795. https://doi.org/10.3390/rs16050795

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop