Next Article in Journal
Long-Range Low-Power Multi-Hop Wireless Sensor Network for Monitoring the Vibration Response of Long-Span Bridges
Previous Article in Journal
General Mass Property Measurement Equipment for Large-Sized Aircraft
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation

1
Pritzker School of Molecular Engineering, University of Chicago, Chicago, IL 60637, USA
2
Materials Science Division, Argonne National Laboratory, Lemont, IL 60439, USA
3
Center for Nanoscale Materials, Argonne National Laboratory, Lemont, IL 60439, USA
4
The Consortium for Advanced Science and Engineering, University of Chicago, Chicago, IL 60637, USA
5
Department of Electrical and Computer Engineering, Northeastern University, Boston, MA 02115, USA
6
Department of Electrical Engineering, University of Notre Dame, Notre Dame, IN 46556, USA
7
Environmental Science Division, Argonne National Laboratory, Lemont, IL 60439, USA
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(10), 3913; https://doi.org/10.3390/s22103913
Submission received: 4 April 2022 / Revised: 10 May 2022 / Accepted: 19 May 2022 / Published: 21 May 2022
(This article belongs to the Topic Wireless Sensor Networks)

Abstract

:
Wireless Underground Sensor Networks (WUSNs) that collect geospatial in situ sensor data are a backbone of internet-of-things (IoT) applications for agriculture and terrestrial ecology. In this paper, we first show how WUSNs can operate reliably under field conditions year-round and at the same time be used for determining and mapping soil conditions from the buried sensor nodes. We demonstrate the design and deployment of a 23-node WUSN installed at an agricultural field site that covers an area with a 530 m radius. The WUSN has continuously operated since September 2019, enabling real-time monitoring of soil volumetric water content (VWC), soil temperature (ST), and soil electrical conductivity. Secondly, we present data collected over a nine-month period across three seasons. We evaluate the performance of a deep learning algorithm in predicting soil VWC using various combinations of the received signal strength (RSSI) from each buried wireless node, above-ground pathloss, the distance between wireless node and receive antenna (D), ST, air temperature (AT), relative humidity (RH), and precipitation as input parameters to the model. The AT, RH, and precipitation were obtained from a nearby weather station. We find that a model with RSSI, D, AT, ST, and RH as inputs was able to predict soil VWC with an R2 of 0.82 for test datasets, with a Root Mean Square Error of ±0.012 (m3/m3). Hence, a combination of deep learning and other easily available soil and climatic parameters can be a viable candidate for replacing expensive soil VWC sensors in WUSNs.

1. Introduction

Wireless Underground Sensor Networks (WUSNs) have been increasingly studied over the past two decades for terrestrial, agricultural, and ecological applications [1,2,3,4,5,6,7,8,9], including the demonstration of a fully buried, spatially distributed sensor node network that will not disrupt agricultural and/or industrial processes [10,11,12,13,14,15,16,17]. Such sensor networks have been explored as the backbone for geospatial internet-of-things (IoT) for agricultural applications [18]. Data gathered from such networks, combined with data curation and artificial intelligence-based analysis, is anticipated to be a significant component of future digital farming and ecological practices provided challenges in cost and scalability are met [18,19,20,21,22]. There are two important areas of WUSN applicability in agriculture and land ecology that require further examination. First, there is the need to test WUSN performance under field conditions over an extended period to examine robustness and scalability. The second area relates to the potential use of the electromagnetic wireless signal, currently only used for data transmission, to become an indicator of the soil environmental conditions, as the signal strength has been shown to be sensitive to variations in soil water content and other soil factors [10,11].
Soil volumetric water content (VWC) is a crucial parameter of interest for many applications in ecology, soil science, and agriculture [23,24]. Methods available for capturing the soil–hydrological system’s natural heterogeneity are unsatisfactory at the 1 to 1000 m2 scales. For instance, remote sensing measurements are limited to low spatial and temporal resolutions [25], while point measurement sensors sample small volumes, are relatively expensive (typically a few hundred US dollars each), and individually do not reflect the heterogeneity of the soil. Thus, there is a need for soil VWC sensor systems that can operate in this intermediate spatial scale at high temporal resolutions.
The primary goal of our work reported in this paper is to show that a WUSN-based IoT system with soil data sensing, curation, and mapping can be successfully and continuously operated in farms under “real-life” conditions. We demonstrate this by presenting results from a nine-months pilot experiment in which we have designed and operated a 23-sensor WUSN over a 130-acre site in an active soy/corn farm. An additional goal of our work has been to show that using a combination of RSSI data and machine learning makes it possible to map the soil VWC without the need for in-ground point moisture sensors, which can be cost prohibitive for large networks.

1.1. Related Work

In WUSNs, the communication hardware within the buried sensor nodes communicates with a base station through a combination of transmission through the soil and the atmosphere. Akyildiz and Stuntebeck have described the opportunities and challenges in WUSN technology [2]. Different types of topologies (e.g., underground-to-underground and underground-to-aboveground) have been modeled and tested experimentally [2,5,15,26,27], and the effect of soil properties on wireless underground signal propagation is well-studied [5,28,29,30,31,32]. Studies have included examining power consumption [30,33,34,35], as well as the deployment of communication protocols such as Mica [14], Zigbee [36], Wi-Fi [37,38], RFID [39], cellular [37], Sigfox [10], and Lora [12,35] for WUSNs. While experimental WUSN evaluations have been carried out in laboratory testbeds [9,22,40,41,42] and in some outdoor environments [10,12,43,44,45,46] and agricultural farms [14,19,32,43,47,48,49,50], testing has been limited, often with one or a few sensor nodes. There are no studies of WUSNs deployed deep in the vadose zone and tested under “real-life” conditions, long time periods, including multiple seasons, and over large areas of active agricultural management.
Soil moisture is an important input for flood and drought forecasting, in soil ecological studies, and in precision agriculture for effective nutrient management [51,52,53,54,55,56,57]. For this purpose—as noted earlier—it is important to be able to measure soil moisture at high resolutions (1–1000 m2), and efficient techniques for this are lacking.
Different machine learning-based models have been developed with varying degrees of success for soil moisture estimation using a variety of environmental inputs (such as air and soil temperature, relative humidity, etc.), with some requiring initial soil moisture measurements as inputs [25,58,59,60,61,62,63,64,65,66]. In addition, it has been pointed out that the Relative Signal Strength Indicator (RSSI) parameter, which quantifies signal attenuation through soil, is an easily measurable variable for any WUSN and can be a powerful input for soil moisture measurement. Microwave propagation through soil is strongly affected by the soil’s dielectric properties [67], which in turn is affected by the soil texture, and the amount of organic matter and water present in the soil. This latter effect can be strong, since water and soil have significantly different dielectric constants of ~80 and 3–5, respectively. Small changes in soil moisture can therefore affect the propagation of the WUSN signal [68] and can be detected via changes in RSSI.
Several researchers have studied the relationship between attenuation of the electromagnetic signal and soil moisture [10,11,36,38,69]. Soil moisture determination via RSSI changes would enable high resolution measurements without relying upon expensive soil sensors. Aroca et al. [70] used a buried passive RFID network and calibrated a neural network model for soil moisture prediction using RSSI as an input. However, due to a limited transmission range, the technique needs proximal signal reception via a mobile robot and can therefore be limited in scalability and resolution. Rodic et al. [33] installed a low-power, LoRa-based, underground sensor node and two above-ground gateways, and optimized deep learning techniques to predict soil moisture from the RSSI at one buried location. All these experiments were carried out under limited and controlled conditions or did not explore the mapping of moisture using RSSI across large areas enabled by multiple-sensor WUSNs. Since signal attenuation can also depend upon the field’s topology, seasonal conditions, various other field conditions (such as crop coverage), and the system’s physical parameters [1,10,17]), the relationship between RSSI and VWC requires field validation under realistic operating conditions—such work has been lacking so far.

1.2. Contribution of This Work

In the present study we offer two contributions pursuant to our research goals noted in the introduction section. Firstly, we demonstrate the design and deployment of a WUSN and then examine the results of 9 months of continuous operation of a fully buried, non-intrusive WUSN at an agricultural field located at Fermi National Laboratory (Fermilab, Batavia, IL, USA). Through this demonstration, we show that a WUSN can operate under all-season, realistic field conditions. The wireless network is based on the increasingly used unlicensed ISM band, deployed around 900 MHz (in the USA) and made popular through low-power IoT wireless networks such as LoRa and Sigfox. The WUSN collects and maps soil VWC, electrical conductivity (EC), and soil temperature (ST) simultaneously, and the data can be visualized in near real-time through a web-based user interface. We discuss the performance of the WUSN through seasonal weather variations (fall, winter, and spring) and the impacts of climate, soil, and site characteristics affecting the sensor module transmissions.
Secondly, we ask the question: Can attenuation of the wireless signal in-ground be used as a robust predictor of soil VWC under real-life conditions in a field and over changing seasonal climatic conditions? In doing so, we examine whether the RSSI, which is used to transmit the sensor measurements to the base antenna, could also be used to predict and spatially map soil VWC under long-term field testing. We found that, while RSSI alone was not able to predict soil VWC accurately over time, the addition of site-specific physical, soil, and climatic factors as input parameters along with the use of available, off-the-self machine learning algorithms significantly improves predictive performance for VWC. We evaluate three well-known machine learning techniques: support vector regression (SVR) [59,60], extreme learning machine (ELM) [61], and artificial neural network–multilayer perceptron (ANN–MLP) [59,66]. Among the tested models, ANN–MLP greatly increased the predictive capability for VWC. We propose this machine learning-based approach as an alternative method for estimating soil VWC with WUSNs, thereby obviating the need for expensive point sensors for VWC measurement (which can limit geographical scalability). We note that the scope of the paper is limited to exploring the efficacy of readily available machine learning algorithms in extracting soil moisture from our sensor network data, and not to carry out detailed research on the algorithms themselves.
The rest of the paper is organized as follows. Section 2 explains the sensor node development, WUSN architecture, and the experimental setup used in the work. Section 3 shows the preliminary results from the WUSN, wireless transmission, and effects of soil moisture and elevation and describes the performance results of soil moisture prediction using different machine learning techniques. The paper’s conclusion is in Section 4.

2. Materials and Methods

2.1. Sensor Node Development

Thoreau 2.0 is a modified version of an earlier system developed and operated at the University of Chicago campus described in Zhang et al. (2017) [11]. The wireless backbone of the Thoreau 2.0 system is a Sigfox 901.2 MHz low-power IoT wireless network, and the architecture contains three components: (1) the buried sensor nodes, (2) a base station, and (3) a user interface (Figure 1).
Each sensor node consists of a sealed carbonate casing (16 cm × 8 cm × 8.5 cm) that contains the electronics, power source, and a transmitting antenna (Figure 1 inset shows the electronic components and antenna, while the power rack is housed beneath the electronics and cannot be seen in the picture). Each node is connected to an external sensor that simultaneously measures soil VWC, ST, and EC (TEROS12, Meter Environment, Pullman, Washington, DC, USA) in the vicinity of the box. The mechanical design of the sensor node box is critical. Building upon our experience from the first-generation WUSN (Thoreau 1.0, [11]), a hermetically sealed box was designed (Windy City Lab, Chicago, IL, USA) that could withstand extreme water and temperature fluctuations. We used O-rings around the lid to prevent leaks and silicone sealant to waterproof the encasing. A watertight, nylon cable gland was used for cable connection to the external sensor. Additionally, a conformal coating was applied to all electronics inside the box. A humidity sensor inside the box transmits the sensor node internal humidity status of the box. The nodes have been running for more than 29 months (6 September 2019, to the time of paper submission) and have withstood high heat and cold conditions in the field.
The sensor node electronics consist of a micro controller unit (MCU) (Xenon, MCU V001) that manages the sensor node core functions, such as data acquisition, radio frequency (RF) transmission, and power use; and an RF transceiver (Sigfox Thinxtra board) that is integrated with an RF trace antenna and a power amplifier (transmission power ~22 dBm). Each sensor node is powered by a battery rack containing 4 AA lithium batteries. Power usage analysis indicates that each sensor node can be active for up to 4.5 years with one set of batteries.
In the sensor nodes, as a way to conserve power, a watchdog timer awakens the MCU from sleep mode every 30 min. The MCU subsequently wakes up the sensor, collects a measurement, and encodes the data prior to transmitting to the base station through the RF transceiver. The RF transceiver initiates a transmission by sending three uplink packages in sequence on three random carrier frequencies to the base station. However, in order to conserve power, and based upon our experience with Thoreau 1.0, we modified the firmware to produce only two uplink packet transmissions for this project. A single, base station (Sigfox Macro, SBS-T-902v3) is installed in the center of the field, with an antenna mounted at a height of 10 m from the ground. The base station receives transmissions from nodes located anywhere in an approximately 530 m radius from the antenna. The base station is powered via a photovoltaic array with battery backup. The location of the base station antenna and the sensors are shown in Figure 2. The Sigfox IoT Network receives the signal from the base station. RSSI is then calculated by SigFox based on the average radio signal intensity of the packets correctly received per transmission. The RSSI varies over time as soil parameters change, and it is these natural variations that our machine learning algorithms identify during training to determine soil moisture from RSSI values.
The base station antenna receives the data packets from the sensor nodes and transmits them (via the internet) to a cloud-based backend operated by Sigfox. The data is then accessed (using a callback API, curated, and visualized on Thoreau (Thoreau-Home (uchicago.edu)) in near real-time. Thoreau is a cloud-based, open web interface [71] where all data is easily accessible and available for download by the public.

2.2. Experimental Setup

Thoreau 2.0 WUSN was installed in an agricultural field located at Fermilab. The field is cultivated utilizing corn–soybean crop rotation management, and the soil is tilled to a ~25 cm depth every other year after the corn is harvested. Twenty-three sensor nodes were deployed within a ~530 m radius area from the base station and were buried ~40 cm deep. The sensors deployed with each node were also buried at a ~40 cm depth, coplanar with the tops of the sensor node boxes. This depth was chosen to avoid interference with farming activities and to avoid sensor displacement and damage due to plowing (plowing depth is typically ~25 cm). Being a noninvasive system is an important consideration and requirement for many buried agricultural network applications. Soil motion can also occur due to “frost heave”, which occurs when ice lenses form in the soil, usually in cold environments with fine-textured soils. As the ice lenses grow, the soil can move upward due to pressure. In our study, the majority of the soils were of the Markham series. The sensors were buried 40 cm deep in the “B horizon”, which is classified as silty clay loam soil with 35–45% clay content and moderately textured. The amount of clay in our soils leads to lower hydraulic conductivity and small void volume. The resultant drop in capillary flow with clay content tends to reduce the severity of frost heave because it impedes ice lens formation [72]. Because of the moderate clay content in our soils, as well as the moderate texture, we do not expect significant frost heave over the time period of our experiments (~9 months). In addition, the antennas contained within the rugged sensor boxes are omnidirectional dipole antennas, and small motions in the soil cannot alter the RSSI readings significantly.
As mentioned in the previous section, each sensor node is integrated with sensors that simultaneously measure soil VWC, ST, and EC. Additionally, weather parameters, including air temperature (AT), relative humidity (RH), and precipitation (P) were obtained from a weather station located at Fermilab near the field site that collected measurements every 5 min (https://wwwesh.fnal.gov/pls/default/weather.html (accessed on 25 June 2020)) (Figure 2). We determined the soil type adjacent to each of the sensor nodes by using the Natural Resources Conservation Services Online Soil Survey (https://www.nrcs.usda.gov/wps/portal/nrcs/main/soils/survey/ (accessed on 15 December 2019)) to map the soil types within the field area. We superimposed this map and the sensors’ geographical coordinates onto a Google Earth (https://www.google.com/earth/ (accessed on 10 January 2020)) image of the field site area (Figure 2). Sensor nodes were adjacent to five soil types, Elliott (146A), Drummer (152A), Peotone (330A), Mundelein (442A), and Markham (531B) (Figure 2).

3. Results

3.1. Temporal Variation of Soil Properties

Measurements were collected over 289 days from 6 September 2019 through 20 June 2020. During this time, the WUSN operated continuously and produced 112,000 measurements after data curation and QA/QC. Descriptive statistics for soil VWC, EC, and ST, and weather variables AT, RH, and P averaged for the three seasons comprising the study time are shown in Table 1. Figure 3 shows daily means for these variables and precipitation events.
The overall high average soil EC values of the field site indicate good soil fertility. The site is composed of silt loam and silty clay loam soils that are prime farmland soils. Nevertheless, the soils have a tendency of being too wet, potentially creating nutrient build up, as indicated by high maximum soil EC and VWC, particularly in the spring, as shown in Table 1. As expected, soil VWC increases after each precipitation event (Figure 3a). A positive correlation of soil VWC with EC was observed throughout the study time (R = 0.47; Pearson correlation analysis, MATLAB R2020b). Analyzing the data by season, the correlation coefficients of soil VWC with EC are 0.54, 0.45, and 0.29 in fall, spring, and winter, respectively (Pearson correlation analysis, MATLAB R2020b). This correlation is not surprising, as it is known that the more water there is in the soil the more cations are in solution and the soils’ capacity to conduct electricity increases, resulting in higher EC values. Weather variations in RH, ST, and AT occurred throughout the study time, with cold winter and warmer spring temperatures, and frequent fluctuations in air temperature and relative humidity typical of continental climates (Figure 3c,d).

3.2. System Performance

Electromagnetic wave transmissions can be attenuated by several factors, including distance between a sensor node and the base station [2,10]. Figure 4a,b show the percentage of data packets received by the base station from the sensors during the 9 months of the study. Results indicate that there is a substantial loss of data packets from the sensor nodes that are farthest away from the base station (Figure 4a). In addition, we found that the amount of data received is not equal across sensors installed the same distance from the base antenna. Analysis of the data packets received from each sensor superimposed onto a topographic map (Figure 4b,c) suggests that the percentage of data packets received is a function of sensor node distance to the base station, terrain elevation, and the localized concentration of soil moisture. For instance, sensors B3S20, B2S8, B2S11, B2S12, B2S13, and B2S21; and B3S19, B3S17, and B2S6 are installed approximately equidistant to the base station, but they differ in the number of data packets received by the base station. Sensor B2S8 (green pins in Figure 4b) is in a floodplain, leading to fewer data packets received compared to the nearest sensors B2S11 and B3S20, while sensors B2S7, B2S12, and B2S13 (red pins in Figure 4b) only differ in their topographic position and elevation yet have different data packet percentages (Figure 4b).

3.3. Spatial Variation of Volumetric Water Content Before, During, and after a Precipitation Event

Soil chemistry attributes vary from site to site due to the soil’s heterogenic nature, and are influenced by the water-holding capacity of soils and water availability. For instance, some soils dry faster than others because of their high porosity. Soils in northern Illinois are generally high in silt and clay, somewhat poorly drained, and have high soil water holding capacity because of high organic matter content. Humid climate conditions prevail in this area, which receives an average of 900 mm of rainfall per year, plus a variable amount of snowmelt in winter and spring. For farmers in this area, one of the most important needs is to know when the soil conditions are adequate for planting, since spring planting in overly wet conditions can result in surface compaction, leading to, in turn, poor plant emergence and root development (and reduced yield). WUSNs have the capability to determine the spatial distribution of soil moisture at any given time. For example, heatmaps on Figure 5 show the spatial distribution of soil VWC daily mean before and after a rainfall event. The heatmaps were generated by linearly interpolating between measured datapoints, as in Harris et al. (2020) [73], and overlaying the results over a base map obtained from the OpenStreet map API from MapBox [74]. Rain began on 9 March 2020, resulting in a 24.6 mm precipitation event. Although before it rained the soil VWC was already high, this event elevated soil VWC content from 0.36 to 0.41 m3/m3 ± 0.03 sensor accuracy for the next 3–4 days, after which soil VWC levels dropped back to 0.37 m3/m3 ± in situ sensor accuracy. Interpolation of measurements and mapping of soil conditions and attributes in almost near real-time is important and can inform agricultural management decisions, one of the many new applications for WUSN technologies.

3.4. Estimation of VWC from Received Signal Strength Indicator (RSSI)

The RSSI value received by the base station is generally lower than the original sensor node transmission. This signal attenuation is the result of the electromagnetic wave traveling through the soil medium and the free-space path in the air and intervening vegetation. Variations in soil moisture also affect RSSI values because the presence of moisture alters the soil’s dielectric response to the propagation of the signal [10]. Figure 6 denotes RSSI values typically received by the base station, plotted against the soil VWC and the amount of precipitation at that time. As Figure 6 indicates, soil VWC rises following precipitation, sometimes reaching the upper detection limit of the sensor, and then decreases within a few hours to days due to soil water drainage and evaporation (when the soil is bare) or evapotranspiration (when plants are present). Correlation of soil VWC with RSSI is not present in winter, but it appears over the course of spring and early fall (Figure 6).
A correlation analysis using all data indicates a weak significant negative correlation (R = −0.25, p-value = <0.005) of soil VWC with RSSI. This analysis was conducted with a total of 92,000 datapoints, obtained after removal of soil VWC values that were above the maximum detection limit of the sensors, 0.45 m3/m3 (removal of 4000 datapoints), and of incomplete datasets due to temporary malfunction of the weather station that led to the removal of another 12,000 datapoints from our dataset. Because electromagnetic signal propagation is also impacted by other factors, such as terrain elevation and distance of the sensor node to the base station, as shown in Figure 4, and other factors identified in the literature, including climatic and weather factors [75,76], we investigated whether a nonlinear approach using standard machine learning algorithms could improve the prediction of soil VWC by taking into consideration RSSI and the various factors that might affect signal transmission from the sensors.
As noted earlier, we used an Artificial Neural Network with Multilayer Perceptron (ANN–MLP) algorithm (details in [58,77,78,79,80]) for constructing soil VWC predictive models. MATLAB R2020b was used for the neural network development, training, and simulations [81]. The total dataset was randomly classified into 70% for training (64,000 datapoints), 15% for validation (13,500 datapoints), and 15% for testing (13,500 datapoints). Soil VWC in situ measurements (collected by the external soil sensor) were used as ground truth data and target parameters for the model. Available input parameters that could be used to train the model included WUSN site parameters (RSSI and hypotenuse distance (D) between the buried sensor node and base station antenna) and soil (ST) and weather parameters (P, AT, and RH). Weather parameters were averaged at 30 min intervals to harmonize all data to that time interval for the model.
WUSN/site parameters are those that can be obtained directly from the deployment of the WUSN in the field. Because the signal transmitted from a buried node first travels through the soil, the power (PT (in dB)) at the soil surface depends on the moisture content in the soil. After traveling through the air with a free space pathloss proportional to 20 × log(D), where D is the hypotenuse distance of the buried sensor to the antenna, the signal is received at the base station antenna with a certain RSSI. Hence, one can approximate PT as being proportional to the sum of 20 × log(D) and RSSI. The distance (D) appears as a separate parameter in addition to the 20 × log(D) factor in the estimate of PT in order to capture propagation effects, such as multipath, which are not accounted for in the free space pathloss. These site parameters along with the measured weather and soil variables were used as input parameters for evaluating the machine learning algorithm.
Trial and error was used to select the optimum number of hidden layers and number of neurons. Table A1 in Appendix A shows the performance matrix of different combinations of hidden layers and number of neurons. Ultimately, a five-layer feed-forward neural network including three hidden layers, one input layer, and one output layer, with each hidden layer containing 55 neurons, was selected based upon performance in VWC predictions. The Levenberg–Marquardt algorithm was used for network training. To avoid overtraining, we used an early stopping training method. Model performance was assessed by comparing the coefficient of determination (R2), root mean square error (RMSE), and mean absolute error (MAE) of the estimated value of soil VWC to in situ, ground-truth measurements. All input and target parameters were normalized to a range between 0.2 to 0.8, as suggested by Cigizoglu (2003) [82]. Table 2 shows the performance of this model in training, validation, and testing with various combinations of input parameters. The six-input parameter model, containing all site and climate input parameters, predicted soil VWC with very good accuracy and low RMSE and MAE.
In contrast, running the model with only site input parameters, i.e., using only RSSI + 20 × log(D) and D as input parameters, substantially reduced the performance of the model, rendering unacceptable predictions (Table 2, two-parameter model). We determined that ST is an important variable in determining the model’s predictive ability, i.e., any model was substantially improved when ST was included as an input parameter (Table 2, three-, four-, and five-parameter models). Similarly, but to a lesser extent, the performance of the model could be further improved with the addition of AT and RH as input parameters (in addition to RSSI + 20 × log(D), D, and ST as inputs) leading to four- and five-parameter models (see Table 2). For example, Figure 7 shows measured and predicted soil VWC when using the ANN–MLP model with RSSI + 20 × log(D), D, ST, AT, and RH as input parameters. Including P in the model did not affect model performance (Table 2). Since P is infrequent, there were fewer inputs into the algorithm, which might have reduced its influence on model performance. Nevertheless, it is possible that the effect of P might already have been accounted for, indirectly, by RSSI and RH variations.
While RSSI is expected to and has been previously shown to be affected by soil VWC due to changes in the soil’s dielectric properties under limited testing conditions [10,36,38,69], our results summarized in Table 2 (and the seasonal examples highlighted in Figure 6) clearly show that RSSI alone is a poor consistent predictor of soil VWC, and we propose the use of this algorithm as an alternative method for estimating soil VWC with WUSNs. Indeed, dropping RH as an input parameter and using a four-parameter model also leads to good prediction of soil VWC (R2 = 0.82). The approach described above, while obviating the need for an expensive VWC sensor at every node, does require other soil and weather data. However, many algorithms developed to predict ST from AT can render this approach feasible [83,84,85,86].
We compared the performance of the six-parameter ANN–MLP model with two other commonly used machine learning algorithms: Support Vector Regression (SVR) [87,88,89] and Extreme Learning Machines (ELMs) [90,91]. We used these algorithms to predict soil moisture in the same way as for our ANN–MLP model, and the implementation details of the two models are described in Appendix B. The performance statistics of the two models are presented in Table 3, showing the best results across a collection of SVR kernel functions and ELM activation functions. Grid searches for these two models yielded poorer results than the ANN–MLP model. The best SVR model was found with a radial basis function (RBF) kernel which resulted in R2 = 0.56 and RMSE = 0.053 m3/m3 for the testing stage; the best ELM model was found with a sigmoid activation function, which resulted in R2 = 0.48 and RMSE = 0.06 m3/m3 for the testing stage. The reason for these models’ poor performance in comparison to the ANN–MLP model is unclear and beyond the scope of the current paper. We can conclude, however, that our deep learning approach surpasses the other surveyed methods even without a thorough grid search, and that the ANN–MLP model proves a useful tool in predicting geospatial VWC.
We now make a few comments regarding our analysis. Firstly, note that we did not include the polarization and antenna gain for the sensor node transmitters as input parameters. Polarization and antenna gains cannot be controlled precisely, especially in a real-world field deployment such as described in this paper. With ML, if measurements from each sensor are adequately represented in the training set, these, as well as other hidden factors, such as differences in terrain, will be learned by the model during the training phase. In the experiment, 92,000 datapoints were collected from 23 sensor nodes over 9 months, ensuring that measurements from each sensor node were well-represented in the training data. Furthermore, in estimating soil moisture, the ML model utilizes the relative difference in RSSI between wet soil and dry soil from each sensor, and hence, the absolute effect of polarization, antenna gain, and terrain do not need to be modeled accurately since these do not change with the level of moisture in the soil. Secondly, as noted in Section 3.2, some sites can have lower number of successful transmissions due to factors such as distance, topography, etc. To examine this effect, we tested the model with data from the sites that had >50% and <50% data packet transmission rates, and the difference in performance statistics during testing was not significant. However, this is a parameter that will likely need to be examined and tested in other site installations.

4. Conclusions

In this paper, we present the successful design and deployment of Thoreau 2.0, a scalable, low-power WUSN for subterranean sensing. The WUSN has been operating continuously in an agricultural field since September 2019, and we present data collected over 9 months (three seasons). High temporal and spatial resolutions were accomplished by measuring soil conditions at 30 min intervals and interpolating and mapping the sensor results over an approximated 530 m radius area. We showcase the ability of our WUSN to monitor and map real-time variations in soil VWC, ST, and EC. Our results show that such WUSNs can be reliably operated under “real-world” conditions and are scalable. Using the RSSI signal from the WUSN along with other inputs as proxies, we developed a deep learning model that can accurately predict and map an important parameter for soil ecology and agriculture: volumetric water content (or soil moisture). This enables soil moisture determination without the need for expensive sensors for direct VWC measurement.

Author Contributions

Conceptualization, R.M., S.G. and S.B.; methodology, S.G., M.G., X.Z. and S.B.; machine learning, S.B. and G.G.; validation, G.G.; formal analysis, S.B.; data curation, S.B. and G.G.; writing—original draft preparation, S.B.; writing—review and editing, S.G., R.M. and M.G.; visualization, S.B.; supervision, S.G. and R.M.; project administration, R.M.; funding acquisition, R.M., X.Z. and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by U.S. National Science Foundation (NSF) under grant numbers #1841650 and #2034418; and by the Agriculture and Food Research Initiative (AFRI) grant no.2020-67021-32799 from the USDA National Institute of Food and Agriculture.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Soil data were obtained from the open-access Thoreau soil database of Femi agricultural field and are available from Thoreau-Home (uchicago.edu) (accessed on 25 June 2020); the weather parameters obtained from the weather station installed at Femi agricultural field are available at https://www-esh.fnal.gov/pls/default/weather.html (accessed on 25 June 2020).

Acknowledgments

The authors thank the Windy City Lab for manufacturing the sensor nodes, Fermi National Laboratory for providing access to the field site and weather information, U. Rai for helping with heatmap coding, and T. Vugteveen, S. Hofmann, and D. Cook from Argonne National Laboratory for providing technical assistance in the field.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1 shows the performance statistics of different neural network architectures tested for volumetric water content (VWC) predictions.
Table A1. Performance statistics of different neural network architectures tested for volumetric water content (VWC) predictions.
Table A1. Performance statistics of different neural network architectures tested for volumetric water content (VWC) predictions.
S.NoModel ArchitectureTrainingTestingValidation
RR2RMSE
(m3/m3)
MAE
(m3/m3)
RR2RMSE
(m3/m3)
MAERR2RMSE
(m3/m3)
MAE
(m3/m3)
16-5-10.6050.3670.0240.0170.6040.3650.0240.0170.5940.3530.0240.017
26-10-10.6690.4480.0220.0160.6800.4620.0220.0160.6640.4410.0220.016
36-15-10.6860.4710.0220.0150.6970.4850.0220.0150.6830.4670.0220.015
46-20-10.7330.5370.0200.0140.7200.5190.0200.0140.7220.5210.0210.015
56-25-10.7370.5430.0200.0140.7230.5220.0200.0140.7300.5320.0200.014
66-30-10.7390.5460.0200.0140.7380.5450.0200.0140.7460.5560.0200.014
76-35-10.7320.5350.0200.0140.7140.5100.0210.0140.7140.5080.0200.014
86-40-10.7560.5720.0190.0140.7580.5750.0190.0140.7580.5740.0200.014
96-45-10.7890.6220.0180.0130.7770.6030.0190.0130.7740.5990.0190.013
106-50-10.7920.6280.0180.0130.7810.6100.0190.0130.7840.6140.0180.013
116-55-10.7860.6180.0180.0130.7760.6030.0190.0130.7730.5980.0190.013
126-60-10.7940.6300.0180.0130.7850.6170.0190.0130.7810.6100.0190.013
136-65-10.7890.6230.0180.0130.7810.6100.0180.0130.7840.6140.0180.013
146-70-10.8020.6430.0180.0130.7870.6190.0180.0130.7690.5900.0190.013
216-5-5-10.6130.3760.0240.0170.6110.3740.0230.0160.6080.3700.0240.017
226-10-10-10.7660.5860.0190.0140.7520.5660.0190.0140.7710.5940.0190.013
236-15-15-10.8170.6680.0170.0120.8090.6540.0180.0120.8050.6480.0170.012
246-20-20-10.8410.7080.0160.0110.8250.6810.0170.0110.8350.6980.0170.011
256-25-25-10.8670.7510.0150.0100.8480.7180.0160.0110.8520.7260.0150.010
266-30-30-10.8750.7650.0140.0100.8590.7370.0150.0100.8700.7570.0150.010
276-35-35-10.8880.7880.0140.0090.8800.7750.0140.0100.8770.7680.0140.010
286-40-40-10.8570.7340.0150.0100.8430.7100.0160.0110.8370.6990.0160.011
296-45-45-10.9090.8270.0120.0080.8820.7780.0140.0090.8910.7940.0140.009
306-50-50-10.8870.7860.0140.0090.8610.7400.0150.0100.8630.7440.0150.010
316-55-55-10.8830.7800.0140.0090.8470.7140.0160.0100.8490.7180.0160.010
326-60-60-10.9040.8170.0130.0080.8710.7580.0150.0090.8720.7580.0150.009
336-65-65-10.9340.8720.0110.0070.8860.7790.0140.0080.8920.7940.0130.008
346-70-70-10.9160.8380.0120.0080.8720.7580.0150.0090.8750.7620.0140.009
356-5-5-5-10.7180.5160.0210.0150.7070.4990.0210.0150.7070.4990.0210.015
366-10-10-10-10.8280.6860.0170.0110.8170.6670.0170.0120.8220.6760.0170.012
376-15-15-15-10.8500.7230.0160.0110.8260.6820.0170.0110.8350.6970.0160.011
386-20-20-20-10.8830.7810.0140.0090.8670.7520.0150.0100.8670.7510.0150.010
396-25-25-25-10.8980.8060.0130.0090.8750.7650.0140.0090.8810.7760.0140.009
406-30-30-30-10.9100.8280.0120.0080.8830.7800.0140.0090.8910.7940.0140.009
416-35-35-35-10.9080.8250.0120.0080.8790.7700.0140.0090.8850.7820.0140.009
426-40-40-40-10.9170.8400.0120.0080.8900.7910.0140.0090.8830.7780.0140.009
436-45-45-45-10.9340.8720.0110.0070.8980.8050.0130.0080.8970.8030.0130.008
446-50-50-50-10.9180.8420.0120.0080.8830.7780.0140.0090.8960.8020.0130.009
456-55-55-55-10.9580.9170.010.0060.9040.8120.0130.0070.8990.8090.0120.007
466-60-60-6010.9260.8580.0110.0070.8840.7770.0140.0090.8930.7950.0140.008
476-65-65-65-10.9160.8390.0120.0080.8870.7860.0140.0090.8860.7840.0140.009
486-70-70-70-10.9150.8380.0120.0080.8820.7760.0140.0090.8820.7760.0140.009

Appendix B

We implemented our SVR models using the out-off-the-box SVR function in Python’s scikit-learn package [88,90]. The SVR function in Python’s scikit-learn package implements epsilon-supported SVR wherein no penalty is associated with training loss within a certain distance ε from the target data. A randomized grid search was used for hyperparameter tuning 89, using scikit-learn’s GridSearchCV function. The search is defined for the regularization parameter C = {0.001, 0.1, 1, 10, 100, 500, 1000, 2500}; the epsilon-support region size ε = {0.00001, 0.0001, 0.001, 0.005, 0.01, 0.1, 1}; and the kernel coefficient γ = {0.0001, 0.001, 0.01, 0.1, 1, 2, 10, 20}; γ was also allowed the values ‘auto’ and ‘scale’ according to scikit-learn’s implementation, which, respectively, use the inverse of the number of input features and the inverse of the number of input features times the variance of the input data. Table A2 shows the optimal C, ε, γ, and degree values for the respective kernel functions for VWC prediction.
For soil moisture prediction, the associated ELM neural network involved an input layer with six neurons (one per input parameter), one hidden layer, and one output layer with one neuron. MATLAB was used to develop an ELM model with a specified number of hidden neurons with a specified activation function (tested sigmoid, sine, tanh, triangular basis, hard limit, ReLu, and RBFs). The number of neurons between 5 and 1000 with an increment of five were tested in the hidden layer of the ELM models. Table A3 shows the optimal hidden neurons for different activation functions.

References

  1. Akyildiz, I.F.; Sun, Z.; Vuran, M.C. Signal propagation techniques for wireless underground communication networks. Phys. Commun. 2009, 2, 167–183. [Google Scholar] [CrossRef]
  2. Akyildiz, I.F.; Stuntebeck, E.P. Wireless underground sensor networks: Research challenges. Ad Hoc Netw. 2006, 4, 669–686. [Google Scholar] [CrossRef]
  3. Cardell-Oliver, R.; Kranz, M.; Smettem, K.; Mayer, K. A Reactive Soil Moisture Sensor Network: Design and Field Evaluation. Int. J. Distrib. Sens. Netw. 2005, 1, 149–162. [Google Scholar] [CrossRef]
  4. Dong, X.; Vuran, M.C. A Channel Model for Wireless Underground Sensor Networks Using Lateral Waves. In Proceedings of the 2011 IEEE Global Telecommunications Conference—GLOBECOM, Houston, TX, USA, 5–9 December 2011; pp. 1–6. [Google Scholar] [CrossRef] [Green Version]
  5. Dong, X.; Vuran, M.C. Impacts of Soil Moisture on Cognitive Radio Underground Networks. In Proceedings of the First International Black Sea Conference on Communications and Networking (BlackSeaCom), Batumi, Georgia, 3–5 July 2013; pp. 222–227. [Google Scholar] [CrossRef] [Green Version]
  6. Elleithy, A.; Liu, G.; Elrashidi, A. Underground Wireless Sensor Network Communication Using Electromagnetic Waves Resonates at 2.5 GHz. J. Wirel. Netw. Commun. 2013, 2, 158–167. [Google Scholar] [CrossRef]
  7. Salam, A.; Vuran, M.C.; Irmak, S. Pulses in the Sand: Impulse Response Analysis of Wireless Underground Channel. In Proceedings of the IEEE INFOCOM 2016—The 35th Annual IEEE International Conference on Computer Communications, San Francisco, CA, USA, 10–14 April 2016; pp. 1–9. [Google Scholar] [CrossRef] [Green Version]
  8. Li, L.; Vuran, M.C.; Akyildiz, I.F. Characteristics of Underground Channel for Wireless Underground Sensor Networks. In Proceedings of the Sixth Annual Mediterranean Ad Hoc Networking WorkShop, Corfu, Greece, 12–15 June 2007; pp. 92–99. Available online: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.221.5310&rep=rep1&type=pdf (accessed on 20 June 2020).
  9. Vuran, M.C.; Salam, A.; Wong, R.; Irmak, S. Internet of underground things: Sensing and communications on the field for precision agriculture. In Proceedings of the 2018 IEEE 4th World Forum Internet Things (WF-IoT), Singapore, 5–8 February 2018; pp. 586–591. [Google Scholar] [CrossRef] [Green Version]
  10. Zhang, X.; Andreyev, A.; Zumpf, C.; Negri, M.C.; Guha, S.; Ghosh, M. Thoreau: A Fully-Buried Wireless Underground Sensor Network in an Urban Environment. In Proceedings of the 2019 11th International Conference on Communication Systems & Networks (COMSNETS), Bengaluru, India, 7–11 January 2019; pp. 239–250. [Google Scholar] [CrossRef]
  11. Zhang, X.; Andreyev, A.; Zumpf, C.; Negri, M.C.; Guha, S.; Ghosh, M. Thoreau: A Subterranean Wireless Sensing Network for Agriculture and the Environment. In Proceedings of the 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Atlanta, GA, USA, 1–4 May 2017; pp. 78–84. [Google Scholar] [CrossRef]
  12. Hardie, M.; Hoyle, D. Underground Wireless Data Transmission Using 433-MHz LoRa for Agriculture. Sensors 2019, 19, 4232. [Google Scholar] [CrossRef] [Green Version]
  13. Akkaş, M.A.; Sokullu, R. Wireless Underground Sensor Networks: Channel Modeling and Operation Analysis in the Terahertz Band. Int. J. Antennas Propag. 2015, 2015, 780235. [Google Scholar] [CrossRef] [Green Version]
  14. Dong, X.; Vuran, M.C.; Irmak, S. Autonomous precision agriculture through integration of wireless underground sensor networks with center pivot irrigation systems. Ad Hoc Netw. 2013, 11, 1975–1987. [Google Scholar] [CrossRef]
  15. Silva, A.R.; Vuran, M.C. Empirical Evaluation of Wireless Underground-to-Underground Communication in Wireless Underground Sensor Networks. In Distributed Computing in Sensor Systems; Krishnamachari, B., Suri, S., Heinzelman, W., Mitra, U., Eds.; Springer: Berlin/Heidelberg, Germany, 2009; pp. 231–244. Available online: https://cse.unl.edu/~cpn/system/files/Silva09WUUC.pdf (accessed on 15 September 2020).
  16. Stuntebeck, E.P.; Pompili, D.; Melodia, T. Wireless Underground Sensor Networks Using Commodity Terrestrial Motes. In Proceedings of the 2006 2nd IEEE Workshop on Wireless Mesh Networks, Reston, VA, USA, 28 September 2006; pp. 112–114. [Google Scholar] [CrossRef] [Green Version]
  17. Yu, X.; Zhang, Z.; Han, W. Experiment Measurements of RSSI for Wireless Underground Sensor Network in Soil. IAENG Int. J. Comput. Sci. 2018, 45, 237–245. Available online: https://www.iaeng.org/IJCS/issues_v45/issue_2/IJCS_45_2_02.pdf (accessed on 20 December 2020).
  18. Mekonnen, Y.; Namuduri, S.; Burton, L.; Sarwat, A.; Bhansali, S. Review—Machine Learning Techniques in Wireless Sensor Network Based Precision Agriculture. J. Electrochem. Soc. 2020, 167, 037522. [Google Scholar] [CrossRef]
  19. Klein, L.J.; Hamann, H.F.; Hinds, N.; Guha, S.; Sanchez, L.; Sams, B.; Dokoozlian, N. Closed Loop Controlled Precision Irrigation Sensor Network. IEEE Internet Things J. 2018, 5, 4580–4588. [Google Scholar] [CrossRef]
  20. Chlingaryan, A.; Sukkarieh, S.; Whelan, B. Machine learning approaches for crop yield prediction and nitrogen status estimation in precision agriculture: A review. Comput. Electron. Agric. 2018, 151, 61–69. [Google Scholar] [CrossRef]
  21. Srivastava, P.K.; Han, D.; Ramirez, M.R.; Islam, T. Machine Learning Techniques for Downscaling SMOS Satellite Soil Moisture Using MODIS Land Surface Temperature for Hydrological Application. Water Resour. Manag. 2013, 27, 3127–3144. [Google Scholar] [CrossRef]
  22. Zhang, Z.; Wu, P.; Han, W.; Yu, X. Design of wireless underground sensor network nodes for field information acquisition. Afr. J. Agric. Res. 2012, 7, 82–88. [Google Scholar] [CrossRef] [Green Version]
  23. Rossato, L.; Alvalá, R.C.; Marengo, J.A.; Zeri, M.; Cunha, A.P.; Pires, L.; Barbosa, H.A. Impact of Soil Moisture on Crop Yields over Brazilian Semiarid. Front. Environ. Sci. 2017, 5, 73. [Google Scholar] [CrossRef] [Green Version]
  24. Katerji, N.; van Hoorn, J.W.; Hamdy, A.; Mastrorilli, M. Salinity effect on crop development and yield, analysis of salt tolerance according to several classification methods. Agric. Water Manag. 2003, 62, 37–66. [Google Scholar] [CrossRef]
  25. Fontanet, M.; Fernàndez-Garcia, D.; Ferrer, F. The value of satellite remote sensing soil moisture data and the DISPATCH algorithm in irrigation fields. Hydrol. Earth Syst. Sci. 2018, 22, 5889–5900. [Google Scholar] [CrossRef] [Green Version]
  26. Vuran, M.C.; Silva, A.R. Communication Through Soil in Wireless Underground Sensor Networks—Theory and Practice. In Sensor Networks. Signals and Communication Technology; Ferrari, G., Ed.; Springer: Berlin/Heidelberg, Germany, 2010; pp. 309–347. [Google Scholar] [CrossRef]
  27. Sun, Z.; Akyildiz, I.F. Connectivity in Wireless Underground Sensor Networks. In Proceedings of the 2010 7th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), Boston, MA, USA, 21–25 June 2010; pp. 1–9. [Google Scholar] [CrossRef] [Green Version]
  28. Trang, H.T.H.; Dung, L.T.; Hwang, S.O. Connectivity analysis of underground sensors in wireless underground sensor networks. Ad Hoc Netw. 2018, 71, 104–116. [Google Scholar] [CrossRef]
  29. Banaseka, F.K.; Franklin, H.; Katsriku, F.A.; Abdulai, J.D.; Ekpezu, A.; Wiafe, I. Soil Medium Electromagnetic Scattering Model for the Study of Wireless Underground Sensor Networks. Wirel. Commun. Mob. Comput. 2021, 2021, 8842508. [Google Scholar] [CrossRef]
  30. Banaseka, F.K.; Katsriku, F.; Abdulai, J.D.; Adu-Manu, K.S.; Engmann, F.N.A. Signal Propagation Models in Soil Medium for the Study of Wireless Underground Sensor Networks: A Review of Current Trends. Wirel. Commun. Mob. Comput. 2021, 2021, 8836426. [Google Scholar] [CrossRef]
  31. Huang, H.; Shi, J.; Wang, F.; Zhang, D.; Zhang, D. Theoretical and Experimental Studies on the Signal Propagation in Soil for Wireless Underground Sensor Networks. Sensors 2020, 20, 2580. [Google Scholar] [CrossRef]
  32. Wohwe Sambo, D.; Forster, A.; Yenke, B.O.; Sarr, I.; Gueye, B.; Dayang, P. Wireless Underground Sensor Networks Path Loss Model for Precision Agriculture (WUSN-PLM). IEEE Sens. J. 2020, 20, 5298–5313. [Google Scholar] [CrossRef]
  33. Dujić Rodić, L.; Županović, T.; Perković, T.; Šolić, P.; Rodrigues, J.J.P.C. Machine Learning and Soil Humidity Sensing: Signal Strength Approach. ACM Trans. Internet Technol. 2022, 22, 1–21. [Google Scholar] [CrossRef]
  34. Ayedi, M.; Eldesouky, E.; Nazeer, J. Energy-Spectral Efficiency Optimization in Wireless Underground Sensor Networks Using Salp Swarm Algorithm. J. Sensors 2021, 2021, 6683988. [Google Scholar] [CrossRef]
  35. Lin, K.; Hao, T. Adaptive Selection of Transmission Configuration for LoRa-based Wireless Underground Sensor Networks. In Proceedings of the 2021 IEEE Wireless Communications and Networking Conference (WCNC), Nanjing, China, 29 March–1 April 2021; pp. 1–6. [Google Scholar] [CrossRef]
  36. Bogena, H.R.; Huisman, J.A.; Meier, H.; Rosenbaum, U.; Weuthen, A. Hybrid Wireless Underground Sensor Networks: Quantification of Signal Attenuation in Soil. Vadose Zone J. 2009, 8, 755–761. [Google Scholar] [CrossRef]
  37. Tooker, J.; Dong, X.; Vuran, M.C.; Irmak, S. Connecting Soil to the Cloud: A Wireless Underground Sensor Network Testbed. In Proceedings of the 2012 9th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), Seoul, Korea, 18–21 June 2012; Volume 1, pp. 79–81. [Google Scholar] [CrossRef] [Green Version]
  38. Ding, J.; Chandra, R. Estimating Soil Moisture and Electrical Conductivity Using Wi-Fi. Available online: https://www.microsoft.com/en-us/research/publication/estimating-soil-moisture-and-electrical-conductivity-using-wi-fi/ (accessed on 18 August 2020).
  39. Elesina, V.V.; Kuznetsov, A.G.; Chukov, G.V.; Elesin, V.V.; Usachev, N.A. A Practical Approach to Underground UHF Channel Characterization. In Proceedings of the 2021 International Siberian Conference on Control and Communications (SIBCON), Kazan, Russia, 13–15 May 2021; pp. 1–5. [Google Scholar] [CrossRef]
  40. Rajadurai, P.; Kathrine, G.J.W. An Intelligent Deep Learning-Based Wireless Underground Sensor System for IoT-Based Agricultural Application. In Applied Learning Algorithms for Intelligent IoT; Auerbach Publications: Boca Raton, FL, USA, 2021; pp. 291–324. [Google Scholar] [CrossRef]
  41. Monteiro, A.F.; Da, F.; Henriques, R.; Beatriz, A.; Pinho, C.; Monteiro, A.; Henriques, F. A System For Landslides Monitoring Using Wireless Underground Sensor Networks and Cloud Computing. An. Do XII Comput. Beach-COTB ’21 2021, 12, 504–506. [Google Scholar] [CrossRef]
  42. Hernandez, S.M.; Bulut, E. Towards Dense and Scalable Soil Sensing Through Low-Cost WiFi Sensing Networks. In Proceedings of the 2021 IEEE 46th Conference on Local Computer Networks (LCN), Edmonton, AB, Canada, 4–7 October 2021; pp. 549–556. [Google Scholar] [CrossRef]
  43. Zaman, I.; Gellhaar, M.; Dede, J.; Koehler, H.; Foerster, A. Demo: Design and Evaluation of MoleNet for Wireless Underground Sensor Networks. In Proceedings of the 2016 IEEE 41st Conference on Local Computer Networks Workshops (LCN Workshops), Dubai, United Arab Emirates, 7–10 November 2016; pp. 145–147. [Google Scholar] [CrossRef]
  44. Liedmann, F.; Wietfeld, C. SoMoS—A Multidimensional Radio Field Based Soil Moisture Sensing System. In Proceedings of the 2017 IEEE SENSORS, Glasgow, UK, 29 October–1 November 2017; pp. 1–3. [Google Scholar] [CrossRef]
  45. Liedmann, F.; Holewa, C.; Wietfeld, C. The Radio Field as a Sensor—A Segmentation Based Soil Moisture Sensing Approach. In Proceedings of the 2018 IEEE Sensors Applications Symposium (SAS), Seoul, Korea, 12–14 March 2018; pp. 1–6. [Google Scholar] [CrossRef]
  46. Wan, X.F.; Yang, Y.; Cui, J.; Sardar, M.S. Lora Propagation Testing in Soil for Wireless Underground Sensor Networks. In Proceedings of the 2017 IEEE 6th Asia-Pacific Conference on Antennas Propagation, APCAP, Xi’an, China, 16–19 October 2017; pp. 1–3. [Google Scholar] [CrossRef]
  47. Wu, S.; Austin, A.C.M.; Ivoghlian, A.; Bisht, A.; Wang, K.I.-K. Long range wide area network for agricultural wireless underground sensor networks. J. Ambient Intell. Humaniz. Comput. 2020, 2020, 1–17. [Google Scholar] [CrossRef]
  48. Yu, X.; Wu, P.; Han, W.; Zhang, Z. A survey on wireless sensor network infrastructure for agriculture. Comput. Stand. Interfaces 2013, 35, 59–64. [Google Scholar] [CrossRef]
  49. Yu, X.; Han, W.; Zhang, Z. Path Loss Estimation for Wireless Underground Sensor Network in Agricultural Application. Agric. Res. 2016, 6, 97–102. [Google Scholar] [CrossRef]
  50. Levintal, E.; Ganot, Y.; Taylor, G.; Freer-Smith, P.; Suvocarev, K.; Dahlke, H.E. An underground, wireless, open-source, low-cost system for monitoring oxygen, temperature, and soil moisture. Soil 2022, 8, 85–87. [Google Scholar] [CrossRef]
  51. Smith, P.; Ashmore, M.R.; Black, H.I.J.; Burgess, P.J.; Evans, C.D.; Quine, T.A.; Thomson, A.M.; Hicks, K.; Orr, H.G. REVIEW: The role of ecosystems and their management in regulating climate, and soil, water and air quality. J. Appl. Ecol. 2013, 50, 812–829. [Google Scholar] [CrossRef]
  52. Adamchuk, V.I.; Hummel, J.W.; Morgan, M.T.; Upadhyaya, S.K. On-the-go soil sensors for precision agriculture. Comput. Electron. Agric. 2004, 44, 71–91. [Google Scholar] [CrossRef] [Green Version]
  53. Schlesinger, W.H.; Jasechko, S. Transpiration in the global water cycle. Agric. For. Meteorol. 2014, 189–190, 115–117. [Google Scholar] [CrossRef]
  54. Li, X.; Huo, Z.; Xu, B. Optimal allocation method of irrigationwater from river and lake by considering the fieldwater cycle process. Water 2017, 9, 911. [Google Scholar] [CrossRef] [Green Version]
  55. Leng, G.; Leung, L.R.; Huang, M. Irrigation impacts on the water cycle and regional climate simulated by the ACME Model. AGUFM 2016, 2016, GC31B-1122. [Google Scholar]
  56. Aghakouchak, A. A baseline probabilistic drought forecasting framework using standardized soil moisture index: Application to the 2012 United States drought. Hydrol. Earth Syst. Sci. 2014, 18, 2485–2492. [Google Scholar] [CrossRef] [Green Version]
  57. Teillet, P.M.; Gauthier, R.P.; Pultz, T.J.; Deschamps, A.; Fedosejevs, G.; Maloley, M.; Ainsley, G.; Chichagov, A. A soil moisture sensorweb for use in flood forecasting applications. Remote Sens. Agric. Ecosyst. Hydrol. V 2004, 5232, 467–478. [Google Scholar] [CrossRef]
  58. Cai, Y.; Zheng, W.; Zhang, X.; Zhangzhong, L.; Xue, X. Research on soil moisture prediction model based on deep learning. PLoS ONE 2019, 14, e0214508. [Google Scholar] [CrossRef]
  59. Gill, M.K.; Asefa, T.; Kemblowski, M.W.; McKee, M. Soil Moisture Prediction Using Support Vector Machines. JAWRA J. Am. Water Resour. Assoc. 2006, 42, 1033–1046. [Google Scholar] [CrossRef]
  60. Hong, Z.; Kalbarczyk, Z.; Iyer, R.K. A Data-Driven Approach to Soil Moisture Collection and Prediction. In Proceedings of the 2016 IEEE International Conference on Smart Computing (SMARTCOMP), St. Louis, MO, USA, 18–20 May 2016; pp. 1–6. [Google Scholar] [CrossRef]
  61. Liu, Y.; Mei, L.; Ki, S.O. Prediction of Soil Moisture Based on Extreme Learning Machine for an Apple Orchard. In Proceedings of the 2014 IEEE 3rd International Conference on Cloud Computing and Intelligence Systems, Shenzhen, China, 27–29 November 2014; pp. 400–404. [Google Scholar] [CrossRef]
  62. Niu, H.; Meng, F.; Yue, H.; Yang, L.; Dong, J.; Zhang, X. Soil moisture prediction in peri-urban beijing, china: Gene expression programming algorithm. Intell. Autom. Soft Comput. 2021, 28, 93–106. [Google Scholar] [CrossRef]
  63. Gu, Z.; Zhu, T.; Jiao, X.; Xu, J.; Qi, Z. Evaluating the Neural Network Ensemble Method in Predicting Soil Moisture in Agricultural Fields. Agronomy 2021, 11, 1521. [Google Scholar] [CrossRef]
  64. Singh, G.; Sharma, D.; Goap, A.; Sehgal, S.; Shukla, A.K.; Kumar, S. Machine Learning Based Soil Moisture Prediction for Internet of Things Based Smart Irrigation System. In Proceedings of the 2019 5th International Conference on Signal Processing, Computing and Control (ISPCC), Solan, India, 10–12 October 2019; pp. 175–180. [Google Scholar] [CrossRef]
  65. Yu, J.; Zhang, X.; Xu, L.; Dong, J.; Zhangzhong, L. A hybrid CNN-GRU model for predicting soil moisture in maize root zone. Agric. Water Manag. 2021, 245, 106649. [Google Scholar] [CrossRef]
  66. Chatterjee, S.; Dey, N.; Sen, S. Soil moisture quantity prediction using optimized neural supported model for sustainable agricultural applications. Sustain. Comput. Inform. Syst. 2020, 28, 100279. [Google Scholar] [CrossRef]
  67. Chaamwe, N.; Liu, W.; Jiang, H. Wave Propagation Communication Models for Wireless Underground Sensor Networks. In Proceedings of the 2010 IEEE 12th International Conference on Communication Technology, Nanjing, China, 11–14 November 2010; pp. 9–12. [Google Scholar] [CrossRef]
  68. Peplinski, N.R.; Ulaby, F.T.; Dobson, M.C. Dielectric properties of soils in the 0.3-1.3-GHz range. IEEE Trans. Geosci. Remote Sens. 1995, 33, 803–807. [Google Scholar] [CrossRef]
  69. Liu, S.; Li, Z.; Zhao, G. Attenuation characteristics of ground penetrating radar electromagnetic wave in aeration zone. Earth Sci. Inform. 2021, 14, 259–266. [Google Scholar] [CrossRef]
  70. Aroca, R.V.; Hernandes, A.C.; Magalhães, D.V.; Becker, M.; Vaz, C.M.P.; Calbo, A.G. Calibration of Passive UHF RFID Tags Using Neural Networks to Measure Soil Moisture. J. Sens. 2018, 2018, 3436503. [Google Scholar] [CrossRef] [Green Version]
  71. Hirani, P.; Balivada, S.; Chauhan, R.; Shaikh, G.; Murthy, L.; Balhara, A.; Ponduru, R.C.; Sharma, H.; Chary, S.; Subramanyam, G.B.; et al. Using Cyber Physical Systems to Map Water Quality over Large Water Bodies. In Proceedings of the 2018 IEEE SENSORS, New Delhi, India, 28–31 October 2018; pp. 1–4. [Google Scholar] [CrossRef]
  72. Manz, L. Frost heave. Geo News. 2011; pp. 1–7. Available online: https://www.dmr.nd.gov/ndgs/documents/newsletter/2011Summer/FrostHeave.pdf (accessed on 28 April 2022).
  73. Harris, C.R.; Millman, K.J.; van der Walt, S.J.; Gommers, R.; Virtanen, P.; Cournapeau, D.; Wieser, E.; Taylor, J.; Berg, S.; Smith, N.J.; et al. Array programming with NumPy. Nature 2020, 585, 357–362. [Google Scholar] [CrossRef]
  74. OpenStreetMap Contributors Planet Dump. Available online: https://planet.osm.org (accessed on 12 December 2020).
  75. Yu, X.; Wu, P.; Zhang, Z.; Wang, N.; Han, W. Electromagnetic wave propagation in soil for wireless underground sensor networks. Prog. Electromagn. Res. M 2013, 30, 11–23. [Google Scholar] [CrossRef] [Green Version]
  76. Luomala, J.; Hakala, I. Effects of Temperature and Humidity on Radio Signal Strength in Outdoor Wireless Sensor Networks. In Proceedings of the 2015 Federated Conference on Computer Science and Information Systems (FedCSIS), Lodz, Poland, 13–16 September 2015; pp. 1247–1255. [Google Scholar] [CrossRef] [Green Version]
  77. Emmert-Streib, F.; Yang, Z.; Feng, H.; Tripathi, S.; Dehmer, M. An Introductory Review of Deep Learning for Prediction Models With Big Data. Front. Artif. Intell. 2020, 3, 4. [Google Scholar] [CrossRef] [Green Version]
  78. Hinton, G.E.; Salakhutdinov, R.R. Reducing the Dimensionality of Data with Neural Networks. Science 2006, 313, 504–507. [Google Scholar] [CrossRef] [Green Version]
  79. Marquardt, D. An Algorithm for Least-Squares Estimation of Nonlinear Parameters. J.Soc. Indust. Appl. Math. 1963, 11, 431–441. [Google Scholar] [CrossRef]
  80. Levenberg, K.; Arsenal, F. A method for the solution of certain non-linear problems in least squares. Q. Appl. Math. 1944, 2, 164–168. [Google Scholar] [CrossRef] [Green Version]
  81. Castro, W.; Oblitas, J.; Santa-Cruz, R.; Avila-George, H. Multilayer perceptron architecture optimization using parallel computing techniques. PLoS ONE 2017, 12, e0189369. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  82. Cigizoglu, H.K. Estimation, forecasting and extrapolation of river flows by artificial neural networks. Hydrol. Sci. J. 2003, 48, 349–361. [Google Scholar] [CrossRef]
  83. Liang, L.L.; Riveros-Iregui, D.A.; Emanuel, R.E.; McGlynn, B.L. A simple framework to estimate distributed soil temperature from discrete air temperature measurements in data-scarce regions. J. Geophys. Res. Atmos. 2014, 119, 407–417. [Google Scholar] [CrossRef]
  84. Dwyer, L.M.; Hayhoe, H.N.; Culley, J.L.B. Prediction of soil temperature from air temperature for estimating corn emergence. Can. J. Plant Sci. 1990, 70, 619–628. [Google Scholar] [CrossRef]
  85. Rankinen, K.; Karvonen, T.; Butterfield, D. A simple model for predicting soil temperature in snow-covered and seasonally frozen soil: Model description and testing. Hydrol. Earth Syst. Sci. 2004, 8, 706–716. [Google Scholar] [CrossRef] [Green Version]
  86. Jungqvist, G.; Oni, S.K.; Teutschbein, C.; Futter, M.N. Effect of Climate Change on Soil Temperature in Swedish Boreal Forests. PLoS ONE 2014, 9, e93957. [Google Scholar] [CrossRef] [Green Version]
  87. Cortes, C.; Vladimir, V. Support-Vector Networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  88. Bergstra, J.; Bengio, Y. Random Search for Hyper-Parameter Optimization. J. Mach. Learn. Res. 2012, 13, 281–305. [Google Scholar]
  89. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in {P}ython. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  90. Huang, G.B.; Zhu, Q.Y.; Siew, C.K. Extreme learning machine: Theory and applications. Neurocomputing 2006, 70, 489–501. [Google Scholar] [CrossRef]
  91. Ribeiro, V.H.A.; Reynoso-Meza, G.; Siqueira, H.V. Multi-objective ensembles of echo state networks and extreme learning machines for streamflow series forecasting. Eng. Appl. Artif. Intell. 2020, 95, 103910. [Google Scholar] [CrossRef]
Figure 1. The wireless underground sensor network Thoreau 2.0 design. Inset shows sensor node and water submersion test conducted in the laboratory prior to field deployment.
Figure 1. The wireless underground sensor network Thoreau 2.0 design. Inset shows sensor node and water submersion test conducted in the laboratory prior to field deployment.
Sensors 22 03913 g001
Figure 2. Sensor node locations (yellow pins), base station location (flag), weather station (purple pin), and soil types (orange lines and numbers denote USDA soil type assessment). Inserts show a sensor node deployed in the soil.
Figure 2. Sensor node locations (yellow pins), base station location (flag), weather station (purple pin), and soil types (orange lines and numbers denote USDA soil type assessment). Inserts show a sensor node deployed in the soil.
Sensors 22 03913 g002
Figure 3. Daily mean averages ± standard deviation of soil volumetric water content (VWC) (a), electrical conductivity (EC) (b), relative humidity (c), and soil and air temperature (d). Relative humidity and air temperature measurements were collected from the weather station shown in Figure 2. Blue bars are cumulative daily precipitation events. Shadows indicates the ± standard deviation of the mean for VWC, EC, and RH.
Figure 3. Daily mean averages ± standard deviation of soil volumetric water content (VWC) (a), electrical conductivity (EC) (b), relative humidity (c), and soil and air temperature (d). Relative humidity and air temperature measurements were collected from the weather station shown in Figure 2. Blue bars are cumulative daily precipitation events. Shadows indicates the ± standard deviation of the mean for VWC, EC, and RH.
Sensors 22 03913 g003
Figure 4. The average percentage of data packets received by the base station from the sensor nodes as a function of the horizontal distance from the base station (a) and from each sensor as they were located in the field (b). The size and color of the filled circles represents the percentage of data packets received. The flag indicates the base station location; yellow, red, and green pins represent sensors installed at 740 and 735 feet elevation and those installed in the flood plain zone of the study area, respectively (b). The soil topographic map (c) used to determine site elevation is retrieved from: https://www.usgs.gov/search-map?search=3DEP (accessed on 25 November 2020).
Figure 4. The average percentage of data packets received by the base station from the sensor nodes as a function of the horizontal distance from the base station (a) and from each sensor as they were located in the field (b). The size and color of the filled circles represents the percentage of data packets received. The flag indicates the base station location; yellow, red, and green pins represent sensors installed at 740 and 735 feet elevation and those installed in the flood plain zone of the study area, respectively (b). The soil topographic map (c) used to determine site elevation is retrieved from: https://www.usgs.gov/search-map?search=3DEP (accessed on 25 November 2020).
Sensors 22 03913 g004
Figure 5. Volumetric water content (m3/m3) daily average intensity maps before and after 24.6 mm precipitation. Brown dots indicate sensor location and brown lines/numbers indicate soil types (brown lines and numbers denote USDA soil type assessment). Intensity maps were generated by linear interpolation between measured points.
Figure 5. Volumetric water content (m3/m3) daily average intensity maps before and after 24.6 mm precipitation. Brown dots indicate sensor location and brown lines/numbers indicate soil types (brown lines and numbers denote USDA soil type assessment). Intensity maps were generated by linear interpolation between measured points.
Sensors 22 03913 g005
Figure 6. Measured RSSI (red line) and VWC (black line) by a sensor node buried 40 cm below the ground and located at 5 m to the base station during fall 2019 (a), winter 2019 (b), and spring 2020 (c) (from 6 September 2019 to 20 June 2020). Blue bars represent cumulative daily precipitation.
Figure 6. Measured RSSI (red line) and VWC (black line) by a sensor node buried 40 cm below the ground and located at 5 m to the base station during fall 2019 (a), winter 2019 (b), and spring 2020 (c) (from 6 September 2019 to 20 June 2020). Blue bars represent cumulative daily precipitation.
Sensors 22 03913 g006
Figure 7. Measured and predicted soil volumetric water content (VWC) at training (a), validation (b), and testing (c) stages of the ANN–MLP model using input parameters: distance of the sensor node to the antenna (D), RSSI + 20 × log(D), relative humidity (RH), and soil and atmospheric temperature. Model is highlighted in bold on Table 2 as the best-performing model.
Figure 7. Measured and predicted soil volumetric water content (VWC) at training (a), validation (b), and testing (c) stages of the ANN–MLP model using input parameters: distance of the sensor node to the antenna (D), RSSI + 20 × log(D), relative humidity (RH), and soil and atmospheric temperature. Model is highlighted in bold on Table 2 as the best-performing model.
Sensors 22 03913 g007
Table 1. Season descriptive parameter statistics.
Table 1. Season descriptive parameter statistics.
Fall-2019Winter-2019Spring-2020 **
MinAvgMaxMinAvgMaxMinAvgMax
VWC0.270.380.450.340.390.450.330.390.45
EC2.135.347.242.445.238.23.835.628.56
ST0.38.726.00.02.45.91.512.223.9
AT−154.729.5−21.80.318.2−4.710.731.9
RH34.880.6103.123.179.4103.223.668.2102.7
P247149304
VWC: volumetric water content (m3/m3), EC: soil electrical conductivity (dS/m), ST: soil temperature (°C), AT: air temperature (°C), RH: relative humidity (%), and P: cumulative precipitation (mm) ** Spring-2020 statistics for AT, RH, and cumulative precipitation are for 65 days.
Table 2. Results of ANN–MLP model with different input parameter combinations.
Table 2. Results of ANN–MLP model with different input parameter combinations.
Input ParametersTrainingValidationTesting
R2RMSE (m3/m3)MAE
(m3/m3)
R2RMSE
(m3/m3)
MAE
(m3/m3)
R2RMSE
(m3/m3)
MAE
(m3/m3)
Six-parameter model
RSSI + K, D, ST, AT, P, RH0.9170.010.0060.8120.0130.0070.8090.0120.007
Two-parameter model
RSSI + K, D0.2490.0260.0160.2590.0260.0160.2370.0260.016
Three-parameter models
RSSI + K, D, ST0.7830.0140.0080.7260.0160.0090.7260.0160.009
RSSI + K, D, AT0.4980.0210.0140.4650.0220.0140.4570.0220.014
RSSI + K, D, P0.2620.0260.0160.2480.0260.0160.2490.0250.016
RSSI + K, D, RH0.3140.0250.0150.2620.0260.0160.2540.0260.016
Four-parameter models
RSSI + K, D, ST, AT0.8210.0130.0080.7640.0150.0090.7420.0150.009
RSSI + K, D, ST, RH0.8140.0130.0080.7160.0160.010.740.0150.009
RSSI + K, D, ST, P0.7230.0160.010.6860.0170.010.6770.0170.01
RSSI + K, D, AT, RH0.650.0180.0120.5930.0190.0130.5360.020.013
RSSI + K, D, AT, P0.4830.0220.0140.470.0220.0140.4310.0220.015
RSSI + K, D, RH, P0.3060.0250.0160.2540.0260.0160.2570.0250.016
ST, AT, P, RH0.4990.0210.0160.4370.0220.0170.4070.0230.017
Five-parameter models
RSSI + K, D, ST, AT, P0.8070.0130.0080.7620.0150.0090.7340.0150.009
RSSI + K, D, ST, AT, RH *0.8890.010.0060.8330.0120.0080.820.0120.008
RSSI + K, D, AT, RH, P0.6170.0180.0120.5620.020.0130.5520.020.013
RSSI + K, D, ST, RH, P0.7450.0150.010.6970.0160.010.6970.0160.01
D: Hypotenuse distance between sensor node and antenna, K: 20 × log(D), ST: soil temperature, AT: air temperature, P: precipitation, and RH: relative humidity. Stats: coefficient of determination (R2), root mean square error (RMSE), and mean absolute error (MAE). * Best overall model performance.
Table 3. Results of Support Vector Regression (SVR) and Extreme Learning Machines (ELMs) for training and testing stages.
Table 3. Results of Support Vector Regression (SVR) and Extreme Learning Machines (ELMs) for training and testing stages.
Kernel/ActivationTrainingTesting
R2RMSE
(m3/m3)
MAE
(m3/m3)
R2RMSE
(m3/m3)
MAE
(m3/m3)
SVRLinear0.170.0720.05440.170.0730.055
Sigmoid0.170.0720.0550.180.0730.054
Poly0.250.0690.0550.250.0690.054
RBF *0.590.0510.030.560.0530.032
ELMSigmoid0.470.0580.04110.480.0580.041
Sine0.440.060.0440.430.060.044
Tanh0.420.0610.0450.390.0620.045
Triangular basis0.430.060.0430.430.0610.044
Hard limit0.390.060.0450.390.0620.046
Relu0.390.0450.060.380.0450.063
RBF *0.430.0440.060.410.0450.062
* RBF: Radial Basis Function.
Table A2. Optimal training constants and kernel functions for developing SVM models.
Table A2. Optimal training constants and kernel functions for developing SVM models.
Kernel FunctionCEpsilonGammaDegree
Linear0.10.1--
Sigmoid1000.10.001-
Poly100.123
RBF100.0120-
Table A3. Optimal hidden neurons for developing ELM model.
Table A3. Optimal hidden neurons for developing ELM model.
Activation FunctionNumber of Neurons in the Hidden Layer
Sigmoid385
Sine270
Tanh180
Triangular basis265
Hard limit970
Relu465
RBF210
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Balivada, S.; Grant, G.; Zhang, X.; Ghosh, M.; Guha, S.; Matamala, R. A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation. Sensors 2022, 22, 3913. https://doi.org/10.3390/s22103913

AMA Style

Balivada S, Grant G, Zhang X, Ghosh M, Guha S, Matamala R. A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation. Sensors. 2022; 22(10):3913. https://doi.org/10.3390/s22103913

Chicago/Turabian Style

Balivada, Srinivasa, Gregory Grant, Xufeng Zhang, Monisha Ghosh, Supratik Guha, and Roser Matamala. 2022. "A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation" Sensors 22, no. 10: 3913. https://doi.org/10.3390/s22103913

APA Style

Balivada, S., Grant, G., Zhang, X., Ghosh, M., Guha, S., & Matamala, R. (2022). A Wireless Underground Sensor Network Field Pilot for Agriculture and Ecology: Soil Moisture Mapping Using Signal Attenuation. Sensors, 22(10), 3913. https://doi.org/10.3390/s22103913

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop