Approximation of smoothness classes by deep rectifier networks

M Ali, A Nouy - SIAM Journal on Numerical Analysis, 2021 - SIAM
… for our work---on ReLU approximation in section 2 and Besov smoothness classes in section
3. Finally, in sec… The reader familiar with results on ReLU/RePU approximation and wavelet …

Optimal approximation of piecewise smooth functions using deep ReLU neural networks

P Petersen, F Voigtlaender - Neural Networks, 2018 - Elsevier
… Finally, in Section 5, we comment on the curse of dimension, and introduce a novel function
class, which can be approximated by ReLU neural networks at a rate independent of the …

Nonlinear Approximation and (Deep) Networks

I Daubechies, R DeVore, S Foucart, B Hanin… - … Approximation, 2022 - Springer
networks approximate functions with classical smoothness to the same accuracy as classical
linear methods of approximation, eg, approximation by … of depth describe certain classes of …

Deep ReLU network approximation of functions on a manifold

J Schmidt-Hieber - arXiv preprint arXiv:1908.00695, 2019 - arxiv.org
deep ReLU network function classes and recall important embedding properties. The network
approximation … with smooth local coordinate maps and the main approximation error bound…

Computation complexity of deep ReLU neural networks in high-dimensional approximation

D Dũng, VK Nguyen, MX Thao - arXiv preprint arXiv:2103.00815, 2021 - arxiv.org
… 4], we have studied the approximation by deep ReLU neural networks, of functions from the
Hölder-Zygmund space of mixed smoothness defined on the … for functions from the classes U …

Optimal approximation of continuous functions by very deep ReLU networks

D Yarotsky - Conference on learning theory, 2018 - proceedings.mlr.press
… We prove that using very deep networks one can approximate … In fact, the depth of the
networks must necessarily grow … Depth separation in relu networks for approximating smooth

Efficient approximation of deep relu networks for functions on low dimensional manifolds

M Chen, H Jiang, W Liao… - Advances in neural …, 2019 - proceedings.neurips.cc
… that neural networks can approximate certain classes of functions with … deep neural networks
with nonsmooth activations to approximate functions supported on a d-dimensional smooth

Deep ReLU networks and high-order finite element methods

JAA Opschoor, PC Petersen, C Schwab - Analysis and Applications, 2020 - World Scientific
… to “best in class” schemes for several important function classes of high and infinite smoothness.
… For example, in Corollary 3.3 we establish ReLU approximation rate bounds in Besov …

Adaptivity of deep ReLU network for learning in Besov and mixed smooth Besov spaces: optimal rate and curse of dimensionality

T Suzuki - arXiv preprint arXiv:1810.08033, 2018 - arxiv.org
… a new approximation and estimation error analysis of deep learning with the ReLU activation
for … In this section, we define the function classes for which we develop error bounds. In …

Universal function approximation by deep neural nets with bounded width and relu activations

B Hanin - Mathematics, 2019 - mdpi.com
… 0 , 1 ] d , the smoothness classes W w , q , γ from [5] reduce to classes of functions that have
… Our results show that deep ReLU networks, even at a moderate width, are universal function …