Sigmoid function: Difference between revisions

Content deleted Content added
MOBle (talk | contribs)
m →‎Examples: Explain significance of the smooth transition function (and use the name actually found in the references)
m Reverted edits by Area2634 (talk) to last version by Mokewxst: spam
 
(4 intermediate revisions by 4 users not shown)
Line 1:
{{Short description|Mathematical function having a characteristic S-shaped curve or sigmoid curve}}
{{Use dmy dates|date=July 2022|cs1-dates=y}}
{{Use list-defined references|date=July 2022}}
[[File:Logistic-curve.svg|thumb|320px|right|The [[logistic curve]]]]
[[File:Error Function.svg|thumb|right|320px|Plot of the [[error function]]]]
 
A '''sigmoid function''' isrefers anyspecifically [[mathematicalto a function]] whose [[graphGraph of a function|graph]] hasfollows athe characteristic[[logistic S-shapedfunction]]. orIt '''sigmoidis curve'''.defined by the formula:
:<math>\sigma(x) = \frac{1}{1 + e^{-x}} = \frac{e^x}{1 + e^x} = 1 - \sigma(-x).</math>
 
In many fields, especially in the context of [[Neural network (machine learning)|artificial neural networks]], the term "sigmoid function" is correctly recognized as a synonym for the logistic function. While other S-shaped curves, such as the [[Gompertz function|Gompertz curve]] or the [[Ogee|ogee curve]], may resemble sigmoid functions, but they are distinct mathematical functions with different properties and applications.
A common example of a sigmoid function is the [[logistic function]] shown in the first figure and defined by the formula:<ref name="Han-Morag_1995" />
:<math>\sigma(x) = \frac{1}{1 + e^{-x}} = \frac{e^x}{1 + e^x}=1-\sigma(-x).</math>
 
Sigmoid functions, particularly the logistic function, have a domain of all [[Real number|real numbers]] and typically produce output values in the range from 0 to 1, although some variations, like the [[Hyperbolic functions|hyperbolic tangent]], output values between −1 and 1. These functions are commonly used as [[Activation function|activation functions]] in artificial neurons and as [[Cumulative distribution function|cumulative distribution functions]] in [[statistics]]. The logistic sigmoid is also invertible, with its inverse being the [[Logit|logit function]].
Other standard sigmoid functions are given in the [[#Examples|Examples section]]. In some fields, most notably in the context of [[artificial neural network]]s, the term "sigmoid function" is used as an alias for the logistic function.
 
Special cases of the sigmoid function include the [[Gompertz curve]] (used in modeling systems that saturate at large values of x) and the [[ogee curve]] (used in the [[spillway]] of some [[dam]]s). Sigmoid functions have domain of all [[real number]]s, with return (response) value commonly [[monotonically increasing]] but could be decreasing. Sigmoid functions most often show a return value (y axis) in the range 0 to 1. Another commonly used range is from −1 to 1.
 
A wide variety of sigmoid functions including the logistic and [[hyperbolic tangent]] functions have been used as the [[activation function]] of [[artificial neuron]]s. Sigmoid curves are also common in statistics as [[cumulative distribution function]]s (which go from 0 to 1), such as the integrals of the [[logistic density]], the [[normal density]], and [[Student's t-distribution|Student's ''t'' probability density functions]]. The logistic sigmoid function is invertible, and its inverse is the [[logit]] function.
 
== Definition ==
Line 89 ⟶ 85:
{{Commons category|Sigmoid functions}}
{{div col|colwidth=30em}}
* [[{{annotated link|Step function]]}}
* [[{{annotated link|Sign function]]}}
* [[{{annotated link|Heaviside step function]]}}
* [[{{annotated link|Logistic regression]]}}
* [[{{annotated link|Logit]]}}
* [[{{annotated link|Softplus function]]}}
* [[{{annotated link|Soboleva modified hyperbolic tangent]]}}
* [[{{annotated link|Softmax function]]}}
* [[{{annotated link|Swish function]]}}
* [[{{annotated link|Weibull distribution]]}}
* [[{{annotated link|Fermi–Dirac statistics]]}}
{{div col end}}