Numerical Solution of Sixth-Order Differential Equations Arising in Astrophysics by Neural Network
Numerical Solution of Sixth-Order Differential Equations Arising in Astrophysics by Neural Network
Numerical Solution of Sixth-Order Differential Equations Arising in Astrophysics by Neural Network
M. Khalid
Mariam Sultana
Faheem Zaidi
Department of Mathematical Sciences
Federal Urdu University of Arts, Sciences & Technology
University Road, Karachi-75300, Pakistan
ABSTRACT
In the current paper, a neural network method to solve sixth-order
differential equations and their boundary conditions has been presented. The idea this method incorporates is to integrate knowledge about the differential equation and its boundary conditions
into neural networks and the training sets. Neural networks are being used incessantly to solve all kinds of problems hailing a wide
range of disciplines. Several examples are given to illustrate the
efficiency and implementation of the Neural Network method.
Keywords:
Sixth Order Differential Equation, Boundary Conditions, Neural
Network
1.
INTRODUCTION
2.
LITERATURE REVIEW
3.
00
y iv (a) = E
00
y iv (b) = F
y (a) = C;
y(b) = B;
y (b) = D;
(1)
(2)
(3)
There are any forms for functions J(x) and M (x) to construct
yT (x, p). Sigmoid function tanh(bi + ci x) is accepted to be an
activation function for hidden unit. The trial function can not be
satisfied in the boundary conditions unless there is
00
J iv (a) = E
00
J iv (b) = F
J(a) = A;
J (a) = C;
J(b) = B;
J (b) = D;
(4)
00
M (a).N (a, p) = 0
(5)
M (b).N (b, p) = 0
(6)
00
00
00
00
000
00
00
000
(11)
ai
0.016505561
0.087265869
0.024116433
0.135271789
-0.19112553
bi
-0.2434469
-0.0058665
-0.0300997
-0.0075984
-0.1365936
ci
0.863716
1.069340
1.0776682
0.7272999
1.4643935
Numerical
Solution
1.0000000000
0.9908587500
0.9699309700
0.9350350300
0.8835115500
0.8121660400
0.7172044500
0.5941605000
0.4378140300
0.2420990000
0.0000000000
Error
0.0000000000
0.0037950800
0.0071912400
0.0098661300
0.0115832700
0.0121945900
0.0116430700
0.0099653100
0.0072941500
0.0038613100
0.0000000000
wo + w1 b + w2 b2 + w3 b3 + w4 b4 + w5 b5 = B
(12)
(13)
(14)
24w4 + 120w5 a = E
(15)
24w4 + 120w5 b = F
(16)
After solving this system of six equations with six unknowns, the
general form of the polynomial J(x) is achieved. For minimization,
the following equation is used
E(p) =
M
X
d6 yT (xi , p)
dyT (xi , p)
,
f (xi , yT (xi , p),
{
6
dx
dx
i=1
(17)
d2 yT (xi , p)
d5 yT (xi , p) 2
.....
)}
2
dx
dx5
3.1
0.0000000000
0.1000000000
0.2000000000
0.3000000000
0.4000000000
0.5000000000
0.6000000000
0.7000000000
0.8000000000
0.9000000000
1.0000000000
Analytical
Solution
1.0000000000
0.9946538300
0.9771222100
0.9449011700
0.8950948200
0.8243606400
0.7288475200
0.6041258100
0.4451081900
0.2459603100
0.0000000000
3.1.1 Example 1:. Let us shed some light on the sixth-order differential equation:
0<x<1
(18)
y(1) = 0;
00
00
y (1) = 2e;
ci
-0.2868379
0.5234077
0.3504931
-0.2325288
0.7076312
y(0) = 1;
0<x<1
y iv (0) = 3
y iv (1) = 4e
(22)
y(1) = e;
y iv (1) = e
y (1) = e;
(23)
(24)
5e8
,
36
(20)
(21)
(19)
y iv (0) = 1
00
where w5 =
w4 =
w3 =
w2 = 12, w1 =
307e472
and
w
=
1.
The
values
of
Neural
parameters
ai , bi and
o
360
ci , where i represents numbers of nodes, are shown in Table 3. The
network is trained for 10 equidistant points with five hidden nodes
according to the algorithm. In Table 4, the analytical solutions are
compared with neural solutions. Also estimated errors are cited in
third column of Table 4. Plot of comparison between (analytical
results) and ( neural results) of Example 2, is shown in Figure 2.
00
y (0) = 1;
e1
,
120
bi
-0.6258868
-0.6391466
-0.5823448
-0.6028480
-0.4779116
In this section, the solution of three example problems with the help
of neural network method is presented
y(0) = 1;
ai
-0.0734690
0.0151022
-0.0296600
0.0867887
0.0018519
Numerical Implementation
i
1
2
3
4
5
, w4 = 18 , w3 = 32e
, w2 = 12,
where w5 = 34e
120
9
23e66
w1 = 15 and wo = 1. The values of Neural parameters ai ,
bi and ci , where i represents numbers of nodes, are shown in Table
1. The network has been trained for 10 equidistant points in [0, 1]
and compared results between analytical and neural with five nodes
fixed in the hidden layer. Comparison between analytical and neural results is outlined in Table 2. Error between two values is also
computed here. Analytical and neural results of Example 1, which
are obtained are depicted in Figure 1.
y vi (x) = ex y 2 (x)
0<x<1
(25)
y (0) = 1;
00
y (0) = 1
y (1) = e1 ;
00
y (1) = e1
(26)
(27)
Analytical
Solution
1.00000000
0.90483742
0.81873075
0.74081822
0.67032005
0.60653066
0.54881164
0.49658530
0.44932896
0.40656966
0.36787944
Numerical
Solution
1.00000000
0.90483742
0.81873075
0.74081822
0.67032005
0.60653066
0.54881164
0.49658530
0.44932896
0.40656966
0.36787944
Error
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0.00000000
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
i
1
2
3
4
5
ai
1.01544450
1.23698750
0.09458130
0.00376860
0.09513450
bi
0.07528380
0.07341860
0.07306020
0.14662330
0.07199000
Numerical
Solution
1.00000000
1.10585595
1.22270049
1.35163868
1.49391357
1.65091952
1.82421682
2.01554776
2.22685442
2.46029828
2.71828183
Error
0.00000000
-0.00068503
-0.00129774
-0.00177987
-0.00208887
-0.00219825
-0.00209802
-0.00179505
-0.00131349
-0.00069517
0.00000000
5.
Table 5. Values of Neural parameters
(Example 3), ai , bi and ci with five nodes
Analytical
Solution
1.00000000
1.10517092
1.22140276
1.34985881
1.49182470
1.64872127
1.82211880
2.01375271
2.22554093
2.45960311
2.71828183
CONFLICT OF INTERESTS
ci
0.12410432
0.13873990
0.26252581
0.50823108
0.17995931
6.
ACKNOWLEDGMENT
We thank the reviewers for their thorough efforts in editing our paper and highly appreciate the comments and constructive criticism
that significantly contributed in improving the quality of the publication. The authors also thank Ms. Wishaal Khalid for proofreading
our research paper.
(28)
1
1
1
, w3 = 29e 2 11 , w2 = 12,
w5 = 19e 2 7 , w4 = 1746e
2
1 and wo = 1. Table 5 gives the values of Neural param-
where
w1 =
eters ai , bi and ci , at different nodes. Ten equidistant points are
taken into consideration in the given domain at five hidden nodes.
Comparison of analytical and neural results of Example 3 has been
shown in Table 6.
It is well known that other numerical methods are usually iterative
in nature, where the step size is fixed before the commencement of
the computation. After the attainment of the solution if we decide
to know what it is between steps, there is no option but to repeat
the procedure from initial stages. Neural Network method may be
a sort of reliefs we bring to this problem, where this repetition of
iterations may be avoided. One can see from the tables and graphs
that the trial solution approach improves the accuracy of the results.
Lastly, it would not go to amiss to mention that the implemented algorithm is simple, computationally efficient, and straight forward.
4.
CONCLUDING REMARKS
7.
REFERENCES
[1] Schalkoff, R.J. (1997) Artificial Neural Networks.
McGraw-Hill, New York.
[2] Picton, P. (2000) Neural Networks. 2nd ed. Palgrave, Great
Britain.
[3] Rosenblatt, F. (1957) The perceptron - a perceiving and
recognizing automation. Comell Aeronautical Laboratory,
Report 85460.
[4] Boutayeb, A. & Twizell, E. (1992) Numerical methods for
the solution of special sixth-order boundary value problems.International Journal of Computer Mathematics,45.
pp 207-233
[5] Twizell, E. & Boutayeb, E. (1990) Numerical methods for
the solution of special and general sixth-order boundary
value problems, with applications to Benard layer eigenvalue problems. Proceedings of the Royal Socity London
Series A. 431(1883). pp 433-450
[6] Baldwin, P. (1987) Asymptotic estimates of the eigenvalues
of a sixth-order boundary-value problem obtained by using
global phase-integral methods. Philosophical Transactions
of the Royal Society of London Series A, 322(1566). pp
281-305
[7] Siddiqi, S.S. & Twizell, E.H. (1996) Spline solutions of
linear sixth-order boundary-value problems. International
Journal of Computer Mathematics, 60(3-4). pp 295-304
[8] El-Gamel, M., Cannon, J.R. & Zayed, A.I. (2004) SincGalerkin method for solving linear sixth-order boundaryvalue problems. Mathematics of Computation, 73(247). pp
1325-1343
[25] Meade, A.J. & Femandez, A.A. (1994) The numerical solution of linear ordinary differential equations by feedforward neural networks. Mathematical and Computer Modelling, 19(12). pp 1-25
[26] Meade, A.J. & Femandez, A.A. (1994) Solution of nonlinear ordinary differential equations by feedforward neural
networks. Mathematical and Computer Modelling, 20(9).
pp 19-44
[27] Lagaris, I.E., Likas, A. & Fotiadis, D.I. (1998) Artificial
neural networks for solving ordinary and partial differential equations. IEEE Transactions on Neural Networks,
9(5) pp 987-1000
[28] Lagaris, I.E., Likas, A. & Papageorgiou, D.G. (2000)
Neural-network methods for boundary value problems with
irregular boundaries. IEEE Transactions on Neural Networks, 11(5). pp 1041-1049
[29] Parisi, D.R., Mariani, M.C. & Laborde, M.A. (2003) Solving differential equations with unsupervised neural networks. Chemical Engineering and Processing, 42(8-9). pp
715-721
[30] Malek, A. & Shekari, B. (2006) Numerical solution for
high order differential equations using a hybrid neural
network-Optimization method. Applied Mathematics and
Computation, 183(1). pp 260-271
[31] Choi, B. & Lee, J.H. (2009) Comparison of generalization
ability on solving differential equations using backpropagation and reformulated radial basis function networks.
Neurocomputing, 73(1-3). pp 115-118
[32] Yazdi, H.S., Pakdaman, M. & Modaghegh, H. (2011) Unsupervised kernel least mean square algorithm for solving
ordinary differential equations. Neurocomputing, 74(1213). pp 2062-2071
[33] Selvaraju, N. & Samant, A. (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. International Journal of Computer
Applications, 29. pp 48-54
[34] He, S., Reif, K. & Unbehauen, R. (2000) Multilayer neural
networks for solving a class of partial differential equations. Neural Networks, 13(3). pp 385-396
[35] Kumar, M. & Yadav, N. (2011) Multilayer perceptrons and
radial basis function neural network methods for the solution of differential equations: a survey. Computers and
Mathematics with Applications, 62(10). pp 3796-3811
[36] Tsoulos, I.G., Gavrilis, D. & Glavas, E. (2009) Solving differential equations with constructed neural networks. Neurocomputing, 72(10-12). pp 2385-2391
[37] Jianyu, L., Siwei, L, Yingjian, Q. & Yaping, H. (2003)
Numerical solution of elliptic partial differential equation
using radial basis function neural networks. Neural Networks, 16(5-6). pp 729-734
[38] Shirvany, Y., Hayati, M. & Moradian, R. (2009) Multilayer
perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential
equations. Applied Soft Computing Journal, 9(1). ppp 2029
[39] Mai-Duy, N. & Tran-Cong, T. (2001) Numerical solution of
differential equations using multiquadric radial basis function networks. Neural Networks, 14(2). pp 185-199