Preliminary Training Output
This section lists the objective function for each preliminary iteration run. The weights from the iteration number that has the
smallest objective function are passed as input for final training. Because the target is continuous, the error function is set to
normal. Therefore, the objective function that is being minimized is the least squares error. Iteration number 0 has the smallest
objective function. The parameter estimates for iteration number 0 are also listed in this section of the output.
NN:1 Hidden Unit, Direct Connections, and Reduced Input Set
Iteration Pseudo-random Objective
number number seed function
0 12345 0.14536
1 845250737 0.14536
2 111329849 0.28210
3 1696138964 0.18477
4 1038363354 0.14536
5 1071492826 0.18942
6 117568856 0.14536
7 1792608669 0.30494
8 1691324682 0.18331
9 2114796956 0.28605
NN:1 Hidden Unit, Direct Connections, and Reduced Input Set
Optimization Start
Parameter Estimates
------------------------------------------------------------------------------
Parameter Estimate Gradient Label
------------------------------------------------------------------------------
1 CR_HITS_ 5.240279 -9.8369E-7 CR_HITS -> HU1
2 NO_HITS_ -0.575284 0.0000118 NO_HITS -> HU1
3 NO_OUTS_ -0.298484 1.91236E-6 NO_OUTS -> HU1
4 _DUP1_ 0.019049 0.0000127 NO_ERROR -> HU1
5 NO_BB_HU -0.097201 8.015E-6 NO_BB -> HU1
6 _DUP2_ -0.159479 3.44079E-6 DIVISIONEAST -> HU1
7 BIAS_HU1 4.099012 1.7976E-6 BIAS -> HU1
8 _DUP3_ 0.114451 -8.5694E-8 CR_HITS -> LOGSALAR
9 _DUP4_ 0.186707 1.18117E-8 NO_HITS -> LOGSALAR
10 _DUP5_ 0.156401 2.6625E-9 NO_OUTS -> LOGSALAR
11 _DUP6_ -0.042491 8.96911E-8 NO_ERROR -> LOGSALAR
12 NO_BB_LO 0.151510 4.8488E-9 NO_BB -> LOGSALAR
13 _DUP7_ 0.055166 3.48459E-8 DIVISIONEAST -> LOGSALAR
14 HU1_LOGS 0.839297 -9.8363E-8 HU1 -> LOGSALAR
15 BIAS_LOG 5.490837 7.82267E-8 BIAS -> LOGSALAR
Value of Objective Function = 0.1453574646
Levenberg-Marquardt Termination Criteria
NN:1 Hidden Unit, Direct Connections, and Reduced Input Set
Levenberg-Marquardt Optimization
*** Termination Criteria ***
Minimum Iterations . . . . . . . . . . . . . . . -1
Maximum Iterations . . . . . . . . . . . . . . . 100
Maximum Function Calls. . . . . . . . . . . . . . 2147483647
Maximum CPU Time . . . . . . . . . . . . . . . . 604800
ABSGCONV Gradient Criterion . . . . . . . . . . . 0.0000100
GCONV Gradient Criterion . . . . . . . . . . . . 1E-8
GCONV2 Gradient Criterion . . . . . . . . . . . . 0
ABSFCONV Function Criterion . . . . . . . . . . . 0
FCONV Function Criterion . . . . . . . . . . . . 0.0001000
FCONV2 Function Criterion . . . . . . . . . . . . 0
FSIZE Parameter . . . . . . . . . . . . . . . . . 0
ABSXCONV Parameter Change Criterion . . . . . . . 0
XCONV Parameter Change Criterion . . . . . . . . 0
XSIZE Parameter . . . . . . . . . . . . . . . . . 0
ABSCONV Function Criterion . . . . . . . . . . . -1.341E154
*** Other Control Parameters ***
Trust Region Initial Radius Factor . . . . . . . 1.00000
Singularity Tolerance (SINGULAR) . . . . . . . . 1E-8
Levenberg-Marquardt Iteration Log
NN:1 Hidden Unit, Direct Connections, and Reduced Input Set
Levenberg-Marquardt Optimization
Scaling Update of More (1978)
Number of Parameter Estimates 15
Optimization Start: Active Constraints= 0 Criterion= 0.145
Maximum Gradient Element= 0.000 Radius= 1.000
Iter rest nfun act optcrit difcrit maxgrad lambda rho
1 0 2 0 0.1454 4.131E-9 8.81E-6 0 1.694
Optimization Results: Iterations= 1 Function Calls= 3 Jacobian Calls= 2
Active Constraints= 0 Criterion= 0.14535746
Maximum Gradient Element= 8.81033E-6 Lambda= 0 Rho= 1.694 Radius= 0.002375
NOTE: ABSGCONV convergence criterion satisfied.
Parameter Estimates
Optimization Results
Parameter Estimates
------------------------------------------------------------------------------
Parameter Estimate Gradient Label
------------------------------------------------------------------------------
1 CR_HITS_ 5.242352 -6.7156E-7 CR_HITS -> HU1
2 NO_HITS_ -0.575574 8.16507E-6 NO_HITS -> HU1
3 NO_OUTS_ -0.298618 1.3324E-6 NO_OUTS -> HU1
4 _DUP1_ 0.018999 8.81033E-6 NO_ERROR -> HU1