Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.276 sec
: Elapsed time for training with 1000 events: 0.28 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00292 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000784 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0041 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.00022 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000353 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31542.1
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33124.3 31216.4 0.00421265 0.000480661 214363 0
: 2 Minimum Test error found - save the configuration
: 2 | 32652 30692.7 0.00420295 0.000493001 215637 0
: 3 Minimum Test error found - save the configuration
: 3 | 31972.4 30011.6 0.00443479 0.000493001 202954 0
: 4 Minimum Test error found - save the configuration
: 4 | 31215.1 29319 0.00447135 0.000514982 202206 0
: 5 Minimum Test error found - save the configuration
: 5 | 30419.9 28503.8 0.00441734 0.00049766 204098 0
: 6 Minimum Test error found - save the configuration
: 6 | 29542.5 27594.1 0.00441912 0.000530361 205721 0
: 7 Minimum Test error found - save the configuration
: 7 | 28870.4 27069.3 0.00443734 0.000478521 202081 0
: 8 Minimum Test error found - save the configuration
: 8 | 28443.4 26700.2 0.0042312 0.000457571 211998 0
: 9 Minimum Test error found - save the configuration
: 9 | 28088.3 26378.6 0.00417484 0.00044727 214617 0
: 10 Minimum Test error found - save the configuration
: 10 | 27764.4 26083.2 0.00418399 0.000449641 214227 0
: 11 Minimum Test error found - save the configuration
: 11 | 27467 25797.6 0.004134 0.000449351 217117 0
: 12 Minimum Test error found - save the configuration
: 12 | 27174.5 25529.1 0.00414926 0.00047143 217520 0
: 13 Minimum Test error found - save the configuration
: 13 | 26898.5 25267 0.00424093 0.000505621 214172 0
: 14 Minimum Test error found - save the configuration
: 14 | 26627.1 25014.7 0.00411906 0.00045188 218151 0
: 15 Minimum Test error found - save the configuration
: 15 | 26367.4 24765 0.00416252 0.000448901 215423 0
: 16 Minimum Test error found - save the configuration
: 16 | 26108.1 24525.2 0.00412753 0.000444542 217215 0
: 17 Minimum Test error found - save the configuration
: 17 | 25861 24284.9 0.00424176 0.000464221 211778 0
: 18 Minimum Test error found - save the configuration
: 18 | 25613.7 24051.5 0.00431096 0.000481571 208911 0
: 19 Minimum Test error found - save the configuration
: 19 | 25369.2 23826.4 0.00425299 0.00046535 211213 0
: 20 Minimum Test error found - save the configuration
: 20 | 25137.8 23596.6 0.00422871 0.000462012 212388 0
: 21 Minimum Test error found - save the configuration
: 21 | 24899.2 23378 0.00430134 0.00063556 218235 0
: 22 Minimum Test error found - save the configuration
: 22 | 24669.1 23162.7 0.00489163 0.000557112 184565 0
: 23 Minimum Test error found - save the configuration
: 23 | 24444.5 22947.2 0.00437199 0.000469411 204993 0
: 24 Minimum Test error found - save the configuration
: 24 | 24223.6 22731.4 0.00429088 0.00047387 209588 0
: 25 Minimum Test error found - save the configuration
: 25 | 23999.8 22523.5 0.00431035 0.000466331 208116 0
: 26 Minimum Test error found - save the configuration
: 26 | 23782.4 22318.5 0.00419988 0.00047704 214890 0
: 27 Minimum Test error found - save the configuration
: 27 | 23569.5 22113.4 0.00425316 0.00046414 211137 0
: 28 Minimum Test error found - save the configuration
: 28 | 23353.2 21916.9 0.00445771 0.000468441 200538 0
: 29 Minimum Test error found - save the configuration
: 29 | 23146.2 21718.8 0.00421221 0.00046031 213225 0
: 30 Minimum Test error found - save the configuration
: 30 | 22941.3 21520.1 0.00417372 0.000460171 215427 0
: 31 Minimum Test error found - save the configuration
: 31 | 22733.3 21328.5 0.00542743 0.00061516 166242 0
: 32 Minimum Test error found - save the configuration
: 32 | 22534.9 21133.4 0.00427531 0.000468351 210142 0
: 33 Minimum Test error found - save the configuration
: 33 | 22331.4 20945.7 0.00419429 0.000452231 213786 0
: 34 Minimum Test error found - save the configuration
: 34 | 22134 20759.5 0.00417762 0.00045337 214809 0
: 35 Minimum Test error found - save the configuration
: 35 | 21939 20574.4 0.004197 0.000450641 213541 0
: 36 Minimum Test error found - save the configuration
: 36 | 21746.7 20389.7 0.00434648 0.000470831 206417 0
: 37 Minimum Test error found - save the configuration
: 37 | 21553.5 20209.7 0.00420051 0.000454132 213540 0
: 38 Minimum Test error found - save the configuration
: 38 | 21365.7 20029.4 0.00409621 0.000446501 219196 0
: 39 Minimum Test error found - save the configuration
: 39 | 21174.4 19856.8 0.00410388 0.00045269 219107 0
: 40 Minimum Test error found - save the configuration
: 40 | 20991.7 19681.6 0.0040859 0.000437301 219262 0
: 41 Minimum Test error found - save the configuration
: 41 | 20807.3 19509.4 0.00409493 0.000438171 218773 0
: 42 Minimum Test error found - save the configuration
: 42 | 20626.2 19338.1 0.00413266 0.000443521 216853 0
: 43 Minimum Test error found - save the configuration
: 43 | 20447.5 19166.6 0.0041424 0.000449301 216620 0
: 44 Minimum Test error found - save the configuration
: 44 | 20268.6 18997.8 0.00415924 0.000464062 216498 0
: 45 Minimum Test error found - save the configuration
: 45 | 20090.6 18831 0.00411054 0.000454561 218820 0
: 46 Minimum Test error found - save the configuration
: 46 | 19912.3 18662.8 0.0041488 0.00045658 216672 0
: 47 Minimum Test error found - save the configuration
: 47 | 19735.9 18491 0.00418686 0.00045749 214514 0
: 48 Minimum Test error found - save the configuration
: 48 | 19568.5 18328.1 0.00420046 0.000460852 213926 0
: 49 Minimum Test error found - save the configuration
: 49 | 19391.2 18176.6 0.00424909 0.00049878 213316 0
: 50 Minimum Test error found - save the configuration
: 50 | 19227.2 18012.8 0.00416536 0.000466701 216295 0
: 51 Minimum Test error found - save the configuration
: 51 | 19049.5 17851.3 0.00422945 0.00046291 212397 0
: 52 Minimum Test error found - save the configuration
: 52 | 18885.4 17693.9 0.0041955 0.000445441 213330 0
: 53 Minimum Test error found - save the configuration
: 53 | 18720.8 17538.5 0.00412481 0.000447902 217574 0
: 54 Minimum Test error found - save the configuration
: 54 | 18555.3 17380.1 0.0041501 0.000461031 216857 0
: 55 Minimum Test error found - save the configuration
: 55 | 18394.2 17221.7 0.00417851 0.000468501 215633 0
: 56 Minimum Test error found - save the configuration
: 56 | 18226.8 17072.7 0.00421517 0.00046332 213228 0
: 57 Minimum Test error found - save the configuration
: 57 | 18073 16914.2 0.00429588 0.000459552 208533 0
: 58 Minimum Test error found - save the configuration
: 58 | 17911.4 16770 0.00453643 0.000491211 197764 0
: 59 Minimum Test error found - save the configuration
: 59 | 17751.1 16613.5 0.00423108 0.000485861 213606 0
: 60 Minimum Test error found - save the configuration
: 60 | 17591.5 16464.1 0.00426173 0.000495682 212424 0
: 61 Minimum Test error found - save the configuration
: 61 | 17438.4 16315 0.00422759 0.000473322 213091 0
: 62 Minimum Test error found - save the configuration
: 62 | 17282.7 16168.9 0.00425731 0.00049969 212901 0
: 63 Minimum Test error found - save the configuration
: 63 | 17128.2 16024.3 0.00422187 0.00046485 212935 0
: 64 Minimum Test error found - save the configuration
: 64 | 16975.4 15879.6 0.00420436 0.000457532 213514 0
: 65 Minimum Test error found - save the configuration
: 65 | 16824 15736 0.00426041 0.000463621 210705 0
: 66 Minimum Test error found - save the configuration
: 66 | 16676.6 15590.7 0.00425865 0.00047824 211617 0
: 67 Minimum Test error found - save the configuration
: 67 | 16524.8 15450 0.00427613 0.000481631 210832 0
: 68 Minimum Test error found - save the configuration
: 68 | 16377.6 15309.3 0.00423534 0.000460361 211922 0
: 69 Minimum Test error found - save the configuration
: 69 | 16231.3 15169.2 0.00423118 0.00046593 212469 0
: 70 Minimum Test error found - save the configuration
: 70 | 16082.6 15034.2 0.00425327 0.000488 212468 0
: 71 Minimum Test error found - save the configuration
: 71 | 15940.7 14898.2 0.00424005 0.000468121 212093 0
: 72 Minimum Test error found - save the configuration
: 72 | 15797.8 14762.1 0.00429931 0.000464692 208626 0
: 73 Minimum Test error found - save the configuration
: 73 | 15656.4 14627.6 0.00431373 0.000491871 209322 0
: 74 Minimum Test error found - save the configuration
: 74 | 15515.9 14494.6 0.00425409 0.00046901 211356 0
: 75 Minimum Test error found - save the configuration
: 75 | 15376.6 14363.2 0.00427468 0.000462641 209862 0
: 76 Minimum Test error found - save the configuration
: 76 | 15237.8 14235 0.00432312 0.000472742 207772 0
: 77 Minimum Test error found - save the configuration
: 77 | 15104 14104.2 0.00429477 0.000474531 209411 0
: 78 Minimum Test error found - save the configuration
: 78 | 14968.6 13975.1 0.00436056 0.000468212 205532 0
: 79 Minimum Test error found - save the configuration
: 79 | 14833.7 13849 0.0042995 0.000468612 208829 0
: 80 Minimum Test error found - save the configuration
: 80 | 14699.2 13726.7 0.00434286 0.000483991 207315 0
: 81 Minimum Test error found - save the configuration
: 81 | 14571.7 13599.9 0.00433713 0.00046431 206568 0
: 82 Minimum Test error found - save the configuration
: 82 | 14438.2 13479.1 0.00426523 0.000465701 210552 0
: 83 Minimum Test error found - save the configuration
: 83 | 14309.8 13358 0.00425837 0.000473431 211364 0
: 84 Minimum Test error found - save the configuration
: 84 | 14182.9 13236.6 0.00432325 0.00047718 208005 0
: 85 Minimum Test error found - save the configuration
: 85 | 14054 13119.4 0.00430221 0.000473482 208947 0
: 86 Minimum Test error found - save the configuration
: 86 | 13929.8 13000.8 0.00428044 0.0004788 210436 0
: 87 Minimum Test error found - save the configuration
: 87 | 13805.6 12882.7 0.00428404 0.000470671 209788 0
: 88 Minimum Test error found - save the configuration
: 88 | 13681.7 12766.4 0.00429437 0.000469571 209161 0
: 89 Minimum Test error found - save the configuration
: 89 | 13559.3 12651 0.00431874 0.000494742 209205 0
: 90 Minimum Test error found - save the configuration
: 90 | 13437.3 12537.9 0.00430266 0.00047732 209132 0
: 91 Minimum Test error found - save the configuration
: 91 | 13317.7 12424.5 0.00435671 0.000470531 205858 0
: 92 Minimum Test error found - save the configuration
: 92 | 13198.5 12312.8 0.00443025 0.000506551 203889 0
: 93 Minimum Test error found - save the configuration
: 93 | 13078.9 12203.5 0.00430297 0.00047164 208805 0
: 94 Minimum Test error found - save the configuration
: 94 | 12964.1 12091.9 0.0044073 0.000504471 204980 0
: 95 Minimum Test error found - save the configuration
: 95 | 12845.3 11985 0.00439407 0.000568002 209092 0
: 96 Minimum Test error found - save the configuration
: 96 | 12732.6 11875.6 0.00438152 0.00048122 205113 0
: 97 Minimum Test error found - save the configuration
: 97 | 12617.4 11769.2 0.00432187 0.000490502 208803 0
: 98 Minimum Test error found - save the configuration
: 98 | 12504 11663.9 0.004322 0.000478011 208117 0
: 99 Minimum Test error found - save the configuration
: 99 | 12391 11560.7 0.00430106 0.000467601 208689 0
: 100 Minimum Test error found - save the configuration
: 100 | 12281.1 11456.6 0.00457322 0.000504232 196609 0
: 101 Minimum Test error found - save the configuration
: 101 | 12171 11352.7 0.00474809 0.00050375 188486 0
: 102 Minimum Test error found - save the configuration
: 102 | 12061.6 11249.9 0.0046796 0.000522131 192425 0
: 103 Minimum Test error found - save the configuration
: 103 | 11951.9 11151.2 0.00457422 0.000513781 197023 0
: 104 Minimum Test error found - save the configuration
: 104 | 11846.7 11048 0.00438604 0.000473721 204482 0
: 105 Minimum Test error found - save the configuration
: 105 | 11738.4 10950.3 0.00429921 0.00047128 208990 0
: 106 Minimum Test error found - save the configuration
: 106 | 11634.3 10852.2 0.00438134 0.00048233 205180 0
: 107 Minimum Test error found - save the configuration
: 107 | 11529.3 10753.5 0.00463881 0.000522891 194367 0
: 108 Minimum Test error found - save the configuration
: 108 | 11426.2 10656.2 0.004453 0.00048549 201638 0
: 109 Minimum Test error found - save the configuration
: 109 | 11322.2 10559.9 0.00471685 0.00050888 190115 0
: 110 Minimum Test error found - save the configuration
: 110 | 11218.8 10470.2 0.00434681 0.000487981 207317 0
: 111 Minimum Test error found - save the configuration
: 111 | 11120.3 10374 0.00438911 0.000487602 205049 0
: 112 Minimum Test error found - save the configuration
: 112 | 11019.8 10281.3 0.00448278 0.00050068 200899 0
: 113 Minimum Test error found - save the configuration
: 113 | 10921.4 10188.3 0.00449594 0.000498361 200121 0
: 114 Minimum Test error found - save the configuration
: 114 | 10821.6 10098 0.00451181 0.0005589 202383 0
: 115 Minimum Test error found - save the configuration
: 115 | 10724 10005.2 0.00448241 0.000495551 200659 0
: 116 Minimum Test error found - save the configuration
: 116 | 10627.7 9918.17 0.00450765 0.0005024 199738 0
: 117 Minimum Test error found - save the configuration
: 117 | 10532.6 9824.07 0.00435878 0.000479761 206238 0
: 118 Minimum Test error found - save the configuration
: 118 | 10436.3 9736.67 0.00440959 0.000492432 204230 0
: 119 Minimum Test error found - save the configuration
: 119 | 10343.2 9649.37 0.00430726 0.00046832 208391 0
: 120 Minimum Test error found - save the configuration
: 120 | 10249.5 9559.59 0.00428744 0.00047015 209573 0
: 121 Minimum Test error found - save the configuration
: 121 | 10156.2 9475.88 0.00429781 0.000492452 210230 0
: 122 Minimum Test error found - save the configuration
: 122 | 10063.3 9392.97 0.00443796 0.000487391 202503 0
: 123 Minimum Test error found - save the configuration
: 123 | 9973.47 9307.84 0.00477163 0.000627892 193062 0
: 124 Minimum Test error found - save the configuration
: 124 | 9884.32 9222.87 0.00440084 0.000487191 204413 0
: 125 Minimum Test error found - save the configuration
: 125 | 9794.37 9139.43 0.00441369 0.00049413 204105 0
: 126 Minimum Test error found - save the configuration
: 126 | 9705.96 9057.45 0.0044871 0.0004859 199940 0
: 127 Minimum Test error found - save the configuration
: 127 | 9618.39 8974.79 0.00445095 0.000505161 202748 0
: 128 Minimum Test error found - save the configuration
: 128 | 9530.16 8894.35 0.00442968 0.000489311 203027 0
: 129 Minimum Test error found - save the configuration
: 129 | 9444.29 8815.09 0.00444988 0.00050132 202606 0
: 130 Minimum Test error found - save the configuration
: 130 | 9358.52 8735.25 0.00493374 0.00054159 182143 0
: 131 Minimum Test error found - save the configuration
: 131 | 9273.59 8657.42 0.00467251 0.000532922 193256 0
: 132 Minimum Test error found - save the configuration
: 132 | 9190.43 8579.58 0.00532646 0.000693062 172659 0
: 133 Minimum Test error found - save the configuration
: 133 | 9107.06 8499.66 0.00451557 0.00047631 198056 0
: 134 Minimum Test error found - save the configuration
: 134 | 9022.58 8427.68 0.00513936 0.000491201 172111 0
: 135 Minimum Test error found - save the configuration
: 135 | 8942.05 8350.79 0.0050826 0.000582202 177762 0
: 136 Minimum Test error found - save the configuration
: 136 | 8862.15 8272.87 0.00522588 0.00051324 169756 0
: 137 Minimum Test error found - save the configuration
: 137 | 8780.06 8196.05 0.00487865 0.000497111 182584 0
: 138 Minimum Test error found - save the configuration
: 138 | 8700.08 8124.93 0.00461028 0.000485651 193957 0
: 139 Minimum Test error found - save the configuration
: 139 | 8622.1 8050.45 0.00464112 0.000569371 196476 0
: 140 Minimum Test error found - save the configuration
: 140 | 8543.98 7975.22 0.00556955 0.000581771 160392 0
: 141 Minimum Test error found - save the configuration
: 141 | 8465.64 7903.53 0.00443067 0.000484881 202748 0
: 142 Minimum Test error found - save the configuration
: 142 | 8388.15 7834.57 0.00431097 0.000469591 208259 0
: 143 Minimum Test error found - save the configuration
: 143 | 8312.26 7761.32 0.00431484 0.00047345 208258 0
: 144 Minimum Test error found - save the configuration
: 144 | 8236.37 7694.01 0.00433263 0.000495171 208471 0
: 145 Minimum Test error found - save the configuration
: 145 | 8162.57 7620.15 0.00437555 0.000475641 205133 0
: 146 Minimum Test error found - save the configuration
: 146 | 8085.82 7555.13 0.00433126 0.000476961 207561 0
: 147 Minimum Test error found - save the configuration
: 147 | 8015.01 7484.85 0.00432204 0.00047421 207910 0
: 148 Minimum Test error found - save the configuration
: 148 | 7940.87 7414.24 0.00432627 0.000482282 208117 0
: 149 Minimum Test error found - save the configuration
: 149 | 7867.52 7348.31 0.00432336 0.000474951 207878 0
: 150 Minimum Test error found - save the configuration
: 150 | 7796.76 7280.93 0.00432001 0.00047636 208136 0
: 151 Minimum Test error found - save the configuration
: 151 | 7725.49 7216.48 0.00435443 0.000476821 206313 0
: 152 Minimum Test error found - save the configuration
: 152 | 7655.6 7148.47 0.00431732 0.000473871 208146 0
: 153 Minimum Test error found - save the configuration
: 153 | 7584.97 7084.94 0.00431318 0.000482981 208867 0
: 154 Minimum Test error found - save the configuration
: 154 | 7514.76 7019.32 0.00439045 0.000484781 204831 0
: 155 Minimum Test error found - save the configuration
: 155 | 7448.26 6953.25 0.00435933 0.000480291 206237 0
: 156 Minimum Test error found - save the configuration
: 156 | 7379.09 6892.11 0.00438099 0.000484881 205333 0
: 157 Minimum Test error found - save the configuration
: 157 | 7312.91 6825.72 0.00438987 0.000488532 205058 0
: 158 Minimum Test error found - save the configuration
: 158 | 7244.8 6765.7 0.00433916 0.0004848 207557 0
: 159 Minimum Test error found - save the configuration
: 159 | 7179.09 6707.07 0.00429616 0.000477011 209471 0
: 160 Minimum Test error found - save the configuration
: 160 | 7112.08 6646.57 0.00431881 0.000477371 208255 0
: 161 Minimum Test error found - save the configuration
: 161 | 7048.16 6586.97 0.00434868 0.00048331 206966 0
: 162 Minimum Test error found - save the configuration
: 162 | 6984.28 6523.06 0.00438496 0.00048407 205082 0
: 163 Minimum Test error found - save the configuration
: 163 | 6920.03 6463.56 0.00433308 0.000475322 207374 0
: 164 Minimum Test error found - save the configuration
: 164 | 6857.16 6405.22 0.00432841 0.0004839 208089 0
: 165 Minimum Test error found - save the configuration
: 165 | 6794.27 6339.59 0.00431284 0.000468881 208119 0
: 166 Minimum Test error found - save the configuration
: 166 | 6731.9 6284.14 0.00429916 0.000470001 208923 0
: 167 Minimum Test error found - save the configuration
: 167 | 6670.06 6225.84 0.0043331 0.000500021 208710 0
: 168 Minimum Test error found - save the configuration
: 168 | 6607.9 6169.75 0.00447652 0.000487641 200558 0
: 169 Minimum Test error found - save the configuration
: 169 | 6547.9 6112.64 0.00436862 0.000478331 205640 0
: 170 Minimum Test error found - save the configuration
: 170 | 6488.87 6053.28 0.00435577 0.000481301 206480 0
: 171 Minimum Test error found - save the configuration
: 171 | 6429.44 5998.99 0.00438432 0.00048532 205181 0
: 172 Minimum Test error found - save the configuration
: 172 | 6369.61 5944.54 0.00436309 0.000496102 206879 0
: 173 Minimum Test error found - save the configuration
: 173 | 6311.06 5886.75 0.00432946 0.000478641 207748 0
: 174 Minimum Test error found - save the configuration
: 174 | 6252.83 5835.9 0.00439545 0.00049507 205108 0
: 175 Minimum Test error found - save the configuration
: 175 | 6196.69 5775.22 0.0043623 0.000477182 205914 0
: 176 Minimum Test error found - save the configuration
: 176 | 6139.03 5726.11 0.0043288 0.000467191 207168 0
: 177 Minimum Test error found - save the configuration
: 177 | 6082.9 5668.53 0.00433153 0.000487571 208119 0
: 178 Minimum Test error found - save the configuration
: 178 | 6026.21 5621.22 0.00433506 0.000476671 207341 0
: 179 Minimum Test error found - save the configuration
: 179 | 5971.32 5565.68 0.00433134 0.00046877 207116 0
: 180 Minimum Test error found - save the configuration
: 180 | 5916.64 5514.13 0.00433885 0.000475741 207087 0
: 181 Minimum Test error found - save the configuration
: 181 | 5862.06 5462.28 0.00433468 0.000475162 207280 0
: 182 Minimum Test error found - save the configuration
: 182 | 5807.81 5410.21 0.00441571 0.000479151 203223 0
: 183 Minimum Test error found - save the configuration
: 183 | 5754.93 5359.9 0.00435627 0.000484942 206647 0
: 184 Minimum Test error found - save the configuration
: 184 | 5701.86 5309.72 0.00432482 0.000479921 208068 0
: 185 Minimum Test error found - save the configuration
: 185 | 5649.29 5259.2 0.00439382 0.00048434 204631 0
: 186 Minimum Test error found - save the configuration
: 186 | 5597.22 5209.39 0.00434192 0.000487251 207541 0
: 187 Minimum Test error found - save the configuration
: 187 | 5545.29 5164.67 0.00457675 0.00049465 195978 0
: 188 Minimum Test error found - save the configuration
: 188 | 5495.17 5109.11 0.00465677 0.000529861 193850 0
: 189 Minimum Test error found - save the configuration
: 189 | 5444.5 5064.17 0.00454773 0.00049051 197179 0
: 190 Minimum Test error found - save the configuration
: 190 | 5393.3 5017.62 0.00448671 0.000523911 201878 0
: 191 Minimum Test error found - save the configuration
: 191 | 5343.81 4971.52 0.00449001 0.00052949 201994 0
: 192 Minimum Test error found - save the configuration
: 192 | 5294.64 4924.01 0.00448161 0.000494711 200657 0
: 193 Minimum Test error found - save the configuration
: 193 | 5246.27 4877.86 0.00462789 0.00050603 194087 0
: 194 Minimum Test error found - save the configuration
: 194 | 5197.23 4830.32 0.00467637 0.000523751 192650 0
: 195 Minimum Test error found - save the configuration
: 195 | 5150.53 4785.17 0.00521958 0.000650592 175093 0
: 196 Minimum Test error found - save the configuration
: 196 | 5102.23 4741.98 0.00496531 0.000495361 178973 0
: 197 Minimum Test error found - save the configuration
: 197 | 5054.9 4693.52 0.0047844 0.000497731 186625 0
: 198 Minimum Test error found - save the configuration
: 198 | 5009.27 4651.93 0.00442127 0.00050605 204331 0
: 199 Minimum Test error found - save the configuration
: 199 | 4962.98 4608.32 0.00442623 0.00048183 202819 0
: 200 Minimum Test error found - save the configuration
: 200 | 4916.42 4568.37 0.0044558 0.00050028 202249 0
: 201 Minimum Test error found - save the configuration
: 201 | 4872.1 4520.54 0.00436875 0.000484211 205945 0
: 202 Minimum Test error found - save the configuration
: 202 | 4826.62 4480.55 0.00445848 0.000520411 203145 0
: 203 Minimum Test error found - save the configuration
: 203 | 4782.81 4438.94 0.00441732 0.000497121 204071 0
: 204 Minimum Test error found - save the configuration
: 204 | 4737.73 4399.96 0.00502963 0.000498451 176555 0
: 205 Minimum Test error found - save the configuration
: 205 | 4695.26 4353.58 0.00472988 0.000627971 195031 0
: 206 Minimum Test error found - save the configuration
: 206 | 4652.46 4311.9 0.00470247 0.000501472 190431 0
: 207 Minimum Test error found - save the configuration
: 207 | 4608.67 4272.57 0.00437133 0.000484611 205829 0
: 208 Minimum Test error found - save the configuration
: 208 | 4566.71 4233.11 0.00441933 0.000483371 203254 0
: 209 Minimum Test error found - save the configuration
: 209 | 4523.61 4196.39 0.00444931 0.000504942 202821 0
: 210 Minimum Test error found - save the configuration
: 210 | 4482.93 4153.59 0.00436437 0.000479261 205915 0
: 211 Minimum Test error found - save the configuration
: 211 | 4442.78 4113.93 0.00468966 0.000504452 191149 0
: 212 Minimum Test error found - save the configuration
: 212 | 4400.08 4078.83 0.00460365 0.000537571 196750 0
: 213 Minimum Test error found - save the configuration
: 213 | 4360.94 4037.1 0.00458462 0.000544411 198010 0
: 214 Minimum Test error found - save the configuration
: 214 | 4321.27 3999.44 0.00452859 0.00051303 199225 0
: 215 Minimum Test error found - save the configuration
: 215 | 4280.31 3961.59 0.00457216 0.000505372 196715 0
: 216 Minimum Test error found - save the configuration
: 216 | 4241.41 3925.51 0.00459628 0.000512471 195896 0
: 217 Minimum Test error found - save the configuration
: 217 | 4202.99 3889.58 0.00459177 0.000523761 196656 0
: 218 Minimum Test error found - save the configuration
: 218 | 4163.81 3854.93 0.00455974 0.000517831 197926 0
: 219 Minimum Test error found - save the configuration
: 219 | 4127.11 3815.62 0.00446556 0.000505542 202019 0
: 220 Minimum Test error found - save the configuration
: 220 | 4088.16 3779.88 0.00446442 0.000494261 201503 0
: 221 Minimum Test error found - save the configuration
: 221 | 4050.32 3746.59 0.00439731 0.00047669 204050 0
: 222 Minimum Test error found - save the configuration
: 222 | 4014.51 3712.47 0.00442403 0.000525711 205217 0
: 223 Minimum Test error found - save the configuration
: 223 | 3977.25 3675.91 0.00434407 0.00048377 207238 0
: 224 Minimum Test error found - save the configuration
: 224 | 3941.24 3639.33 0.00440096 0.000481291 204099 0
: 225 Minimum Test error found - save the configuration
: 225 | 3904.63 3606.97 0.00441172 0.000494061 204204 0
: 226 Minimum Test error found - save the configuration
: 226 | 3869.92 3572.77 0.00444608 0.000488291 202133 0
: 227 Minimum Test error found - save the configuration
: 227 | 3833.71 3539.5 0.0045467 0.000494822 197439 0
: 228 Minimum Test error found - save the configuration
: 228 | 3799.27 3507.36 0.0045305 0.00048873 197933 0
: 229 Minimum Test error found - save the configuration
: 229 | 3764.7 3472.74 0.0044422 0.000498862 202874 0
: 230 Minimum Test error found - save the configuration
: 230 | 3729.71 3442.58 0.00446459 0.000516351 202622 0
: 231 Minimum Test error found - save the configuration
: 231 | 3696.43 3409.45 0.00439788 0.000515691 206069 0
: 232 Minimum Test error found - save the configuration
: 232 | 3663.12 3376.33 0.00444186 0.00048066 201959 0
: 233 Minimum Test error found - save the configuration
: 233 | 3629.63 3344.25 0.00503682 0.000719551 185302 0
: 234 Minimum Test error found - save the configuration
: 234 | 3596 3313.31 0.00474747 0.00049154 187973 0
: 235 Minimum Test error found - save the configuration
: 235 | 3563.43 3283.26 0.00436827 0.000483422 205928 0
: 236 Minimum Test error found - save the configuration
: 236 | 3531.17 3252.99 0.00440408 0.000488031 204288 0
: 237 Minimum Test error found - save the configuration
: 237 | 3498.93 3221.89 0.00440322 0.000476941 203755 0
: 238 Minimum Test error found - save the configuration
: 238 | 3467.83 3191.93 0.00438932 0.000501511 205772 0
: 239 Minimum Test error found - save the configuration
: 239 | 3436.44 3161.27 0.0044805 0.000512141 201595 0
: 240 Minimum Test error found - save the configuration
: 240 | 3404.82 3131.9 0.00457148 0.000512992 197118 0
: 241 Minimum Test error found - save the configuration
: 241 | 3373.18 3102.95 0.00448483 0.000495041 200512 0
: 242 Minimum Test error found - save the configuration
: 242 | 3344.06 3073.25 0.00439296 0.000492911 205126 0
: 243 Minimum Test error found - save the configuration
: 243 | 3312.76 3045.64 0.00444127 0.000485201 202221 0
: 244 Minimum Test error found - save the configuration
: 244 | 3282.55 3017.23 0.00462568 0.000527742 195220 0
: 245 Minimum Test error found - save the configuration
: 245 | 3253.14 2988.86 0.00450988 0.000485691 198798 0
: 246 Minimum Test error found - save the configuration
: 246 | 3223.15 2962.04 0.0045199 0.000510131 199513 0
: 247 Minimum Test error found - save the configuration
: 247 | 3195.62 2932.63 0.00441926 0.000479381 203052 0
: 248 Minimum Test error found - save the configuration
: 248 | 3165.42 2904.93 0.00445179 0.000514411 203181 0
: 249 Minimum Test error found - save the configuration
: 249 | 3136.35 2878.48 0.00570338 0.000692242 159644 0
: 250 Minimum Test error found - save the configuration
: 250 | 3107.56 2852.65 0.00617473 0.000655192 144940 0
: 251 Minimum Test error found - save the configuration
: 251 | 3080.47 2825.28 0.00467283 0.00048836 191183 0
: 252 Minimum Test error found - save the configuration
: 252 | 3052.15 2799.37 0.00446153 0.000496162 201747 0
: 253 Minimum Test error found - save the configuration
: 253 | 3024.81 2772.86 0.0044636 0.00049062 201360 0
: 254 Minimum Test error found - save the configuration
: 254 | 2997.19 2747.08 0.00483336 0.000614412 189621 0
: 255 Minimum Test error found - save the configuration
: 255 | 2969.51 2722.01 0.00500434 0.000495711 177438 0
: 256 Minimum Test error found - save the configuration
: 256 | 2943.03 2696.87 0.00455358 0.00050936 197813 0
: 257 Minimum Test error found - save the configuration
: 257 | 2916.46 2671.57 0.00459146 0.000488051 194960 0
: 258 Minimum Test error found - save the configuration
: 258 | 2890 2647.06 0.00443779 0.000493461 202823 0
: 259 Minimum Test error found - save the configuration
: 259 | 2863.98 2622.38 0.00468184 0.000506801 191615 0
: 260 Minimum Test error found - save the configuration
: 260 | 2838.22 2597.92 0.00449387 0.000498651 200239 0
: 261 Minimum Test error found - save the configuration
: 261 | 2811.87 2574.38 0.00454227 0.00049083 197461 0
: 262 Minimum Test error found - save the configuration
: 262 | 2787.34 2549.78 0.00445856 0.000542281 204276 0
: 263 Minimum Test error found - save the configuration
: 263 | 2760.99 2527.61 0.00581448 0.000626731 154209 0
: 264 Minimum Test error found - save the configuration
: 264 | 2737.24 2503.25 0.00543691 0.000690812 168559 0
: 265 Minimum Test error found - save the configuration
: 265 | 2711.72 2480.36 0.00568297 0.000545032 155704 0
: 266 Minimum Test error found - save the configuration
: 266 | 2687.66 2457.22 0.00440467 0.00047553 203607 0
: 267 Minimum Test error found - save the configuration
: 267 | 2663.56 2434.03 0.00447595 0.000509521 201693 0
: 268 Minimum Test error found - save the configuration
: 268 | 2638.92 2412.04 0.00438351 0.00047653 204762 0
: 269 Minimum Test error found - save the configuration
: 269 | 2614.96 2390.23 0.0046811 0.000507261 191670 0
: 270 Minimum Test error found - save the configuration
: 270 | 2591.22 2368.36 0.00467335 0.000524861 192841 0
: 271 Minimum Test error found - save the configuration
: 271 | 2568.27 2345.99 0.00450465 0.000492551 199397 0
: 272 Minimum Test error found - save the configuration
: 272 | 2544.98 2323.8 0.00437421 0.00047714 205283 0
: 273 Minimum Test error found - save the configuration
: 273 | 2521.74 2302.88 0.00446282 0.000493691 201556 0
: 274 Minimum Test error found - save the configuration
: 274 | 2499.26 2280.65 0.00435798 0.000470942 205812 0
: 275 Minimum Test error found - save the configuration
: 275 | 2475.39 2261 0.00480086 0.000497361 185895 0
: 276 Minimum Test error found - save the configuration
: 276 | 2453.46 2240.42 0.00445932 0.000501131 202113 0
: 277 Minimum Test error found - save the configuration
: 277 | 2431.77 2219.4 0.00446941 0.0005066 201877 0
: 278 Minimum Test error found - save the configuration
: 278 | 2409.25 2199.06 0.00442468 0.000483801 203000 0
: 279 Minimum Test error found - save the configuration
: 279 | 2387.33 2179.05 0.00442588 0.000503891 203978 0
: 280 Minimum Test error found - save the configuration
: 280 | 2365.79 2159 0.00445135 0.000478482 201366 0
: 281 Minimum Test error found - save the configuration
: 281 | 2344.38 2138.66 0.00464729 0.00050515 193137 0
: 282 Minimum Test error found - save the configuration
: 282 | 2323 2118.88 0.00441466 0.000512221 205000 0
: 283 Minimum Test error found - save the configuration
: 283 | 2301.32 2099.66 0.00455185 0.00049334 197117 0
: 284 Minimum Test error found - save the configuration
: 284 | 2280.16 2080.69 0.00441535 0.000526101 205695 0
: 285 Minimum Test error found - save the configuration
: 285 | 2259.4 2061.74 0.00450678 0.000490892 199209 0
: 286 Minimum Test error found - save the configuration
: 286 | 2239.34 2042.2 0.00442905 0.00048717 202949 0
: 287 Minimum Test error found - save the configuration
: 287 | 2218.81 2023.02 0.00447198 0.000593772 206281 0
: 288 Minimum Test error found - save the configuration
: 288 | 2197.69 2004.97 0.00440053 0.00047489 203789 0
: 289 Minimum Test error found - save the configuration
: 289 | 2177.53 1986.99 0.00435156 0.000477291 206491 0
: 290 Minimum Test error found - save the configuration
: 290 | 2158.22 1968.07 0.0045301 0.000487441 197890 0
: 291 Minimum Test error found - save the configuration
: 291 | 2138.12 1950.29 0.00439287 0.000481891 204552 0
: 292 Minimum Test error found - save the configuration
: 292 | 2118.28 1932.63 0.00444581 0.000490012 202235 0
: 293 Minimum Test error found - save the configuration
: 293 | 2098.81 1914.75 0.00448335 0.00051077 201381 0
: 294 Minimum Test error found - save the configuration
: 294 | 2078.95 1898.14 0.00449194 0.000487432 199775 0
: 295 Minimum Test error found - save the configuration
: 295 | 2060.62 1880.33 0.00448877 0.000487 199912 0
: 296 Minimum Test error found - save the configuration
: 296 | 2041.57 1862.64 0.00446724 0.000557411 204613 0
: 297 Minimum Test error found - save the configuration
: 297 | 2022.07 1846.4 0.00437782 0.000477992 205137 0
: 298 Minimum Test error found - save the configuration
: 298 | 2004.5 1827.92 0.00437903 0.000515271 207052 0
: 299 Minimum Test error found - save the configuration
: 299 | 1984.72 1811.65 0.0045732 0.000490172 195933 0
: 300 Minimum Test error found - save the configuration
: 300 | 1966.46 1795.34 0.0045865 0.000587581 200054 0
: 301 Minimum Test error found - save the configuration
: 301 | 1948.29 1778.91 0.00470465 0.000511591 190792 0
: 302 Minimum Test error found - save the configuration
: 302 | 1930.13 1762.63 0.0044518 0.00049181 202021 0
: 303 Minimum Test error found - save the configuration
: 303 | 1912.19 1746.71 0.00450856 0.000501921 199669 0
: 304 Minimum Test error found - save the configuration
: 304 | 1894.29 1730.86 0.00499316 0.00048693 177532 0
: 305 Minimum Test error found - save the configuration
: 305 | 1876.79 1715.32 0.00462268 0.00047931 193080 0
: 306 Minimum Test error found - save the configuration
: 306 | 1859.36 1698.89 0.00439759 0.00049273 204873 0
: 307 Minimum Test error found - save the configuration
: 307 | 1841.58 1683.71 0.00435551 0.000480302 206441 0
: 308 Minimum Test error found - save the configuration
: 308 | 1824.91 1667.62 0.00436278 0.000477411 205901 0
: 309 Minimum Test error found - save the configuration
: 309 | 1807.5 1652.24 0.00436318 0.00048327 206191 0
: 310 Minimum Test error found - save the configuration
: 310 | 1790.65 1637.13 0.00434044 0.000479151 207185 0
: 311 Minimum Test error found - save the configuration
: 311 | 1773.27 1622.65 0.00435921 0.000478581 206152 0
: 312 Minimum Test error found - save the configuration
: 312 | 1757.15 1607.38 0.00435653 0.000502521 207576 0
: 313 Minimum Test error found - save the configuration
: 313 | 1740.3 1593.08 0.00435198 0.000468191 205985 0
: 314 Minimum Test error found - save the configuration
: 314 | 1723.65 1578.98 0.0043417 0.00047445 206865 0
: 315 Minimum Test error found - save the configuration
: 315 | 1707.46 1564.55 0.0043235 0.000474061 207823 0
: 316 Minimum Test error found - save the configuration
: 316 | 1691.56 1550.19 0.00432266 0.000468202 207552 0
: 317 Minimum Test error found - save the configuration
: 317 | 1675.33 1536.16 0.00443988 0.000491801 202630 0
: 318 Minimum Test error found - save the configuration
: 318 | 1659.72 1522 0.00432332 0.000480241 208167 0
: 319 Minimum Test error found - save the configuration
: 319 | 1644.01 1507.78 0.00433555 0.000470911 207005 0
: 320 Minimum Test error found - save the configuration
: 320 | 1627.91 1494.22 0.0043426 0.000483701 207313 0
: 321 Minimum Test error found - save the configuration
: 321 | 1612.91 1480.33 0.00435476 0.00047923 206424 0
: 322 Minimum Test error found - save the configuration
: 322 | 1597.72 1466.74 0.00443826 0.000484741 202351 0
: 323 Minimum Test error found - save the configuration
: 323 | 1582.01 1453.51 0.00441258 0.000486511 203766 0
: 324 Minimum Test error found - save the configuration
: 324 | 1567.36 1439.41 0.00435153 0.000469851 206096 0
: 325 Minimum Test error found - save the configuration
: 325 | 1551.93 1426.56 0.00438702 0.000507661 206220 0
: 326 Minimum Test error found - save the configuration
: 326 | 1537.45 1413.17 0.00437157 0.00047906 205523 0
: 327 Minimum Test error found - save the configuration
: 327 | 1522.81 1399.81 0.0043672 0.000477641 205679 0
: 328 Minimum Test error found - save the configuration
: 328 | 1508 1386.85 0.0043742 0.000487001 205804 0
: 329 Minimum Test error found - save the configuration
: 329 | 1493.47 1374.98 0.00433268 0.000469511 207084 0
: 330 Minimum Test error found - save the configuration
: 330 | 1479.32 1361.98 0.00436304 0.000476691 205849 0
: 331 Minimum Test error found - save the configuration
: 331 | 1464.93 1349.44 0.00434454 0.000477461 206875 0
: 332 Minimum Test error found - save the configuration
: 332 | 1450.99 1336.83 0.00432262 0.0004705 207678 0
: 333 Minimum Test error found - save the configuration
: 333 | 1436.89 1324.78 0.00434398 0.000477952 206931 0
: 334 Minimum Test error found - save the configuration
: 334 | 1423.19 1313.03 0.00433797 0.000478371 207276 0
: 335 Minimum Test error found - save the configuration
: 335 | 1409.81 1300.05 0.00437863 0.00047557 204968 0
: 336 Minimum Test error found - save the configuration
: 336 | 1396.05 1288.48 0.00438295 0.000487981 205393 0
: 337 Minimum Test error found - save the configuration
: 337 | 1382.18 1276.4 0.00434725 0.000480701 206903 0
: 338 Minimum Test error found - save the configuration
: 338 | 1369.53 1264.1 0.00435862 0.0004783 206169 0
: 339 Minimum Test error found - save the configuration
: 339 | 1355.78 1252.78 0.00439175 0.000486552 204855 0
: 340 Minimum Test error found - save the configuration
: 340 | 1343.01 1240.94 0.00443754 0.00047655 201970 0
: 341 Minimum Test error found - save the configuration
: 341 | 1329.84 1229.87 0.00435027 0.000478381 206618 0
: 342 Minimum Test error found - save the configuration
: 342 | 1317.53 1217.97 0.00434256 0.000475292 206864 0
: 343 Minimum Test error found - save the configuration
: 343 | 1304.51 1206.44 0.00433814 0.00046789 206705 0
: 344 Minimum Test error found - save the configuration
: 344 | 1291.53 1195.5 0.00434778 0.00047356 206493 0
: 345 Minimum Test error found - save the configuration
: 345 | 1279.41 1184.71 0.00440677 0.000485 203990 0
: 346 Minimum Test error found - save the configuration
: 346 | 1267.71 1173.44 0.0043402 0.000474561 206952 0
: 347 Minimum Test error found - save the configuration
: 347 | 1254.68 1162.23 0.00436226 0.000486511 206412 0
: 348 Minimum Test error found - save the configuration
: 348 | 1242.5 1151.62 0.00434263 0.000478631 207040 0
: 349 Minimum Test error found - save the configuration
: 349 | 1230.76 1140.69 0.00440101 0.00048548 204315 0
: 350 Minimum Test error found - save the configuration
: 350 | 1218.8 1130.21 0.00436392 0.000479802 205967 0
: 351 Minimum Test error found - save the configuration
: 351 | 1206.96 1119.38 0.00438762 0.000486781 205084 0
: 352 Minimum Test error found - save the configuration
: 352 | 1195.64 1108.43 0.00442473 0.00049267 203456 0
: 353 Minimum Test error found - save the configuration
: 353 | 1183.64 1097.99 0.00434093 0.000479662 207186 0
: 354 Minimum Test error found - save the configuration
: 354 | 1172.26 1087.6 0.00432811 0.00047655 207708 0
: 355 Minimum Test error found - save the configuration
: 355 | 1160.81 1077.3 0.00434042 0.000483241 207406 0
: 356 Minimum Test error found - save the configuration
: 356 | 1149.55 1067.45 0.0043368 0.000482502 207561 0
: 357 Minimum Test error found - save the configuration
: 357 | 1138.46 1057.28 0.00437936 0.00049469 205938 0
: 358 Minimum Test error found - save the configuration
: 358 | 1127.41 1047.23 0.00438119 0.000485 205329 0
: 359 Minimum Test error found - save the configuration
: 359 | 1116.36 1037.75 0.00436803 0.000471271 205299 0
: 360 Minimum Test error found - save the configuration
: 360 | 1105.7 1027.72 0.00434188 0.00047593 206935 0
: 361 Minimum Test error found - save the configuration
: 361 | 1094.93 1018 0.00437152 0.00048368 205770 0
: 362 Minimum Test error found - save the configuration
: 362 | 1083.98 1008.42 0.00441241 0.000517622 205403 0
: 363 Minimum Test error found - save the configuration
: 363 | 1073.48 998.814 0.00437362 0.00048799 205887 0
: 364 Minimum Test error found - save the configuration
: 364 | 1063.3 989.829 0.00433538 0.00047785 207387 0
: 365 Minimum Test error found - save the configuration
: 365 | 1052.83 979.771 0.0043277 0.000475111 207653 0
: 366 Minimum Test error found - save the configuration
: 366 | 1042.17 970.6 0.0043352 0.000482341 207638 0
: 367 Minimum Test error found - save the configuration
: 367 | 1032.22 962.012 0.00433429 0.000476661 207381 0
: 368 Minimum Test error found - save the configuration
: 368 | 1022.34 952.076 0.0044111 0.000486202 203827 0
: 369 Minimum Test error found - save the configuration
: 369 | 1011.92 943.376 0.00436267 0.000481431 206120 0
: 370 Minimum Test error found - save the configuration
: 370 | 1002.21 934.056 0.00434287 0.000471261 206633 0
: 371 Minimum Test error found - save the configuration
: 371 | 992.503 924.84 0.00435077 0.000475312 206427 0
: 372 Minimum Test error found - save the configuration
: 372 | 982.324 916.386 0.00434773 0.000477401 206701 0
: 373 Minimum Test error found - save the configuration
: 373 | 973.525 906.869 0.00434957 0.000469212 206167 0
: 374 Minimum Test error found - save the configuration
: 374 | 963.069 898.388 0.00442196 0.00049773 203862 0
: 375 Minimum Test error found - save the configuration
: 375 | 954.147 889.898 0.00434924 0.00047862 206685 0
: 376 Minimum Test error found - save the configuration
: 376 | 944.6 881.071 0.00437844 0.000488292 205648 0
: 377 Minimum Test error found - save the configuration
: 377 | 935.1 872.674 0.00439927 0.000483871 204322 0
: 378 Minimum Test error found - save the configuration
: 378 | 925.979 864.377 0.00443365 0.000477621 202223 0
: 379 Minimum Test error found - save the configuration
: 379 | 916.845 855.793 0.00456675 0.000496861 196566 0
: 380 Minimum Test error found - save the configuration
: 380 | 907.987 847.348 0.00445566 0.00048273 201363 0
: 381 Minimum Test error found - save the configuration
: 381 | 899.045 839.005 0.00593246 0.000710372 153195 0
: 382 Minimum Test error found - save the configuration
: 382 | 890.008 830.577 0.00633609 0.000707142 142122 0
: 383 Minimum Test error found - save the configuration
: 383 | 880.929 822.963 0.00631672 0.000714542 142802 0
: 384 Minimum Test error found - save the configuration
: 384 | 872.653 814.97 0.0063373 0.00070194 141961 0
: 385 Minimum Test error found - save the configuration
: 385 | 863.889 807.102 0.0063544 0.00070991 141731 0
: 386 Minimum Test error found - save the configuration
: 386 | 855.316 799.157 0.00632437 0.00070586 142386 0
: 387 Minimum Test error found - save the configuration
: 387 | 846.964 790.839 0.00604005 0.000491562 144183 0
: 388 Minimum Test error found - save the configuration
: 388 | 838.146 783.4 0.00442873 0.000513011 204305 0
: 389 Minimum Test error found - save the configuration
: 389 | 830.099 775.56 0.00435266 0.000480022 206578 0
: 390 Minimum Test error found - save the configuration
: 390 | 821.675 768.089 0.00434759 0.000472611 206453 0
: 391 Minimum Test error found - save the configuration
: 391 | 813.608 760.326 0.00434609 0.0004794 206895 0
: 392 Minimum Test error found - save the configuration
: 392 | 805.665 752.7 0.00441653 0.000488652 203672 0
: 393 Minimum Test error found - save the configuration
: 393 | 797.361 745.226 0.00440755 0.000488121 204111 0
: 394 Minimum Test error found - save the configuration
: 394 | 789.738 738.206 0.00444054 0.000490401 202525 0
: 395 Minimum Test error found - save the configuration
: 395 | 781.676 730.71 0.00439625 0.000476132 204076 0
: 396 Minimum Test error found - save the configuration
: 396 | 773.719 723.452 0.00438073 0.00048588 205400 0
: 397 Minimum Test error found - save the configuration
: 397 | 765.832 716.321 0.0045405 0.000486892 197355 0
: 398 Minimum Test error found - save the configuration
: 398 | 758.512 708.917 0.00450973 0.00049752 199391 0
: 399 Minimum Test error found - save the configuration
: 399 | 750.759 701.576 0.00446775 0.00047595 200411 0
: 400 Minimum Test error found - save the configuration
: 400 | 743.081 694.87 0.00446375 0.00048964 201303 0
: 401 Minimum Test error found - save the configuration
: 401 | 735.649 687.896 0.00446464 0.000481001 200822 0
: 402 Minimum Test error found - save the configuration
: 402 | 728.123 681.145 0.00450061 0.000526342 201295 0
: 403 Minimum Test error found - save the configuration
: 403 | 720.936 673.928 0.0044556 0.00047747 201100 0
: 404 Minimum Test error found - save the configuration
: 404 | 713.668 667.172 0.00452458 0.000549212 201239 0
: 405 Minimum Test error found - save the configuration
: 405 | 706.572 660.221 0.00448477 0.000479391 199732 0
: 406 Minimum Test error found - save the configuration
: 406 | 699.411 653.869 0.00449653 0.000494161 199882 0
: 407 Minimum Test error found - save the configuration
: 407 | 692.321 646.69 0.00451335 0.00051949 200308 0
: 408 Minimum Test error found - save the configuration
: 408 | 685.13 640.212 0.00448419 0.00049226 200404 0
: 409 Minimum Test error found - save the configuration
: 409 | 678.459 633.819 0.00445183 0.00047708 201271 0
: 410 Minimum Test error found - save the configuration
: 410 | 671.32 627.25 0.00451832 0.000503411 199257 0
: 411 Minimum Test error found - save the configuration
: 411 | 664.705 621.576 0.0044772 0.000484822 200382 0
: 412 Minimum Test error found - save the configuration
: 412 | 658.169 614.973 0.00454913 0.000520611 198584 0
: 413 Minimum Test error found - save the configuration
: 413 | 651.39 608.348 0.00449067 0.000519641 201459 0
: 414 Minimum Test error found - save the configuration
: 414 | 644.584 602.028 0.00448813 0.000496891 200439 0
: 415 Minimum Test error found - save the configuration
: 415 | 637.865 595.885 0.00446106 0.000475961 200748 0
: 416 Minimum Test error found - save the configuration
: 416 | 631.41 589.625 0.00452841 0.00049796 198489 0
: 417 Minimum Test error found - save the configuration
: 417 | 625.296 583.77 0.00447078 0.000477141 200319 0
: 418 Minimum Test error found - save the configuration
: 418 | 618.823 577.296 0.00460935 0.00053842 196515 0
: 419 Minimum Test error found - save the configuration
: 419 | 611.751 571.783 0.00450035 0.000483171 199145 0
: 420 Minimum Test error found - save the configuration
: 420 | 606.032 565.372 0.00447129 0.00048927 200903 0
: 421 Minimum Test error found - save the configuration
: 421 | 599.891 559.843 0.00452165 0.000535011 200670 0
: 422 Minimum Test error found - save the configuration
: 422 | 593.553 553.816 0.00452854 0.000488821 198034 0
: 423 Minimum Test error found - save the configuration
: 423 | 587.693 547.688 0.00452148 0.000525711 200212 0
: 424 Minimum Test error found - save the configuration
: 424 | 581.192 542.234 0.00444835 0.000530232 204180 0
: 425 Minimum Test error found - save the configuration
: 425 | 575.457 536.553 0.00444477 0.00047623 201586 0
: 426 Minimum Test error found - save the configuration
: 426 | 569.309 530.723 0.00446022 0.000489412 201470 0
: 427 Minimum Test error found - save the configuration
: 427 | 563.967 524.82 0.00446369 0.00048045 200842 0
: 428 Minimum Test error found - save the configuration
: 428 | 557.536 519.57 0.00449196 0.00049127 199966 0
: 429 Minimum Test error found - save the configuration
: 429 | 551.686 514.334 0.00452207 0.000528871 200341 0
: 430 Minimum Test error found - save the configuration
: 430 | 546.645 508.586 0.00447662 0.00050784 201573 0
: 431 Minimum Test error found - save the configuration
: 431 | 540.548 504.344 0.00447441 0.000477712 200165 0
: 432 Minimum Test error found - save the configuration
: 432 | 535.672 498.995 0.00453793 0.00053903 200055 0
: 433 Minimum Test error found - save the configuration
: 433 | 529.629 492.809 0.00439886 0.000481702 204230 0
: 434 Minimum Test error found - save the configuration
: 434 | 524.055 487.307 0.0043595 0.00047808 206110 0
: 435 Minimum Test error found - save the configuration
: 435 | 518.302 482.416 0.00436685 0.00048069 205859 0
: 436 Minimum Test error found - save the configuration
: 436 | 513.106 477.285 0.00435685 0.000473082 205986 0
: 437 Minimum Test error found - save the configuration
: 437 | 508.136 471.97 0.0043636 0.000487571 206397 0
: 438 Minimum Test error found - save the configuration
: 438 | 502.495 467.141 0.00438945 0.000513461 206399 0
: 439 Minimum Test error found - save the configuration
: 439 | 497.24 462.314 0.00447117 0.000499342 201419 0
: 440 Minimum Test error found - save the configuration
: 440 | 492.439 456.765 0.00438374 0.00047938 204899 0
: 441 Minimum Test error found - save the configuration
: 441 | 486.943 452.022 0.00440214 0.000489101 204445 0
: 442 Minimum Test error found - save the configuration
: 442 | 482.169 447.168 0.00442435 0.00050478 204104 0
: 443 Minimum Test error found - save the configuration
: 443 | 476.96 442.649 0.00436999 0.000471311 205198 0
: 444 Minimum Test error found - save the configuration
: 444 | 472.052 437.491 0.00443251 0.000506391 203764 0
: 445 Minimum Test error found - save the configuration
: 445 | 466.912 432.825 0.00439446 0.000492531 205027 0
: 446 Minimum Test error found - save the configuration
: 446 | 462.276 428.477 0.00436152 0.00047588 205886 0
: 447 Minimum Test error found - save the configuration
: 447 | 457.536 423.719 0.00438972 0.000486462 204957 0
: 448 Minimum Test error found - save the configuration
: 448 | 452.587 419.621 0.00440331 0.00048921 204389 0
: 449 Minimum Test error found - save the configuration
: 449 | 447.805 414.896 0.00436603 0.00048722 206249 0
: 450 Minimum Test error found - save the configuration
: 450 | 443.034 410.013 0.00438374 0.00048344 205112 0
: 451 Minimum Test error found - save the configuration
: 451 | 438.574 405.548 0.004368 0.000476471 205575 0
: 452 Minimum Test error found - save the configuration
: 452 | 433.984 401.471 0.00440653 0.000508892 205253 0
: 453 Minimum Test error found - save the configuration
: 453 | 429.477 397.197 0.00436967 0.000480141 205681 0
: 454 Minimum Test error found - save the configuration
: 454 | 425.071 392.42 0.00437326 0.00048123 205548 0
: 455 Minimum Test error found - save the configuration
: 455 | 420.543 387.931 0.0044378 0.000503101 203319 0
: 456 Minimum Test error found - save the configuration
: 456 | 415.738 383.774 0.00439854 0.00047073 203676 0
: 457 Minimum Test error found - save the configuration
: 457 | 411.594 379.762 0.0043824 0.000486151 205326 0
: 458 Minimum Test error found - save the configuration
: 458 | 407.548 375.408 0.00440501 0.000495491 204629 0
: 459 Minimum Test error found - save the configuration
: 459 | 402.999 371.063 0.0044233 0.0004833 203046 0
: 460 Minimum Test error found - save the configuration
: 460 | 398.67 367.118 0.00445064 0.000490331 202005 0
: 461 Minimum Test error found - save the configuration
: 461 | 394.379 363.081 0.00450502 0.00050124 199811 0
: 462 Minimum Test error found - save the configuration
: 462 | 390.387 359.098 0.00445477 0.00048695 201622 0
: 463 Minimum Test error found - save the configuration
: 463 | 386.316 355.201 0.00438683 0.00048162 204855 0
: 464 Minimum Test error found - save the configuration
: 464 | 382.266 351.155 0.00437633 0.000485341 205603 0
: 465 Minimum Test error found - save the configuration
: 465 | 378.192 347.2 0.00444585 0.000479182 201681 0
: 466 Minimum Test error found - save the configuration
: 466 | 374.453 342.994 0.00452617 0.000497131 198559 0
: 467 Minimum Test error found - save the configuration
: 467 | 370.064 339.414 0.0044668 0.000474271 200374 0
: 468 Minimum Test error found - save the configuration
: 468 | 366.218 335.724 0.00459232 0.000497591 195373 0
: 469 Minimum Test error found - save the configuration
: 469 | 362.36 331.64 0.00461308 0.000538181 196324 0
: 470 Minimum Test error found - save the configuration
: 470 | 358.373 328.334 0.00466404 0.000480561 191228 0
: 471 Minimum Test error found - save the configuration
: 471 | 354.991 324.234 0.0045414 0.000497061 197807 0
: 472 Minimum Test error found - save the configuration
: 472 | 350.984 321.369 0.00461502 0.000483741 193645 0
: 473 Minimum Test error found - save the configuration
: 473 | 347.098 317.248 0.00450525 0.000508572 200166 0
: 474 Minimum Test error found - save the configuration
: 474 | 343.248 313.546 0.0044648 0.00051429 202506 0
: 475 Minimum Test error found - save the configuration
: 475 | 339.719 310.211 0.00453415 0.000489451 197790 0
: 476 Minimum Test error found - save the configuration
: 476 | 335.895 306.742 0.00444035 0.00047295 201643 0
: 477 Minimum Test error found - save the configuration
: 477 | 332.658 303.118 0.00451901 0.00050006 199057 0
: 478 Minimum Test error found - save the configuration
: 478 | 328.874 299.891 0.00451644 0.00048142 198264 0
: 479 Minimum Test error found - save the configuration
: 479 | 325.443 296.708 0.00465523 0.000554591 195092 0
: 480 Minimum Test error found - save the configuration
: 480 | 321.83 292.64 0.00447299 0.000500642 201392 0
: 481 Minimum Test error found - save the configuration
: 481 | 318.457 289.305 0.00446401 0.000487791 201196 0
: 482 Minimum Test error found - save the configuration
: 482 | 314.714 286.076 0.00461213 0.000492692 194201 0
: 483 Minimum Test error found - save the configuration
: 483 | 311.477 282.608 0.0045546 0.00051307 197945 0
: 484 Minimum Test error found - save the configuration
: 484 | 308.038 279.41 0.00458493 0.000547932 198167 0
: 485 Minimum Test error found - save the configuration
: 485 | 305.019 276.247 0.00452664 0.000479991 197695 0
: 486 Minimum Test error found - save the configuration
: 486 | 301.631 273.115 0.00458909 0.000493931 195353 0
: 487 Minimum Test error found - save the configuration
: 487 | 298.326 270.034 0.00445355 0.000473481 201002 0
: 488 Minimum Test error found - save the configuration
: 488 | 295.06 266.816 0.00465954 0.000494892 192093 0
: 489 Minimum Test error found - save the configuration
: 489 | 291.748 263.972 0.00455824 0.000537291 198958 0
: 490 Minimum Test error found - save the configuration
: 490 | 288.651 260.874 0.00450928 0.000492712 199175 0
: 491 Minimum Test error found - save the configuration
: 491 | 285.623 257.939 0.00446541 0.000479441 200704 0
: 492 Minimum Test error found - save the configuration
: 492 | 282.716 254.715 0.00450321 0.000488532 199269 0
: 493 Minimum Test error found - save the configuration
: 493 | 279.601 251.996 0.00449009 0.00049389 200190 0
: 494 Minimum Test error found - save the configuration
: 494 | 276.33 249.538 0.00450683 0.000532531 201293 0
: 495 Minimum Test error found - save the configuration
: 495 | 273.601 246.326 0.00451492 0.00049277 198899 0
: 496 Minimum Test error found - save the configuration
: 496 | 270.496 243.551 0.00449892 0.000479441 199031 0
: 497 Minimum Test error found - save the configuration
: 497 | 267.549 240.797 0.00454731 0.00050175 197748 0
: 498 Minimum Test error found - save the configuration
: 498 | 264.491 237.997 0.00444191 0.00047525 201681 0
: 499 Minimum Test error found - save the configuration
: 499 | 261.691 235.243 0.00452627 0.000515591 199468 0
: 500 Minimum Test error found - save the configuration
: 500 | 258.907 233.387 0.00448987 0.00052049 201543 0
: 501 Minimum Test error found - save the configuration
: 501 | 256.071 230.093 0.00442116 0.000478021 202884 0
: 502 Minimum Test error found - save the configuration
: 502 | 253.315 227.547 0.00443866 0.00047974 202075 0
: 503 Minimum Test error found - save the configuration
: 503 | 250.26 224.857 0.00444915 0.000476191 201361 0
: 504 Minimum Test error found - save the configuration
: 504 | 247.928 222.502 0.00443091 0.00048182 202578 0
: 505 Minimum Test error found - save the configuration
: 505 | 245.26 219.37 0.00442864 0.00048622 202921 0
: 506 Minimum Test error found - save the configuration
: 506 | 242.379 217.703 0.00438004 0.000485662 205424 0
: 507 Minimum Test error found - save the configuration
: 507 | 239.969 215.304 0.0043263 0.00047525 207736 0
: 508 Minimum Test error found - save the configuration
: 508 | 237.074 213.181 0.00437948 0.000480691 205192 0
: 509 Minimum Test error found - save the configuration
: 509 | 234.506 210.122 0.00445256 0.000485131 201642 0
: 510 Minimum Test error found - save the configuration
: 510 | 231.687 208.27 0.00443398 0.00047529 202087 0
: 511 Minimum Test error found - save the configuration
: 511 | 229.44 206.248 0.00448741 0.000484801 199870 0
: 512 Minimum Test error found - save the configuration
: 512 | 226.703 202.733 0.00445976 0.000491141 201582 0
: 513 Minimum Test error found - save the configuration
: 513 | 224.205 201.356 0.00456384 0.000568682 200242 0
: 514 Minimum Test error found - save the configuration
: 514 | 221.733 199.064 0.0045659 0.00049646 196587 0
: 515 Minimum Test error found - save the configuration
: 515 | 219.461 196.099 0.00451471 0.000489142 198730 0
: 516 Minimum Test error found - save the configuration
: 516 | 216.737 194.515 0.00443932 0.00047832 201969 0
: 517 Minimum Test error found - save the configuration
: 517 | 214.376 191.891 0.00454118 0.000487531 197353 0
: 518 Minimum Test error found - save the configuration
: 518 | 212.239 190.111 0.00448552 0.000523762 201931 0
: 519 Minimum Test error found - save the configuration
: 519 | 209.716 187.182 0.0044879 0.00049015 200113 0
: 520 Minimum Test error found - save the configuration
: 520 | 207.579 185.048 0.00443259 0.000478712 202333 0
: 521 Minimum Test error found - save the configuration
: 521 | 205.321 182.913 0.00507384 0.000502422 175000 0
: 522 Minimum Test error found - save the configuration
: 522 | 203.207 182.091 0.00441385 0.000485681 203657 0
: 523 Minimum Test error found - save the configuration
: 523 | 200.902 178.998 0.00433999 0.00047375 206920 0
: 524 Minimum Test error found - save the configuration
: 524 | 198.364 177.173 0.00434424 0.000482631 207168 0
: 525 Minimum Test error found - save the configuration
: 525 | 196.164 175.958 0.00444298 0.0004912 202441 0
: 526 Minimum Test error found - save the configuration
: 526 | 194.334 173.32 0.00445763 0.000480392 201145 0
: 527 Minimum Test error found - save the configuration
: 527 | 191.888 171.065 0.00445653 0.000484262 201396 0
: 528 Minimum Test error found - save the configuration
: 528 | 189.648 169.216 0.00462032 0.000535351 195840 0
: 529 Minimum Test error found - save the configuration
: 529 | 187.581 166.92 0.00447151 0.000531842 203063 0
: 530 Minimum Test error found - save the configuration
: 530 | 185.314 164.578 0.0044498 0.000483041 201676 0
: 531 Minimum Test error found - save the configuration
: 531 | 183.348 163.035 0.00445776 0.000484182 201330 0
: 532 Minimum Test error found - save the configuration
: 532 | 181.222 161.494 0.00444945 0.00048174 201628 0
: 533 Minimum Test error found - save the configuration
: 533 | 179.508 158.695 0.00444833 0.000482131 201705 0
: 534 Minimum Test error found - save the configuration
: 534 | 177.218 157.46 0.00454842 0.0005289 199029 0
: 535 Minimum Test error found - save the configuration
: 535 | 175.206 155.057 0.00454493 0.000504471 197997 0
: 536 Minimum Test error found - save the configuration
: 536 | 173.154 154.245 0.00452113 0.00048946 198429 0
: 537 Minimum Test error found - save the configuration
: 537 | 171.213 151.505 0.00447394 0.000491471 200881 0
: 538 Minimum Test error found - save the configuration
: 538 | 169.148 149.647 0.00445761 0.000480511 201152 0
: 539 Minimum Test error found - save the configuration
: 539 | 167.211 148.785 0.00458921 0.000531001 197131 0
: 540 Minimum Test error found - save the configuration
: 540 | 165.633 146.285 0.00453334 0.000541861 200427 0
: 541 Minimum Test error found - save the configuration
: 541 | 163.492 145.42 0.00443115 0.000478671 202405 0
: 542 Minimum Test error found - save the configuration
: 542 | 161.636 143.186 0.00453808 0.000534322 199812 0
: 543 Minimum Test error found - save the configuration
: 543 | 159.729 142.169 0.00447058 0.00047614 200278 0
: 544 Minimum Test error found - save the configuration
: 544 | 158.113 140.799 0.004528 0.000496101 198418 0
: 545 Minimum Test error found - save the configuration
: 545 | 156.124 138.593 0.00453036 0.00052903 199934 0
: 546 Minimum Test error found - save the configuration
: 546 | 154.301 136.433 0.00451311 0.000496161 199156 0
: 547 Minimum Test error found - save the configuration
: 547 | 152.77 136.097 0.00447801 0.000475021 199851 0
: 548 Minimum Test error found - save the configuration
: 548 | 151.112 133.5 0.00448815 0.0004926 200223 0
: 549 Minimum Test error found - save the configuration
: 549 | 149.067 132.795 0.00449207 0.000478731 199335 0
: 550 Minimum Test error found - save the configuration
: 550 | 147.298 131.1 0.00453081 0.000540651 200493 0
: 551 Minimum Test error found - save the configuration
: 551 | 145.5 128.538 0.00444753 0.000477631 201517 0
: 552 Minimum Test error found - save the configuration
: 552 | 143.912 127.547 0.00442548 0.000520461 204865 0
: 553 Minimum Test error found - save the configuration
: 553 | 142.047 126.708 0.00433298 0.000479661 207613 0
: 554 Minimum Test error found - save the configuration
: 554 | 140.669 124.624 0.00437144 0.000480331 205597 0
: 555 Minimum Test error found - save the configuration
: 555 | 138.753 123.953 0.00433561 0.000481191 207554 0
: 556 Minimum Test error found - save the configuration
: 556 | 137.271 121.73 0.00432798 0.00047978 207890 0
: 557 Minimum Test error found - save the configuration
: 557 | 135.765 120.737 0.00451599 0.000492891 198852 0
: 558 Minimum Test error found - save the configuration
: 558 | 133.942 118.615 0.00438834 0.000492821 205364 0
: 559 Minimum Test error found - save the configuration
: 559 | 132.588 118.123 0.00436602 0.000477501 205734 0
: 560 Minimum Test error found - save the configuration
: 560 | 130.997 116.965 0.00441738 0.00048742 203565 0
: 561 Minimum Test error found - save the configuration
: 561 | 129.503 115.597 0.00440149 0.00050748 205444 0
: 562 Minimum Test error found - save the configuration
: 562 | 127.799 113.922 0.00436122 0.000477842 206006 0
: 563 Minimum Test error found - save the configuration
: 563 | 126.269 111.738 0.0043433 0.00048073 207116 0
: 564 Minimum Test error found - save the configuration
: 564 | 124.804 110.825 0.00433417 0.000470071 207034 0
: 565 Minimum Test error found - save the configuration
: 565 | 123.368 109.927 0.00435289 0.000480551 206594 0
: 566 Minimum Test error found - save the configuration
: 566 | 122.03 108.761 0.00461141 0.000486061 193923 0
: 567 Minimum Test error found - save the configuration
: 567 | 120.496 108.119 0.0044852 0.000513992 201450 0
: 568 Minimum Test error found - save the configuration
: 568 | 119.083 107.2 0.00473641 0.000487601 188288 0
: 569 Minimum Test error found - save the configuration
: 569 | 117.786 105.223 0.00461245 0.00050003 194533 0
: 570 Minimum Test error found - save the configuration
: 570 | 116.354 103.237 0.00485106 0.000517851 184621 0
: 571 | 114.811 103.523 0.00456592 0.00053922 198674 1
: 572 Minimum Test error found - save the configuration
: 572 | 113.509 101.258 0.00452704 0.000542971 200800 0
: 573 Minimum Test error found - save the configuration
: 573 | 112.022 99.6689 0.00449981 0.000504821 200251 0
: 574 Minimum Test error found - save the configuration
: 574 | 110.8 99.2239 0.00452265 0.000497321 198742 0
: 575 Minimum Test error found - save the configuration
: 575 | 109.409 97.6669 0.0044797 0.000481501 200090 0
: 576 Minimum Test error found - save the configuration
: 576 | 107.913 95.6935 0.00438223 0.00048188 205110 0
: 577 | 106.877 95.851 0.00431825 0.000438061 206176 1
: 578 Minimum Test error found - save the configuration
: 578 | 106.039 94.0006 0.00435061 0.00048239 206814 0
: 579 Minimum Test error found - save the configuration
: 579 | 104.315 93.3264 0.00450862 0.000519441 200543 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.364 91.9509 0.00446146 0.000507991 202354 0
: 581 Minimum Test error found - save the configuration
: 581 | 102.173 91.0011 0.00444982 0.000475851 201310 0
: 582 Minimum Test error found - save the configuration
: 582 | 100.642 89.5542 0.00449504 0.000507012 200600 0
: 583 Minimum Test error found - save the configuration
: 583 | 99.6523 88.3806 0.00441414 0.000525281 205716 0
: 584 Minimum Test error found - save the configuration
: 584 | 98.2009 86.8518 0.00453682 0.000488372 197607 0
: 585 Minimum Test error found - save the configuration
: 585 | 96.9825 86.6543 0.00445787 0.000508441 202561 0
: 586 Minimum Test error found - save the configuration
: 586 | 95.7732 84.7291 0.00450238 0.000483571 199064 0
: 587 Minimum Test error found - save the configuration
: 587 | 94.9765 84.101 0.00443191 0.000493772 203142 0
: 588 Minimum Test error found - save the configuration
: 588 | 93.7007 83.6677 0.00450239 0.00048547 199158 0
: 589 Minimum Test error found - save the configuration
: 589 | 92.5696 81.8127 0.00449742 0.000494311 199845 0
: 590 Minimum Test error found - save the configuration
: 590 | 91.4933 81.0587 0.00447812 0.000487001 200445 0
: 591 Minimum Test error found - save the configuration
: 591 | 90.3222 80.1463 0.00447498 0.000486732 200589 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.7282 79.0595 0.00449826 0.000523491 201270 0
: 593 | 89.03 79.1552 0.00455455 0.00046077 195419 1
: 594 Minimum Test error found - save the configuration
: 594 | 87.6953 76.8545 0.0043977 0.000484301 204426 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.2274 75.9372 0.00449217 0.000488471 199815 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.372 75.6783 0.00443916 0.000484131 202274 0
: 597 Minimum Test error found - save the configuration
: 597 | 84.7441 75.03 0.00452413 0.0005315 200369 0
: 598 Minimum Test error found - save the configuration
: 598 | 83.3637 73.0545 0.00462868 0.000519701 194696 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.1215 72.6307 0.00456044 0.00049166 196619 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.1248 70.8755 0.00452498 0.000503452 198929 0
: 601 Minimum Test error found - save the configuration
: 601 | 80.2134 70.3983 0.00596116 0.000738121 153168 0
: 602 Minimum Test error found - save the configuration
: 602 | 79.3698 69.1814 0.00547612 0.000637012 165320 0
: 603 Minimum Test error found - save the configuration
: 603 | 78.6275 68.1037 0.00548518 0.000710442 167548 0
: 604 Minimum Test error found - save the configuration
: 604 | 77.2742 67.2511 0.00620135 0.000728562 146178 0
: 605 Minimum Test error found - save the configuration
: 605 | 76.4846 66.6515 0.00612884 0.000504811 142247 0
: 606 Minimum Test error found - save the configuration
: 606 | 75.6151 65.7547 0.00505934 0.000707311 183822 0
: 607 Minimum Test error found - save the configuration
: 607 | 74.8043 64.6562 0.00547869 0.000508451 160958 0
: 608 Minimum Test error found - save the configuration
: 608 | 73.8825 64.144 0.00584968 0.000708091 155594 0
: 609 Minimum Test error found - save the configuration
: 609 | 73.2416 63.7533 0.00613432 0.000705542 147363 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.3003 62.6215 0.00585454 0.000689961 154901 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.3086 61.64 0.00568409 0.000707912 160766 0
: 612 Minimum Test error found - save the configuration
: 612 | 70.6156 60.6689 0.00629855 0.000680081 142388 0
: 613 Minimum Test error found - save the configuration
: 613 | 69.7056 59.7958 0.00444201 0.000502482 203070 0
: 614 Minimum Test error found - save the configuration
: 614 | 68.829 59.0433 0.00439108 0.00048074 204586 0
: 615 Minimum Test error found - save the configuration
: 615 | 67.9583 58.0126 0.00441734 0.000507631 204619 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.3332 57.4644 0.00439793 0.000480102 204195 0
: 617 Minimum Test error found - save the configuration
: 617 | 66.2987 56.6395 0.00438242 0.000484391 205232 0
: 618 Minimum Test error found - save the configuration
: 618 | 65.6682 56.1445 0.00441775 0.000525162 205519 0
: 619 Minimum Test error found - save the configuration
: 619 | 64.8448 55.5015 0.00436609 0.00047535 205617 0
: 620 Minimum Test error found - save the configuration
: 620 | 63.9527 54.4579 0.00437596 0.00048484 205596 0
: 621 Minimum Test error found - save the configuration
: 621 | 63.2758 54.4506 0.0043649 0.000474081 205612 0
: 622 Minimum Test error found - save the configuration
: 622 | 62.542 52.7298 0.0043879 0.00048248 204844 0
: 623 Minimum Test error found - save the configuration
: 623 | 61.5481 52.0099 0.0043999 0.00048667 204435 0
: 624 Minimum Test error found - save the configuration
: 624 | 60.8843 51.3322 0.00433988 0.000470151 206733 0
: 625 Minimum Test error found - save the configuration
: 625 | 60.1199 50.4256 0.00437978 0.000487971 205560 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.6898 50.0329 0.004336 0.00047753 207336 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.8041 49.2849 0.00432085 0.000469251 207706 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.0572 48.6568 0.00434256 0.000484581 207363 0
: 629 Minimum Test error found - save the configuration
: 629 | 57.4568 47.9665 0.00433596 0.000476491 207283 0
: 630 Minimum Test error found - save the configuration
: 630 | 56.6142 46.8526 0.00435304 0.000478072 206453 0
: 631 | 55.8082 46.8939 0.00437887 0.000503641 206440 1
: 632 Minimum Test error found - save the configuration
: 632 | 55.2497 46.2643 0.00443608 0.00048812 202636 0
: 633 Minimum Test error found - save the configuration
: 633 | 54.7112 45.5313 0.00441695 0.000491391 203793 0
: 634 Minimum Test error found - save the configuration
: 634 | 54.2115 45.2106 0.00435461 0.000478751 206406 0
: 635 Minimum Test error found - save the configuration
: 635 | 53.4851 44.4529 0.00435979 0.000477981 206090 0
: 636 Minimum Test error found - save the configuration
: 636 | 52.7258 43.2844 0.00439711 0.00052259 206477 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.111 42.759 0.00442152 0.000477761 202852 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.3605 42.6628 0.00436265 0.000477662 205921 0
: 639 Minimum Test error found - save the configuration
: 639 | 51.0188 41.6662 0.00435102 0.000476561 206481 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.403 41.051 0.00434695 0.00047104 206403 0
: 641 Minimum Test error found - save the configuration
: 641 | 49.722 40.5546 0.00436414 0.000485161 206240 0
: 642 Minimum Test error found - save the configuration
: 642 | 49.1227 39.9066 0.00434995 0.000476631 206541 0
: 643 Minimum Test error found - save the configuration
: 643 | 48.5845 39.3181 0.00434775 0.000475841 206617 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.9057 38.817 0.00438141 0.000491171 205643 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.2565 38.7016 0.00434493 0.000471051 206511 0
: 646 Minimum Test error found - save the configuration
: 646 | 46.8259 38.1586 0.00434384 0.000476471 206859 0
: 647 Minimum Test error found - save the configuration
: 647 | 46.3269 38.011 0.00436204 0.000479692 206061 0
: 648 Minimum Test error found - save the configuration
: 648 | 45.9624 36.8992 0.00483436 0.000545841 186545 0
: 649 Minimum Test error found - save the configuration
: 649 | 44.9866 36.4371 0.00445393 0.000480762 201351 0
: 650 Minimum Test error found - save the configuration
: 650 | 44.5724 35.4694 0.0043683 0.0004834 205926 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.9523 35.0361 0.00439528 0.000486851 204686 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.5544 34.4873 0.00435271 0.00047115 206103 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.8055 34.0508 0.00435361 0.00047657 206343 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.2897 33.5649 0.00455282 0.000492982 197052 0
: 655 Minimum Test error found - save the configuration
: 655 | 41.8957 33.1807 0.00460272 0.00050809 195378 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.3571 32.6491 0.00453679 0.000486582 197521 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.9397 32.1252 0.00439375 0.000501111 205516 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.2598 31.8112 0.00464819 0.000493622 192559 0
: 659 Minimum Test error found - save the configuration
: 659 | 39.7797 31.398 0.00479239 0.00049427 186128 0
: 660 Minimum Test error found - save the configuration
: 660 | 39.334 30.8679 0.00466893 0.000510181 192366 0
: 661 | 38.7014 30.9288 0.00471604 0.000449951 187525 1
: 662 Minimum Test error found - save the configuration
: 662 | 38.589 30.3304 0.00461005 0.000477841 193601 0
: 663 Minimum Test error found - save the configuration
: 663 | 37.9177 29.6946 0.00471046 0.000491341 189613 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.5351 28.8968 0.00438089 0.00047996 205079 0
: 665 Minimum Test error found - save the configuration
: 665 | 37.0793 28.3928 0.00463618 0.000486692 192795 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.5057 28.2327 0.00470328 0.00049049 189898 0
: 667 Minimum Test error found - save the configuration
: 667 | 36.3801 27.8697 0.00457861 0.000565611 199352 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.7398 27.2313 0.00449315 0.00049293 199989 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.2296 26.9477 0.00469981 0.000489481 190009 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.7488 26.7946 0.00442004 0.00048439 203270 0
: 671 Minimum Test error found - save the configuration
: 671 | 34.4225 26.0004 0.00438267 0.000486951 205354 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.997 25.2172 0.00472289 0.00050285 189572 0
: 673 | 33.5161 25.2566 0.00437825 0.00045552 203940 1
: 674 Minimum Test error found - save the configuration
: 674 | 33.1228 24.4977 0.00455915 0.000490491 196625 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.6012 24.2265 0.0044405 0.000497061 202869 0
: 676 | 32.2464 24.6015 0.00443226 0.000459791 201386 1
: 677 Minimum Test error found - save the configuration
: 677 | 32.1147 23.5307 0.00437591 0.000475431 205103 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.6295 23.134 0.0045252 0.000502191 198856 0
: 679 Minimum Test error found - save the configuration
: 679 | 31.2297 22.5723 0.00440302 0.000479141 203880 0
: 680 Minimum Test error found - save the configuration
: 680 | 30.7048 22.1995 0.00436448 0.00047984 205939 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.1779 21.8709 0.00442636 0.000490592 203264 0
: 682 | 29.8992 21.8892 0.004329 0.000444921 205969 1
: 683 Minimum Test error found - save the configuration
: 683 | 29.6437 21.2144 0.00436086 0.00048644 206483 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.2651 20.8236 0.00439839 0.00048142 204240 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.8643 20.821 0.00436959 0.00047854 205600 0
: 686 Minimum Test error found - save the configuration
: 686 | 28.4395 20.1566 0.00439581 0.000484932 204558 0
: 687 | 28.0191 20.3136 0.00435634 0.000453901 205000 1
: 688 Minimum Test error found - save the configuration
: 688 | 27.6044 19.4782 0.00440152 0.00048899 204471 0
: 689 | 27.4667 20.2014 0.00432778 0.000448891 206245 1
: 690 | 27.1436 19.7939 0.00432375 0.000445731 206291 2
: 691 Minimum Test error found - save the configuration
: 691 | 26.7598 18.9446 0.00438258 0.000488481 205439 0
: 692 Minimum Test error found - save the configuration
: 692 | 26.3831 18.2503 0.00436742 0.000475521 205555 0
: 693 Minimum Test error found - save the configuration
: 693 | 25.9008 18.1139 0.00441983 0.00048477 203301 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.6317 17.8254 0.00456844 0.000484192 195875 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.4055 17.7504 0.00437863 0.000482381 205326 0
: 696 Minimum Test error found - save the configuration
: 696 | 25.1558 17.5995 0.00437317 0.000482041 205596 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.8014 17.3928 0.00436606 0.000477251 205719 0
: 698 Minimum Test error found - save the configuration
: 698 | 24.5234 17.2111 0.00442532 0.000492491 203416 0
: 699 Minimum Test error found - save the configuration
: 699 | 24.1555 16.6842 0.00436287 0.00048057 206064 0
: 700 Minimum Test error found - save the configuration
: 700 | 23.6226 16.3142 0.00462106 0.000570351 197496 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.4045 15.8223 0.00443186 0.00047855 202362 0
: 702 Minimum Test error found - save the configuration
: 702 | 23.0078 15.6785 0.00442013 0.000489142 203511 0
: 703 Minimum Test error found - save the configuration
: 703 | 22.7094 15.6658 0.00438473 0.000480941 204929 0
: 704 Minimum Test error found - save the configuration
: 704 | 22.5452 15.3901 0.0043736 0.00048234 205589 0
: 705 Minimum Test error found - save the configuration
: 705 | 22.0694 14.9293 0.0043886 0.000491562 205284 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.7338 14.7259 0.00437769 0.000475001 204987 0
: 707 | 21.4096 14.7743 0.00432377 0.00044413 206205 1
: 708 Minimum Test error found - save the configuration
: 708 | 21.1626 14.4559 0.00439396 0.000486372 204730 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.8659 14.1031 0.00435341 0.0004726 206143 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.547 13.855 0.00435729 0.000477221 206182 0
: 711 | 20.405 14.0658 0.0043387 0.000447802 205608 1
: 712 | 20.6289 14.0715 0.00432039 0.000439561 206142 2
: 713 Minimum Test error found - save the configuration
: 713 | 20.147 13.4434 0.00437875 0.00048706 205566 0
: 714 | 19.6852 13.7565 0.00445081 0.00043994 199458 1
: 715 Minimum Test error found - save the configuration
: 715 | 19.5278 13.0681 0.00445566 0.000481771 201314 0
: 716 Minimum Test error found - save the configuration
: 716 | 19.1959 12.8994 0.00448116 0.000485212 200203 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.9311 12.6912 0.00444432 0.00047998 201799 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.4613 12.371 0.0044887 0.000526892 201928 0
: 719 | 18.2407 12.4442 0.00441001 0.00044596 201814 1
: 720 Minimum Test error found - save the configuration
: 720 | 18.0154 12.1407 0.0044489 0.000482351 201687 0
: 721 Minimum Test error found - save the configuration
: 721 | 17.8344 12.0132 0.00450403 0.0004911 199356 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.5487 11.6493 0.0045315 0.000493581 198122 0
: 723 | 17.4558 11.8439 0.00448404 0.000480882 199842 1
: 724 | 17.123 11.7634 0.0044933 0.00050032 200352 2
: 725 | 17.0011 12.1853 0.00442514 0.000449232 201212 3
: 726 | 17.2987 11.7363 0.00450511 0.00045586 197568 4
: 727 Minimum Test error found - save the configuration
: 727 | 16.6806 11.4864 0.00450847 0.000489692 199066 0
: 728 Minimum Test error found - save the configuration
: 728 | 16.111 10.655 0.00448032 0.000486791 200324 0
: 729 | 15.9715 10.9645 0.00458124 0.000496832 195867 1
: 730 | 15.7043 10.7925 0.00443637 0.000449381 200653 2
: 731 | 15.5654 10.6706 0.00446865 0.000449211 199033 3
: 732 Minimum Test error found - save the configuration
: 732 | 15.5022 10.4191 0.00447897 0.000489211 200513 0
: 733 Minimum Test error found - save the configuration
: 733 | 15.1418 10.1661 0.00458693 0.00048929 195234 0
: 734 | 15.1883 10.8376 0.00447315 0.000494712 201084 1
: 735 Minimum Test error found - save the configuration
: 735 | 14.9281 9.99187 0.0045186 0.00050478 199311 0
: 736 Minimum Test error found - save the configuration
: 736 | 14.5291 9.87267 0.00468646 0.000485601 190437 0
: 737 Minimum Test error found - save the configuration
: 737 | 14.2441 9.52992 0.00455267 0.00051543 198155 0
: 738 | 14.1602 9.69396 0.00446116 0.000439691 198932 1
: 739 Minimum Test error found - save the configuration
: 739 | 14.1198 9.34321 0.00450384 0.000532801 201459 0
: 740 | 13.8079 9.52592 0.00445371 0.000439751 199305 1
: 741 Minimum Test error found - save the configuration
: 741 | 13.5446 9.01018 0.00470897 0.000491791 189700 0
: 742 | 13.3416 9.31059 0.0048301 0.0005288 185990 1
: 743 Minimum Test error found - save the configuration
: 743 | 13.1538 8.87631 0.00469007 0.000486102 190296 0
: 744 | 12.9932 8.90403 0.00446789 0.000465341 199873 1
: 745 Minimum Test error found - save the configuration
: 745 | 12.7922 8.63077 0.00442192 0.00048541 203226 0
: 746 Minimum Test error found - save the configuration
: 746 | 12.6474 8.51524 0.00448881 0.000484341 199777 0
: 747 | 12.5181 8.89408 0.00435671 0.000447731 204657 1
: 748 Minimum Test error found - save the configuration
: 748 | 12.4795 8.12239 0.00445432 0.000492732 201939 0
: 749 | 12.1745 8.22975 0.00433945 0.000441981 205262 1
: 750 | 11.9878 8.60283 0.00433316 0.000449101 205970 2
: 751 Minimum Test error found - save the configuration
: 751 | 11.9026 7.87395 0.00439574 0.000485312 204581 0
: 752 Minimum Test error found - save the configuration
: 752 | 11.7243 7.55607 0.00436143 0.000471911 205681 0
: 753 | 11.4562 7.68858 0.00439177 0.000456101 203269 1
: 754 | 11.3983 8.10378 0.00432176 0.000449671 206607 2
: 755 | 11.4027 7.85196 0.00435365 0.00044442 204644 3
: 756 | 10.9916 7.6419 0.00436399 0.000464441 205152 4
: 757 Minimum Test error found - save the configuration
: 757 | 10.8663 7.11697 0.00437996 0.000480481 205156 0
: 758 Minimum Test error found - save the configuration
: 758 | 10.8083 7.06109 0.00438931 0.000499731 205678 0
: 759 Minimum Test error found - save the configuration
: 759 | 10.6067 6.98875 0.00436124 0.00047971 206104 0
: 760 | 10.6216 7.53037 0.00433517 0.000443632 205574 1
: 761 | 10.4518 7.02393 0.00434071 0.000453031 205778 2
: 762 Minimum Test error found - save the configuration
: 762 | 10.2729 6.66878 0.00437736 0.00048331 205442 0
: 763 Minimum Test error found - save the configuration
: 763 | 10.1364 6.40311 0.0043788 0.000481592 205275 0
: 764 | 10.0334 6.80473 0.00434726 0.00045357 205461 1
: 765 Minimum Test error found - save the configuration
: 765 | 9.82135 6.17927 0.00435619 0.000470182 205867 0
: 766 Minimum Test error found - save the configuration
: 766 | 9.72207 6.10186 0.00437263 0.00047844 205434 0
: 767 | 9.75296 6.74244 0.00434408 0.00044986 205433 1
: 768 Minimum Test error found - save the configuration
: 768 | 9.54044 6.03741 0.0043718 0.000471321 205103 0
: 769 Minimum Test error found - save the configuration
: 769 | 9.283 5.562 0.00435696 0.000475451 206106 0
: 770 Minimum Test error found - save the configuration
: 770 | 9.13518 5.44182 0.0043482 0.000477691 206691 0
: 771 | 9.13727 6.50356 0.00431981 0.000439341 206161 1
: 772 Minimum Test error found - save the configuration
: 772 | 8.9337 5.18494 0.00435537 0.000484181 206655 0
: 773 | 8.86662 5.46475 0.00431649 0.000447761 206786 1
: 774 Minimum Test error found - save the configuration
: 774 | 8.67787 4.94905 0.00434207 0.000471022 206662 0
: 775 | 8.57167 5.01367 0.00433112 0.0004537 206323 1
: 776 Minimum Test error found - save the configuration
: 776 | 8.60844 4.75771 0.00436428 0.000480811 206002 0
: 777 | 8.41091 4.95736 0.00431436 0.000444841 206744 1
: 778 | 8.60695 5.22068 0.00432523 0.000453021 206600 2
: 779 | 8.22626 4.83111 0.00431901 0.000448231 206677 3
: 780 Minimum Test error found - save the configuration
: 780 | 7.95027 4.20923 0.00436808 0.000477281 205613 0
: 781 | 8.04286 4.50785 0.00443207 0.000476841 202264 1
: 782 Minimum Test error found - save the configuration
: 782 | 7.87823 4.11333 0.00454003 0.00049446 197747 0
: 783 Minimum Test error found - save the configuration
: 783 | 7.67861 3.75389 0.00442588 0.000492522 203389 0
: 784 | 7.67691 3.87934 0.00435196 0.000439081 204453 1
: 785 | 7.56584 4.25436 0.00435466 0.000447061 204729 2
: 786 Minimum Test error found - save the configuration
: 786 | 7.40753 3.70034 0.00437463 0.000483622 205602 0
: 787 Minimum Test error found - save the configuration
: 787 | 7.43468 3.55755 0.00437767 0.000478571 205176 0
: 788 | 7.44422 3.5769 0.0043429 0.000452232 205620 1
: 789 Minimum Test error found - save the configuration
: 789 | 7.16671 3.46033 0.00435175 0.000478981 206571 0
: 790 | 7.07853 3.51306 0.00434101 0.000443861 205278 1
: 791 | 7.002 3.48045 0.00431264 0.000450331 207130 2
: 792 Minimum Test error found - save the configuration
: 792 | 7.05263 3.2467 0.00436696 0.000483412 205997 0
: 793 Minimum Test error found - save the configuration
: 793 | 6.96128 2.94865 0.00434672 0.00047516 206635 0
: 794 Minimum Test error found - save the configuration
: 794 | 6.78628 2.93522 0.00436641 0.000483482 206030 0
: 795 | 6.56751 3.26029 0.00458548 0.00052907 197219 1
: 796 | 6.56347 3.04235 0.00467009 0.000439552 189101 2
: 797 | 6.38754 2.93764 0.00455127 0.000550791 199976 3
: 798 Minimum Test error found - save the configuration
: 798 | 6.38871 2.44215 0.00470091 0.000507082 190757 0
: 799 | 6.32035 2.60217 0.00449268 0.00045352 198061 1
: 800 | 6.37726 3.89594 0.00441899 0.000452822 201706 2
: 801 | 6.35405 2.8035 0.00437814 0.00045467 203901 3
: 802 | 6.28403 3.18412 0.00433422 0.000446761 205790 4
: 803 | 6.35283 3.23146 0.00440319 0.000447501 202240 5
: 804 Minimum Test error found - save the configuration
: 804 | 5.97174 2.41312 0.00450576 0.00056622 203069 0
: 805 Minimum Test error found - save the configuration
: 805 | 5.83444 2.27451 0.00446806 0.000507651 201999 0
: 806 | 5.81633 2.65421 0.00434922 0.00045109 205227 1
: 807 | 5.76158 2.42914 0.00437863 0.00045059 203664 2
: 808 | 5.77957 3.5471 0.00440239 0.000463641 203110 3
: 809 | 5.90347 2.68176 0.00468954 0.000447421 188585 4
: 810 Minimum Test error found - save the configuration
: 810 | 5.62427 2.0173 0.00442401 0.000498471 203794 0
: 811 | 5.56171 2.08451 0.00435888 0.000441261 204206 1
: 812 | 5.32115 2.17685 0.00441075 0.000448791 201920 2
: 813 Minimum Test error found - save the configuration
: 813 | 5.34016 2.01171 0.00443895 0.000491262 202650 0
: 814 | 5.31227 2.39974 0.00445038 0.000484341 201713 1
: 815 Minimum Test error found - save the configuration
: 815 | 5.36671 1.6874 0.00439397 0.000485041 204660 0
: 816 | 5.20048 2.07078 0.00442546 0.000514431 204550 1
: 817 | 5.02387 1.76784 0.00447669 0.000451801 198763 2
: 818 | 4.9705 1.73175 0.00445788 0.000440971 199158 3
: 819 | 4.97592 1.74636 0.00442716 0.000456661 201486 4
: 820 | 4.9861 2.09509 0.00444199 0.000444562 200129 5
: 821 | 4.98504 1.99521 0.00449212 0.000498781 200334 6
: 822 Minimum Test error found - save the configuration
: 822 | 5.07885 1.56334 0.00445677 0.000527002 203574 0
: 823 | 4.80902 1.85852 0.00446007 0.00045831 199912 1
: 824 | 4.81674 2.01742 0.00446145 0.000444421 199152 2
: 825 | 4.71133 1.79182 0.00443338 0.000448931 200781 3
: 826 | 4.80071 2.08098 0.00443323 0.00045029 200857 4
: 827 | 4.67179 2.13964 0.00448878 0.000491301 200126 5
: 828 | 4.56193 1.59479 0.00442164 0.000489201 203436 6
: 829 Minimum Test error found - save the configuration
: 829 | 4.41752 1.52995 0.00447581 0.000489381 200681 0
: 830 | 4.48965 1.90085 0.00443709 0.000448541 200574 1
: 831 | 4.4756 1.69948 0.00442399 0.0004464 201127 2
: 832 | 4.25241 1.75975 0.00443836 0.000450651 200616 3
: 833 | 4.36821 1.70544 0.00449956 0.00049212 199629 4
: 834 Minimum Test error found - save the configuration
: 834 | 4.28828 1.24336 0.00448223 0.000541471 203007 0
: 835 | 4.14267 1.54401 0.00443398 0.000442531 200429 1
: 836 | 4.27902 1.55608 0.00446385 0.000458261 199721 2
: 837 | 4.13851 1.95497 0.00444394 0.00044378 199992 3
: 838 | 4.04077 1.36769 0.00449275 0.000489521 199839 4
: 839 | 3.85386 1.66557 0.00445572 0.000444032 199417 5
: 840 | 3.88676 1.47929 0.00447295 0.000460891 199399 6
: 841 | 3.87653 1.73925 0.00447631 0.000440271 198214 7
: 842 | 3.79958 1.46947 0.00445588 0.00045513 199963 8
: 843 | 4.06525 1.43147 0.00446206 0.00046667 200231 9
: 844 | 3.8174 1.34376 0.00444554 0.000493231 202413 10
: 845 | 3.77174 1.69258 0.00448446 0.00048434 199994 11
: 846 | 3.70882 1.32905 0.00482978 0.00055066 186954 12
: 847 | 3.64982 1.67436 0.00488525 0.000541761 184184 13
: 848 | 3.63912 1.41051 0.00475996 0.0004789 186870 14
: 849 | 3.52474 1.57832 0.00454229 0.00044384 195196 15
: 850 | 3.75243 1.62016 0.00463982 0.000456092 191217 16
: 851 | 3.59474 1.58055 0.00452463 0.000463511 196990 17
: 852 | 3.50628 2.04293 0.00441259 0.000463191 202563 18
: 853 | 3.51862 1.93409 0.00452869 0.000450571 196169 19
: 854 | 3.44561 1.77759 0.00451356 0.0004557 197148 20
: 855 | 3.40079 1.36586 0.00447183 0.000451212 198974 21
:
: Elapsed time for training with 1000 events: 3.84 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00607 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.882 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.182 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.31048e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.0889e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0443 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0398 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00152 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0535 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.937 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0227 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00276 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0401 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00482 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00211 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000439 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0501 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00579 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.926 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.104 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.748 0.0259 5.43 1.54 | 3.238 3.241
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.0511 0.102 1.89 1.12 | 3.358 3.347
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.