Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.31 sec
: Elapsed time for training with 1000 events: 0.314 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00466 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.00122 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00599 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000427 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000608 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31608.7
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33184.4 31206.4 0.00624874 0.000746165 145386 0
: 2 Minimum Test error found - save the configuration
: 2 | 32661.8 30664.3 0.00621766 0.000733696 145880 0
: 3 Minimum Test error found - save the configuration
: 3 | 31942.6 29947.7 0.00644242 0.000749976 140537 0
: 4 Minimum Test error found - save the configuration
: 4 | 31124.8 29234.3 0.00667422 0.000768275 135457 0
: 5 Minimum Test error found - save the configuration
: 5 | 30322.3 28471.8 0.00663863 0.000758435 136050 0
: 6 Minimum Test error found - save the configuration
: 6 | 29454 27559.2 0.0065795 0.000755305 137358 0
: 7 Minimum Test error found - save the configuration
: 7 | 28650.5 26788.4 0.00667934 0.000769835 135375 0
: 8 Minimum Test error found - save the configuration
: 8 | 28114.1 26365 0.00669841 0.000776636 135095 0
: 9 Minimum Test error found - save the configuration
: 9 | 27725.4 26032.3 0.00659092 0.000774835 137550 0
: 10 Minimum Test error found - save the configuration
: 10 | 27396.1 25722.7 0.0066284 0.000777036 136720 0
: 11 Minimum Test error found - save the configuration
: 11 | 27083 25436.9 0.00662032 0.000742165 136097 0
: 12 Minimum Test error found - save the configuration
: 12 | 26793.8 25159 0.00657835 0.000742236 137078 0
: 13 Minimum Test error found - save the configuration
: 13 | 26510.8 24894.6 0.00654041 0.000753435 138242 0
: 14 Minimum Test error found - save the configuration
: 14 | 26239.2 24638.6 0.00649605 0.000747385 139163 0
: 15 Minimum Test error found - save the configuration
: 15 | 25974.5 24391.2 0.00658216 0.000754336 137273 0
: 16 Minimum Test error found - save the configuration
: 16 | 25718.2 24148.8 0.00652971 0.000740555 138189 0
: 17 Minimum Test error found - save the configuration
: 17 | 25465.2 23914.1 0.00655823 0.000747514 137677 0
: 18 Minimum Test error found - save the configuration
: 18 | 25224.1 23677.5 0.00661143 0.000748077 136441 0
: 19 Minimum Test error found - save the configuration
: 19 | 24979 23451 0.00648723 0.000739475 139185 0
: 20 Minimum Test error found - save the configuration
: 20 | 24743.8 23226.1 0.00641679 0.000713565 140272 0
: 21 Minimum Test error found - save the configuration
: 21 | 24509.5 23006.8 0.0063598 0.000737545 142292 0
: 22 Minimum Test error found - save the configuration
: 22 | 24284.3 22785.7 0.00650832 0.000730895 138470 0
: 23 Minimum Test error found - save the configuration
: 23 | 24053.8 22574.7 0.00655341 0.000753145 137925 0
: 24 Minimum Test error found - save the configuration
: 24 | 23834 22363.1 0.00659763 0.000760575 137055 0
: 25 Minimum Test error found - save the configuration
: 25 | 23613.1 22156.8 0.00651172 0.000744317 138711 0
: 26 Minimum Test error found - save the configuration
: 26 | 23396.7 21953.1 0.00645249 0.000734985 139921 0
: 27 Minimum Test error found - save the configuration
: 27 | 23183.6 21751.8 0.0065169 0.000765384 139094 0
: 28 Minimum Test error found - save the configuration
: 28 | 22971.9 21554.1 0.0065958 0.000767795 137268 0
: 29 Minimum Test error found - save the configuration
: 29 | 22766.6 21354.9 0.00660754 0.000747496 136518 0
: 30 Minimum Test error found - save the configuration
: 30 | 22559.4 21160.6 0.00664264 0.000760366 136002 0
: 31 Minimum Test error found - save the configuration
: 31 | 22357.1 20967.4 0.00663088 0.000770646 136513 0
: 32 Minimum Test error found - save the configuration
: 32 | 22155.4 20778.2 0.00659572 0.000741234 136647 0
: 33 Minimum Test error found - save the configuration
: 33 | 21957.7 20590.4 0.00660487 0.000755875 136776 0
: 34 Minimum Test error found - save the configuration
: 34 | 21760 20406.9 0.00633225 0.000745396 143193 0
: 35 Minimum Test error found - save the configuration
: 35 | 21568.6 20222.1 0.00666506 0.000769586 135697 0
: 36 Minimum Test error found - save the configuration
: 36 | 21374 20043.5 0.00668173 0.000768455 135289 0
: 37 Minimum Test error found - save the configuration
: 37 | 21186.8 19863.2 0.00657317 0.000734575 137019 0
: 38 Minimum Test error found - save the configuration
: 38 | 21000.2 19683.6 0.00669003 0.000753796 134766 0
: 39 Minimum Test error found - save the configuration
: 39 | 20814.7 19506.5 0.00662703 0.000756025 136263 0
: 40 Minimum Test error found - save the configuration
: 40 | 20625.9 19339 0.00663771 0.000730435 135426 0
: 41 Minimum Test error found - save the configuration
: 41 | 20449.2 19166.1 0.00666139 0.000757694 135508 0
: 42 Minimum Test error found - save the configuration
: 42 | 20267.1 18998.5 0.00658433 0.000724655 136526 0
: 43 Minimum Test error found - save the configuration
: 43 | 20089.6 18832.4 0.00655499 0.000751716 137853 0
: 44 Minimum Test error found - save the configuration
: 44 | 19915.3 18665.5 0.00666632 0.000768645 135647 0
: 45 Minimum Test error found - save the configuration
: 45 | 19741.6 18499.9 0.0066285 0.000757045 136252 0
: 46 Minimum Test error found - save the configuration
: 46 | 19566.5 18340.1 0.00660145 0.000742775 136550 0
: 47 Minimum Test error found - save the configuration
: 47 | 19397.9 18179 0.00657715 0.000755296 137413 0
: 48 Minimum Test error found - save the configuration
: 48 | 19229.5 18019 0.00669068 0.000752355 134718 0
: 49 Minimum Test error found - save the configuration
: 49 | 19060.3 17863.5 0.00672035 0.000759626 134212 0
: 50 Minimum Test error found - save the configuration
: 50 | 18895.2 17708.4 0.00680718 0.000771165 132538 0
: 51 Minimum Test error found - save the configuration
: 51 | 18732.3 17551.7 0.00686779 0.000791725 131664 0
: 52 Minimum Test error found - save the configuration
: 52 | 18567.4 17391.8 0.00678558 0.000766556 132912 0
: 53 Minimum Test error found - save the configuration
: 53 | 18402.2 17230 0.0067012 0.000753265 134501 0
: 54 Minimum Test error found - save the configuration
: 54 | 18234.4 17085.2 0.00669375 0.000778465 135243 0
: 55 Minimum Test error found - save the configuration
: 55 | 18072.4 16927.5 0.00673155 0.000780546 134431 0
: 56 Minimum Test error found - save the configuration
: 56 | 17926.1 16776.7 0.00669963 0.000784347 135243 0
: 57 Minimum Test error found - save the configuration
: 57 | 17758.8 16643.1 0.00676957 0.000767685 133292 0
: 58 Minimum Test error found - save the configuration
: 58 | 17604 16483.4 0.00662578 0.000759406 136371 0
: 59 Minimum Test error found - save the configuration
: 59 | 17444.6 16329.2 0.00674962 0.000776675 133937 0
: 60 Minimum Test error found - save the configuration
: 60 | 17296.2 16186.2 0.00668183 0.000760205 135098 0
: 61 Minimum Test error found - save the configuration
: 61 | 17135.4 16044.9 0.00673199 0.000764705 134064 0
: 62 Minimum Test error found - save the configuration
: 62 | 16982.5 15891.7 0.00677769 0.000785136 133499 0
: 63 Minimum Test error found - save the configuration
: 63 | 16830 15744.9 0.00678014 0.000792666 133612 0
: 64 Minimum Test error found - save the configuration
: 64 | 16682.3 15600.8 0.00672197 0.000780157 134639 0
: 65 Minimum Test error found - save the configuration
: 65 | 16532.4 15454.5 0.00682671 0.000782686 132362 0
: 66 Minimum Test error found - save the configuration
: 66 | 16381.7 15317.7 0.0067772 0.000753436 132807 0
: 67 Minimum Test error found - save the configuration
: 67 | 16235 15175.4 0.00677438 0.000794975 133793 0
: 68 Minimum Test error found - save the configuration
: 68 | 16089.4 15038.5 0.00679732 0.000781486 132982 0
: 69 Minimum Test error found - save the configuration
: 69 | 15944.9 14902.5 0.00684834 0.000779295 131816 0
: 70 Minimum Test error found - save the configuration
: 70 | 15803.9 14764.4 0.00693515 0.000787926 130140 0
: 71 Minimum Test error found - save the configuration
: 71 | 15657.9 14630.7 0.00676443 0.000785725 133808 0
: 72 Minimum Test error found - save the configuration
: 72 | 15521.1 14497.3 0.00684246 0.000767356 131685 0
: 73 Minimum Test error found - save the configuration
: 73 | 15377.9 14366 0.00676187 0.000764855 133400 0
: 74 Minimum Test error found - save the configuration
: 74 | 15240.4 14233.3 0.00676032 0.000795216 134113 0
: 75 Minimum Test error found - save the configuration
: 75 | 15099.9 14105.1 0.00681561 0.000781067 132570 0
: 76 Minimum Test error found - save the configuration
: 76 | 14967.4 13971.3 0.00675298 0.000777405 133878 0
: 77 Minimum Test error found - save the configuration
: 77 | 14827.3 13846.3 0.00673927 0.000755854 133703 0
: 78 Minimum Test error found - save the configuration
: 78 | 14694.3 13718.9 0.00688891 0.000790395 131179 0
: 79 Minimum Test error found - save the configuration
: 79 | 14559.8 13594.6 0.00689458 0.000786485 130974 0
: 80 Minimum Test error found - save the configuration
: 80 | 14430.1 13468.3 0.00679565 0.000774426 132863 0
: 81 Minimum Test error found - save the configuration
: 81 | 14298.5 13344.8 0.00679982 0.000777554 132840 0
: 82 Minimum Test error found - save the configuration
: 82 | 14168 13223.1 0.0069024 0.000795495 130999 0
: 83 Minimum Test error found - save the configuration
: 83 | 14040.5 13102.2 0.00679992 0.000766717 132600 0
: 84 Minimum Test error found - save the configuration
: 84 | 13913.2 12982.3 0.00653394 0.000782014 139084 0
: 85 Minimum Test error found - save the configuration
: 85 | 13787.7 12864.4 0.00683808 0.000794875 132380 0
: 86 Minimum Test error found - save the configuration
: 86 | 13664.5 12743.5 0.00684549 0.000796746 132259 0
: 87 Minimum Test error found - save the configuration
: 87 | 13538 12628.9 0.00683286 0.000784526 132268 0
: 88 Minimum Test error found - save the configuration
: 88 | 13416.6 12513.6 0.00677129 0.000787165 133687 0
: 89 Minimum Test error found - save the configuration
: 89 | 13295.2 12399.9 0.00683225 0.000770046 131965 0
: 90 Minimum Test error found - save the configuration
: 90 | 13173.7 12289 0.00691329 0.000786205 130568 0
: 91 Minimum Test error found - save the configuration
: 91 | 13057.9 12174.3 0.00679032 0.000808455 133738 0
: 92 Minimum Test error found - save the configuration
: 92 | 12937.5 12064.1 0.00690763 0.000828596 131600 0
: 93 Minimum Test error found - save the configuration
: 93 | 12822 11952.7 0.006753 0.000796166 134300 0
: 94 Minimum Test error found - save the configuration
: 94 | 12703.9 11845.9 0.00681009 0.000783806 132752 0
: 95 Minimum Test error found - save the configuration
: 95 | 12592.3 11734.9 0.00678597 0.000769146 132961 0
: 96 Minimum Test error found - save the configuration
: 96 | 12474.6 11630.7 0.00672301 0.000764955 134272 0
: 97 Minimum Test error found - save the configuration
: 97 | 12363.3 11525.1 0.00673325 0.000780897 134401 0
: 98 Minimum Test error found - save the configuration
: 98 | 12252.9 11418.1 0.0068661 0.000793766 131745 0
: 99 Minimum Test error found - save the configuration
: 99 | 12140.8 11313.8 0.00692235 0.000796085 130585 0
: 100 Minimum Test error found - save the configuration
: 100 | 12030.6 11211.2 0.00684386 0.000794557 132247 0
: 101 Minimum Test error found - save the configuration
: 101 | 11921.9 11108.9 0.00685493 0.000802617 132181 0
: 102 Minimum Test error found - save the configuration
: 102 | 11815.1 11005.6 0.00688848 0.000763916 130622 0
: 103 Minimum Test error found - save the configuration
: 103 | 11706.5 10905.7 0.00686107 0.000781175 131581 0
: 104 Minimum Test error found - save the configuration
: 104 | 11600.6 10806.6 0.00691392 0.000774015 130295 0
: 105 Minimum Test error found - save the configuration
: 105 | 11495.1 10709 0.00684266 0.000783254 132026 0
: 106 Minimum Test error found - save the configuration
: 106 | 11391.7 10611 0.0063333 0.000791214 144350 0
: 107 Minimum Test error found - save the configuration
: 107 | 11288.9 10513.3 0.00541951 0.000632234 167110 0
: 108 Minimum Test error found - save the configuration
: 108 | 11186.4 10416.6 0.00590794 0.000791974 156373 0
: 109 Minimum Test error found - save the configuration
: 109 | 11083.8 10322.6 0.00653705 0.000618853 135176 0
: 110 Minimum Test error found - save the configuration
: 110 | 10985.4 10226.6 0.00484513 0.000689245 192498 0
: 111 Minimum Test error found - save the configuration
: 111 | 10883.5 10134.6 0.00598771 0.000550023 147121 0
: 112 Minimum Test error found - save the configuration
: 112 | 10784.2 10044.5 0.00562181 0.000644694 160736 0
: 113 Minimum Test error found - save the configuration
: 113 | 10688.4 9951.69 0.0061808 0.000770775 147874 0
: 114 Minimum Test error found - save the configuration
: 114 | 10591.1 9860.43 0.00639496 0.000641674 139051 0
: 115 Minimum Test error found - save the configuration
: 115 | 10495 9769.46 0.00576644 0.000757415 159712 0
: 116 Minimum Test error found - save the configuration
: 116 | 10399 9680.88 0.00628641 0.000758864 144730 0
: 117 Minimum Test error found - save the configuration
: 117 | 10304.8 9592.54 0.00505452 0.000700856 183753 0
: 118 Minimum Test error found - save the configuration
: 118 | 10210.5 9505.71 0.00460952 0.000508545 195075 0
: 119 Minimum Test error found - save the configuration
: 119 | 10119.6 9416.96 0.00485132 0.000529443 185105 0
: 120 Minimum Test error found - save the configuration
: 120 | 10025.8 9331.58 0.00463528 0.000525533 194659 0
: 121 Minimum Test error found - save the configuration
: 121 | 9936.41 9244.48 0.00499156 0.000551044 180159 0
: 122 Minimum Test error found - save the configuration
: 122 | 9843.94 9161.16 0.00461594 0.000523953 195504 0
: 123 Minimum Test error found - save the configuration
: 123 | 9755.59 9077.02 0.00519222 0.000543455 172089 0
: 124 Minimum Test error found - save the configuration
: 124 | 9665.23 8995.84 0.00484734 0.000543124 185864 0
: 125 Minimum Test error found - save the configuration
: 125 | 9579.44 8912.16 0.00489057 0.000550143 184313 0
: 126 Minimum Test error found - save the configuration
: 126 | 9491.39 8830.61 0.00461534 0.000512294 194977 0
: 127 Minimum Test error found - save the configuration
: 127 | 9404.61 8749.75 0.00459085 0.000520983 196567 0
: 128 Minimum Test error found - save the configuration
: 128 | 9319.66 8669 0.0046846 0.000533654 192727 0
: 129 Minimum Test error found - save the configuration
: 129 | 9234.5 8589.16 0.00461176 0.000504874 194795 0
: 130 Minimum Test error found - save the configuration
: 130 | 9151.2 8508.77 0.00503534 0.000641405 182069 0
: 131 Minimum Test error found - save the configuration
: 131 | 9065.15 8433.53 0.00525537 0.000602055 171921 0
: 132 Minimum Test error found - save the configuration
: 132 | 8985.47 8354.07 0.005465 0.000592463 164186 0
: 133 Minimum Test error found - save the configuration
: 133 | 8901.52 8278.52 0.00499507 0.000561074 180424 0
: 134 Minimum Test error found - save the configuration
: 134 | 8821.46 8201.96 0.00491421 0.000600354 185449 0
: 135 Minimum Test error found - save the configuration
: 135 | 8741.52 8124.81 0.00491697 0.000559543 183594 0
: 136 Minimum Test error found - save the configuration
: 136 | 8660.22 8050.91 0.00482413 0.000552663 187289 0
: 137 Minimum Test error found - save the configuration
: 137 | 8581.52 7977.22 0.00489806 0.000562644 184527 0
: 138 Minimum Test error found - save the configuration
: 138 | 8503.36 7903.84 0.00491503 0.000573454 184265 0
: 139 Minimum Test error found - save the configuration
: 139 | 8425.68 7830.98 0.00490658 0.000538145 183132 0
: 140 Minimum Test error found - save the configuration
: 140 | 8349.45 7757.64 0.0051243 0.000566913 175539 0
: 141 Minimum Test error found - save the configuration
: 141 | 8272.12 7686.81 0.00480467 0.000524574 186912 0
: 142 Minimum Test error found - save the configuration
: 142 | 8197.22 7615.46 0.0047918 0.000530454 187734 0
: 143 Minimum Test error found - save the configuration
: 143 | 8121.34 7546.09 0.00466747 0.000527102 193219 0
: 144 Minimum Test error found - save the configuration
: 144 | 8047.94 7475.95 0.00470947 0.000551364 192395 0
: 145 Minimum Test error found - save the configuration
: 145 | 7973.8 7407.16 0.00476861 0.000560183 190095 0
: 146 Minimum Test error found - save the configuration
: 146 | 7902.79 7336.34 0.00477525 0.000526025 188270 0
: 147 Minimum Test error found - save the configuration
: 147 | 7827.68 7270.41 0.00467927 0.000533863 192985 0
: 148 Minimum Test error found - save the configuration
: 148 | 7756.4 7204.75 0.00467019 0.000532493 193344 0
: 149 Minimum Test error found - save the configuration
: 149 | 7686.51 7137.35 0.00475008 0.000525723 189378 0
: 150 Minimum Test error found - save the configuration
: 150 | 7616.3 7070.81 0.00469401 0.000536703 192432 0
: 151 Minimum Test error found - save the configuration
: 151 | 7545.6 7005.8 0.00466535 0.000529465 193429 0
: 152 Minimum Test error found - save the configuration
: 152 | 7477.55 6940.2 0.00477866 0.000530404 188312 0
: 153 Minimum Test error found - save the configuration
: 153 | 7408.08 6876.66 0.00470178 0.000519984 191305 0
: 154 Minimum Test error found - save the configuration
: 154 | 7341.06 6812.18 0.00472358 0.000537524 191111 0
: 155 Minimum Test error found - save the configuration
: 155 | 7273.14 6749.26 0.00475123 0.000539935 189965 0
: 156 Minimum Test error found - save the configuration
: 156 | 7205.64 6688.51 0.00476794 0.000521743 188404 0
: 157 Minimum Test error found - save the configuration
: 157 | 7140.73 6626.15 0.00466355 0.000510622 192635 0
: 158 Minimum Test error found - save the configuration
: 158 | 7076.07 6563.26 0.00468733 0.000533343 192586 0
: 159 Minimum Test error found - save the configuration
: 159 | 7009.91 6502.84 0.00474298 0.000522113 189534 0
: 160 Minimum Test error found - save the configuration
: 160 | 6946.18 6442.04 0.00492081 0.000553463 183178 0
: 161 Minimum Test error found - save the configuration
: 161 | 6882.43 6381.61 0.00518522 0.000746146 180218 0
: 162 Minimum Test error found - save the configuration
: 162 | 6816.8 6325.89 0.00664865 0.000733446 135245 0
: 163 Minimum Test error found - save the configuration
: 163 | 6757.41 6265.37 0.00577852 0.000524874 152275 0
: 164 Minimum Test error found - save the configuration
: 164 | 6695.01 6206.06 0.00467633 0.000528465 192870 0
: 165 Minimum Test error found - save the configuration
: 165 | 6632.59 6148.63 0.00466891 0.000550623 194255 0
: 166 Minimum Test error found - save the configuration
: 166 | 6571.79 6091.47 0.00500475 0.000612265 182129 0
: 167 Minimum Test error found - save the configuration
: 167 | 6510.86 6035.46 0.00470669 0.000518063 190993 0
: 168 Minimum Test error found - save the configuration
: 168 | 6451.52 5979.2 0.00466992 0.000538675 193646 0
: 169 Minimum Test error found - save the configuration
: 169 | 6392.25 5923.43 0.00474946 0.000536625 189896 0
: 170 Minimum Test error found - save the configuration
: 170 | 6332.63 5869.22 0.00464264 0.000516693 193895 0
: 171 Minimum Test error found - save the configuration
: 171 | 6275.37 5814.08 0.00496255 0.000548463 181238 0
: 172 Minimum Test error found - save the configuration
: 172 | 6216.79 5760.37 0.00474218 0.000532924 190057 0
: 173 Minimum Test error found - save the configuration
: 173 | 6160.4 5705.99 0.00488594 0.000565063 185147 0
: 174 Minimum Test error found - save the configuration
: 174 | 6103.92 5651.58 0.00476194 0.000540644 189515 0
: 175 Minimum Test error found - save the configuration
: 175 | 6046.19 5600.11 0.00488885 0.000573195 185372 0
: 176 Minimum Test error found - save the configuration
: 176 | 5990.85 5547.84 0.00510101 0.000754715 184065 0
: 177 Minimum Test error found - save the configuration
: 177 | 5936.58 5495.47 0.00493541 0.000571383 183317 0
: 178 Minimum Test error found - save the configuration
: 178 | 5880.01 5445.98 0.00475729 0.000531625 189319 0
: 179 Minimum Test error found - save the configuration
: 179 | 5827.34 5394.29 0.00484681 0.000584354 187685 0
: 180 Minimum Test error found - save the configuration
: 180 | 5773.21 5343.82 0.00475601 0.000525603 189107 0
: 181 Minimum Test error found - save the configuration
: 181 | 5719.7 5294.34 0.00478614 0.000551474 188917 0
: 182 Minimum Test error found - save the configuration
: 182 | 5667.27 5244.66 0.00477602 0.000549975 189302 0
: 183 Minimum Test error found - save the configuration
: 183 | 5614.75 5195.59 0.00477803 0.000538664 188707 0
: 184 Minimum Test error found - save the configuration
: 184 | 5562.54 5147.38 0.0047003 0.000529753 191821 0
: 185 Minimum Test error found - save the configuration
: 185 | 5511.49 5099.69 0.00472959 0.000561834 191950 0
: 186 Minimum Test error found - save the configuration
: 186 | 5459.88 5053.23 0.00476508 0.000576144 190979 0
: 187 Minimum Test error found - save the configuration
: 187 | 5411.25 5004.31 0.004781 0.000533785 188359 0
: 188 Minimum Test error found - save the configuration
: 188 | 5360.77 4957.01 0.00464993 0.000522905 193844 0
: 189 Minimum Test error found - save the configuration
: 189 | 5310.55 4910.68 0.00460106 0.000526263 196329 0
: 190 Minimum Test error found - save the configuration
: 190 | 5261.43 4864.91 0.00498567 0.000551044 180399 0
: 191 Minimum Test error found - save the configuration
: 191 | 5213.06 4819.17 0.00456138 0.000507215 197328 0
: 192 Minimum Test error found - save the configuration
: 192 | 5164.49 4774.68 0.00459521 0.000525473 196573 0
: 193 Minimum Test error found - save the configuration
: 193 | 5116.29 4731.34 0.00470041 0.000556953 193075 0
: 194 Minimum Test error found - save the configuration
: 194 | 5069.72 4686.98 0.00488693 0.000532493 183720 0
: 195 Minimum Test error found - save the configuration
: 195 | 5022.7 4643.63 0.0044943 0.000492804 199925 0
: 196 Minimum Test error found - save the configuration
: 196 | 4977.06 4599.09 0.00461103 0.000530385 196047 0
: 197 Minimum Test error found - save the configuration
: 197 | 4930.34 4556.33 0.00470891 0.000538884 191845 0
: 198 Minimum Test error found - save the configuration
: 198 | 4884.95 4513.54 0.00453385 0.000532554 199935 0
: 199 Minimum Test error found - save the configuration
: 199 | 4840.12 4470.68 0.00460299 0.000517145 195798 0
: 200 Minimum Test error found - save the configuration
: 200 | 4794.61 4430.45 0.00450133 0.000494984 199683 0
: 201 Minimum Test error found - save the configuration
: 201 | 4751.41 4387.79 0.00458655 0.000524964 196967 0
: 202 Minimum Test error found - save the configuration
: 202 | 4706.36 4347.47 0.00462547 0.000506583 194227 0
: 203 Minimum Test error found - save the configuration
: 203 | 4663.75 4306.12 0.00477641 0.000522573 188065 0
: 204 Minimum Test error found - save the configuration
: 204 | 4620.42 4266.23 0.00462096 0.000539494 196008 0
: 205 Minimum Test error found - save the configuration
: 205 | 4577.41 4226.7 0.00458146 0.000512283 196600 0
: 206 Minimum Test error found - save the configuration
: 206 | 4535.89 4187.05 0.00455708 0.000518234 198076 0
: 207 Minimum Test error found - save the configuration
: 207 | 4493.4 4147.86 0.00475916 0.000624115 193468 0
: 208 Minimum Test error found - save the configuration
: 208 | 4451.79 4110.36 0.00556695 0.000548443 159410 0
: 209 Minimum Test error found - save the configuration
: 209 | 4411.68 4071.26 0.00467819 0.000548225 193706 0
: 210 Minimum Test error found - save the configuration
: 210 | 4369.97 4034.3 0.00491405 0.000563764 183896 0
: 211 Minimum Test error found - save the configuration
: 211 | 4330.99 3995.66 0.0046599 0.000548225 194568 0
: 212 Minimum Test error found - save the configuration
: 212 | 4290.72 3957.9 0.00456222 0.000511435 197492 0
: 213 Minimum Test error found - save the configuration
: 213 | 4250.27 3922.3 0.00456301 0.000541143 198913 0
: 214 Minimum Test error found - save the configuration
: 214 | 4212.85 3884.37 0.00470307 0.000513524 190951 0
: 215 Minimum Test error found - save the configuration
: 215 | 4173.9 3847.27 0.00455932 0.000509955 197562 0
: 216 Minimum Test error found - save the configuration
: 216 | 4134.83 3812.02 0.00450857 0.000502683 199706 0
: 217 Minimum Test error found - save the configuration
: 217 | 4096.44 3777.33 0.00452029 0.000506822 199329 0
: 218 Minimum Test error found - save the configuration
: 218 | 4059.53 3742.1 0.00448859 0.000500643 200604 0
: 219 Minimum Test error found - save the configuration
: 219 | 4022.9 3706.21 0.00455071 0.000499084 197451 0
: 220 Minimum Test error found - save the configuration
: 220 | 3984.92 3672.32 0.00450128 0.000507305 200302 0
: 221 Minimum Test error found - save the configuration
: 221 | 3949.57 3636.87 0.00457112 0.000501373 196572 0
: 222 Minimum Test error found - save the configuration
: 222 | 3912.08 3604.21 0.00472833 0.000554404 191666 0
: 223 Minimum Test error found - save the configuration
: 223 | 3877.63 3569.85 0.00473169 0.000550524 191334 0
: 224 Minimum Test error found - save the configuration
: 224 | 3841.27 3537.03 0.00454955 0.000506323 197862 0
: 225 Minimum Test error found - save the configuration
: 225 | 3806.55 3503.71 0.00462832 0.000531825 195289 0
: 226 Minimum Test error found - save the configuration
: 226 | 3771.91 3470.32 0.00455097 0.000495663 197272 0
: 227 Minimum Test error found - save the configuration
: 227 | 3737.07 3438.17 0.00461987 0.000561094 197104 0
: 228 Minimum Test error found - save the configuration
: 228 | 3702.43 3407.11 0.00461951 0.000522414 195260 0
: 229 Minimum Test error found - save the configuration
: 229 | 3669.76 3374.68 0.00460967 0.000512884 195275 0
: 230 Minimum Test error found - save the configuration
: 230 | 3635.4 3344.37 0.00480531 0.000517023 186555 0
: 231 Minimum Test error found - save the configuration
: 231 | 3603.29 3312.05 0.00475494 0.000534192 189540 0
: 232 Minimum Test error found - save the configuration
: 232 | 3569.56 3281.63 0.00481064 0.000529644 186872 0
: 233 Minimum Test error found - save the configuration
: 233 | 3537.61 3250.69 0.00463117 0.000537813 195438 0
: 234 Minimum Test error found - save the configuration
: 234 | 3505.25 3220.22 0.00575987 0.000758937 159970 0
: 235 Minimum Test error found - save the configuration
: 235 | 3472.86 3191.22 0.00475333 0.000537543 189763 0
: 236 Minimum Test error found - save the configuration
: 236 | 3442.21 3160.62 0.0047266 0.000528255 190551 0
: 237 Minimum Test error found - save the configuration
: 237 | 3409.63 3132.28 0.00467607 0.000533853 193133 0
: 238 Minimum Test error found - save the configuration
: 238 | 3379.7 3102.58 0.00466597 0.000535343 193675 0
: 239 Minimum Test error found - save the configuration
: 239 | 3348.59 3073.83 0.00467978 0.000523444 192477 0
: 240 Minimum Test error found - save the configuration
: 240 | 3318.3 3045.13 0.00467827 0.000516643 192232 0
: 241 Minimum Test error found - save the configuration
: 241 | 3287.9 3017.31 0.00458993 0.000513933 196271 0
: 242 Minimum Test error found - save the configuration
: 242 | 3258.92 2988.15 0.00455847 0.000525243 198352 0
: 243 Minimum Test error found - save the configuration
: 243 | 3228.24 2960.46 0.00458593 0.000505464 196056 0
: 244 Minimum Test error found - save the configuration
: 244 | 3199.22 2933.06 0.00456529 0.000516014 197566 0
: 245 Minimum Test error found - save the configuration
: 245 | 3169.69 2906.36 0.00452083 0.000499614 198945 0
: 246 Minimum Test error found - save the configuration
: 246 | 3141.14 2879.15 0.00454832 0.000508414 198024 0
: 247 Minimum Test error found - save the configuration
: 247 | 3112.93 2852.18 0.00451979 0.000496553 198845 0
: 248 Minimum Test error found - save the configuration
: 248 | 3083.84 2827 0.00462865 0.000519573 194691 0
: 249 Minimum Test error found - save the configuration
: 249 | 3057.27 2799.37 0.00463638 0.000552175 195876 0
: 250 Minimum Test error found - save the configuration
: 250 | 3028.32 2773.79 0.00469043 0.000513524 191529 0
: 251 Minimum Test error found - save the configuration
: 251 | 3000.87 2748.57 0.00463753 0.000514815 194047 0
: 252 Minimum Test error found - save the configuration
: 252 | 2974.13 2722.83 0.00465004 0.000525744 193972 0
: 253 Minimum Test error found - save the configuration
: 253 | 2946.95 2697.38 0.00453714 0.000498462 198085 0
: 254 Minimum Test error found - save the configuration
: 254 | 2919.94 2672.56 0.00466914 0.000526403 193109 0
: 255 Minimum Test error found - save the configuration
: 255 | 2893.53 2647.8 0.00455897 0.000503604 197269 0
: 256 Minimum Test error found - save the configuration
: 256 | 2867.33 2623.38 0.00458269 0.000525804 197195 0
: 257 Minimum Test error found - save the configuration
: 257 | 2841.83 2598.4 0.00473292 0.000568703 192113 0
: 258 Minimum Test error found - save the configuration
: 258 | 2815.49 2574.7 0.00477777 0.000564104 189858 0
: 259 Minimum Test error found - save the configuration
: 259 | 2789.95 2551.07 0.00457749 0.000510284 196695 0
: 260 Minimum Test error found - save the configuration
: 260 | 2765.04 2526.97 0.00463213 0.000526623 194860 0
: 261 Minimum Test error found - save the configuration
: 261 | 2739.68 2503.56 0.00456668 0.000505193 196972 0
: 262 Minimum Test error found - save the configuration
: 262 | 2715.14 2479.82 0.00455672 0.000510615 197721 0
: 263 Minimum Test error found - save the configuration
: 263 | 2690.16 2457.33 0.00460005 0.000525033 196318 0
: 264 Minimum Test error found - save the configuration
: 264 | 2666.04 2435.39 0.00472034 0.000526012 190734 0
: 265 Minimum Test error found - save the configuration
: 265 | 2641.56 2412.77 0.00463683 0.000549424 195723 0
: 266 Minimum Test error found - save the configuration
: 266 | 2618 2389.97 0.00470755 0.000534474 191705 0
: 267 Minimum Test error found - save the configuration
: 267 | 2593.41 2368.79 0.00466767 0.000508573 192349 0
: 268 Minimum Test error found - save the configuration
: 268 | 2570.8 2346.9 0.00473564 0.000526584 190066 0
: 269 Minimum Test error found - save the configuration
: 269 | 2547.92 2324.09 0.00464451 0.000528903 194382 0
: 270 Minimum Test error found - save the configuration
: 270 | 2523.64 2302.94 0.00465524 0.000533655 194100 0
: 271 Minimum Test error found - save the configuration
: 271 | 2501.39 2281.51 0.00463175 0.000504124 193816 0
: 272 Minimum Test error found - save the configuration
: 272 | 2478.01 2261.17 0.00460127 0.000531935 196592 0
: 273 Minimum Test error found - save the configuration
: 273 | 2455.92 2240.25 0.00473526 0.000498864 188840 0
: 274 Minimum Test error found - save the configuration
: 274 | 2433.42 2219.85 0.00456337 0.000504144 197082 0
: 275 Minimum Test error found - save the configuration
: 275 | 2411.12 2199.41 0.00461579 0.000543644 196456 0
: 276 Minimum Test error found - save the configuration
: 276 | 2389.15 2179.51 0.00455324 0.000506384 197684 0
: 277 Minimum Test error found - save the configuration
: 277 | 2367.89 2159.09 0.00485668 0.000665874 190894 0
: 278 Minimum Test error found - save the configuration
: 278 | 2345.96 2139.51 0.00500486 0.000532295 178868 0
: 279 Minimum Test error found - save the configuration
: 279 | 2324.64 2119.8 0.00467665 0.000516555 192303 0
: 280 Minimum Test error found - save the configuration
: 280 | 2303.88 2100.42 0.00452097 0.000492062 198565 0
: 281 Minimum Test error found - save the configuration
: 281 | 2282.39 2081.59 0.00487491 0.000498394 182794 0
: 282 Minimum Test error found - save the configuration
: 282 | 2261.6 2062.12 0.00451617 0.000508264 199605 0
: 283 Minimum Test error found - save the configuration
: 283 | 2240.83 2043.26 0.00465759 0.000532973 193957 0
: 284 Minimum Test error found - save the configuration
: 284 | 2220.54 2023.85 0.00459084 0.000578004 199360 0
: 285 Minimum Test error found - save the configuration
: 285 | 2199.52 2005.05 0.0047344 0.000589993 193031 0
: 286 Minimum Test error found - save the configuration
: 286 | 2179.04 1987.13 0.00480014 0.000544504 187986 0
: 287 Minimum Test error found - save the configuration
: 287 | 2159.55 1968.71 0.0046442 0.000504764 193263 0
: 288 Minimum Test error found - save the configuration
: 288 | 2139.51 1950.27 0.00469245 0.000545254 192901 0
: 289 Minimum Test error found - save the configuration
: 289 | 2119.88 1932.31 0.0046864 0.000519454 191987 0
: 290 Minimum Test error found - save the configuration
: 290 | 2099.86 1915.1 0.0045956 0.000506403 195637 0
: 291 Minimum Test error found - save the configuration
: 291 | 2081.03 1897.19 0.00467545 0.000517875 192420 0
: 292 Minimum Test error found - save the configuration
: 292 | 2061.22 1880.51 0.00477379 0.000527745 188411 0
: 293 Minimum Test error found - save the configuration
: 293 | 2042.75 1863.18 0.00453914 0.000498033 197966 0
: 294 Minimum Test error found - save the configuration
: 294 | 2023.55 1845.95 0.00491606 0.000523874 182141 0
: 295 Minimum Test error found - save the configuration
: 295 | 2004.99 1828.81 0.00468346 0.000536313 192904 0
: 296 Minimum Test error found - save the configuration
: 296 | 1986.3 1811.99 0.00464607 0.000552444 195426 0
: 297 Minimum Test error found - save the configuration
: 297 | 1967.53 1795.68 0.00458953 0.000505094 195865 0
: 298 Minimum Test error found - save the configuration
: 298 | 1949.6 1779.99 0.00460561 0.000538564 196703 0
: 299 Minimum Test error found - save the configuration
: 299 | 1931.71 1763.14 0.00482594 0.000551604 187163 0
: 300 Minimum Test error found - save the configuration
: 300 | 1913.46 1746.69 0.00475447 0.000530804 189409 0
: 301 Minimum Test error found - save the configuration
: 301 | 1895.23 1731.23 0.00473202 0.000532764 190510 0
: 302 Minimum Test error found - save the configuration
: 302 | 1878.03 1715.31 0.00462761 0.000542914 195853 0
: 303 Minimum Test error found - save the configuration
: 303 | 1860.8 1700.14 0.004588 0.000512434 196292 0
: 304 Minimum Test error found - save the configuration
: 304 | 1842.76 1683.59 0.00453745 0.000534924 199874 0
: 305 Minimum Test error found - save the configuration
: 305 | 1825.44 1668.5 0.00468653 0.000556453 193701 0
: 306 Minimum Test error found - save the configuration
: 306 | 1808.13 1653.43 0.00469569 0.000540335 192522 0
: 307 Minimum Test error found - save the configuration
: 307 | 1791.37 1638.24 0.00471479 0.000518674 190652 0
: 308 Minimum Test error found - save the configuration
: 308 | 1774.27 1623.53 0.00462683 0.000515423 194580 0
: 309 Minimum Test error found - save the configuration
: 309 | 1757.67 1608.21 0.00454617 0.000501834 197807 0
: 310 Minimum Test error found - save the configuration
: 310 | 1741.3 1593.4 0.00464994 0.000525724 193976 0
: 311 Minimum Test error found - save the configuration
: 311 | 1724.86 1578.39 0.00456069 0.000500675 197043 0
: 312 Minimum Test error found - save the configuration
: 312 | 1708.33 1564.09 0.00459662 0.000509494 195736 0
: 313 Minimum Test error found - save the configuration
: 313 | 1691.98 1551.15 0.00457656 0.000513164 196880 0
: 314 Minimum Test error found - save the configuration
: 314 | 1676.57 1535.68 0.00456345 0.000512193 197470 0
: 315 Minimum Test error found - save the configuration
: 315 | 1659.98 1522.13 0.00472021 0.000533924 191100 0
: 316 Minimum Test error found - save the configuration
: 316 | 1644.61 1507.66 0.00457614 0.000499425 196236 0
: 317 Minimum Test error found - save the configuration
: 317 | 1628.66 1494.03 0.00452443 0.000494524 198516 0
: 318 Minimum Test error found - save the configuration
: 318 | 1613.33 1480.36 0.00461604 0.000539124 196227 0
: 319 Minimum Test error found - save the configuration
: 319 | 1597.93 1466.67 0.00455572 0.000498975 197202 0
: 320 Minimum Test error found - save the configuration
: 320 | 1582.91 1452.69 0.00459489 0.000523444 196490 0
: 321 Minimum Test error found - save the configuration
: 321 | 1567.42 1439.53 0.00462301 0.000563484 197067 0
: 322 Minimum Test error found - save the configuration
: 322 | 1552.78 1425.92 0.00457118 0.000523044 197622 0
: 323 Minimum Test error found - save the configuration
: 323 | 1537.14 1413.75 0.00452367 0.000505332 199087 0
: 324 Minimum Test error found - save the configuration
: 324 | 1523.16 1400.37 0.00453782 0.000493893 197827 0
: 325 Minimum Test error found - save the configuration
: 325 | 1508.29 1387.81 0.00455132 0.000509572 197934 0
: 326 Minimum Test error found - save the configuration
: 326 | 1493.89 1374.67 0.00464353 0.000501923 193162 0
: 327 Minimum Test error found - save the configuration
: 327 | 1479.94 1361.68 0.00465387 0.000511823 193141 0
: 328 Minimum Test error found - save the configuration
: 328 | 1465.14 1349.26 0.00458578 0.000513564 196453 0
: 329 Minimum Test error found - save the configuration
: 329 | 1451.03 1337.07 0.00463347 0.000506604 193852 0
: 330 Minimum Test error found - save the configuration
: 330 | 1437.81 1324.11 0.00464173 0.000529484 194541 0
: 331 Minimum Test error found - save the configuration
: 331 | 1423.43 1312.42 0.00485271 0.000561895 186445 0
: 332 Minimum Test error found - save the configuration
: 332 | 1409.69 1300.94 0.00462747 0.000502324 193932 0
: 333 Minimum Test error found - save the configuration
: 333 | 1396.72 1287.68 0.00486092 0.000642233 189632 0
: 334 Minimum Test error found - save the configuration
: 334 | 1383.05 1275.55 0.00497707 0.000532973 180014 0
: 335 Minimum Test error found - save the configuration
: 335 | 1369.27 1263.95 0.00508764 0.000523304 175272 0
: 336 Minimum Test error found - save the configuration
: 336 | 1356.38 1252.36 0.00464678 0.000518084 193766 0
: 337 Minimum Test error found - save the configuration
: 337 | 1343.32 1240.86 0.00549349 0.000544404 161646 0
: 338 Minimum Test error found - save the configuration
: 338 | 1330.35 1229.39 0.00481273 0.000525823 186615 0
: 339 Minimum Test error found - save the configuration
: 339 | 1317.92 1217.72 0.00500536 0.000557644 179868 0
: 340 Minimum Test error found - save the configuration
: 340 | 1304.53 1206.29 0.00496046 0.000535695 180801 0
: 341 Minimum Test error found - save the configuration
: 341 | 1291.77 1195.21 0.00494726 0.000534443 181290 0
: 342 Minimum Test error found - save the configuration
: 342 | 1279.73 1183.97 0.00494633 0.000556284 182231 0
: 343 Minimum Test error found - save the configuration
: 343 | 1267.06 1173.16 0.00531181 0.000563295 168474 0
: 344 Minimum Test error found - save the configuration
: 344 | 1255.05 1162.09 0.00494922 0.000543514 181582 0
: 345 Minimum Test error found - save the configuration
: 345 | 1242.75 1151.22 0.00495485 0.000546374 181468 0
: 346 Minimum Test error found - save the configuration
: 346 | 1231.12 1140.07 0.00490645 0.000535423 183023 0
: 347 Minimum Test error found - save the configuration
: 347 | 1218.86 1129.14 0.00499582 0.000543213 179670 0
: 348 Minimum Test error found - save the configuration
: 348 | 1206.59 1119.26 0.00488808 0.000536383 183836 0
: 349 Minimum Test error found - save the configuration
: 349 | 1195.43 1108.23 0.00512151 0.000632945 178231 0
: 350 Minimum Test error found - save the configuration
: 350 | 1183.6 1098.05 0.00483022 0.000528883 185989 0
: 351 Minimum Test error found - save the configuration
: 351 | 1172.37 1087.38 0.00487123 0.000549505 185111 0
: 352 Minimum Test error found - save the configuration
: 352 | 1160.68 1077.25 0.00495078 0.000546784 181653 0
: 353 Minimum Test error found - save the configuration
: 353 | 1149.2 1067.78 0.00472941 0.000530204 190512 0
: 354 Minimum Test error found - save the configuration
: 354 | 1139.05 1056.52 0.00508745 0.000543174 176046 0
: 355 Minimum Test error found - save the configuration
: 355 | 1127.37 1047.02 0.00470668 0.000551594 192535 0
: 356 Minimum Test error found - save the configuration
: 356 | 1116.23 1036.77 0.00480369 0.000530993 187235 0
: 357 Minimum Test error found - save the configuration
: 357 | 1105.24 1027.91 0.00477413 0.000516554 187900 0
: 358 Minimum Test error found - save the configuration
: 358 | 1094.64 1018.01 0.00479704 0.000547534 188257 0
: 359 Minimum Test error found - save the configuration
: 359 | 1084.49 1007.91 0.00477601 0.000538794 188803 0
: 360 Minimum Test error found - save the configuration
: 360 | 1073.59 997.842 0.00467341 0.000524933 192842 0
: 361 Minimum Test error found - save the configuration
: 361 | 1062.49 989.153 0.00471605 0.000523124 190797 0
: 362 Minimum Test error found - save the configuration
: 362 | 1052.45 979.8 0.00464086 0.000526004 194417 0
: 363 Minimum Test error found - save the configuration
: 363 | 1042.27 970.209 0.0047306 0.000571804 192363 0
: 364 Minimum Test error found - save the configuration
: 364 | 1031.99 960.982 0.00487352 0.000529783 184173 0
: 365 Minimum Test error found - save the configuration
: 365 | 1022.23 951.528 0.00482189 0.000561304 187767 0
: 366 Minimum Test error found - save the configuration
: 366 | 1012.12 942.261 0.00457242 0.000507093 196786 0
: 367 Minimum Test error found - save the configuration
: 367 | 1002.26 933.661 0.00490657 0.000614714 186399 0
: 368 Minimum Test error found - save the configuration
: 368 | 992.217 924.08 0.00464356 0.000554364 195637 0
: 369 Minimum Test error found - save the configuration
: 369 | 982.035 916.054 0.0048203 0.000542174 186998 0
: 370 Minimum Test error found - save the configuration
: 370 | 973.046 907.063 0.00474826 0.000518164 189121 0
: 371 Minimum Test error found - save the configuration
: 371 | 963.627 898.863 0.00485001 0.000590734 187825 0
: 372 Minimum Test error found - save the configuration
: 372 | 954.504 889.304 0.00472623 0.000534924 190871 0
: 373 Minimum Test error found - save the configuration
: 373 | 944.507 880.648 0.00478544 0.000564894 189549 0
: 374 Minimum Test error found - save the configuration
: 374 | 935.035 872.425 0.00466293 0.000509173 192597 0
: 375 Minimum Test error found - save the configuration
: 375 | 926.339 863.651 0.00491662 0.000517434 181852 0
: 376 Minimum Test error found - save the configuration
: 376 | 916.857 855.457 0.00471946 0.000537234 191286 0
: 377 Minimum Test error found - save the configuration
: 377 | 908.08 847.038 0.00461871 0.000514774 194935 0
: 378 Minimum Test error found - save the configuration
: 378 | 898.577 839.252 0.00476076 0.000525324 188882 0
: 379 Minimum Test error found - save the configuration
: 379 | 890.234 830.709 0.0046813 0.000526474 192547 0
: 380 Minimum Test error found - save the configuration
: 380 | 881.145 822.563 0.00472826 0.000535814 190819 0
: 381 Minimum Test error found - save the configuration
: 381 | 872.268 814.748 0.00463053 0.000507874 194050 0
: 382 Minimum Test error found - save the configuration
: 382 | 864.032 806.989 0.00483379 0.000562524 187298 0
: 383 Minimum Test error found - save the configuration
: 383 | 855.308 799.343 0.0048236 0.000626084 190589 0
: 384 Minimum Test error found - save the configuration
: 384 | 846.998 790.767 0.00470939 0.000532724 191540 0
: 385 Minimum Test error found - save the configuration
: 385 | 838.397 783.013 0.00469093 0.000529193 192227 0
: 386 Minimum Test error found - save the configuration
: 386 | 829.974 775.444 0.0047134 0.000523504 190935 0
: 387 Minimum Test error found - save the configuration
: 387 | 821.545 768.017 0.00477067 0.000547784 189444 0
: 388 Minimum Test error found - save the configuration
: 388 | 813.649 760.314 0.0054586 0.000611655 165052 0
: 389 Minimum Test error found - save the configuration
: 389 | 805.788 752.499 0.00592149 0.000594284 150172 0
: 390 Minimum Test error found - save the configuration
: 390 | 797.24 745.058 0.00600729 0.000678565 150130 0
: 391 Minimum Test error found - save the configuration
: 391 | 789.61 737.468 0.0049869 0.000633234 183753 0
: 392 Minimum Test error found - save the configuration
: 392 | 781.226 730.563 0.00499138 0.000530084 179320 0
: 393 Minimum Test error found - save the configuration
: 393 | 773.625 722.981 0.00628849 0.000786706 145407 0
: 394 Minimum Test error found - save the configuration
: 394 | 765.767 715.944 0.00580562 0.000649335 155150 0
: 395 Minimum Test error found - save the configuration
: 395 | 758.076 708.752 0.00545818 0.000651125 166422 0
: 396 Minimum Test error found - save the configuration
: 396 | 750.69 701.717 0.00482214 0.000541894 186905 0
: 397 Minimum Test error found - save the configuration
: 397 | 742.781 694.859 0.00462719 0.000513283 194462 0
: 398 Minimum Test error found - save the configuration
: 398 | 735.761 687.285 0.00492539 0.000648744 187063 0
: 399 Minimum Test error found - save the configuration
: 399 | 728.074 680.569 0.00468931 0.000511244 191476 0
: 400 Minimum Test error found - save the configuration
: 400 | 721.045 673.452 0.0052233 0.000547274 171086 0
: 401 Minimum Test error found - save the configuration
: 401 | 713.425 667.265 0.00493285 0.000531794 181774 0
: 402 Minimum Test error found - save the configuration
: 402 | 706.604 660.101 0.00482572 0.000529413 186206 0
: 403 Minimum Test error found - save the configuration
: 403 | 699.256 653.41 0.00498036 0.000545714 180398 0
: 404 Minimum Test error found - save the configuration
: 404 | 692.219 646.57 0.0053241 0.000800856 176864 0
: 405 Minimum Test error found - save the configuration
: 405 | 685.215 640.174 0.00553391 0.000583294 161596 0
: 406 Minimum Test error found - save the configuration
: 406 | 677.962 633.985 0.00493005 0.000569665 183470 0
: 407 Minimum Test error found - save the configuration
: 407 | 671.614 627.395 0.00555326 0.000763355 167018 0
: 408 Minimum Test error found - save the configuration
: 408 | 664.724 621.126 0.00496551 0.000558684 181537 0
: 409 Minimum Test error found - save the configuration
: 409 | 657.761 614.346 0.00522377 0.000743836 178574 0
: 410 Minimum Test error found - save the configuration
: 410 | 651.223 607.784 0.00575809 0.000705865 158346 0
: 411 Minimum Test error found - save the configuration
: 411 | 644.377 601.413 0.00576057 0.000547254 153453 0
: 412 Minimum Test error found - save the configuration
: 412 | 637.563 595.93 0.00547033 0.000693255 167467 0
: 413 Minimum Test error found - save the configuration
: 413 | 631.35 589.336 0.00574971 0.000570394 154461 0
: 414 Minimum Test error found - save the configuration
: 414 | 625.103 583.248 0.00599705 0.000561414 147177 0
: 415 Minimum Test error found - save the configuration
: 415 | 618.572 577.606 0.00582779 0.000634704 154051 0
: 416 Minimum Test error found - save the configuration
: 416 | 612.689 570.923 0.0056745 0.000602145 157718 0
: 417 Minimum Test error found - save the configuration
: 417 | 605.83 564.848 0.00670505 0.000775145 134909 0
: 418 Minimum Test error found - save the configuration
: 418 | 599.775 558.965 0.00543081 0.000594814 165426 0
: 419 Minimum Test error found - save the configuration
: 419 | 593.33 553.372 0.00615844 0.000702075 146618 0
: 420 Minimum Test error found - save the configuration
: 420 | 587.215 547.509 0.00616601 0.000567364 142892 0
: 421 Minimum Test error found - save the configuration
: 421 | 581.031 541.97 0.00479878 0.000533663 187568 0
: 422 Minimum Test error found - save the configuration
: 422 | 575.041 536.619 0.00474537 0.000519154 189294 0
: 423 Minimum Test error found - save the configuration
: 423 | 569.613 530.733 0.00477802 0.000521513 187947 0
: 424 Minimum Test error found - save the configuration
: 424 | 563.701 524.94 0.00479365 0.000539493 188051 0
: 425 Minimum Test error found - save the configuration
: 425 | 557.578 519.366 0.00493247 0.000660715 187277 0
: 426 Minimum Test error found - save the configuration
: 426 | 552.049 513.871 0.00639014 0.000781636 142640 0
: 427 Minimum Test error found - save the configuration
: 427 | 546.042 508.408 0.00611948 0.000551074 143668 0
: 428 Minimum Test error found - save the configuration
: 428 | 540.475 503.454 0.00621136 0.000742255 146276 0
: 429 Minimum Test error found - save the configuration
: 429 | 535.01 498.129 0.00490275 0.000558554 184154 0
: 430 Minimum Test error found - save the configuration
: 430 | 529.4 492.598 0.00477203 0.000534814 188803 0
: 431 Minimum Test error found - save the configuration
: 431 | 523.777 487.429 0.00468348 0.000527843 192509 0
: 432 Minimum Test error found - save the configuration
: 432 | 518.525 482.084 0.00593972 0.000680405 152111 0
: 433 Minimum Test error found - save the configuration
: 433 | 512.98 477.264 0.00586301 0.000625564 152746 0
: 434 Minimum Test error found - save the configuration
: 434 | 507.676 472.29 0.00537683 0.000652195 169325 0
: 435 Minimum Test error found - save the configuration
: 435 | 502.904 466.697 0.0049905 0.000607674 182531 0
: 436 Minimum Test error found - save the configuration
: 436 | 497.087 461.925 0.00480051 0.000571644 189176 0
: 437 Minimum Test error found - save the configuration
: 437 | 491.946 457.843 0.00499674 0.000652645 184158 0
: 438 Minimum Test error found - save the configuration
: 438 | 487.029 451.849 0.00550297 0.000596404 163047 0
: 439 Minimum Test error found - save the configuration
: 439 | 481.715 446.899 0.00492778 0.000572514 183685 0
: 440 Minimum Test error found - save the configuration
: 440 | 476.541 442.147 0.00473691 0.000515503 189510 0
: 441 Minimum Test error found - save the configuration
: 441 | 471.97 436.914 0.00488654 0.000540064 184057 0
: 442 Minimum Test error found - save the configuration
: 442 | 466.661 432.443 0.00490863 0.000547544 183440 0
: 443 Minimum Test error found - save the configuration
: 443 | 461.822 427.941 0.00576294 0.000604854 155096 0
: 444 Minimum Test error found - save the configuration
: 444 | 456.951 423.588 0.00595499 0.000574205 148677 0
: 445 Minimum Test error found - save the configuration
: 445 | 452.128 418.893 0.00474897 0.000592594 192475 0
: 446 Minimum Test error found - save the configuration
: 446 | 447.789 414.202 0.00603342 0.000686024 149605 0
: 447 Minimum Test error found - save the configuration
: 447 | 442.826 409.76 0.00500378 0.000574544 180618 0
: 448 Minimum Test error found - save the configuration
: 448 | 438.089 405.38 0.00492142 0.000549684 182994 0
: 449 Minimum Test error found - save the configuration
: 449 | 433.766 401.157 0.00466354 0.000504953 192373 0
: 450 Minimum Test error found - save the configuration
: 450 | 429.185 396.407 0.0045988 0.000517804 196030 0
: 451 Minimum Test error found - save the configuration
: 451 | 424.854 392.095 0.00462365 0.000509744 194462 0
: 452 Minimum Test error found - save the configuration
: 452 | 419.807 387.878 0.00573904 0.000722845 159483 0
: 453 Minimum Test error found - save the configuration
: 453 | 415.631 383.375 0.00619997 0.000745365 146665 0
: 454 Minimum Test error found - save the configuration
: 454 | 411.343 379.422 0.00556848 0.000751105 166066 0
: 455 Minimum Test error found - save the configuration
: 455 | 407.086 375.073 0.00545526 0.000753236 170140 0
: 456 Minimum Test error found - save the configuration
: 456 | 402.904 370.674 0.00596499 0.000575524 148438 0
: 457 Minimum Test error found - save the configuration
: 457 | 398.532 367.013 0.00537029 0.000763566 173659 0
: 458 Minimum Test error found - save the configuration
: 458 | 394.326 362.964 0.00512574 0.000551744 174902 0
: 459 Minimum Test error found - save the configuration
: 459 | 390.108 358.728 0.0047595 0.000542524 189709 0
: 460 Minimum Test error found - save the configuration
: 460 | 386.029 354.179 0.00495875 0.000599514 183518 0
: 461 Minimum Test error found - save the configuration
: 461 | 381.836 350.402 0.0048152 0.000559684 187991 0
: 462 Minimum Test error found - save the configuration
: 462 | 377.925 346.339 0.00498864 0.000594824 182074 0
: 463 Minimum Test error found - save the configuration
: 463 | 373.607 343.027 0.00475636 0.000526834 189146 0
: 464 Minimum Test error found - save the configuration
: 464 | 369.922 338.817 0.00473084 0.000513254 189682 0
: 465 Minimum Test error found - save the configuration
: 465 | 365.693 335.437 0.00478461 0.000530224 188041 0
: 466 Minimum Test error found - save the configuration
: 466 | 362.052 331.727 0.0046569 0.000539494 194297 0
: 467 Minimum Test error found - save the configuration
: 467 | 357.92 327.743 0.00489862 0.000571794 184893 0
: 468 Minimum Test error found - save the configuration
: 468 | 354.472 324.178 0.00517541 0.000557604 173243 0
: 469 Minimum Test error found - save the configuration
: 469 | 350.595 320.322 0.00485928 0.000594205 187570 0
: 470 Minimum Test error found - save the configuration
: 470 | 346.684 316.58 0.00493419 0.000563694 183045 0
: 471 Minimum Test error found - save the configuration
: 471 | 342.844 313.354 0.00470711 0.000539504 191957 0
: 472 Minimum Test error found - save the configuration
: 472 | 339.4 309.491 0.00481516 0.000554154 187749 0
: 473 Minimum Test error found - save the configuration
: 473 | 335.928 305.513 0.00483236 0.000536174 186212 0
: 474 Minimum Test error found - save the configuration
: 474 | 331.972 302.2 0.00463243 0.000529294 194973 0
: 475 Minimum Test error found - save the configuration
: 475 | 328.217 299.203 0.00449348 0.000492673 199960 0
: 476 Minimum Test error found - save the configuration
: 476 | 325.292 295.643 0.00449323 0.000506474 200664 0
: 477 Minimum Test error found - save the configuration
: 477 | 321.574 292.537 0.00451674 0.000503143 199322 0
: 478 Minimum Test error found - save the configuration
: 478 | 318.067 288.96 0.00456302 0.000553154 199508 0
: 479 Minimum Test error found - save the configuration
: 479 | 314.47 285.948 0.00464934 0.000508114 193179 0
: 480 Minimum Test error found - save the configuration
: 480 | 311.547 282.337 0.00454831 0.000509543 198080 0
: 481 Minimum Test error found - save the configuration
: 481 | 307.787 279.305 0.00463191 0.000576844 197284 0
: 482 Minimum Test error found - save the configuration
: 482 | 304.509 276 0.00449649 0.000501893 200270 0
: 483 Minimum Test error found - save the configuration
: 483 | 301.101 272.711 0.00469546 0.000536374 192350 0
: 484 Minimum Test error found - save the configuration
: 484 | 297.876 269.491 0.00454477 0.000511844 198367 0
: 485 Minimum Test error found - save the configuration
: 485 | 294.404 266.88 0.0047229 0.000521164 190397 0
: 486 Minimum Test error found - save the configuration
: 486 | 291.52 263.859 0.00459951 0.000549633 197537 0
: 487 Minimum Test error found - save the configuration
: 487 | 288.552 261.002 0.00468568 0.000514294 191783 0
: 488 Minimum Test error found - save the configuration
: 488 | 285.422 257.503 0.0045464 0.000507893 198093 0
: 489 Minimum Test error found - save the configuration
: 489 | 282.08 255.869 0.00458457 0.000517954 196724 0
: 490 Minimum Test error found - save the configuration
: 490 | 279.492 252.082 0.00467336 0.000624884 197605 0
: 491 Minimum Test error found - save the configuration
: 491 | 276.141 249.137 0.00506311 0.000542444 176965 0
: 492 Minimum Test error found - save the configuration
: 492 | 273.095 246.343 0.00469304 0.000523514 191868 0
: 493 Minimum Test error found - save the configuration
: 493 | 270.06 243.036 0.00518549 0.000633265 175738 0
: 494 Minimum Test error found - save the configuration
: 494 | 266.944 239.905 0.00529109 0.000634694 171807 0
: 495 Minimum Test error found - save the configuration
: 495 | 264.135 237.601 0.00465475 0.000521684 193561 0
: 496 Minimum Test error found - save the configuration
: 496 | 261.213 235.241 0.004645 0.000530444 194432 0
: 497 Minimum Test error found - save the configuration
: 497 | 258.414 232.206 0.00458094 0.000507313 196385 0
: 498 Minimum Test error found - save the configuration
: 498 | 255.765 228.974 0.00495632 0.000531663 180805 0
: 499 Minimum Test error found - save the configuration
: 499 | 252.744 226.602 0.00472911 0.000531323 190576 0
: 500 Minimum Test error found - save the configuration
: 500 | 249.895 224.404 0.00466739 0.000528304 193279 0
: 501 Minimum Test error found - save the configuration
: 501 | 247.212 221.327 0.00463857 0.000520944 194287 0
: 502 Minimum Test error found - save the configuration
: 502 | 244.557 219.134 0.00460311 0.000504483 195187 0
: 503 Minimum Test error found - save the configuration
: 503 | 241.885 216.048 0.00469306 0.000535894 192439 0
: 504 Minimum Test error found - save the configuration
: 504 | 239.236 213.653 0.00477375 0.000534944 188732 0
: 505 Minimum Test error found - save the configuration
: 505 | 236.602 211.04 0.00474084 0.000539104 190397 0
: 506 Minimum Test error found - save the configuration
: 506 | 233.833 208.947 0.00488874 0.000513203 182835 0
: 507 Minimum Test error found - save the configuration
: 507 | 231.465 206.027 0.00454537 0.000516964 198590 0
: 508 Minimum Test error found - save the configuration
: 508 | 228.772 203.794 0.00481536 0.000540214 187128 0
: 509 Minimum Test error found - save the configuration
: 509 | 226.379 201.369 0.0046203 0.000518134 195019 0
: 510 Minimum Test error found - save the configuration
: 510 | 223.75 199.223 0.00462896 0.000564664 196836 0
: 511 Minimum Test error found - save the configuration
: 511 | 221.599 197.418 0.00468369 0.000533713 192772 0
: 512 Minimum Test error found - save the configuration
: 512 | 219.278 194.795 0.00488241 0.000529224 183774 0
: 513 Minimum Test error found - save the configuration
: 513 | 216.656 192.321 0.00487827 0.000622764 187992 0
: 514 Minimum Test error found - save the configuration
: 514 | 214.141 190.43 0.00550359 0.000712745 166985 0
: 515 Minimum Test error found - save the configuration
: 515 | 211.79 187.927 0.00476714 0.000542594 189369 0
: 516 Minimum Test error found - save the configuration
: 516 | 209.548 185.935 0.00468322 0.000500744 191274 0
: 517 Minimum Test error found - save the configuration
: 517 | 207.841 184.225 0.00450138 0.000512364 200551 0
: 518 Minimum Test error found - save the configuration
: 518 | 205.231 181.898 0.00471769 0.000532174 191135 0
: 519 Minimum Test error found - save the configuration
: 519 | 202.831 178.952 0.00461139 0.000516754 195377 0
: 520 Minimum Test error found - save the configuration
: 520 | 200.298 176.709 0.00460084 0.000536634 196840 0
: 521 Minimum Test error found - save the configuration
: 521 | 198.036 174.826 0.00451801 0.000505434 199373 0
: 522 Minimum Test error found - save the configuration
: 522 | 195.959 172.527 0.00471413 0.000535124 191433 0
: 523 Minimum Test error found - save the configuration
: 523 | 193.647 170.487 0.00471995 0.000612024 194745 0
: 524 Minimum Test error found - save the configuration
: 524 | 191.392 169.094 0.0049745 0.000660795 185456 0
: 525 Minimum Test error found - save the configuration
: 525 | 189.225 166.69 0.00513817 0.000674674 179232 0
: 526 Minimum Test error found - save the configuration
: 526 | 187.346 164.597 0.0049203 0.000591365 184803 0
: 527 Minimum Test error found - save the configuration
: 527 | 185.076 162.746 0.00467992 0.000536194 193063 0
: 528 Minimum Test error found - save the configuration
: 528 | 182.92 160.849 0.00466773 0.000511814 192497 0
: 529 Minimum Test error found - save the configuration
: 529 | 181.155 158.635 0.00470081 0.000510964 190938 0
: 530 Minimum Test error found - save the configuration
: 530 | 178.978 156.859 0.00473374 0.000568374 192060 0
: 531 Minimum Test error found - save the configuration
: 531 | 176.858 155.154 0.0046361 0.000510453 193909 0
: 532 Minimum Test error found - save the configuration
: 532 | 174.925 153.67 0.0045489 0.000495284 197355 0
: 533 Minimum Test error found - save the configuration
: 533 | 173.312 151.898 0.00472182 0.000557024 192086 0
: 534 Minimum Test error found - save the configuration
: 534 | 170.772 149.842 0.00484407 0.000565924 186997 0
: 535 Minimum Test error found - save the configuration
: 535 | 168.739 147.907 0.0049104 0.000534784 182831 0
: 536 Minimum Test error found - save the configuration
: 536 | 166.921 146.438 0.00513554 0.000763756 182992 0
: 537 Minimum Test error found - save the configuration
: 537 | 165.023 144.373 0.00560779 0.000604955 159909 0
: 538 Minimum Test error found - save the configuration
: 538 | 163.122 143.285 0.00466863 0.000520474 192857 0
: 539 Minimum Test error found - save the configuration
: 539 | 161.198 141.588 0.00499712 0.000580124 181118 0
: 540 Minimum Test error found - save the configuration
: 540 | 159.414 139.446 0.00464364 0.000540873 194990 0
: 541 Minimum Test error found - save the configuration
: 541 | 157.847 137.759 0.0047628 0.000556814 190205 0
: 542 Minimum Test error found - save the configuration
: 542 | 155.739 136.297 0.00495237 0.000559124 182098 0
: 543 Minimum Test error found - save the configuration
: 543 | 153.901 134.853 0.00462956 0.000504714 193946 0
: 544 Minimum Test error found - save the configuration
: 544 | 152.397 133.408 0.00542412 0.000713875 169843 0
: 545 Minimum Test error found - save the configuration
: 545 | 150.719 131.505 0.00644987 0.000769235 140829 0
: 546 Minimum Test error found - save the configuration
: 546 | 148.854 130.021 0.00657677 0.000758445 137497 0
: 547 Minimum Test error found - save the configuration
: 547 | 146.846 128.51 0.00652354 0.000759686 138796 0
: 548 Minimum Test error found - save the configuration
: 548 | 145.765 127.434 0.0066034 0.000752286 136726 0
: 549 Minimum Test error found - save the configuration
: 549 | 143.713 126.105 0.0066685 0.000759255 135381 0
: 550 Minimum Test error found - save the configuration
: 550 | 141.883 124.303 0.00663066 0.000772915 136571 0
: 551 Minimum Test error found - save the configuration
: 551 | 140.169 122.508 0.0066568 0.000771676 135936 0
: 552 Minimum Test error found - save the configuration
: 552 | 138.494 121.522 0.00663055 0.000757035 136205 0
: 553 Minimum Test error found - save the configuration
: 553 | 136.93 119.597 0.00663712 0.000765655 136252 0
: 554 Minimum Test error found - save the configuration
: 554 | 135.458 118.305 0.00663737 0.000769456 136335 0
: 555 Minimum Test error found - save the configuration
: 555 | 133.595 116.656 0.00661391 0.000749445 136415 0
: 556 Minimum Test error found - save the configuration
: 556 | 132.274 115.178 0.0066358 0.000773865 136474 0
: 557 Minimum Test error found - save the configuration
: 557 | 130.662 114.302 0.00663288 0.000782405 136741 0
: 558 Minimum Test error found - save the configuration
: 558 | 129.233 112.268 0.00660912 0.000762036 136820 0
: 559 Minimum Test error found - save the configuration
: 559 | 127.42 111.009 0.00666258 0.000781285 136025 0
: 560 Minimum Test error found - save the configuration
: 560 | 126.215 110.099 0.00671281 0.000781566 134879 0
: 561 Minimum Test error found - save the configuration
: 561 | 124.524 108.634 0.00633459 0.000561924 138584 0
: 562 Minimum Test error found - save the configuration
: 562 | 123.03 107.21 0.00645838 0.000765805 140534 0
: 563 Minimum Test error found - save the configuration
: 563 | 121.593 105.387 0.00658601 0.000786445 137941 0
: 564 Minimum Test error found - save the configuration
: 564 | 119.937 104.388 0.00622146 0.000728585 145643 0
: 565 Minimum Test error found - save the configuration
: 565 | 118.539 103.446 0.00590691 0.000737715 154763 0
: 566 Minimum Test error found - save the configuration
: 566 | 117.319 102.57 0.00622767 0.000696995 144648 0
: 567 Minimum Test error found - save the configuration
: 567 | 115.872 101.228 0.00645139 0.000774366 140919 0
: 568 Minimum Test error found - save the configuration
: 568 | 114.536 99.5122 0.00572674 0.000767296 161308 0
: 569 Minimum Test error found - save the configuration
: 569 | 113.126 97.9383 0.00662926 0.000753895 136162 0
: 570 Minimum Test error found - save the configuration
: 570 | 111.669 96.9479 0.00664046 0.000769155 136256 0
: 571 Minimum Test error found - save the configuration
: 571 | 110.345 95.5419 0.00659712 0.000798205 137957 0
: 572 Minimum Test error found - save the configuration
: 572 | 109.005 94.6248 0.00654628 0.000752345 138075 0
: 573 Minimum Test error found - save the configuration
: 573 | 107.69 93.9797 0.00659659 0.000773126 137375 0
: 574 Minimum Test error found - save the configuration
: 574 | 106.716 92.6629 0.0066172 0.000770635 136833 0
: 575 Minimum Test error found - save the configuration
: 575 | 105.462 91.0153 0.00658853 0.000770295 137499 0
: 576 Minimum Test error found - save the configuration
: 576 | 104.186 89.5543 0.00637715 0.000537824 137002 0
: 577 Minimum Test error found - save the configuration
: 577 | 102.833 88.8391 0.00658027 0.000773666 137774 0
: 578 Minimum Test error found - save the configuration
: 578 | 101.396 88.1083 0.00664287 0.000766605 136141 0
: 579 Minimum Test error found - save the configuration
: 579 | 100.385 87.3135 0.00637217 0.000632704 139386 0
: 580 Minimum Test error found - save the configuration
: 580 | 99.3786 85.9388 0.00609942 0.000738985 149242 0
: 581 Minimum Test error found - save the configuration
: 581 | 98.0015 84.5895 0.00602029 0.000735246 151370 0
: 582 Minimum Test error found - save the configuration
: 582 | 96.866 83.3917 0.00654457 0.000767285 138473 0
: 583 Minimum Test error found - save the configuration
: 583 | 95.5885 82.792 0.00653559 0.000752915 138344 0
: 584 Minimum Test error found - save the configuration
: 584 | 94.4214 81.0794 0.00649534 0.000762375 139544 0
: 585 Minimum Test error found - save the configuration
: 585 | 93.4346 80.8401 0.00655656 0.000772016 138300 0
: 586 Minimum Test error found - save the configuration
: 586 | 92.2155 79.013 0.00627396 0.000751076 144852 0
: 587 Minimum Test error found - save the configuration
: 587 | 91.3226 78.4489 0.00627328 0.000740145 144583 0
: 588 Minimum Test error found - save the configuration
: 588 | 90.3531 77.9904 0.00647038 0.000749915 139849 0
: 589 Minimum Test error found - save the configuration
: 589 | 89.1979 77.0288 0.00603998 0.000569125 146229 0
: 590 Minimum Test error found - save the configuration
: 590 | 88.2519 75.1656 0.00581069 0.000623375 154222 0
: 591 Minimum Test error found - save the configuration
: 591 | 86.8865 74.2659 0.00614708 0.000654775 145658 0
: 592 Minimum Test error found - save the configuration
: 592 | 85.8646 73.9161 0.00591985 0.000661295 152133 0
: 593 Minimum Test error found - save the configuration
: 593 | 84.7533 72.0568 0.00627153 0.000756096 145048 0
: 594 Minimum Test error found - save the configuration
: 594 | 83.9382 71.6768 0.00608071 0.000723285 149325 0
: 595 Minimum Test error found - save the configuration
: 595 | 83.018 70.2823 0.0063437 0.000726985 142432 0
: 596 Minimum Test error found - save the configuration
: 596 | 81.8708 69.7144 0.0061247 0.000702635 147545 0
: 597 Minimum Test error found - save the configuration
: 597 | 81.046 69.6984 0.00528123 0.000658434 173056 0
: 598 Minimum Test error found - save the configuration
: 598 | 80.1998 68.0457 0.00605438 0.000608285 146894 0
: 599 Minimum Test error found - save the configuration
: 599 | 79.1262 66.7625 0.00629738 0.000739326 143935 0
: 600 Minimum Test error found - save the configuration
: 600 | 78.0576 66.1092 0.00626766 0.000731085 144494 0
: 601 Minimum Test error found - save the configuration
: 601 | 77.1322 65.0602 0.0064402 0.000749635 140584 0
: 602 Minimum Test error found - save the configuration
: 602 | 76.25 64.2595 0.00640171 0.000739526 141288 0
: 603 Minimum Test error found - save the configuration
: 603 | 75.429 63.671 0.00646783 0.000749855 139910 0
: 604 Minimum Test error found - save the configuration
: 604 | 74.6534 62.8739 0.00640272 0.000713356 140613 0
: 605 Minimum Test error found - save the configuration
: 605 | 73.6467 61.8817 0.00637196 0.000728425 141755 0
: 606 Minimum Test error found - save the configuration
: 606 | 72.8109 61.1493 0.00640719 0.000747816 141358 0
: 607 Minimum Test error found - save the configuration
: 607 | 71.9697 60.4265 0.0064815 0.000742226 139391 0
: 608 | 71.1448 60.5503 0.00638602 0.000668145 139912 1
: 609 Minimum Test error found - save the configuration
: 609 | 70.4159 58.8678 0.006538 0.000770435 138707 0
: 610 Minimum Test error found - save the configuration
: 610 | 69.309 58.8028 0.00646975 0.000748395 139827 0
: 611 Minimum Test error found - save the configuration
: 611 | 68.3349 57.2688 0.00653028 0.000726426 137840 0
: 612 Minimum Test error found - save the configuration
: 612 | 67.7562 56.378 0.00644888 0.000742456 140193 0
: 613 Minimum Test error found - save the configuration
: 613 | 66.8897 55.9256 0.00644898 0.000740976 140154 0
: 614 Minimum Test error found - save the configuration
: 614 | 66.0064 54.8631 0.00653139 0.000762335 138671 0
: 615 Minimum Test error found - save the configuration
: 615 | 65.3837 54.3469 0.00651176 0.000746286 138757 0
: 616 Minimum Test error found - save the configuration
: 616 | 64.482 53.5335 0.00645123 0.000764495 140678 0
: 617 Minimum Test error found - save the configuration
: 617 | 63.5722 52.4746 0.0064577 0.000718526 139393 0
: 618 Minimum Test error found - save the configuration
: 618 | 62.8886 52.0785 0.006396 0.000717225 140875 0
: 619 Minimum Test error found - save the configuration
: 619 | 62.2384 51.2399 0.00636736 0.000729515 141898 0
: 620 Minimum Test error found - save the configuration
: 620 | 61.3258 50.2454 0.00644815 0.000753545 140484 0
: 621 Minimum Test error found - save the configuration
: 621 | 60.8761 50.221 0.00530765 0.000650054 171763 0
: 622 Minimum Test error found - save the configuration
: 622 | 60.1231 49.564 0.00579959 0.000587855 153500 0
: 623 Minimum Test error found - save the configuration
: 623 | 59.4012 48.9329 0.00578408 0.000539514 152539 0
: 624 Minimum Test error found - save the configuration
: 624 | 58.6713 47.9576 0.00460485 0.000530664 196358 0
: 625 Minimum Test error found - save the configuration
: 625 | 57.9774 47.0164 0.00487464 0.000609184 187553 0
: 626 Minimum Test error found - save the configuration
: 626 | 57.0659 46.7858 0.00481779 0.000510834 185746 0
: 627 Minimum Test error found - save the configuration
: 627 | 56.5746 45.9633 0.0046746 0.000544434 193697 0
: 628 Minimum Test error found - save the configuration
: 628 | 55.7596 44.8696 0.00499543 0.000535143 179361 0
: 629 Minimum Test error found - save the configuration
: 629 | 55.017 44.7312 0.00474232 0.000529644 189903 0
: 630 Minimum Test error found - save the configuration
: 630 | 54.2433 44.2734 0.00465278 0.000503473 192803 0
: 631 Minimum Test error found - save the configuration
: 631 | 53.8384 43.2066 0.00482317 0.000543454 186928 0
: 632 Minimum Test error found - save the configuration
: 632 | 52.9822 42.8111 0.00471681 0.000549654 191977 0
: 633 Minimum Test error found - save the configuration
: 633 | 52.3986 42.0138 0.00471786 0.000521724 190651 0
: 634 Minimum Test error found - save the configuration
: 634 | 51.9537 41.8766 0.00478609 0.000514674 187291 0
: 635 Minimum Test error found - save the configuration
: 635 | 51.3056 40.7497 0.00497211 0.000523373 179827 0
: 636 Minimum Test error found - save the configuration
: 636 | 50.3922 40.26 0.00478056 0.000523524 187924 0
: 637 Minimum Test error found - save the configuration
: 637 | 49.8535 39.9335 0.00466144 0.000535284 193885 0
: 638 Minimum Test error found - save the configuration
: 638 | 49.5177 39.2279 0.00465205 0.000497584 192564 0
: 639 | 48.7488 39.2439 0.00458205 0.000457123 193943 1
: 640 Minimum Test error found - save the configuration
: 640 | 48.351 39.0045 0.00456811 0.000531124 198168 0
: 641 Minimum Test error found - save the configuration
: 641 | 47.7533 37.8237 0.00505608 0.000540094 177149 0
: 642 Minimum Test error found - save the configuration
: 642 | 46.9685 37.4402 0.00453938 0.000499533 198027 0
: 643 Minimum Test error found - save the configuration
: 643 | 46.4632 36.5879 0.00470117 0.000551554 192789 0
: 644 Minimum Test error found - save the configuration
: 644 | 45.9226 35.7649 0.00503747 0.000546524 178136 0
: 645 | 45.2855 35.7691 0.00536053 0.000492434 164335 1
: 646 Minimum Test error found - save the configuration
: 646 | 44.7832 34.9774 0.00463244 0.000511084 194111 0
: 647 Minimum Test error found - save the configuration
: 647 | 44.206 34.4953 0.0046863 0.000575954 194631 0
: 648 Minimum Test error found - save the configuration
: 648 | 43.5938 34.365 0.00453513 0.000486004 197573 0
: 649 Minimum Test error found - save the configuration
: 649 | 43.2052 33.6767 0.00459063 0.000510544 196074 0
: 650 Minimum Test error found - save the configuration
: 650 | 42.5925 33.4534 0.00455087 0.000513484 198148 0
: 651 Minimum Test error found - save the configuration
: 651 | 42.1603 32.6433 0.00467253 0.000525293 192899 0
: 652 Minimum Test error found - save the configuration
: 652 | 41.6835 31.9771 0.00484727 0.000577145 187348 0
: 653 Minimum Test error found - save the configuration
: 653 | 41.2396 31.8623 0.00490122 0.000536104 183271 0
: 654 Minimum Test error found - save the configuration
: 654 | 40.7661 31.5316 0.00470458 0.000521084 191228 0
: 655 Minimum Test error found - save the configuration
: 655 | 40.0438 31.0031 0.00481389 0.000504734 185651 0
: 656 Minimum Test error found - save the configuration
: 656 | 39.6713 30.6545 0.00529121 0.000756035 176399 0
: 657 Minimum Test error found - save the configuration
: 657 | 39.2749 29.9132 0.00469985 0.000506214 190765 0
: 658 | 38.8232 30.1651 0.00470488 0.000460323 188476 1
: 659 Minimum Test error found - save the configuration
: 659 | 38.3408 28.813 0.00511119 0.000534934 174816 0
: 660 | 37.8511 29.1727 0.00491069 0.000464283 179920 1
: 661 Minimum Test error found - save the configuration
: 661 | 37.3024 28.2222 0.00476033 0.000539704 189545 0
: 662 Minimum Test error found - save the configuration
: 662 | 36.9879 27.9758 0.00472972 0.000522524 190150 0
: 663 Minimum Test error found - save the configuration
: 663 | 36.5516 27.4363 0.00473267 0.000507614 189346 0
: 664 | 36.161 27.6296 0.00470104 0.000470613 189106 1
: 665 Minimum Test error found - save the configuration
: 665 | 35.5945 26.2463 0.00479785 0.000568465 189153 0
: 666 Minimum Test error found - save the configuration
: 666 | 35.0165 26.2376 0.00465739 0.000543974 194485 0
: 667 Minimum Test error found - save the configuration
: 667 | 34.595 25.5185 0.00496292 0.000620684 184237 0
: 668 | 34.2771 25.5971 0.00467731 0.000482914 190731 1
: 669 Minimum Test error found - save the configuration
: 669 | 33.9338 25.3015 0.00490371 0.000516554 182350 0
: 670 Minimum Test error found - save the configuration
: 670 | 33.4358 24.2507 0.00468127 0.000508864 191736 0
: 671 Minimum Test error found - save the configuration
: 671 | 32.9302 24.0827 0.00450926 0.000490074 199045 0
: 672 Minimum Test error found - save the configuration
: 672 | 32.5074 23.451 0.00477091 0.000717215 197351 0
: 673 Minimum Test error found - save the configuration
: 673 | 32.0813 22.9632 0.00469787 0.000520235 191496 0
: 674 | 31.7281 23.1162 0.00447352 0.000451683 198914 1
: 675 Minimum Test error found - save the configuration
: 675 | 31.3376 22.4032 0.00457088 0.000505184 196768 0
: 676 Minimum Test error found - save the configuration
: 676 | 31.0727 22.2614 0.00467762 0.000538425 193274 0
: 677 Minimum Test error found - save the configuration
: 677 | 30.5512 21.7503 0.00479368 0.000549955 188513 0
: 678 Minimum Test error found - save the configuration
: 678 | 30.1867 21.5974 0.00494979 0.000543183 181545 0
: 679 Minimum Test error found - save the configuration
: 679 | 29.8689 21.3059 0.00465743 0.000515863 193163 0
: 680 Minimum Test error found - save the configuration
: 680 | 29.4123 20.6212 0.00465449 0.000554373 195116 0
: 681 Minimum Test error found - save the configuration
: 681 | 29.0567 20.4276 0.00501057 0.000575044 180362 0
: 682 | 28.7397 20.573 0.00466346 0.000542123 194112 1
: 683 Minimum Test error found - save the configuration
: 683 | 28.4386 19.6285 0.00464724 0.000503415 193058 0
: 684 Minimum Test error found - save the configuration
: 684 | 27.9828 19.3625 0.00470041 0.000514824 191132 0
: 685 Minimum Test error found - save the configuration
: 685 | 27.5762 18.9334 0.00462684 0.000535114 195516 0
: 686 | 27.1619 19.0474 0.00466138 0.000455382 190204 1
: 687 Minimum Test error found - save the configuration
: 687 | 26.9331 18.314 0.00463043 0.000518573 194559 0
: 688 Minimum Test error found - save the configuration
: 688 | 26.7586 18.1482 0.00478916 0.000555944 188981 0
: 689 Minimum Test error found - save the configuration
: 689 | 26.2478 18.0335 0.00461236 0.000493263 194217 0
: 690 Minimum Test error found - save the configuration
: 690 | 26.028 17.8417 0.00458541 0.000510924 196344 0
: 691 Minimum Test error found - save the configuration
: 691 | 25.5417 17.4543 0.00455116 0.000494953 197228 0
: 692 Minimum Test error found - save the configuration
: 692 | 25.268 17.4523 0.00519304 0.000554634 172473 0
: 693 Minimum Test error found - save the configuration
: 693 | 24.8372 16.6812 0.00618247 0.000742945 147072 0
: 694 | 24.5698 16.9166 0.00536775 0.000465924 163205 1
: 695 Minimum Test error found - save the configuration
: 695 | 24.5218 16.1362 0.00464233 0.000524953 194298 0
: 696 Minimum Test error found - save the configuration
: 696 | 23.8068 15.74 0.00456268 0.000510673 197433 0
: 697 Minimum Test error found - save the configuration
: 697 | 23.5868 15.7095 0.00454523 0.000502594 197891 0
: 698 Minimum Test error found - save the configuration
: 698 | 23.4323 15.3943 0.00577585 0.000751734 159232 0
: 699 Minimum Test error found - save the configuration
: 699 | 22.9526 15.0776 0.00601933 0.000704546 150523 0
: 700 Minimum Test error found - save the configuration
: 700 | 22.578 14.6339 0.0061872 0.000764736 147535 0
: 701 Minimum Test error found - save the configuration
: 701 | 22.2522 14.3711 0.00608932 0.000746505 149734 0
: 702 Minimum Test error found - save the configuration
: 702 | 21.9113 14.338 0.0060268 0.000606593 147596 0
: 703 Minimum Test error found - save the configuration
: 703 | 21.7891 14.1038 0.00572302 0.000543454 154453 0
: 704 Minimum Test error found - save the configuration
: 704 | 21.4605 13.8134 0.0051534 0.000711494 180103 0
: 705 | 21.1089 13.9751 0.00569601 0.000474933 153225 1
: 706 Minimum Test error found - save the configuration
: 706 | 21.1311 13.4775 0.00550867 0.000726434 167286 0
: 707 Minimum Test error found - save the configuration
: 707 | 20.6191 13.1581 0.0057823 0.000521614 152071 0
: 708 | 20.4489 13.357 0.00485942 0.000569974 186504 1
: 709 Minimum Test error found - save the configuration
: 709 | 20.3172 12.7593 0.00625792 0.000716495 144367 0
: 710 | 20.2278 12.8174 0.00616212 0.000664174 145509 1
: 711 Minimum Test error found - save the configuration
: 711 | 19.7212 12.3814 0.00654234 0.000764545 138461 0
: 712 | 19.3967 12.459 0.00609084 0.000650675 147054 1
: 713 Minimum Test error found - save the configuration
: 713 | 19.1484 11.8528 0.00654643 0.000742516 137838 0
: 714 Minimum Test error found - save the configuration
: 714 | 18.7065 11.6847 0.00646509 0.000731766 139535 0
: 715 | 18.5037 11.779 0.00642223 0.000675234 139203 1
: 716 Minimum Test error found - save the configuration
: 716 | 18.2894 11.6158 0.00654504 0.000730575 137588 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.0574 11.2038 0.00663058 0.000777106 136671 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.0063 10.8658 0.00678695 0.000765836 132866 0
: 719 Minimum Test error found - save the configuration
: 719 | 17.5862 10.59 0.00677753 0.000793397 133687 0
: 720 | 17.3446 10.6286 0.00691391 0.000708165 128913 1
: 721 Minimum Test error found - save the configuration
: 721 | 17.0644 10.1877 0.00701568 0.000802846 128766 0
: 722 Minimum Test error found - save the configuration
: 722 | 16.7338 9.78934 0.0070127 0.000795246 128670 0
: 723 Minimum Test error found - save the configuration
: 723 | 16.579 9.68132 0.00702429 0.000801947 128569 0
: 724 | 16.3412 10.0662 0.00691051 0.000730906 129458 1
: 725 | 16.0966 9.98396 0.00698434 0.000725145 127812 2
: 726 Minimum Test error found - save the configuration
: 726 | 15.8668 9.31479 0.00705077 0.000818005 128354 0
: 727 Minimum Test error found - save the configuration
: 727 | 15.7071 9.29706 0.00710751 0.000826686 127372 0
: 728 | 15.4096 9.38745 0.00702136 0.000728645 127131 1
: 729 Minimum Test error found - save the configuration
: 729 | 15.3116 8.5005 0.00707245 0.000819225 127934 0
: 730 Minimum Test error found - save the configuration
: 730 | 15.0022 8.43923 0.00711309 0.000816875 127060 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.0167 8.27007 0.00712386 0.000798186 126469 0
: 732 | 14.6348 8.35298 0.00699662 0.000700125 127055 1
: 733 Minimum Test error found - save the configuration
: 733 | 14.5772 8.00179 0.00669009 0.000809346 136037 0
: 734 Minimum Test error found - save the configuration
: 734 | 14.344 7.75015 0.0067298 0.000723824 133201 0
: 735 | 14.2268 7.86831 0.00683103 0.000653225 129496 1
: 736 Minimum Test error found - save the configuration
: 736 | 14.1147 7.37933 0.00691311 0.000801245 130893 0
: 737 Minimum Test error found - save the configuration
: 737 | 13.7646 7.32994 0.00704559 0.000807706 128249 0
: 738 Minimum Test error found - save the configuration
: 738 | 13.4678 6.90215 0.0070459 0.000807455 128237 0
: 739 | 13.2061 6.90696 0.00695369 0.000715205 128236 1
: 740 | 13.1013 7.14224 0.00691254 0.000727225 129339 2
: 741 Minimum Test error found - save the configuration
: 741 | 13.1157 6.53983 0.00700672 0.000824826 129410 0
: 742 | 12.9966 6.5715 0.00691919 0.000714825 128941 1
: 743 Minimum Test error found - save the configuration
: 743 | 12.8198 6.31322 0.00695351 0.000803886 130089 0
: 744 Minimum Test error found - save the configuration
: 744 | 12.6911 6.16215 0.00686025 0.000789076 131770 0
: 745 | 12.4869 6.18322 0.00679335 0.000691875 131116 1
: 746 Minimum Test error found - save the configuration
: 746 | 12.0967 6.12076 0.00686921 0.000764146 131039 0
: 747 Minimum Test error found - save the configuration
: 747 | 11.9038 5.94521 0.00683169 0.000777555 132141 0
: 748 Minimum Test error found - save the configuration
: 748 | 11.7686 5.71612 0.00680637 0.000791916 133013 0
: 749 Minimum Test error found - save the configuration
: 749 | 11.7093 5.6105 0.00680134 0.000784966 132970 0
: 750 | 11.6697 5.65668 0.00639352 0.000674755 139890 1
: 751 | 11.4467 5.91083 0.00683249 0.000686535 130167 2
: 752 Minimum Test error found - save the configuration
: 752 | 11.126 5.30476 0.00680431 0.000797786 133189 0
: 753 Minimum Test error found - save the configuration
: 753 | 10.9875 5.2558 0.00699251 0.000790836 128997 0
: 754 | 10.9771 5.91026 0.0066817 0.000704605 133844 1
: 755 | 10.8795 5.26131 0.00682586 0.000699316 130579 2
: 756 Minimum Test error found - save the configuration
: 756 | 10.7034 4.77152 0.00669966 0.000742255 134287 0
: 757 | 10.5836 5.12242 0.0066095 0.000695125 135264 1
: 758 Minimum Test error found - save the configuration
: 758 | 10.3185 4.76795 0.006767 0.000775646 133526 0
: 759 | 10.4273 5.56101 0.00667034 0.000695075 133885 1
: 760 Minimum Test error found - save the configuration
: 760 | 10.331 4.59464 0.00677882 0.000759436 132904 0
: 761 Minimum Test error found - save the configuration
: 761 | 10.0306 4.36915 0.00684875 0.000770037 131607 0
: 762 Minimum Test error found - save the configuration
: 762 | 9.95372 4.26702 0.00561952 0.000539905 157492 0
: 763 | 9.69098 4.63752 0.00550225 0.000659495 165195 1
: 764 Minimum Test error found - save the configuration
: 764 | 9.6332 4.08047 0.00687899 0.000748845 130503 0
: 765 | 9.60105 4.86118 0.00678876 0.000726376 131961 1
: 766 | 9.45821 4.11856 0.00673256 0.000707494 132779 2
: 767 | 9.33707 4.49341 0.00676363 0.000705994 132065 3
: 768 Minimum Test error found - save the configuration
: 768 | 9.20139 3.72917 0.00689908 0.000781095 130762 0
: 769 | 8.89625 3.78236 0.00680014 0.000688605 130900 1
: 770 Minimum Test error found - save the configuration
: 770 | 8.87633 3.51803 0.00680274 0.000744926 132061 0
: 771 | 8.74641 3.54563 0.00681208 0.000699874 130886 1
: 772 | 8.65629 3.99404 0.0067246 0.000705264 132905 2
: 773 | 8.57763 3.86933 0.00687404 0.000722654 130052 3
: 774 | 8.41168 3.56215 0.00675561 0.000690485 131902 4
: 775 Minimum Test error found - save the configuration
: 775 | 8.32585 3.25637 0.00692238 0.000791517 130487 0
: 776 | 8.07279 3.71324 0.00675575 0.000697306 132047 1
: 777 Minimum Test error found - save the configuration
: 777 | 8.04112 3.11604 0.00687604 0.000779605 131224 0
: 778 | 7.94714 3.15899 0.00677359 0.000681534 131319 1
: 779 | 8.01133 3.29331 0.00678602 0.000702146 131495 2
: 780 | 7.88512 3.57343 0.00674401 0.000702346 132414 3
: 781 | 7.80621 3.21576 0.00674453 0.000696615 132277 4
: 782 Minimum Test error found - save the configuration
: 782 | 7.60243 2.95514 0.00690231 0.000794535 130981 0
: 783 Minimum Test error found - save the configuration
: 783 | 7.3867 2.80292 0.00679143 0.000777425 133023 0
: 784 | 7.25089 2.8266 0.00670514 0.000687605 132945 1
: 785 | 7.38535 2.94515 0.00672623 0.000700355 132761 2
: 786 Minimum Test error found - save the configuration
: 786 | 7.26822 2.72447 0.00682543 0.000800065 132772 0
: 787 | 7.19252 2.79677 0.00682422 0.000708574 130812 1
: 788 Minimum Test error found - save the configuration
: 788 | 7.00534 2.63414 0.00682185 0.000797526 132795 0
: 789 Minimum Test error found - save the configuration
: 789 | 6.79887 2.58509 0.00693981 0.000791625 130120 0
: 790 | 6.8009 2.85426 0.00679699 0.000667855 130524 1
: 791 | 6.74984 3.06878 0.00672784 0.000702645 132776 2
: 792 Minimum Test error found - save the configuration
: 792 | 6.78063 2.46665 0.00682495 0.000788336 132525 0
: 793 | 6.61341 2.54245 0.00668488 0.000691424 133479 1
: 794 Minimum Test error found - save the configuration
: 794 | 6.44106 2.25976 0.00679294 0.000798135 133449 0
: 795 | 6.73132 2.6091 0.00656093 0.000676676 135956 1
: 796 | 6.3361 2.4805 0.00586207 0.000693395 154779 2
: 797 | 6.29942 2.83412 0.00656448 0.000667055 135653 3
: 798 | 6.2295 2.32324 0.00589729 0.000472782 147479 4
: 799 Minimum Test error found - save the configuration
: 799 | 6.08792 2.2468 0.00665263 0.000747845 135483 0
: 800 | 6.01124 2.33301 0.00669426 0.000695556 133362 1
: 801 Minimum Test error found - save the configuration
: 801 | 5.99828 2.14966 0.00645903 0.000782316 140927 0
: 802 Minimum Test error found - save the configuration
: 802 | 5.7808 2.12725 0.0068752 0.000786326 131387 0
: 803 | 5.79178 2.37386 0.00678349 0.000661404 130674 1
: 804 Minimum Test error found - save the configuration
: 804 | 5.6623 1.95755 0.00674127 0.000798486 134617 0
: 805 Minimum Test error found - save the configuration
: 805 | 5.59584 1.92455 0.00691627 0.000796996 130735 0
: 806 | 5.46816 1.97208 0.00673921 0.000710215 132692 1
: 807 | 5.44523 2.01968 0.00686613 0.000706066 129869 2
: 808 | 5.43276 2.71973 0.0067693 0.000679535 131368 3
: 809 | 5.39589 2.3919 0.00675195 0.000686554 131896 4
: 810 | 5.30717 2.40319 0.00687646 0.000679144 129088 5
: 811 | 5.2479 1.95764 0.00658379 0.000710405 136208 6
: 812 Minimum Test error found - save the configuration
: 812 | 5.10805 1.89984 0.00686534 0.000796077 131812 0
: 813 | 5.11556 2.13563 0.0068047 0.000699645 131039 1
: 814 | 5.16629 2.56156 0.00660758 0.000594295 133039 2
: 815 | 5.03843 2.26307 0.00659866 0.000704735 135733 3
: 816 | 4.94062 2.22726 0.00677863 0.000708944 131803 4
: 817 | 4.90413 2.21988 0.0067284 0.000694066 132575 5
: 818 | 4.88458 2.01882 0.00671312 0.000673984 132469 6
: 819 | 4.66331 2.15694 0.00670814 0.000692544 132988 7
: 820 | 4.67154 2.07064 0.00671099 0.000697605 133037 8
: 821 | 4.63739 2.30208 0.00669386 0.000690984 133270 9
: 822 | 4.62015 2.18584 0.00663792 0.000643374 133455 10
: 823 | 4.52371 2.03648 0.00659222 0.000705664 135903 11
: 824 | 4.70432 2.1976 0.00670982 0.000699586 133106 12
: 825 | 4.71942 2.25015 0.00670831 0.000687396 132870 13
: 826 | 4.44241 2.24849 0.00678608 0.000671355 130832 14
: 827 | 4.43288 3.03556 0.00680376 0.000673133 130492 15
: 828 | 4.34004 2.27817 0.00683829 0.000712904 130604 16
: 829 | 4.20925 2.51226 0.00684943 0.000708835 130281 17
: 830 | 4.20824 2.4549 0.00682087 0.000713816 130996 18
: 831 | 4.24736 2.15045 0.00693869 0.000713986 128520 19
: 832 | 4.2201 2.05761 0.00701562 0.000720675 127086 20
: 833 | 4.21507 2.2718 0.00696038 0.000723715 128274 21
:
: Elapsed time for training with 1000 events: 4.63 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0101 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 1.2 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.29 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.24768e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.02559e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0675 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0595 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00287 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0624 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 1.21 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0346 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00461 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0533 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00533 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00205 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000436 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0653 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00681 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 1.03 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.121 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.885 -0.0221 5.93 1.57 | 3.219 3.222
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.152 0.0265 2.08 1.09 | 3.377 3.365
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.