Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.344 sec
: Elapsed time for training with 1000 events: 0.348 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00338 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.00164 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0061 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000305 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000442 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31541.2
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33078.4 31173 0.00573255 0.000642009 157154 0
: 2 Minimum Test error found - save the configuration
: 2 | 32559.7 30582.5 0.00590844 0.000685181 153161 0
: 3 Minimum Test error found - save the configuration
: 3 | 31832.8 29888 0.00582263 0.000657 154870 0
: 4 Minimum Test error found - save the configuration
: 4 | 31092.4 29251.9 0.00623674 0.00067712 143895 0
: 5 Minimum Test error found - save the configuration
: 5 | 30376.6 28557.4 0.0061088 0.000732511 148801 0
: 6 Minimum Test error found - save the configuration
: 6 | 29603.8 27687.4 0.00730868 0.000591949 119106 0
: 7 Minimum Test error found - save the configuration
: 7 | 28885 27069.9 0.00592149 0.000563128 149299 0
: 8 Minimum Test error found - save the configuration
: 8 | 28429 26684.2 0.00552618 0.00058945 162050 0
: 9 Minimum Test error found - save the configuration
: 9 | 28069.6 26364.4 0.00547053 0.000589618 163904 0
: 10 Minimum Test error found - save the configuration
: 10 | 27750.8 26066.3 0.00532429 0.000572428 168355 0
: 11 Minimum Test error found - save the configuration
: 11 | 27451.2 25782.1 0.00553472 0.000595379 161965 0
: 12 Minimum Test error found - save the configuration
: 12 | 27160.7 25514 0.00729128 0.000578908 119183 0
: 13 Minimum Test error found - save the configuration
: 13 | 26882.2 25256.5 0.00770352 0.000709071 114376 0
: 14 Minimum Test error found - save the configuration
: 14 | 26615.9 25002.6 0.00784994 0.000934483 115683 0
: 15 Minimum Test error found - save the configuration
: 15 | 26353.1 24756.6 0.00696366 0.000915574 132273 0
: 16 Minimum Test error found - save the configuration
: 16 | 26100.4 24511.6 0.00803375 0.000577458 107292 0
: 17 Minimum Test error found - save the configuration
: 17 | 25848.6 24274.2 0.00638824 0.000955935 147267 0
: 18 Minimum Test error found - save the configuration
: 18 | 25600.7 24044.8 0.0074658 0.000593729 116413 0
: 19 Minimum Test error found - save the configuration
: 19 | 25362.3 23815.4 0.00667452 0.000933574 139350 0
: 20 Minimum Test error found - save the configuration
: 20 | 25127 23587.6 0.00711818 0.000580299 122364 0
: 21 Minimum Test error found - save the configuration
: 21 | 24888.7 23371 0.00672891 0.000939793 138190 0
: 22 Minimum Test error found - save the configuration
: 22 | 24663.2 23151.2 0.00754005 0.000570699 114788 0
: 23 Minimum Test error found - save the configuration
: 23 | 24433.3 22939.6 0.00527529 0.000555688 169506 0
: 24 Minimum Test error found - save the configuration
: 24 | 24211.6 22728.5 0.00529934 0.000564238 168951 0
: 25 Minimum Test error found - save the configuration
: 25 | 23993 22517.7 0.00545468 0.000598199 164728 0
: 26 Minimum Test error found - save the configuration
: 26 | 23773.9 22312.2 0.00534104 0.000568699 167633 0
: 27 Minimum Test error found - save the configuration
: 27 | 23561.6 22105.9 0.00547361 0.000582849 163574 0
: 28 Minimum Test error found - save the configuration
: 28 | 23349.1 21903.3 0.005315 0.000604099 169819 0
: 29 Minimum Test error found - save the configuration
: 29 | 23134.1 21711.2 0.00559067 0.000636569 161482 0
: 30 Minimum Test error found - save the configuration
: 30 | 22933.7 21511.4 0.00544519 0.000581759 164493 0
: 31 Minimum Test error found - save the configuration
: 31 | 22726.2 21318.4 0.00540263 0.000578808 165844 0
: 32 Minimum Test error found - save the configuration
: 32 | 22521.7 21130.9 0.0055604 0.000578768 160590 0
: 33 Minimum Test error found - save the configuration
: 33 | 22324.3 20941.4 0.00540198 0.000577579 165824 0
: 34 Minimum Test error found - save the configuration
: 34 | 22127.7 20752.4 0.00546792 0.000574928 163499 0
: 35 Minimum Test error found - save the configuration
: 35 | 21931.5 20566.5 0.00541097 0.000573839 165387 0
: 36 Minimum Test error found - save the configuration
: 36 | 21736.6 20384.9 0.00541989 0.000597089 165879 0
: 37 Minimum Test error found - save the configuration
: 37 | 21544.7 20205.9 0.00533807 0.000565148 167612 0
: 38 Minimum Test error found - save the configuration
: 38 | 21357.5 20025.6 0.00535901 0.000580119 167403 0
: 39 Minimum Test error found - save the configuration
: 39 | 21171.4 19845.7 0.00583109 0.000584789 152488 0
: 40 Minimum Test error found - save the configuration
: 40 | 20981.7 19674.1 0.00583891 0.00063773 153811 0
: 41 Minimum Test error found - save the configuration
: 41 | 20800.4 19501 0.00548992 0.000606089 163806 0
: 42 Minimum Test error found - save the configuration
: 42 | 20618.8 19329.9 0.00599773 0.00065953 149863 0
: 43 Minimum Test error found - save the configuration
: 43 | 20438.1 19161.9 0.00705281 0.000947144 131026 0
: 44 Minimum Test error found - save the configuration
: 44 | 20261.9 18993 0.00806702 0.00060793 107252 0
: 45 Minimum Test error found - save the configuration
: 45 | 20086.2 18825 0.00572589 0.000645559 157470 0
: 46 Minimum Test error found - save the configuration
: 46 | 19908.7 18662.8 0.00574654 0.000579988 154842 0
: 47 Minimum Test error found - save the configuration
: 47 | 19738.5 18496.9 0.00561933 0.00062807 160280 0
: 48 Minimum Test error found - save the configuration
: 48 | 19563.5 18333.6 0.00612436 0.000587549 144487 0
: 49 Minimum Test error found - save the configuration
: 49 | 19389.8 18170.6 0.00566031 0.000604329 158229 0
: 50 Minimum Test error found - save the configuration
: 50 | 19222.8 18010.7 0.00582645 0.000598439 153022 0
: 51 Minimum Test error found - save the configuration
: 51 | 19054 17855.7 0.00590104 0.000613509 151299 0
: 52 Minimum Test error found - save the configuration
: 52 | 18886.1 17694.3 0.00679409 0.000591599 128980 0
: 53 Minimum Test error found - save the configuration
: 53 | 18720.5 17538.1 0.00627192 0.000623979 141645 0
: 54 Minimum Test error found - save the configuration
: 54 | 18554.4 17387.8 0.00677108 0.000595269 129538 0
: 55 Minimum Test error found - save the configuration
: 55 | 18394.8 17229.5 0.0064382 0.000631379 137769 0
: 56 Minimum Test error found - save the configuration
: 56 | 18231 17080.3 0.00582737 0.00064761 154447 0
: 57 Minimum Test error found - save the configuration
: 57 | 18070.9 16924.9 0.00571856 0.000588728 155951 0
: 58 Minimum Test error found - save the configuration
: 58 | 17912.6 16772.8 0.00585739 0.00065859 153882 0
: 59 Minimum Test error found - save the configuration
: 59 | 17753.3 16623 0.00573565 0.000692431 158629 0
: 60 Minimum Test error found - save the configuration
: 60 | 17596.7 16471.2 0.0057693 0.00059224 154528 0
: 61 Minimum Test error found - save the configuration
: 61 | 17441.5 16319.5 0.00593277 0.00071174 153226 0
: 62 Minimum Test error found - save the configuration
: 62 | 17283.8 16171.3 0.00597679 0.00067443 150876 0
: 63 Minimum Test error found - save the configuration
: 63 | 17128.8 16026.9 0.0060568 0.000703162 149431 0
: 64 Minimum Test error found - save the configuration
: 64 | 16978.5 15879.1 0.00584739 0.000594419 152295 0
: 65 Minimum Test error found - save the configuration
: 65 | 16824.4 15733 0.00552767 0.000594588 162170 0
: 66 Minimum Test error found - save the configuration
: 66 | 16673.2 15594 0.00547115 0.000598299 164175 0
: 67 Minimum Test error found - save the configuration
: 67 | 16525.6 15451.4 0.00567837 0.000610069 157844 0
: 68 Minimum Test error found - save the configuration
: 68 | 16378.2 15307.2 0.00574401 0.00065424 157178 0
: 69 Minimum Test error found - save the configuration
: 69 | 16228.2 15169.7 0.00643634 0.0006918 139263 0
: 70 Minimum Test error found - save the configuration
: 70 | 16083.5 15031.5 0.00634933 0.000743231 142702 0
: 71 Minimum Test error found - save the configuration
: 71 | 15938.1 14897 0.00617925 0.00065338 144774 0
: 72 Minimum Test error found - save the configuration
: 72 | 15798.2 14758.5 0.00609848 0.000637779 146501 0
: 73 Minimum Test error found - save the configuration
: 73 | 15655 14624.1 0.0059644 0.000597359 149058 0
: 74 Minimum Test error found - save the configuration
: 74 | 15513.1 14493 0.00554936 0.000595478 161489 0
: 75 Minimum Test error found - save the configuration
: 75 | 15374 14363.8 0.00581831 0.000740371 157544 0
: 76 Minimum Test error found - save the configuration
: 76 | 15239.4 14230.3 0.00628232 0.000831273 146761 0
: 77 Minimum Test error found - save the configuration
: 77 | 15102.2 14099.7 0.00563224 0.000605089 159136 0
: 78 Minimum Test error found - save the configuration
: 78 | 14964.9 13973.5 0.00556648 0.000598769 161040 0
: 79 Minimum Test error found - save the configuration
: 79 | 14831.5 13846.8 0.00567016 0.000615109 158257 0
: 80 Minimum Test error found - save the configuration
: 80 | 14698.1 13722.9 0.00744759 0.000931693 122777 0
: 81 Minimum Test error found - save the configuration
: 81 | 14567.5 13598.4 0.00838736 0.000953034 107609 0
: 82 Minimum Test error found - save the configuration
: 82 | 14437.8 13474.7 0.00820753 0.000907594 109590 0
: 83 Minimum Test error found - save the configuration
: 83 | 14305.8 13356 0.00829626 0.000899124 108150 0
: 84 Minimum Test error found - save the configuration
: 84 | 14180.6 13233.5 0.00753178 0.000840313 119555 0
: 85 Minimum Test error found - save the configuration
: 85 | 14052.6 13113.9 0.00699053 0.00061171 125415 0
: 86 Minimum Test error found - save the configuration
: 86 | 13926.7 12995.5 0.00558843 0.000599909 160368 0
: 87 Minimum Test error found - save the configuration
: 87 | 13803.5 12876 0.00576689 0.000706061 158077 0
: 88 Minimum Test error found - save the configuration
: 88 | 13677.9 12760.5 0.00610282 0.000800482 150877 0
: 89 Minimum Test error found - save the configuration
: 89 | 13555.6 12645.7 0.00571906 0.00061923 156868 0
: 90 Minimum Test error found - save the configuration
: 90 | 13434.9 12530.8 0.00559517 0.000608789 160437 0
: 91 Minimum Test error found - save the configuration
: 91 | 13314.6 12417.2 0.00595946 0.000724561 152821 0
: 92 Minimum Test error found - save the configuration
: 92 | 13193.3 12307.1 0.00617585 0.000769611 147977 0
: 93 Minimum Test error found - save the configuration
: 93 | 13075.5 12197.2 0.00627461 0.000764622 145191 0
: 94 Minimum Test error found - save the configuration
: 94 | 12960.8 12084.7 0.00635887 0.0006396 139878 0
: 95 Minimum Test error found - save the configuration
: 95 | 12842.4 11976.9 0.00636643 0.000702672 141249 0
: 96 Minimum Test error found - save the configuration
: 96 | 12729 11866.6 0.00748306 0.000942495 122314 0
: 97 Minimum Test error found - save the configuration
: 97 | 12612.6 11761.2 0.00604444 0.000600489 146952 0
: 98 Minimum Test error found - save the configuration
: 98 | 12499.3 11656.8 0.00602497 0.00066843 149350 0
: 99 Minimum Test error found - save the configuration
: 99 | 12388.6 11550.9 0.00856296 0.000988755 105622 0
: 100 Minimum Test error found - save the configuration
: 100 | 12276.3 11448.4 0.00756699 0.000625879 115255 0
: 101 Minimum Test error found - save the configuration
: 101 | 12165.7 11345.9 0.00582597 0.000630209 153972 0
: 102 Minimum Test error found - save the configuration
: 102 | 12057.7 11242.7 0.00575617 0.000612909 155543 0
: 103 Minimum Test error found - save the configuration
: 103 | 11947.9 11144.4 0.0056556 0.000604289 158375 0
: 104 Minimum Test error found - save the configuration
: 104 | 11842.7 11041.1 0.0059428 0.00064933 151130 0
: 105 Minimum Test error found - save the configuration
: 105 | 11734.4 10942.9 0.00642733 0.000931833 145574 0
: 106 Minimum Test error found - save the configuration
: 106 | 11629.6 10844.5 0.00746771 0.000935694 122474 0
: 107 Minimum Test error found - save the configuration
: 107 | 11526 10744.9 0.00814593 0.000990844 111809 0
: 108 Minimum Test error found - save the configuration
: 108 | 11420.9 10648.7 0.00683098 0.000626859 128946 0
: 109 Minimum Test error found - save the configuration
: 109 | 11317.6 10554.8 0.00814542 0.000987264 111761 0
: 110 Minimum Test error found - save the configuration
: 110 | 11217 10458.2 0.00652745 0.000875173 141536 0
: 111 Minimum Test error found - save the configuration
: 111 | 11113.4 10367.8 0.00782809 0.000617239 110944 0
: 112 Minimum Test error found - save the configuration
: 112 | 11016.9 10273.2 0.00741997 0.000977164 124169 0
: 113 Minimum Test error found - save the configuration
: 113 | 10916.1 10179.2 0.00609066 0.00064103 146799 0
: 114 Minimum Test error found - save the configuration
: 114 | 10816.3 10090.7 0.0079311 0.000631371 109593 0
: 115 Minimum Test error found - save the configuration
: 115 | 10719.9 9999.64 0.00741014 0.000870973 122340 0
: 116 Minimum Test error found - save the configuration
: 116 | 10624.6 9907.48 0.00644366 0.000611399 137168 0
: 117 Minimum Test error found - save the configuration
: 117 | 10526.3 9819.25 0.00555803 0.0005892 161004 0
: 118 Minimum Test error found - save the configuration
: 118 | 10432.9 9730.38 0.00555104 0.000606419 161792 0
: 119 Minimum Test error found - save the configuration
: 119 | 10338.5 9644.36 0.00562652 0.000602309 159229 0
: 120 Minimum Test error found - save the configuration
: 120 | 10244.1 9557.82 0.00562891 0.000602229 159151 0
: 121 Minimum Test error found - save the configuration
: 121 | 10151.9 9470.63 0.0058226 0.00070666 156374 0
: 122 Minimum Test error found - save the configuration
: 122 | 10060.8 9386.25 0.00557764 0.000595349 160569 0
: 123 Minimum Test error found - save the configuration
: 123 | 9970 9300.79 0.00580971 0.000596329 153451 0
: 124 Minimum Test error found - save the configuration
: 124 | 9878.76 9217.44 0.00555357 0.000603488 161613 0
: 125 Minimum Test error found - save the configuration
: 125 | 9789.63 9134.11 0.00563193 0.000593179 158769 0
: 126 Minimum Test error found - save the configuration
: 126 | 9700.83 9052.5 0.0055232 0.000593238 162273 0
: 127 Minimum Test error found - save the configuration
: 127 | 9612.64 8971.54 0.00556937 0.000609409 161291 0
: 128 Minimum Test error found - save the configuration
: 128 | 9527.72 8890.21 0.00551323 0.000603359 162937 0
: 129 Minimum Test error found - save the configuration
: 129 | 9440.12 8808.06 0.00551798 0.000603039 162769 0
: 130 Minimum Test error found - save the configuration
: 130 | 9353.94 8730.53 0.00551965 0.000587139 162189 0
: 131 Minimum Test error found - save the configuration
: 131 | 9269.04 8653.07 0.00561994 0.00067658 161833 0
: 132 Minimum Test error found - save the configuration
: 132 | 9185.14 8575.39 0.00583732 0.000613249 153137 0
: 133 Minimum Test error found - save the configuration
: 133 | 9102.55 8496.77 0.00553504 0.00058713 161684 0
: 134 Minimum Test error found - save the configuration
: 134 | 9019.58 8419.51 0.00555469 0.000605579 161645 0
: 135 Minimum Test error found - save the configuration
: 135 | 8937.28 8341.61 0.0056273 0.000595088 158976 0
: 136 Minimum Test error found - save the configuration
: 136 | 8856.29 8267.51 0.0055422 0.000597339 161784 0
: 137 Minimum Test error found - save the configuration
: 137 | 8775.99 8192.9 0.00565914 0.000618939 158724 0
: 138 Minimum Test error found - save the configuration
: 138 | 8695.89 8119.61 0.00556935 0.000594359 160804 0
: 139 Minimum Test error found - save the configuration
: 139 | 8616.23 8046.82 0.00554056 0.000604429 162070 0
: 140 Minimum Test error found - save the configuration
: 140 | 8539.56 7973.69 0.00553043 0.000587959 161862 0
: 141 Minimum Test error found - save the configuration
: 141 | 8461.59 7896.74 0.00553411 0.000603699 162258 0
: 142 Minimum Test error found - save the configuration
: 142 | 8383.95 7826.01 0.0055306 0.000596129 162125 0
: 143 Minimum Test error found - save the configuration
: 143 | 8307.52 7755.83 0.00553336 0.000600489 162177 0
: 144 Minimum Test error found - save the configuration
: 144 | 8231.72 7685.99 0.00558898 0.000604189 160488 0
: 145 Minimum Test error found - save the configuration
: 145 | 8157.35 7615.42 0.00558781 0.00060326 160496 0
: 146 Minimum Test error found - save the configuration
: 146 | 8083.42 7547.15 0.00554624 0.000602059 161806 0
: 147 Minimum Test error found - save the configuration
: 147 | 8008.01 7479.43 0.00552361 0.000583429 161937 0
: 148 Minimum Test error found - save the configuration
: 148 | 7936.31 7407.47 0.00562742 0.0006156 159623 0
: 149 Minimum Test error found - save the configuration
: 149 | 7863.36 7340.85 0.00554242 0.000596329 161744 0
: 150 Minimum Test error found - save the configuration
: 150 | 7792.78 7271.23 0.0055308 0.000602649 162333 0
: 151 Minimum Test error found - save the configuration
: 151 | 7719.86 7209.82 0.00555853 0.000598549 161291 0
: 152 Minimum Test error found - save the configuration
: 152 | 7651.11 7141.81 0.00556535 0.000601729 161173 0
: 153 Minimum Test error found - save the configuration
: 153 | 7580.22 7077.91 0.00561704 0.000604079 159586 0
: 154 Minimum Test error found - save the configuration
: 154 | 7510.77 7012.21 0.00550135 0.000591489 162937 0
: 155 Minimum Test error found - save the configuration
: 155 | 7442.88 6945.13 0.00550955 0.000598649 162903 0
: 156 Minimum Test error found - save the configuration
: 156 | 7374.73 6881.59 0.00555742 0.000591329 161092 0
: 157 Minimum Test error found - save the configuration
: 157 | 7308.55 6819.87 0.00553458 0.00060762 162372 0
: 158 Minimum Test error found - save the configuration
: 158 | 7239.17 6758.46 0.0055158 0.000584238 162220 0
: 159 Minimum Test error found - save the configuration
: 159 | 7174.85 6692.64 0.00552693 0.000601799 162432 0
: 160 Minimum Test error found - save the configuration
: 160 | 7109.31 6629.95 0.00552878 0.000593319 162092 0
: 161 Minimum Test error found - save the configuration
: 161 | 7043.72 6571.82 0.00552856 0.000595059 162157 0
: 162 Minimum Test error found - save the configuration
: 162 | 6978.84 6513.43 0.00552373 0.00059213 162219 0
: 163 Minimum Test error found - save the configuration
: 163 | 6916 6447.77 0.00556121 0.00062607 162103 0
: 164 Minimum Test error found - save the configuration
: 164 | 6851.57 6393.54 0.00586571 0.00071018 155173 0
: 165 Minimum Test error found - save the configuration
: 165 | 6788.9 6330.23 0.00577528 0.00062622 155368 0
: 166 Minimum Test error found - save the configuration
: 166 | 6727.85 6270.82 0.00551448 0.000583738 162247 0
: 167 Minimum Test error found - save the configuration
: 167 | 6664.96 6213.97 0.00562574 0.00068434 161897 0
: 168 Minimum Test error found - save the configuration
: 168 | 6605.32 6154.08 0.00577717 0.000605608 154692 0
: 169 Minimum Test error found - save the configuration
: 169 | 6542.97 6100.08 0.00552805 0.000594219 162146 0
: 170 Minimum Test error found - save the configuration
: 170 | 6484.03 6045.24 0.00553305 0.000603669 162292 0
: 171 Minimum Test error found - save the configuration
: 171 | 6424.4 5987.49 0.00561373 0.000647169 161077 0
: 172 Minimum Test error found - save the configuration
: 172 | 6364.63 5927.03 0.00564761 0.000597249 158404 0
: 173 Minimum Test error found - save the configuration
: 173 | 6307.46 5874.07 0.00553065 0.000593859 162048 0
: 174 Minimum Test error found - save the configuration
: 174 | 6248.99 5819.99 0.00559588 0.000609689 160443 0
: 175 Minimum Test error found - save the configuration
: 175 | 6191.09 5766.32 0.00554136 0.000600058 161901 0
: 176 Minimum Test error found - save the configuration
: 176 | 6135.48 5707.57 0.00563405 0.000587009 158509 0
: 177 Minimum Test error found - save the configuration
: 177 | 6078.54 5659.47 0.00553528 0.000607109 162332 0
: 178 Minimum Test error found - save the configuration
: 178 | 6022.88 5601.05 0.00559674 0.00060067 160126 0
: 179 Minimum Test error found - save the configuration
: 179 | 5966.29 5550.3 0.00628482 0.00063371 141565 0
: 180 Minimum Test error found - save the configuration
: 180 | 5911.44 5504.36 0.00570141 0.00060287 156908 0
: 181 Minimum Test error found - save the configuration
: 181 | 5857.74 5444.92 0.0057191 0.000635139 157358 0
: 182 Minimum Test error found - save the configuration
: 182 | 5804 5395.88 0.00595821 0.000639409 150410 0
: 183 Minimum Test error found - save the configuration
: 183 | 5751.39 5346.32 0.00578202 0.000680471 156815 0
: 184 Minimum Test error found - save the configuration
: 184 | 5697.19 5293.21 0.00594425 0.00064999 151107 0
: 185 Minimum Test error found - save the configuration
: 185 | 5644.04 5246.28 0.00595775 0.000724341 152864 0
: 186 Minimum Test error found - save the configuration
: 186 | 5592.66 5197.27 0.00586391 0.000670301 154035 0
: 187 Minimum Test error found - save the configuration
: 187 | 5541.89 5147.17 0.00592427 0.00063657 151295 0
: 188 Minimum Test error found - save the configuration
: 188 | 5489.81 5101.75 0.00560339 0.000592159 159641 0
: 189 Minimum Test error found - save the configuration
: 189 | 5440.79 5052.26 0.00576539 0.000602579 154954 0
: 190 Minimum Test error found - save the configuration
: 190 | 5389.49 5005.17 0.0058857 0.000662571 153165 0
: 191 Minimum Test error found - save the configuration
: 191 | 5339.99 4955.6 0.00575196 0.000611309 155622 0
: 192 Minimum Test error found - save the configuration
: 192 | 5290.16 4912.77 0.00573111 0.000603819 156028 0
: 193 Minimum Test error found - save the configuration
: 193 | 5242.32 4865.94 0.00554766 0.000595699 161552 0
: 194 Minimum Test error found - save the configuration
: 194 | 5193.57 4818.13 0.00550822 0.000593349 162771 0
: 195 Minimum Test error found - save the configuration
: 195 | 5146.18 4773.15 0.00551718 0.000592439 162445 0
: 196 Minimum Test error found - save the configuration
: 196 | 5098.43 4727.76 0.00589789 0.00066757 152954 0
: 197 Minimum Test error found - save the configuration
: 197 | 5051.45 4683.69 0.00597603 0.000684321 151180 0
: 198 Minimum Test error found - save the configuration
: 198 | 5004.89 4639.65 0.00613712 0.000604709 144602 0
: 199 Minimum Test error found - save the configuration
: 199 | 4958.81 4596.38 0.00580112 0.00071449 157275 0
: 200 Minimum Test error found - save the configuration
: 200 | 4912.64 4554.09 0.00632118 0.000600769 139850 0
: 201 Minimum Test error found - save the configuration
: 201 | 4867.59 4508.52 0.00613014 0.00064224 145775 0
: 202 Minimum Test error found - save the configuration
: 202 | 4822.99 4469.23 0.00632539 0.0006687 141426 0
: 203 Minimum Test error found - save the configuration
: 203 | 4778.28 4427.11 0.00576771 0.000689231 157528 0
: 204 Minimum Test error found - save the configuration
: 204 | 4734.01 4384.35 0.00598688 0.00060825 148737 0
: 205 Minimum Test error found - save the configuration
: 205 | 4691.32 4344.13 0.00627806 0.00068533 143043 0
: 206 Minimum Test error found - save the configuration
: 206 | 4648.14 4303.02 0.00604633 0.000623879 147535 0
: 207 Minimum Test error found - save the configuration
: 207 | 4605.1 4261.21 0.00583451 0.000622959 153505 0
: 208 Minimum Test error found - save the configuration
: 208 | 4562.26 4222.26 0.00624 0.000606479 142007 0
: 209 Minimum Test error found - save the configuration
: 209 | 4520.5 4183.34 0.00611959 0.00067299 146881 0
: 210 Minimum Test error found - save the configuration
: 210 | 4479.12 4142.75 0.00573171 0.0006512 157465 0
: 211 Minimum Test error found - save the configuration
: 211 | 4437.6 4106.23 0.00687991 0.000762801 130781 0
: 212 Minimum Test error found - save the configuration
: 212 | 4396.88 4067.57 0.0061814 0.00068627 145583 0
: 213 Minimum Test error found - save the configuration
: 213 | 4356.54 4027.91 0.00573404 0.00063707 156956 0
: 214 Minimum Test error found - save the configuration
: 214 | 4316.16 3991.06 0.00556269 0.00059153 160928 0
: 215 Minimum Test error found - save the configuration
: 215 | 4277.73 3952.99 0.00594199 0.000689031 152295 0
: 216 Minimum Test error found - save the configuration
: 216 | 4238.34 3915.54 0.00638461 0.000766212 142389 0
: 217 Minimum Test error found - save the configuration
: 217 | 4198.22 3880.09 0.00629538 0.0006857 142611 0
: 218 Minimum Test error found - save the configuration
: 218 | 4160.45 3844.18 0.00627304 0.00067706 142960 0
: 219 Minimum Test error found - save the configuration
: 219 | 4122.08 3807.99 0.0060309 0.000596249 147204 0
: 220 Minimum Test error found - save the configuration
: 220 | 4084.6 3772.15 0.00560983 0.000607129 159913 0
: 221 Minimum Test error found - save the configuration
: 221 | 4047.84 3736.43 0.00558625 0.000601108 160477 0
: 222 Minimum Test error found - save the configuration
: 222 | 4009.62 3701.69 0.00564458 0.0006186 159173 0
: 223 Minimum Test error found - save the configuration
: 223 | 3974.07 3667.36 0.00560714 0.000611369 160135 0
: 224 Minimum Test error found - save the configuration
: 224 | 3936.92 3632.37 0.00580968 0.00066432 155480 0
: 225 Minimum Test error found - save the configuration
: 225 | 3901.08 3598.79 0.00599594 0.00062633 148987 0
: 226 Minimum Test error found - save the configuration
: 226 | 3865.84 3564.4 0.00582914 0.000615239 153436 0
: 227 Minimum Test error found - save the configuration
: 227 | 3830.58 3531.74 0.00604925 0.000703951 149664 0
: 228 Minimum Test error found - save the configuration
: 228 | 3794.86 3499.01 0.00590593 0.00063996 151919 0
: 229 Minimum Test error found - save the configuration
: 229 | 3761.75 3465.35 0.00611793 0.000659521 146563 0
: 230 Minimum Test error found - save the configuration
: 230 | 3726.56 3433.03 0.00564716 0.000605139 158666 0
: 231 Minimum Test error found - save the configuration
: 231 | 3692.57 3400.36 0.00568756 0.000693 160174 0
: 232 Minimum Test error found - save the configuration
: 232 | 3659.14 3369.54 0.00568223 0.000618779 157995 0
: 233 Minimum Test error found - save the configuration
: 233 | 3625.6 3338.08 0.00615825 0.00064533 145114 0
: 234 Minimum Test error found - save the configuration
: 234 | 3592.53 3307 0.005852 0.000600209 152329 0
: 235 Minimum Test error found - save the configuration
: 235 | 3560.37 3276.33 0.00556335 0.000599849 161176 0
: 236 Minimum Test error found - save the configuration
: 236 | 3527.82 3245.2 0.00573767 0.00061055 156033 0
: 237 Minimum Test error found - save the configuration
: 237 | 3495.09 3215.76 0.00555903 0.000597529 161241 0
: 238 Minimum Test error found - save the configuration
: 238 | 3464.26 3185.81 0.00565814 0.00060236 158235 0
: 239 Minimum Test error found - save the configuration
: 239 | 3432.23 3156.51 0.00597374 0.00061632 149326 0
: 240 Minimum Test error found - save the configuration
: 240 | 3401.78 3126.41 0.00651547 0.000732841 138345 0
: 241 Minimum Test error found - save the configuration
: 241 | 3369.99 3098.46 0.00607212 0.000625609 146883 0
: 242 Minimum Test error found - save the configuration
: 242 | 3340.32 3068.46 0.00583112 0.000615999 153400 0
: 243 Minimum Test error found - save the configuration
: 243 | 3309.72 3039.64 0.0057346 0.000603099 155900 0
: 244 Minimum Test error found - save the configuration
: 244 | 3279.08 3011.72 0.00581274 0.00064771 154888 0
: 245 Minimum Test error found - save the configuration
: 245 | 3249.13 2984.01 0.00573399 0.000629939 156738 0
: 246 Minimum Test error found - save the configuration
: 246 | 3220.18 2955.98 0.00576174 0.000623809 155705 0
: 247 Minimum Test error found - save the configuration
: 247 | 3191.07 2928.06 0.00572053 0.00060824 156486 0
: 248 Minimum Test error found - save the configuration
: 248 | 3161.75 2901.68 0.00575675 0.00062005 155742 0
: 249 Minimum Test error found - save the configuration
: 249 | 3133.91 2873.83 0.00573407 0.000634479 156875 0
: 250 Minimum Test error found - save the configuration
: 250 | 3104.33 2847.7 0.00594646 0.000644039 150875 0
: 251 Minimum Test error found - save the configuration
: 251 | 3076.69 2820.82 0.00596048 0.00062834 150034 0
: 252 Minimum Test error found - save the configuration
: 252 | 3048.79 2794.8 0.0060354 0.000618509 147686 0
: 253 Minimum Test error found - save the configuration
: 253 | 3021.25 2768.01 0.00577638 0.000612081 154910 0
: 254 Minimum Test error found - save the configuration
: 254 | 2993.44 2742.65 0.00583064 0.00062592 153707 0
: 255 Minimum Test error found - save the configuration
: 255 | 2966.51 2717.06 0.00572399 0.000624169 156868 0
: 256 Minimum Test error found - save the configuration
: 256 | 2939.77 2691.66 0.0057031 0.00062615 157575 0
: 257 Minimum Test error found - save the configuration
: 257 | 2912.96 2667.22 0.00578572 0.00063696 155377 0
: 258 Minimum Test error found - save the configuration
: 258 | 2886.54 2641.94 0.00568702 0.000612649 157655 0
: 259 Minimum Test error found - save the configuration
: 259 | 2860.59 2617.5 0.00576865 0.00065359 156401 0
: 260 Minimum Test error found - save the configuration
: 260 | 2834.42 2593.67 0.00598166 0.000675741 150775 0
: 261 Minimum Test error found - save the configuration
: 261 | 2808.93 2569.88 0.00599135 0.000764962 153069 0
: 262 Minimum Test error found - save the configuration
: 262 | 2783.49 2546.58 0.00614968 0.000678561 146222 0
: 263 Minimum Test error found - save the configuration
: 263 | 2758.8 2521.98 0.00736906 0.00064398 118958 0
: 264 Minimum Test error found - save the configuration
: 264 | 2733.28 2499.04 0.00595914 0.000673371 151350 0
: 265 Minimum Test error found - save the configuration
: 265 | 2708.78 2475.61 0.00617474 0.000953264 153213 0
: 266 Minimum Test error found - save the configuration
: 266 | 2684.24 2452.66 0.00681688 0.00061688 129032 0
: 267 Minimum Test error found - save the configuration
: 267 | 2659.4 2430.71 0.0059593 0.000623109 149920 0
: 268 Minimum Test error found - save the configuration
: 268 | 2635.85 2408.17 0.00589104 0.000646 152525 0
: 269 Minimum Test error found - save the configuration
: 269 | 2612.05 2385.85 0.00603793 0.000680581 149328 0
: 270 Minimum Test error found - save the configuration
: 270 | 2588.27 2363.59 0.00607967 0.00065908 147585 0
: 271 Minimum Test error found - save the configuration
: 271 | 2564.93 2341.49 0.00724022 0.000656239 121507 0
: 272 Minimum Test error found - save the configuration
: 272 | 2541.39 2320.15 0.00616464 0.000706071 146558 0
: 273 Minimum Test error found - save the configuration
: 273 | 2518.73 2298.73 0.00647395 0.000947125 144749 0
: 274 Minimum Test error found - save the configuration
: 274 | 2495.17 2278.53 0.00667867 0.00065268 132758 0
: 275 Minimum Test error found - save the configuration
: 275 | 2472.95 2257.47 0.00614366 0.00068399 146529 0
: 276 Minimum Test error found - save the configuration
: 276 | 2451.14 2236.2 0.0073679 0.0006803 119624 0
: 277 Minimum Test error found - save the configuration
: 277 | 2428.11 2216.37 0.00606282 0.000700002 149175 0
: 278 Minimum Test error found - save the configuration
: 278 | 2406.37 2196.01 0.00649353 0.000859993 142007 0
: 279 Minimum Test error found - save the configuration
: 279 | 2384.59 2175.43 0.00737057 0.00068448 119651 0
: 280 Minimum Test error found - save the configuration
: 280 | 2362.84 2154.8 0.00610645 0.000618839 145783 0
: 281 Minimum Test error found - save the configuration
: 281 | 2340.97 2135.5 0.00695872 0.000943465 132995 0
: 282 Minimum Test error found - save the configuration
: 282 | 2319.81 2115.63 0.00621363 0.000650219 143797 0
: 283 Minimum Test error found - save the configuration
: 283 | 2299.02 2095.7 0.00591121 0.000606409 150807 0
: 284 Minimum Test error found - save the configuration
: 284 | 2277.15 2077.3 0.00581876 0.000642941 154565 0
: 285 Minimum Test error found - save the configuration
: 285 | 2256.55 2058.4 0.00561121 0.000602219 159713 0
: 286 Minimum Test error found - save the configuration
: 286 | 2236.4 2039.07 0.00568459 0.000607699 157577 0
: 287 Minimum Test error found - save the configuration
: 287 | 2215.67 2020.07 0.00583312 0.000633159 153847 0
: 288 Minimum Test error found - save the configuration
: 288 | 2195.1 2001.9 0.005624 0.000615979 159744 0
: 289 Minimum Test error found - save the configuration
: 289 | 2175.32 1983.2 0.00585021 0.00061616 152845 0
: 290 Minimum Test error found - save the configuration
: 290 | 2155.09 1964.89 0.00564239 0.000612679 159055 0
: 291 Minimum Test error found - save the configuration
: 291 | 2135.22 1946.87 0.00573031 0.00065123 157509 0
: 292 Minimum Test error found - save the configuration
: 292 | 2115.04 1929.77 0.00573207 0.000619781 156486 0
: 293 Minimum Test error found - save the configuration
: 293 | 2096.5 1911.82 0.00585366 0.000606849 152474 0
: 294 Minimum Test error found - save the configuration
: 294 | 2077.18 1893.52 0.0058444 0.000637579 153645 0
: 295 Minimum Test error found - save the configuration
: 295 | 2057.28 1877.07 0.00567713 0.000627489 158427 0
: 296 Minimum Test error found - save the configuration
: 296 | 2038.54 1859.76 0.00601676 0.000649939 149064 0
: 297 Minimum Test error found - save the configuration
: 297 | 2019.8 1842.52 0.00574056 0.00063198 156599 0
: 298 Minimum Test error found - save the configuration
: 298 | 2000.67 1825.93 0.00582234 0.000630949 154101 0
: 299 Minimum Test error found - save the configuration
: 299 | 1982.43 1809.21 0.00576281 0.000613299 155355 0
: 300 Minimum Test error found - save the configuration
: 300 | 1964.1 1792.99 0.00577944 0.000606439 154649 0
: 301 Minimum Test error found - save the configuration
: 301 | 1946.14 1776.26 0.00572754 0.000615559 156495 0
: 302 Minimum Test error found - save the configuration
: 302 | 1927.78 1760.09 0.00576074 0.00062346 155725 0
: 303 Minimum Test error found - save the configuration
: 303 | 1909.85 1743.65 0.00574038 0.000648799 157122 0
: 304 Minimum Test error found - save the configuration
: 304 | 1892.25 1727.2 0.00576611 0.000659649 156664 0
: 305 Minimum Test error found - save the configuration
: 305 | 1873.57 1712.37 0.00578953 0.00064488 155501 0
: 306 Minimum Test error found - save the configuration
: 306 | 1856.94 1696.71 0.00594966 0.00069454 152232 0
: 307 Minimum Test error found - save the configuration
: 307 | 1839.41 1681.21 0.00587581 0.00067785 153907 0
: 308 Minimum Test error found - save the configuration
: 308 | 1822.8 1664.84 0.00607903 0.00069856 148686 0
: 309 Minimum Test error found - save the configuration
: 309 | 1804.69 1650.07 0.00609718 0.00062475 146187 0
: 310 Minimum Test error found - save the configuration
: 310 | 1787.79 1635.39 0.00573086 0.000628469 156789 0
: 311 Minimum Test error found - save the configuration
: 311 | 1771.48 1620.14 0.00586238 0.000624429 152732 0
: 312 Minimum Test error found - save the configuration
: 312 | 1754.43 1605.43 0.0057193 0.000610219 156584 0
: 313 Minimum Test error found - save the configuration
: 313 | 1738.2 1590.63 0.00568511 0.000601439 157367 0
: 314 Minimum Test error found - save the configuration
: 314 | 1721.87 1576.76 0.00588122 0.00064165 152684 0
: 315 Minimum Test error found - save the configuration
: 315 | 1705.54 1561.67 0.00559674 0.000611649 160479 0
: 316 Minimum Test error found - save the configuration
: 316 | 1689.22 1547.63 0.00569984 0.000594968 156713 0
: 317 Minimum Test error found - save the configuration
: 317 | 1673.27 1533.28 0.00565324 0.00060109 158349 0
: 318 Minimum Test error found - save the configuration
: 318 | 1657.17 1519.44 0.00568377 0.000659919 159241 0
: 319 Minimum Test error found - save the configuration
: 319 | 1641.6 1505.74 0.00599939 0.000634359 149114 0
: 320 Minimum Test error found - save the configuration
: 320 | 1626.27 1491.51 0.0055354 0.00058757 161687 0
: 321 Minimum Test error found - save the configuration
: 321 | 1610.64 1478.06 0.00571396 0.00063996 157667 0
: 322 Minimum Test error found - save the configuration
: 322 | 1595.31 1464.44 0.00594299 0.000624029 150405 0
: 323 Minimum Test error found - save the configuration
: 323 | 1580.07 1450.97 0.00586162 0.000784592 157573 0
: 324 Minimum Test error found - save the configuration
: 324 | 1564.92 1437.5 0.00665723 0.00071396 134606 0
: 325 Minimum Test error found - save the configuration
: 325 | 1550.2 1424.26 0.00579495 0.00060326 154092 0
: 326 Minimum Test error found - save the configuration
: 326 | 1535.63 1410.79 0.00576081 0.000609409 155298 0
: 327 Minimum Test error found - save the configuration
: 327 | 1520.04 1398.71 0.00596278 0.00070787 152239 0
: 328 Minimum Test error found - save the configuration
: 328 | 1506.2 1385.36 0.00568811 0.000606679 157436 0
: 329 Minimum Test error found - save the configuration
: 329 | 1491.55 1373 0.00622216 0.000728331 145618 0
: 330 Minimum Test error found - save the configuration
: 330 | 1477.51 1360.06 0.00587068 0.000616849 152270 0
: 331 Minimum Test error found - save the configuration
: 331 | 1463.18 1347.38 0.00669002 0.000714651 133883 0
: 332 Minimum Test error found - save the configuration
: 332 | 1449.36 1334.73 0.00811847 0.000982754 112112 0
: 333 Minimum Test error found - save the configuration
: 333 | 1434.9 1322.77 0.00886549 0.000952484 101099 0
: 334 Minimum Test error found - save the configuration
: 334 | 1421.45 1310.32 0.00873746 0.000939284 102588 0
: 335 Minimum Test error found - save the configuration
: 335 | 1407.37 1298.56 0.00874067 0.000955223 102756 0
: 336 Minimum Test error found - save the configuration
: 336 | 1394.43 1286.04 0.00871426 0.000955445 103109 0
: 337 Minimum Test error found - save the configuration
: 337 | 1380.49 1274.39 0.00874985 0.000954634 102627 0
: 338 Minimum Test error found - save the configuration
: 338 | 1367.37 1262.83 0.00871895 0.000948953 102960 0
: 339 Minimum Test error found - save the configuration
: 339 | 1354.45 1250.93 0.00813805 0.000609909 106268 0
: 340 Minimum Test error found - save the configuration
: 340 | 1341.18 1239.55 0.00608784 0.00063458 146701 0
: 341 Minimum Test error found - save the configuration
: 341 | 1328.61 1227.42 0.00606446 0.00066703 148219 0
: 342 Minimum Test error found - save the configuration
: 342 | 1315.54 1215.97 0.00596097 0.00068186 151541 0
: 343 Minimum Test error found - save the configuration
: 343 | 1302.64 1205.41 0.00594481 0.000630889 150548 0
: 344 Minimum Test error found - save the configuration
: 344 | 1290.47 1193.52 0.00623717 0.000638169 142883 0
: 345 Minimum Test error found - save the configuration
: 345 | 1277.7 1182.41 0.00606927 0.000628109 147027 0
: 346 Minimum Test error found - save the configuration
: 346 | 1265.68 1171.13 0.0056954 0.000611789 157368 0
: 347 Minimum Test error found - save the configuration
: 347 | 1253.05 1160.97 0.00569638 0.00059129 156706 0
: 348 Minimum Test error found - save the configuration
: 348 | 1241.41 1149.34 0.00572688 0.00062462 156793 0
: 349 Minimum Test error found - save the configuration
: 349 | 1228.72 1139.12 0.0059777 0.000614919 149176 0
: 350 Minimum Test error found - save the configuration
: 350 | 1217.22 1128.48 0.0061083 0.000697641 147856 0
: 351 Minimum Test error found - save the configuration
: 351 | 1205.46 1118.35 0.00595631 0.00066583 151215 0
: 352 Minimum Test error found - save the configuration
: 352 | 1193.75 1107.54 0.00599778 0.000640279 149323 0
: 353 Minimum Test error found - save the configuration
: 353 | 1182.22 1097.18 0.00602704 0.0006463 148678 0
: 354 Minimum Test error found - save the configuration
: 354 | 1170.92 1087.22 0.00609729 0.00068954 147936 0
: 355 Minimum Test error found - save the configuration
: 355 | 1159.78 1076.03 0.00615406 0.0006689 145848 0
: 356 Minimum Test error found - save the configuration
: 356 | 1148.13 1065.97 0.00598211 0.00071124 151778 0
: 357 Minimum Test error found - save the configuration
: 357 | 1136.93 1055.92 0.00601991 0.000648149 148927 0
: 358 Minimum Test error found - save the configuration
: 358 | 1125.74 1046.18 0.00614585 0.000822353 150277 0
: 359 Minimum Test error found - save the configuration
: 359 | 1114.98 1036.3 0.00635192 0.00064863 140270 0
: 360 Minimum Test error found - save the configuration
: 360 | 1103.76 1026.6 0.0060854 0.000719811 149098 0
: 361 Minimum Test error found - save the configuration
: 361 | 1093.54 1017.05 0.00605586 0.00063961 147704 0
: 362 Minimum Test error found - save the configuration
: 362 | 1082.68 1007.06 0.00574924 0.00062195 156028 0
: 363 Minimum Test error found - save the configuration
: 363 | 1072.42 997.127 0.00581523 0.00062857 154242 0
: 364 Minimum Test error found - save the configuration
: 364 | 1061.6 987.658 0.00592448 0.000651499 151717 0
: 365 Minimum Test error found - save the configuration
: 365 | 1051.42 978.099 0.00647393 0.000728391 139239 0
: 366 Minimum Test error found - save the configuration
: 366 | 1041.07 969.113 0.00658781 0.00064076 134520 0
: 367 Minimum Test error found - save the configuration
: 367 | 1030.73 959.86 0.00650459 0.00068302 137420 0
: 368 Minimum Test error found - save the configuration
: 368 | 1021.05 950.694 0.0061989 0.00067507 144827 0
: 369 Minimum Test error found - save the configuration
: 369 | 1010.75 941.559 0.00639266 0.00066872 139764 0
: 370 Minimum Test error found - save the configuration
: 370 | 1000.99 932.412 0.00619059 0.000700941 145729 0
: 371 Minimum Test error found - save the configuration
: 371 | 991.1 923.702 0.00592906 0.00066876 152083 0
: 372 Minimum Test error found - save the configuration
: 372 | 981.576 914.949 0.0064861 0.000733901 139077 0
: 373 Minimum Test error found - save the configuration
: 373 | 971.747 906.313 0.00642116 0.000695131 139713 0
: 374 Minimum Test error found - save the configuration
: 374 | 962.409 897.139 0.00570637 0.000611089 157008 0
: 375 Minimum Test error found - save the configuration
: 375 | 952.824 888.469 0.00619158 0.000699211 145657 0
: 376 Minimum Test error found - save the configuration
: 376 | 943.633 879.774 0.00620647 0.00064822 143930 0
: 377 Minimum Test error found - save the configuration
: 377 | 933.93 871.804 0.00596758 0.000642321 150227 0
: 378 Minimum Test error found - save the configuration
: 378 | 924.826 863.207 0.00599664 0.00061391 148623 0
: 379 Minimum Test error found - save the configuration
: 379 | 915.719 854.916 0.00562239 0.00068131 161908 0
: 380 Minimum Test error found - save the configuration
: 380 | 907.27 846.061 0.00596638 0.00065539 150631 0
: 381 Minimum Test error found - save the configuration
: 381 | 897.923 837.883 0.00595161 0.000615119 149911 0
: 382 Minimum Test error found - save the configuration
: 382 | 888.912 829.922 0.00608392 0.000632649 146755 0
: 383 Minimum Test error found - save the configuration
: 383 | 880.271 821.773 0.0058917 0.000598068 151125 0
: 384 Minimum Test error found - save the configuration
: 384 | 871.57 813.565 0.00578665 0.000608259 154488 0
: 385 Minimum Test error found - save the configuration
: 385 | 862.832 806.333 0.00578891 0.00062452 154907 0
: 386 Minimum Test error found - save the configuration
: 386 | 854.301 798.207 0.00578806 0.00064974 155693 0
: 387 Minimum Test error found - save the configuration
: 387 | 846.029 790.288 0.00593361 0.00062926 150820 0
: 388 Minimum Test error found - save the configuration
: 388 | 837.65 782.226 0.00596726 0.00065922 150715 0
: 389 Minimum Test error found - save the configuration
: 389 | 828.942 775.249 0.00573025 0.000608949 156210 0
: 390 Minimum Test error found - save the configuration
: 390 | 820.891 767.333 0.00604734 0.000729551 150438 0
: 391 Minimum Test error found - save the configuration
: 391 | 813.104 759.576 0.00587225 0.000611229 152062 0
: 392 Minimum Test error found - save the configuration
: 392 | 804.574 751.699 0.00564313 0.000594909 158472 0
: 393 Minimum Test error found - save the configuration
: 393 | 796.66 744.398 0.00605519 0.000596868 146565 0
: 394 Minimum Test error found - save the configuration
: 394 | 788.649 736.852 0.00576153 0.000687341 157661 0
: 395 Minimum Test error found - save the configuration
: 395 | 780.566 730.305 0.00581912 0.000614199 153701 0
: 396 Minimum Test error found - save the configuration
: 396 | 773.338 722.552 0.00568827 0.000610519 157550 0
: 397 Minimum Test error found - save the configuration
: 397 | 765.343 715.197 0.00590684 0.000612409 151102 0
: 398 Minimum Test error found - save the configuration
: 398 | 757.33 708.409 0.00600458 0.000618859 148541 0
: 399 Minimum Test error found - save the configuration
: 399 | 749.875 701.644 0.00574595 0.000596409 155354 0
: 400 Minimum Test error found - save the configuration
: 400 | 742.323 694.07 0.00575104 0.000601608 155357 0
: 401 Minimum Test error found - save the configuration
: 401 | 734.794 687.442 0.00568489 0.000626469 158152 0
: 402 Minimum Test error found - save the configuration
: 402 | 727.617 680.173 0.00645644 0.000859543 142936 0
: 403 Minimum Test error found - save the configuration
: 403 | 719.886 674.004 0.00579928 0.000627209 154677 0
: 404 Minimum Test error found - save the configuration
: 404 | 713.147 666.554 0.00578158 0.000610389 154703 0
: 405 Minimum Test error found - save the configuration
: 405 | 705.829 659.615 0.00563247 0.000607589 159208 0
: 406 Minimum Test error found - save the configuration
: 406 | 698.647 652.989 0.0057173 0.000629881 157251 0
: 407 Minimum Test error found - save the configuration
: 407 | 691.803 646.094 0.00577672 0.00065862 156308 0
: 408 Minimum Test error found - save the configuration
: 408 | 684.478 639.78 0.00585103 0.000628879 153194 0
: 409 Minimum Test error found - save the configuration
: 409 | 678.12 633.96 0.00586216 0.000644639 153330 0
: 410 Minimum Test error found - save the configuration
: 410 | 671.145 626.712 0.00609075 0.000680091 147856 0
: 411 Minimum Test error found - save the configuration
: 411 | 664.001 619.886 0.00639813 0.000747801 141585 0
: 412 Minimum Test error found - save the configuration
: 412 | 657.304 613.826 0.0061239 0.00066519 146555 0
: 413 Minimum Test error found - save the configuration
: 413 | 650.195 607.864 0.00597894 0.000624939 149421 0
: 414 Minimum Test error found - save the configuration
: 414 | 643.904 601.527 0.0059994 0.00066333 149923 0
: 415 Minimum Test error found - save the configuration
: 415 | 637.249 595.344 0.00605959 0.000635009 147477 0
: 416 Minimum Test error found - save the configuration
: 416 | 631.103 588.696 0.00582732 0.000603829 153154 0
: 417 Minimum Test error found - save the configuration
: 417 | 624.527 582.964 0.00570495 0.000608589 156975 0
: 418 Minimum Test error found - save the configuration
: 418 | 618.015 576.657 0.00572428 0.00062368 156844 0
: 419 Minimum Test error found - save the configuration
: 419 | 611.577 570.561 0.00581652 0.00061722 153867 0
: 420 Minimum Test error found - save the configuration
: 420 | 605.258 565.325 0.00567245 0.000597229 157629 0
: 421 Minimum Test error found - save the configuration
: 421 | 599.503 559.243 0.00577467 0.00066917 156694 0
: 422 Minimum Test error found - save the configuration
: 422 | 593.011 553.417 0.00592408 0.00068937 152826 0
: 423 Minimum Test error found - save the configuration
: 423 | 586.921 547.456 0.00573626 0.000620701 156386 0
: 424 Minimum Test error found - save the configuration
: 424 | 580.906 541.669 0.00589562 0.000787132 156602 0
: 425 Minimum Test error found - save the configuration
: 425 | 574.837 536.166 0.00603447 0.00063461 148152 0
: 426 Minimum Test error found - save the configuration
: 426 | 569.124 530.066 0.00583316 0.00065367 154455 0
: 427 Minimum Test error found - save the configuration
: 427 | 563.022 524.681 0.00569818 0.00065079 158498 0
: 428 Minimum Test error found - save the configuration
: 428 | 557.466 519.191 0.00570235 0.00060886 157063 0
: 429 Minimum Test error found - save the configuration
: 429 | 551.683 513.785 0.00568783 0.000639559 158470 0
: 430 Minimum Test error found - save the configuration
: 430 | 545.89 508.287 0.00569484 0.000596688 156919 0
: 431 Minimum Test error found - save the configuration
: 431 | 539.981 503.303 0.00602149 0.00062525 148251 0
: 432 Minimum Test error found - save the configuration
: 432 | 534.73 497.393 0.00603822 0.000643719 148299 0
: 433 Minimum Test error found - save the configuration
: 433 | 528.925 492.088 0.0059825 0.00067277 150667 0
: 434 Minimum Test error found - save the configuration
: 434 | 524.036 487.107 0.00609553 0.00069414 148110 0
: 435 Minimum Test error found - save the configuration
: 435 | 517.908 482.054 0.0059465 0.00066055 151345 0
: 436 Minimum Test error found - save the configuration
: 436 | 512.865 477.087 0.0059899 0.000620669 148997 0
: 437 Minimum Test error found - save the configuration
: 437 | 507.603 472.341 0.00588726 0.000634399 152298 0
: 438 Minimum Test error found - save the configuration
: 438 | 502.265 467.816 0.0069644 0.000601549 125730 0
: 439 Minimum Test error found - save the configuration
: 439 | 497.383 461.633 0.00568426 0.000611099 157693 0
: 440 Minimum Test error found - save the configuration
: 440 | 491.853 457.043 0.00595921 0.000632779 150194 0
: 441 Minimum Test error found - save the configuration
: 441 | 486.907 451.699 0.00587139 0.00064303 153012 0
: 442 Minimum Test error found - save the configuration
: 442 | 481.629 446.869 0.00582921 0.000634299 153997 0
: 443 Minimum Test error found - save the configuration
: 443 | 476.521 442.438 0.00584031 0.00064151 153882 0
: 444 Minimum Test error found - save the configuration
: 444 | 471.758 437.447 0.00584493 0.000613469 152921 0
: 445 Minimum Test error found - save the configuration
: 445 | 466.772 432.783 0.00586669 0.000606109 152074 0
: 446 Minimum Test error found - save the configuration
: 446 | 461.93 428.002 0.00576514 0.000613789 155299 0
: 447 Minimum Test error found - save the configuration
: 447 | 456.967 423.166 0.0060392 0.00068108 149306 0
: 448 Minimum Test error found - save the configuration
: 448 | 452.165 418.759 0.00582255 0.000604948 153327 0
: 449 Minimum Test error found - save the configuration
: 449 | 447.539 414.002 0.00593208 0.000668 151973 0
: 450 Minimum Test error found - save the configuration
: 450 | 442.717 409.843 0.00592719 0.00064036 151319 0
: 451 Minimum Test error found - save the configuration
: 451 | 438.123 405.067 0.00587471 0.00064717 153036 0
: 452 Minimum Test error found - save the configuration
: 452 | 433.709 401.015 0.00581602 0.000610709 153689 0
: 453 Minimum Test error found - save the configuration
: 453 | 429.45 396.532 0.0058309 0.00063365 153928 0
: 454 Minimum Test error found - save the configuration
: 454 | 424.854 391.879 0.00578269 0.000645669 155732 0
: 455 Minimum Test error found - save the configuration
: 455 | 420.337 388.02 0.00578338 0.000621069 154969 0
: 456 Minimum Test error found - save the configuration
: 456 | 415.835 383.718 0.00581685 0.00065137 154874 0
: 457 Minimum Test error found - save the configuration
: 457 | 411.52 378.979 0.00589593 0.000648191 152447 0
: 458 Minimum Test error found - save the configuration
: 458 | 406.934 375.437 0.0059843 0.000653781 150079 0
: 459 Minimum Test error found - save the configuration
: 459 | 402.766 370.748 0.00600765 0.000617699 148424 0
: 460 Minimum Test error found - save the configuration
: 460 | 398.459 366.874 0.00578453 0.000644779 155650 0
: 461 Minimum Test error found - save the configuration
: 461 | 394.318 362.592 0.00571187 0.000594568 156333 0
: 462 Minimum Test error found - save the configuration
: 462 | 390.068 359.337 0.00607072 0.000739582 150062 0
: 463 Minimum Test error found - save the configuration
: 463 | 386.305 354.766 0.00647336 0.00068876 138298 0
: 464 Minimum Test error found - save the configuration
: 464 | 381.969 350.982 0.00677375 0.000721111 132174 0
: 465 Minimum Test error found - save the configuration
: 465 | 377.848 347.435 0.00718642 0.00067754 122909 0
: 466 Minimum Test error found - save the configuration
: 466 | 374.195 343.862 0.00634462 0.000695511 141615 0
: 467 Minimum Test error found - save the configuration
: 467 | 370.178 339.211 0.00845471 0.000718911 103415 0
: 468 Minimum Test error found - save the configuration
: 468 | 365.968 335.27 0.00673598 0.000608239 130554 0
: 469 Minimum Test error found - save the configuration
: 469 | 362.126 331.99 0.00571445 0.000617329 156951 0
: 470 Minimum Test error found - save the configuration
: 470 | 358.343 327.792 0.00651967 0.000836063 140756 0
: 471 Minimum Test error found - save the configuration
: 471 | 354.232 324.19 0.00652317 0.000665469 136572 0
: 472 Minimum Test error found - save the configuration
: 472 | 350.852 320.638 0.00640104 0.000718701 140787 0
: 473 Minimum Test error found - save the configuration
: 473 | 346.882 317.256 0.0062564 0.00070359 144071 0
: 474 Minimum Test error found - save the configuration
: 474 | 343.265 313.935 0.00625778 0.000737261 144914 0
: 475 Minimum Test error found - save the configuration
: 475 | 339.859 309.678 0.00632699 0.00067196 141467 0
: 476 Minimum Test error found - save the configuration
: 476 | 335.819 306.196 0.00658487 0.00069295 135779 0
: 477 Minimum Test error found - save the configuration
: 477 | 332.484 302.346 0.00644084 0.000679861 138865 0
: 478 Minimum Test error found - save the configuration
: 478 | 328.558 299.555 0.0062835 0.00070273 143349 0
: 479 Minimum Test error found - save the configuration
: 479 | 325.2 296.171 0.0059945 0.000626369 149028 0
: 480 Minimum Test error found - save the configuration
: 480 | 321.651 292.83 0.00581282 0.00062646 154251 0
: 481 Minimum Test error found - save the configuration
: 481 | 318.417 289.549 0.00614781 0.000719351 147371 0
: 482 Minimum Test error found - save the configuration
: 482 | 315.163 286.451 0.00625415 0.000834923 147622 0
: 483 Minimum Test error found - save the configuration
: 483 | 311.597 282.954 0.00652691 0.000696141 137203 0
: 484 Minimum Test error found - save the configuration
: 484 | 308.129 279.365 0.00664067 0.000645219 133434 0
: 485 Minimum Test error found - save the configuration
: 485 | 304.866 276.108 0.00590675 0.000605899 150919 0
: 486 Minimum Test error found - save the configuration
: 486 | 301.18 273.046 0.00649727 0.000723121 138549 0
: 487 Minimum Test error found - save the configuration
: 487 | 298.144 269.942 0.00616918 0.000729761 147074 0
: 488 Minimum Test error found - save the configuration
: 488 | 294.88 267.163 0.00655076 0.000768872 138363 0
: 489 Minimum Test error found - save the configuration
: 489 | 291.773 263.433 0.00639131 0.000710491 140825 0
: 490 Minimum Test error found - save the configuration
: 490 | 288.511 260.429 0.00648926 0.000710421 138436 0
: 491 Minimum Test error found - save the configuration
: 491 | 285.41 257.824 0.00669138 0.000789742 135556 0
: 492 Minimum Test error found - save the configuration
: 492 | 282.221 254.573 0.0061366 0.00065343 145901 0
: 493 Minimum Test error found - save the configuration
: 493 | 279.277 251.712 0.00642454 0.00067037 139030 0
: 494 Minimum Test error found - save the configuration
: 494 | 276.477 248.82 0.00621148 0.000733901 146050 0
: 495 Minimum Test error found - save the configuration
: 495 | 273.115 246.305 0.00625085 0.00064796 142783 0
: 496 Minimum Test error found - save the configuration
: 496 | 270.726 243.656 0.0060479 0.000605559 146996 0
: 497 Minimum Test error found - save the configuration
: 497 | 267.359 240.881 0.00599356 0.000741451 152320 0
: 498 Minimum Test error found - save the configuration
: 498 | 264.585 237.844 0.00675807 0.000698401 132020 0
: 499 Minimum Test error found - save the configuration
: 499 | 261.588 234.676 0.00628704 0.00068442 142790 0
: 500 Minimum Test error found - save the configuration
: 500 | 258.761 231.896 0.00577398 0.000606959 154828 0
: 501 Minimum Test error found - save the configuration
: 501 | 256.066 229.342 0.00586594 0.000618829 152465 0
: 502 Minimum Test error found - save the configuration
: 502 | 253.032 226.813 0.00560366 0.00064437 161314 0
: 503 Minimum Test error found - save the configuration
: 503 | 250.063 223.908 0.0058844 0.000604959 151531 0
: 504 Minimum Test error found - save the configuration
: 504 | 247.502 221.498 0.00606904 0.00062856 147046 0
: 505 Minimum Test error found - save the configuration
: 505 | 244.917 219.333 0.00594465 0.0006327 150604 0
: 506 Minimum Test error found - save the configuration
: 506 | 242.324 216.219 0.00580385 0.00068319 156230 0
: 507 Minimum Test error found - save the configuration
: 507 | 239.401 214.474 0.00597995 0.00069339 151327 0
: 508 Minimum Test error found - save the configuration
: 508 | 236.785 211.271 0.00575353 0.000604679 155375 0
: 509 Minimum Test error found - save the configuration
: 509 | 234.081 209.092 0.0056799 0.00063556 158594 0
: 510 Minimum Test error found - save the configuration
: 510 | 231.412 206.574 0.00572964 0.00065975 157794 0
: 511 Minimum Test error found - save the configuration
: 511 | 229.165 203.87 0.00601868 0.000658799 149257 0
: 512 Minimum Test error found - save the configuration
: 512 | 226.485 201.561 0.00605686 0.00066232 148298 0
: 513 Minimum Test error found - save the configuration
: 513 | 224.028 199.252 0.005955 0.000625939 150120 0
: 514 Minimum Test error found - save the configuration
: 514 | 221.741 197.052 0.00795177 0.000962473 114461 0
: 515 Minimum Test error found - save the configuration
: 515 | 219.345 195.708 0.00642081 0.000617099 137843 0
: 516 Minimum Test error found - save the configuration
: 516 | 216.662 192.601 0.00567176 0.000615069 158206 0
: 517 Minimum Test error found - save the configuration
: 517 | 214.175 190.466 0.00579453 0.00062965 154892 0
: 518 Minimum Test error found - save the configuration
: 518 | 211.918 188.435 0.00568225 0.000601509 157457 0
: 519 Minimum Test error found - save the configuration
: 519 | 209.688 186.259 0.0064535 0.000707061 139217 0
: 520 Minimum Test error found - save the configuration
: 520 | 207.435 183.381 0.00611657 0.0006483 146298 0
: 521 Minimum Test error found - save the configuration
: 521 | 205.084 181.812 0.00642273 0.000667581 139006 0
: 522 Minimum Test error found - save the configuration
: 522 | 202.826 180.222 0.0059561 0.000630051 150205 0
: 523 Minimum Test error found - save the configuration
: 523 | 200.626 178.584 0.00625 0.000597259 141524 0
: 524 Minimum Test error found - save the configuration
: 524 | 198.419 175.443 0.00650704 0.000672641 137118 0
: 525 Minimum Test error found - save the configuration
: 525 | 196.18 173.812 0.00620139 0.00067526 144767 0
: 526 Minimum Test error found - save the configuration
: 526 | 194.017 171.461 0.00622658 0.00063451 143060 0
: 527 Minimum Test error found - save the configuration
: 527 | 191.716 169.784 0.00621768 0.000861103 149349 0
: 528 Minimum Test error found - save the configuration
: 528 | 189.775 166.949 0.00588777 0.000620299 151876 0
: 529 Minimum Test error found - save the configuration
: 529 | 187.279 165.613 0.00600549 0.000640779 149123 0
: 530 Minimum Test error found - save the configuration
: 530 | 185.329 163.522 0.0061842 0.000742751 147020 0
: 531 Minimum Test error found - save the configuration
: 531 | 183.289 161.353 0.00585416 0.00065842 153972 0
: 532 Minimum Test error found - save the configuration
: 532 | 181.293 159.877 0.00595238 0.000692181 152086 0
: 533 Minimum Test error found - save the configuration
: 533 | 179.548 157.547 0.00605357 0.000627611 147439 0
: 534 Minimum Test error found - save the configuration
: 534 | 177.141 155.62 0.00587518 0.000602779 151734 0
: 535 Minimum Test error found - save the configuration
: 535 | 175.305 154.457 0.00580332 0.000618579 154299 0
: 536 Minimum Test error found - save the configuration
: 536 | 173.304 152.485 0.00565286 0.00063202 159336 0
: 537 Minimum Test error found - save the configuration
: 537 | 171.516 151.12 0.0057125 0.000613679 156899 0
: 538 Minimum Test error found - save the configuration
: 538 | 169.622 148.792 0.00576282 0.00068445 157531 0
: 539 Minimum Test error found - save the configuration
: 539 | 167.299 146.462 0.00593233 0.000619279 150573 0
: 540 Minimum Test error found - save the configuration
: 540 | 165.408 146.142 0.0064466 0.000769451 140916 0
: 541 Minimum Test error found - save the configuration
: 541 | 163.775 143.608 0.00723425 0.000741392 123212 0
: 542 Minimum Test error found - save the configuration
: 542 | 161.601 141.319 0.00581702 0.00070061 156360 0
: 543 Minimum Test error found - save the configuration
: 543 | 159.427 140.122 0.0059569 0.000615039 149761 0
: 544 Minimum Test error found - save the configuration
: 544 | 157.824 138.024 0.00555114 0.000594788 161409 0
: 545 Minimum Test error found - save the configuration
: 545 | 155.943 136.687 0.00571418 0.000708571 159821 0
: 546 Minimum Test error found - save the configuration
: 546 | 154.444 134.96 0.00557104 0.00060959 161243 0
: 547 Minimum Test error found - save the configuration
: 547 | 152.419 133.645 0.00560113 0.000594279 159781 0
: 548 Minimum Test error found - save the configuration
: 548 | 150.888 131.705 0.00559711 0.000609309 160391 0
: 549 Minimum Test error found - save the configuration
: 549 | 149.033 129.638 0.00556802 0.000595269 160877 0
: 550 Minimum Test error found - save the configuration
: 550 | 147.064 128.814 0.00554998 0.000595269 161462 0
: 551 Minimum Test error found - save the configuration
: 551 | 145.651 127.685 0.00563153 0.000611339 159357 0
: 552 Minimum Test error found - save the configuration
: 552 | 143.942 126.045 0.00558013 0.000586419 160201 0
: 553 Minimum Test error found - save the configuration
: 553 | 142.409 124.288 0.00557339 0.000606459 161065 0
: 554 Minimum Test error found - save the configuration
: 554 | 140.532 122.69 0.00579824 0.000615599 154361 0
: 555 Minimum Test error found - save the configuration
: 555 | 138.848 120.645 0.00565205 0.000601079 158385 0
: 556 Minimum Test error found - save the configuration
: 556 | 137.065 120.272 0.00575689 0.000630539 156057 0
: 557 Minimum Test error found - save the configuration
: 557 | 135.724 119.037 0.00584052 0.00063769 153763 0
: 558 Minimum Test error found - save the configuration
: 558 | 134.277 117.609 0.00657205 0.000719481 136692 0
: 559 Minimum Test error found - save the configuration
: 559 | 132.432 115.568 0.00618055 0.000635041 144261 0
: 560 Minimum Test error found - save the configuration
: 560 | 131.043 114.114 0.00580271 0.000608669 154023 0
: 561 Minimum Test error found - save the configuration
: 561 | 129.539 112.839 0.0058691 0.000620259 152415 0
: 562 Minimum Test error found - save the configuration
: 562 | 127.851 111.766 0.00582523 0.000779951 158564 0
: 563 Minimum Test error found - save the configuration
: 563 | 126.294 109.946 0.00576684 0.00062968 155728 0
: 564 Minimum Test error found - save the configuration
: 564 | 124.803 108.386 0.00724961 0.000912864 126248 0
: 565 Minimum Test error found - save the configuration
: 565 | 123.533 106.901 0.00604459 0.00066255 148642 0
: 566 Minimum Test error found - save the configuration
: 566 | 121.822 106.167 0.00593376 0.000595939 149874 0
: 567 Minimum Test error found - save the configuration
: 567 | 120.394 104.388 0.00671174 0.000964625 139200 0
: 568 Minimum Test error found - save the configuration
: 568 | 118.991 102.643 0.0066478 0.0006403 133167 0
: 569 Minimum Test error found - save the configuration
: 569 | 117.636 102.115 0.007621 0.00063619 114534 0
: 570 Minimum Test error found - save the configuration
: 570 | 116.244 100.743 0.00604498 0.00070584 149837 0
: 571 Minimum Test error found - save the configuration
: 571 | 114.88 99.5083 0.00618338 0.000607629 143478 0
: 572 Minimum Test error found - save the configuration
: 572 | 113.977 98.707 0.00595931 0.000635441 150267 0
: 573 Minimum Test error found - save the configuration
: 573 | 112.379 97.4725 0.00603938 0.000649659 148431 0
: 574 Minimum Test error found - save the configuration
: 574 | 110.734 95.7687 0.00589418 0.000637371 152184 0
: 575 Minimum Test error found - save the configuration
: 575 | 109.413 94.916 0.00618003 0.000613719 143722 0
: 576 Minimum Test error found - save the configuration
: 576 | 108.111 94.1201 0.0059876 0.00068432 150850 0
: 577 Minimum Test error found - save the configuration
: 577 | 106.794 92.7837 0.00601889 0.00062489 148313 0
: 578 Minimum Test error found - save the configuration
: 578 | 105.748 91.6094 0.00794062 0.000958195 114573 0
: 579 Minimum Test error found - save the configuration
: 579 | 104.576 89.4543 0.00705866 0.000622499 124298 0
: 580 Minimum Test error found - save the configuration
: 580 | 103.146 88.8036 0.00799724 0.000964525 113754 0
: 581 Minimum Test error found - save the configuration
: 581 | 101.689 87.6591 0.00697849 0.00065088 126430 0
: 582 Minimum Test error found - save the configuration
: 582 | 100.667 86.2224 0.00859894 0.000970475 104870 0
: 583 Minimum Test error found - save the configuration
: 583 | 99.3544 85.6407 0.0064171 0.000712081 140227 0
: 584 Minimum Test error found - save the configuration
: 584 | 98.2808 84.0742 0.00852048 0.000949684 105669 0
: 585 Minimum Test error found - save the configuration
: 585 | 97.2092 83.7234 0.0070866 0.000641199 124120 0
: 586 Minimum Test error found - save the configuration
: 586 | 95.8764 82.2379 0.0081505 0.000955093 111182 0
: 587 Minimum Test error found - save the configuration
: 587 | 94.6562 81.047 0.0063558 0.000794892 143862 0
: 588 Minimum Test error found - save the configuration
: 588 | 93.6139 79.9318 0.00859674 0.000802681 102642 0
: 589 Minimum Test error found - save the configuration
: 589 | 92.623 79.5169 0.00657993 0.000964815 142473 0
: 590 Minimum Test error found - save the configuration
: 590 | 91.5333 77.9234 0.00859184 0.000819462 102929 0
: 591 Minimum Test error found - save the configuration
: 591 | 90.2466 77.0356 0.00646347 0.000963765 145462 0
: 592 Minimum Test error found - save the configuration
: 592 | 89.1292 75.8284 0.00800728 0.000611209 108166 0
: 593 | 88.2107 75.9898 0.00702583 0.000891563 130415 1
: 594 Minimum Test error found - save the configuration
: 594 | 87.5039 73.9271 0.00662913 0.00065704 133956 0
: 595 Minimum Test error found - save the configuration
: 595 | 86.0356 73.469 0.00752853 0.000970745 121992 0
: 596 Minimum Test error found - save the configuration
: 596 | 85.0299 72.1172 0.00887053 0.000969925 101258 0
: 597 Minimum Test error found - save the configuration
: 597 | 84.138 71.4697 0.00818292 0.00064422 106119 0
: 598 Minimum Test error found - save the configuration
: 598 | 83.0123 70.3133 0.0067104 0.000599949 130923 0
: 599 Minimum Test error found - save the configuration
: 599 | 82.1967 69.4021 0.0055618 0.000604519 161379 0
: 600 Minimum Test error found - save the configuration
: 600 | 81.4508 69.3851 0.00555073 0.000596159 161467 0
: 601 Minimum Test error found - save the configuration
: 601 | 80.4331 67.6428 0.00553872 0.00059437 161801 0
: 602 Minimum Test error found - save the configuration
: 602 | 79.5899 67.169 0.00560863 0.000606029 159917 0
: 603 Minimum Test error found - save the configuration
: 603 | 78.6627 65.3779 0.00553703 0.00059266 161800 0
: 604 Minimum Test error found - save the configuration
: 604 | 77.623 65.1522 0.00555809 0.000603119 161454 0
: 605 Minimum Test error found - save the configuration
: 605 | 76.6819 64.0776 0.00554633 0.000585729 161271 0
: 606 Minimum Test error found - save the configuration
: 606 | 75.6389 62.992 0.00562483 0.00067796 161718 0
: 607 Minimum Test error found - save the configuration
: 607 | 74.8684 62.1189 0.0055487 0.000594709 161486 0
: 608 Minimum Test error found - save the configuration
: 608 | 73.7615 61.4056 0.00554821 0.00059559 161531 0
: 609 Minimum Test error found - save the configuration
: 609 | 72.9762 60.4808 0.00555075 0.000594329 161407 0
: 610 Minimum Test error found - save the configuration
: 610 | 72.0914 59.8755 0.0069894 0.000968395 132868 0
: 611 Minimum Test error found - save the configuration
: 611 | 71.3128 59.0757 0.00810404 0.00066852 107592 0
: 612 Minimum Test error found - save the configuration
: 612 | 70.2849 58.2727 0.00753277 0.000968385 121870 0
: 613 Minimum Test error found - save the configuration
: 613 | 69.5507 57.6036 0.00756564 0.00065623 115784 0
: 614 Minimum Test error found - save the configuration
: 614 | 69.147 56.6009 0.00769289 0.000973484 119058 0
: 615 Minimum Test error found - save the configuration
: 615 | 68.0871 55.6888 0.00647918 0.000955245 144824 0
: 616 Minimum Test error found - save the configuration
: 616 | 66.9713 55.1698 0.00773428 0.000650189 112929 0
: 617 Minimum Test error found - save the configuration
: 617 | 66.4314 54.6565 0.00569927 0.000602788 156971 0
: 618 Minimum Test error found - save the configuration
: 618 | 65.7808 53.8479 0.00585348 0.000597339 152203 0
: 619 Minimum Test error found - save the configuration
: 619 | 64.8323 53.0697 0.00563043 0.00060242 159109 0
: 620 Minimum Test error found - save the configuration
: 620 | 63.9514 52.4044 0.00597929 0.000663771 150503 0
: 621 | 63.1911 52.7003 0.00580796 0.000567038 152645 1
: 622 Minimum Test error found - save the configuration
: 622 | 62.5821 51.1926 0.00559907 0.000601509 160078 0
: 623 Minimum Test error found - save the configuration
: 623 | 61.7147 50.0961 0.00621801 0.000613069 142731 0
: 624 Minimum Test error found - save the configuration
: 624 | 60.9201 49.6601 0.00579697 0.000613529 154338 0
: 625 Minimum Test error found - save the configuration
: 625 | 60.3174 48.9232 0.00635914 0.000722691 141933 0
: 626 Minimum Test error found - save the configuration
: 626 | 59.5375 48.7034 0.00620879 0.000721411 145789 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.7556 47.3837 0.00597419 0.000696691 151587 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.1065 47.1399 0.00591833 0.0006233 151085 0
: 629 Minimum Test error found - save the configuration
: 629 | 57.5076 46.0139 0.00594238 0.00064468 151009 0
: 630 Minimum Test error found - save the configuration
: 630 | 56.606 45.4359 0.00612405 0.000622889 145424 0
: 631 Minimum Test error found - save the configuration
: 631 | 55.9811 45.1314 0.0059316 0.000659321 151737 0
: 632 Minimum Test error found - save the configuration
: 632 | 55.3696 44.6081 0.00586818 0.00067686 154103 0
: 633 Minimum Test error found - save the configuration
: 633 | 54.8623 43.6297 0.00630881 0.000901684 147953 0
: 634 | 54.0803 43.7531 0.00870609 0.000905914 102562 1
: 635 Minimum Test error found - save the configuration
: 635 | 53.5625 43.1383 0.00884956 0.000959725 101396 0
: 636 Minimum Test error found - save the configuration
: 636 | 52.9313 42.0013 0.00885278 0.000993115 101785 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.0993 41.3085 0.00767108 0.0006004 113143 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.4885 41.0652 0.00561005 0.000612319 160073 0
: 639 | 50.9622 42.0186 0.00679767 0.000913904 135967 1
: 640 Minimum Test error found - save the configuration
: 640 | 50.22 39.8595 0.00581277 0.000625659 154229 0
: 641 Minimum Test error found - save the configuration
: 641 | 49.6619 39.5203 0.00644378 0.000692331 139095 0
: 642 Minimum Test error found - save the configuration
: 642 | 48.9746 38.7079 0.00789332 0.0006275 110105 0
: 643 Minimum Test error found - save the configuration
: 643 | 48.4173 38.5814 0.00558662 0.000597519 160349 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.8379 37.3323 0.00556882 0.000594479 160825 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.1566 37.1656 0.00685726 0.00067095 129318 0
: 646 Minimum Test error found - save the configuration
: 646 | 46.6514 36.4875 0.00619261 0.00066422 144707 0
: 647 Minimum Test error found - save the configuration
: 647 | 46.1535 36.483 0.00592202 0.00064256 151531 0
: 648 Minimum Test error found - save the configuration
: 648 | 45.5053 35.3769 0.00593002 0.000649729 151507 0
: 649 | 44.9549 35.8805 0.00701403 0.000862963 130059 1
: 650 Minimum Test error found - save the configuration
: 650 | 44.6576 34.3878 0.00790992 0.000821023 112853 0
: 651 Minimum Test error found - save the configuration
: 651 | 44.1497 34.1896 0.00769446 0.000744872 115115 0
: 652 Minimum Test error found - save the configuration
: 652 | 43.5857 33.5382 0.00628424 0.000614009 141088 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.9375 33.4124 0.00559814 0.000608159 160321 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.6411 33.0398 0.00557388 0.000599799 160834 0
: 655 Minimum Test error found - save the configuration
: 655 | 41.8812 31.9224 0.00558959 0.000609199 160630 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.492 31.815 0.00565142 0.000603789 158490 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.8736 31.63 0.00568959 0.000597639 157111 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.6698 30.915 0.0055858 0.000605259 160625 0
: 659 Minimum Test error found - save the configuration
: 659 | 40.0023 30.7357 0.00556917 0.000590259 160678 0
: 660 Minimum Test error found - save the configuration
: 660 | 39.5828 29.7355 0.00585064 0.00067593 154598 0
: 661 | 39.0799 29.8015 0.00569598 0.000568259 156015 1
: 662 Minimum Test error found - save the configuration
: 662 | 38.7094 28.9792 0.00564126 0.000613639 159121 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.0624 28.6193 0.00561764 0.000599249 159414 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.6245 28.249 0.00589485 0.00067785 153345 0
: 665 Minimum Test error found - save the configuration
: 665 | 37.1486 27.4367 0.00573129 0.000607449 156133 0
: 666 | 36.8754 27.6912 0.00571841 0.000558328 155036 1
: 667 Minimum Test error found - save the configuration
: 667 | 36.2888 26.7558 0.00558138 0.000604479 160743 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.9261 26.2348 0.00587953 0.000601589 151574 0
: 669 | 35.4158 26.2488 0.0058622 0.000656409 153675 1
: 670 Minimum Test error found - save the configuration
: 670 | 34.9525 25.4054 0.00580359 0.000646829 155136 0
: 671 | 34.5049 25.5443 0.00604885 0.00066143 148494 1
: 672 Minimum Test error found - save the configuration
: 672 | 34.1028 24.6738 0.00581617 0.00060775 153597 0
: 673 Minimum Test error found - save the configuration
: 673 | 33.7705 24.3905 0.00567627 0.000597749 157526 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.3112 23.8974 0.00606918 0.00065828 147850 0
: 675 | 32.855 23.901 0.00628373 0.00061597 141149 1
: 676 | 32.4915 23.9093 0.00652153 0.000547319 133909 2
: 677 Minimum Test error found - save the configuration
: 677 | 32.2184 22.9573 0.00565127 0.000611519 158738 0
: 678 | 31.5617 22.993 0.00569063 0.000557599 155853 1
: 679 Minimum Test error found - save the configuration
: 679 | 31.3142 22.304 0.00574905 0.00062344 156079 0
: 680 Minimum Test error found - save the configuration
: 680 | 30.8481 21.704 0.00562799 0.00063916 160358 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.4817 21.5529 0.00616981 0.000649239 144912 0
: 682 Minimum Test error found - save the configuration
: 682 | 30.0597 21.0887 0.00575419 0.000648979 156703 0
: 683 Minimum Test error found - save the configuration
: 683 | 29.6483 20.7385 0.00645418 0.000607609 136832 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.28 20.6372 0.00669995 0.000959155 139353 0
: 685 Minimum Test error found - save the configuration
: 685 | 29.0966 20.0694 0.00717658 0.00062721 122149 0
: 686 Minimum Test error found - save the configuration
: 686 | 28.5926 19.7013 0.00778306 0.000960575 117259 0
: 687 Minimum Test error found - save the configuration
: 687 | 28.3323 19.2483 0.00605683 0.000602059 146661 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.8583 18.7988 0.00828741 0.000748201 106112 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.6228 18.4492 0.00615236 0.000940774 153504 0
: 690 Minimum Test error found - save the configuration
: 690 | 27.2149 18.0402 0.00756789 0.000597899 114778 0
: 691 | 26.8735 18.343 0.00700593 0.000900634 131034 1
: 692 Minimum Test error found - save the configuration
: 692 | 26.4799 17.8766 0.00656394 0.000851333 140041 0
: 693 Minimum Test error found - save the configuration
: 693 | 26.3252 17.4863 0.00744984 0.000593679 116683 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.7379 17.3151 0.00587653 0.000734811 155590 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.4377 16.9036 0.00651566 0.000836433 140864 0
: 696 Minimum Test error found - save the configuration
: 696 | 25.0259 16.7458 0.00722659 0.000634639 121360 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.7524 16.3756 0.00593003 0.000625609 150818 0
: 698 Minimum Test error found - save the configuration
: 698 | 24.4298 16.0238 0.00589653 0.000616159 151505 0
: 699 | 24.2078 16.2082 0.0065887 0.000753052 137088 1
: 700 Minimum Test error found - save the configuration
: 700 | 24.0696 15.227 0.00603614 0.0006663 148980 0
: 701 | 23.6215 15.3994 0.00592615 0.000575488 149514 1
: 702 | 23.3642 15.2944 0.00577003 0.000575369 154004 2
: 703 Minimum Test error found - save the configuration
: 703 | 23.1621 14.8701 0.00580287 0.000617629 154284 0
: 704 Minimum Test error found - save the configuration
: 704 | 22.7279 14.1771 0.00579622 0.000616619 154452 0
: 705 | 22.3143 15.0392 0.00565403 0.000570719 157378 1
: 706 Minimum Test error found - save the configuration
: 706 | 22.1327 13.8871 0.00573426 0.00065821 157603 0
: 707 Minimum Test error found - save the configuration
: 707 | 21.8899 13.6234 0.00584376 0.00069015 155231 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.5286 13.5548 0.00610829 0.000642039 146353 0
: 709 | 21.2594 13.5672 0.00604524 0.000562048 145900 1
: 710 Minimum Test error found - save the configuration
: 710 | 21.0166 13.3151 0.00581062 0.000640719 154742 0
: 711 Minimum Test error found - save the configuration
: 711 | 21.0338 13.2704 0.00608272 0.00067008 147802 0
: 712 Minimum Test error found - save the configuration
: 712 | 20.4464 13.2115 0.0058213 0.000641479 154446 0
: 713 Minimum Test error found - save the configuration
: 713 | 20.3606 12.7577 0.00586609 0.000620879 152520 0
: 714 Minimum Test error found - save the configuration
: 714 | 20.0178 12.6915 0.0059464 0.000658359 151285 0
: 715 Minimum Test error found - save the configuration
: 715 | 19.9417 12.5764 0.00579362 0.000630199 154936 0
: 716 Minimum Test error found - save the configuration
: 716 | 19.333 11.5169 0.00619804 0.00065414 144303 0
: 717 | 19.0545 11.6281 0.00572007 0.000556429 154929 1
: 718 Minimum Test error found - save the configuration
: 718 | 18.697 11.0962 0.0057503 0.000603259 155429 0
: 719 | 18.7037 11.9523 0.0070321 0.00065653 125479 1
: 720 Minimum Test error found - save the configuration
: 720 | 18.5498 10.9636 0.00608731 0.00061446 146176 0
: 721 Minimum Test error found - save the configuration
: 721 | 18.0747 10.5243 0.00583507 0.00068647 155382 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.8845 10.3994 0.0061462 0.00064184 145339 0
: 723 Minimum Test error found - save the configuration
: 723 | 17.5984 10.1084 0.00605656 0.00064879 147935 0
: 724 Minimum Test error found - save the configuration
: 724 | 17.3567 10.0957 0.00585965 0.00060761 152322 0
: 725 Minimum Test error found - save the configuration
: 725 | 17.061 9.97307 0.00678467 0.000632751 130041 0
: 726 Minimum Test error found - save the configuration
: 726 | 16.8664 9.46983 0.00592386 0.000617121 150752 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.7089 9.40366 0.00595189 0.000612019 149816 0
: 728 Minimum Test error found - save the configuration
: 728 | 16.5603 9.26045 0.00562871 0.000602219 159157 0
: 729 Minimum Test error found - save the configuration
: 729 | 16.1788 8.97271 0.00591868 0.000772802 155464 0
: 730 | 15.9821 8.99777 0.00639979 0.000689711 140103 1
: 731 | 15.7942 9.10846 0.00612686 0.0005701 143969 2
: 732 Minimum Test error found - save the configuration
: 732 | 15.5631 8.38313 0.00585701 0.000632269 153118 0
: 733 | 15.2075 8.48006 0.00570936 0.000611419 156926 1
: 734 | 15.293 8.44086 0.00591121 0.000768731 155567 2
: 735 Minimum Test error found - save the configuration
: 735 | 14.8704 8.35481 0.00637294 0.0006161 138965 0
: 736 Minimum Test error found - save the configuration
: 736 | 14.8395 7.94415 0.00626572 0.00065931 142694 0
: 737 Minimum Test error found - save the configuration
: 737 | 14.5043 7.59096 0.00567827 0.000595849 157405 0
: 738 | 14.3273 7.65804 0.00585998 0.000552428 150729 1
: 739 | 14.211 7.6393 0.00591576 0.00062538 151218 2
: 740 Minimum Test error found - save the configuration
: 740 | 14.0208 7.26005 0.00566475 0.000607569 158191 0
: 741 | 13.7264 7.3125 0.00598199 0.00066019 150325 1
: 742 Minimum Test error found - save the configuration
: 742 | 13.4766 6.89642 0.00575706 0.00062949 156019 0
: 743 | 13.3081 6.91929 0.00573484 0.000586358 155386 1
: 744 | 13.2779 7.06773 0.00582174 0.000559659 152031 2
: 745 | 13.2014 6.93704 0.00566393 0.000583979 157482 3
: 746 | 13.0886 6.98518 0.00577433 0.000566709 153621 4
: 747 Minimum Test error found - save the configuration
: 747 | 12.7535 6.65163 0.00579154 0.000595939 153977 0
: 748 | 12.6908 6.85675 0.00647316 0.000647211 137317 1
: 749 Minimum Test error found - save the configuration
: 749 | 12.4421 6.29462 0.00609731 0.00065955 147119 0
: 750 Minimum Test error found - save the configuration
: 750 | 12.2454 6.21983 0.0080191 0.000785322 110592 0
: 751 Minimum Test error found - save the configuration
: 751 | 12.109 5.95112 0.00747334 0.00114637 126443 0
: 752 | 11.8777 6.73628 0.00782557 0.000568029 110230 1
: 753 Minimum Test error found - save the configuration
: 753 | 11.8409 5.93816 0.0064569 0.000777862 140869 0
: 754 | 11.9606 7.07829 0.00667273 0.0006039 131821 1
: 755 | 12.7469 6.29126 0.00973126 0.00131723 95079.3 2
: 756 Minimum Test error found - save the configuration
: 756 | 12.1461 5.49579 0.00920756 0.000791352 95054.7 0
: 757 | 11.7465 6.62254 0.00615434 0.000595458 143914 1
: 758 | 11.3609 6.03919 0.00656257 0.000909864 141525 2
: 759 | 11.3165 5.95746 0.00907557 0.000913654 98016.2 3
: 760 Minimum Test error found - save the configuration
: 760 | 10.7812 5.48226 0.00933487 0.00125209 98975.8 0
: 761 Minimum Test error found - save the configuration
: 761 | 10.4444 5.0889 0.00815475 0.000627339 106278 0
: 762 | 10.3838 5.22647 0.00565292 0.0006345 159413 1
: 763 | 10.4118 5.63052 0.00680831 0.000568698 128213 2
: 764 | 10.3513 5.0996 0.00819798 0.000901494 109642 3
: 765 | 9.97979 5.26444 0.00883939 0.000933324 101188 4
: 766 Minimum Test error found - save the configuration
: 766 | 9.919 4.65716 0.00833284 0.000622409 103756 0
: 767 | 9.88117 5.38164 0.00601355 0.000627909 148543 1
: 768 Minimum Test error found - save the configuration
: 768 | 10.0093 4.5161 0.00782115 0.000638 111372 0
: 769 | 9.67691 4.82327 0.00595405 0.00059132 149178 1
: 770 | 9.54137 4.96663 0.00712604 0.000586748 122337 2
: 771 Minimum Test error found - save the configuration
: 771 | 9.22796 4.24975 0.00739513 0.000621919 118112 0
: 772 | 9.08095 4.38791 0.00569723 0.000576299 156222 1
: 773 | 8.98552 4.5268 0.00558614 0.000558749 159128 2
: 774 Minimum Test error found - save the configuration
: 774 | 9.01296 4.12595 0.00602342 0.000942554 157453 0
: 775 | 8.97733 5.25166 0.0103144 0.00114651 87261 1
: 776 Minimum Test error found - save the configuration
: 776 | 8.73207 4.09136 0.0072496 0.000624121 120746 0
: 777 Minimum Test error found - save the configuration
: 777 | 8.52314 3.97765 0.00616035 0.00070272 146584 0
: 778 | 8.45277 4.33955 0.00567723 0.000578159 156891 1
: 779 Minimum Test error found - save the configuration
: 779 | 8.44822 3.73446 0.00584394 0.00062634 153327 0
: 780 | 8.24478 3.89874 0.00617242 0.00058775 143249 1
: 781 | 8.25893 3.80844 0.00611565 0.000797183 150419 2
: 782 | 7.91436 3.8437 0.00591993 0.000743382 154543 3
: 783 Minimum Test error found - save the configuration
: 783 | 7.90895 3.6516 0.00577225 0.00063096 155603 0
: 784 | 7.9443 3.8318 0.00671768 0.000608329 130947 1
: 785 | 7.68895 3.76623 0.00688782 0.000745531 130245 2
: 786 | 7.74523 4.45486 0.0058074 0.000567339 152670 3
: 787 Minimum Test error found - save the configuration
: 787 | 7.77714 3.28692 0.00571162 0.000609789 156807 0
: 788 Minimum Test error found - save the configuration
: 788 | 7.56022 3.20931 0.00574613 0.000609949 155758 0
: 789 | 7.37115 3.43993 0.00650764 0.00110213 147997 1
: 790 | 7.38393 3.48981 0.00593284 0.000569298 149155 2
: 791 Minimum Test error found - save the configuration
: 791 | 7.32477 3.12064 0.00599967 0.000651569 149586 0
: 792 | 7.2259 3.63483 0.00665465 0.000592169 131959 1
: 793 | 7.17143 3.26293 0.00564585 0.000571849 157667 2
: 794 | 7.0146 3.87964 0.00561606 0.000570768 158564 3
: 795 | 6.87156 3.13944 0.00560361 0.000575249 159097 4
: 796 | 6.8009 3.26898 0.00556907 0.000563079 159808 5
: 797 Minimum Test error found - save the configuration
: 797 | 6.66956 2.9707 0.00558631 0.000589859 160114 0
: 798 Minimum Test error found - save the configuration
: 798 | 6.52499 2.92055 0.00562009 0.00061182 159736 0
: 799 | 6.50815 3.03032 0.00586593 0.000598739 151884 1
: 800 | 6.34398 3.11557 0.00732814 0.000589758 118723 2
: 801 Minimum Test error found - save the configuration
: 801 | 6.4467 2.5693 0.00676955 0.000636859 130448 0
: 802 | 6.3654 2.88456 0.00571997 0.000591459 155991 1
: 803 | 6.2417 2.83226 0.00686788 0.000562699 126880 2
: 804 | 6.21201 2.97286 0.00691191 0.000556668 125880 3
: 805 Minimum Test error found - save the configuration
: 805 | 6.00842 2.55593 0.0057535 0.000594309 155063 0
: 806 | 5.98644 2.7869 0.00569488 0.000556038 155677 1
: 807 | 5.94506 3.03827 0.00559095 0.000572128 159400 2
: 808 | 5.95014 2.65391 0.00567556 0.000563138 156482 3
: 809 Minimum Test error found - save the configuration
: 809 | 5.82466 2.40461 0.00589953 0.000611879 151296 0
: 810 | 5.72709 2.75039 0.0058305 0.000557908 151728 1
: 811 | 5.88539 3.01679 0.00575059 0.000603719 155434 2
: 812 | 5.81717 2.94621 0.00579345 0.00058667 153646 3
: 813 | 5.5071 2.66659 0.00573199 0.000568289 154928 4
: 814 | 5.52938 3.08629 0.00889043 0.000887224 99960 5
: 815 | 5.5242 2.76025 0.00892258 0.000945845 100292 6
: 816 | 5.26985 2.55016 0.00929762 0.000972095 96090 7
: 817 Minimum Test error found - save the configuration
: 817 | 5.17749 2.35929 0.00903016 0.000948085 98984.5 0
: 818 | 5.14289 2.56278 0.00656188 0.000591229 133989 1
: 819 | 5.21488 2.70254 0.00672742 0.000555978 129629 2
: 820 | 5.11557 2.36384 0.00779513 0.000575639 110811 3
: 821 | 5.00021 2.53541 0.00584908 0.000569889 151538 4
: 822 | 4.95106 2.8273 0.00825284 0.000887884 108623 5
: 823 Minimum Test error found - save the configuration
: 823 | 4.92586 2.32658 0.00710189 0.000616629 123357 0
: 824 | 4.97299 2.46317 0.00561462 0.00057413 158715 1
: 825 | 5.06694 3.39848 0.00556561 0.000551028 159535 2
: 826 | 4.8993 2.5604 0.00583119 0.000560868 151793 3
: 827 | 4.82654 3.28152 0.00571697 0.000581029 155765 4
: 828 | 4.95625 4.00657 0.00568412 0.000570008 156430 5
: 829 | 5.30521 3.719 0.00580273 0.000547518 152230 6
: 830 | 5.03388 2.82589 0.0057869 0.00059669 154136 7
: 831 Minimum Test error found - save the configuration
: 831 | 4.71096 2.17343 0.0061623 0.000616929 144264 0
: 832 | 4.57922 3.29635 0.00580094 0.0005861 153408 1
: 833 | 4.4482 2.49739 0.00592759 0.000569709 149313 2
: 834 Minimum Test error found - save the configuration
: 834 | 4.32959 2.01054 0.00565422 0.000610879 158625 0
: 835 | 4.2579 2.56135 0.00550696 0.000545719 161250 1
: 836 | 4.26815 2.31705 0.00574402 0.000556288 154210 2
: 837 | 4.32766 2.25285 0.00556688 0.000557439 159698 3
: 838 | 4.13548 2.30203 0.00571466 0.000550088 154902 4
: 839 | 4.04904 2.22849 0.00565756 0.000594338 158002 5
: 840 | 4.40905 2.0975 0.00569203 0.00062321 157828 6
: 841 | 4.33001 3.39251 0.00749826 0.000550978 115153 7
: 842 | 4.25469 2.51297 0.00578079 0.000558949 153203 8
: 843 | 4.01942 2.48597 0.00555474 0.000559089 160139 9
: 844 | 3.8645 2.17837 0.00555248 0.000546738 159816 10
: 845 | 3.83153 2.60288 0.005614 0.0005636 158403 11
: 846 Minimum Test error found - save the configuration
: 846 | 4.13998 1.98022 0.00572723 0.000633789 157065 0
: 847 | 3.85588 2.93045 0.00563472 0.000563068 157740 1
: 848 | 3.84122 2.37578 0.00581108 0.00058117 152966 2
: 849 | 3.76724 2.66038 0.00568272 0.000616729 157916 3
: 850 | 3.73107 1.98309 0.00596676 0.000618459 149580 4
: 851 | 3.65396 2.23287 0.00558802 0.000597389 160300 5
: 852 | 3.5317 2.24993 0.00565431 0.000596149 158160 6
: 853 | 3.49796 2.45766 0.00568385 0.00066951 159543 7
: 854 | 3.44057 2.41516 0.00589551 0.000555869 149823 8
: 855 | 3.37379 2.91178 0.00556144 0.000545748 159499 9
: 856 | 3.59538 2.52618 0.00563136 0.000682 161637 10
: 857 | 3.52876 2.59088 0.00598452 0.00062008 149130 11
: 858 | 3.6627 2.21857 0.00576155 0.000586319 154583 12
: 859 | 3.31161 2.04003 0.00562282 0.000545618 157567 13
: 860 | 3.3554 2.20035 0.00585384 0.000580139 151696 14
: 861 | 3.44346 2.55848 0.00586524 0.00061141 152270 15
: 862 | 3.40268 2.78272 0.00595886 0.000556679 148088 16
: 863 | 3.45556 2.1525 0.00569323 0.0006174 157610 17
: 864 | 3.29965 2.49087 0.00567419 0.000579378 157022 18
: 865 | 3.20604 1.98755 0.00585724 0.00059886 152138 19
: 866 | 3.19723 2.26217 0.00567466 0.000555008 156261 20
: 867 | 3.20912 2.55578 0.00648449 0.000583719 135576 21
:
: Elapsed time for training with 1000 events: 5.36 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00971 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 1.01 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.197 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.30877e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.08618e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0581 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0459 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00178 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0869 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 1.08 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0294 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00308 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0529 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00506 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00211 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000401 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0928 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00976 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 1.08 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.119 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.610 0.166 5.43 1.51 | 3.206 3.211
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.0668 0.207 1.82 1.13 | 3.368 3.363
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.