Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.301 sec
: Elapsed time for training with 1000 events: 0.305 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00285 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000873 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00452 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000247 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000318 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31541.4
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33121.5 31212.5 0.00528265 0.000604249 170999 0
: 2 Minimum Test error found - save the configuration
: 2 | 32671.4 30702.9 0.00524557 0.000563729 170873 0
: 3 Minimum Test error found - save the configuration
: 3 | 32034.4 30073.5 0.00545805 0.000610279 165024 0
: 4 Minimum Test error found - save the configuration
: 4 | 31341.4 29490.7 0.00552091 0.000630869 163598 0
: 5 Minimum Test error found - save the configuration
: 5 | 30656.6 28813 0.00550341 0.000592329 162897 0
: 6 Minimum Test error found - save the configuration
: 6 | 29859 27910.2 0.00539447 0.000584428 166319 0
: 7 Minimum Test error found - save the configuration
: 7 | 29138.2 27305.2 0.00551919 0.000609839 162954 0
: 8 Minimum Test error found - save the configuration
: 8 | 28692 26936.1 0.00565397 0.000596629 158186 0
: 9 Minimum Test error found - save the configuration
: 9 | 28337.5 26612.4 0.00558552 0.000598749 160424 0
: 10 Minimum Test error found - save the configuration
: 10 | 28010.5 26315.4 0.00536051 0.000579587 167332 0
: 11 Minimum Test error found - save the configuration
: 11 | 27707.1 26031.9 0.00530732 0.000573368 168992 0
: 12 Minimum Test error found - save the configuration
: 12 | 27415 25761.5 0.00543056 0.000578519 164879 0
: 13 Minimum Test error found - save the configuration
: 13 | 27139.7 25493.7 0.00536305 0.000570018 166909 0
: 14 Minimum Test error found - save the configuration
: 14 | 26864.2 25238.9 0.00535402 0.000582659 167667 0
: 15 Minimum Test error found - save the configuration
: 15 | 26599.2 24991 0.00531812 0.000562697 168229 0
: 16 Minimum Test error found - save the configuration
: 16 | 26343.1 24745.9 0.00547363 0.00062124 164867 0
: 17 Minimum Test error found - save the configuration
: 17 | 26088.3 24508.7 0.00538195 0.000603679 167425 0
: 18 Minimum Test error found - save the configuration
: 18 | 25840.8 24275.3 0.00537675 0.000565678 166283 0
: 19 Minimum Test error found - save the configuration
: 19 | 25601.9 24039.8 0.00549447 0.000576949 162684 0
: 20 Minimum Test error found - save the configuration
: 20 | 25360.4 23812.7 0.00533472 0.000581498 168307 0
: 21 Minimum Test error found - save the configuration
: 21 | 25125.2 23589.4 0.00543773 0.000602229 165443 0
: 22 Minimum Test error found - save the configuration
: 22 | 24891.8 23372.4 0.00531971 0.000569548 168415 0
: 23 Minimum Test error found - save the configuration
: 23 | 24665.8 23155.5 0.00527387 0.000565578 169913 0
: 24 Minimum Test error found - save the configuration
: 24 | 24441.6 22940.5 0.00532891 0.000574768 168274 0
: 25 Minimum Test error found - save the configuration
: 25 | 24218.2 22730.8 0.00546184 0.000638108 165847 0
: 26 Minimum Test error found - save the configuration
: 26 | 23998.8 22524.3 0.00565337 0.000588799 157960 0
: 27 Minimum Test error found - save the configuration
: 27 | 23786.7 22315 0.00573888 0.00069099 158482 0
: 28 Minimum Test error found - save the configuration
: 28 | 23566.6 22117.7 0.00616572 0.000603539 143828 0
: 29 Minimum Test error found - save the configuration
: 29 | 23359 21917.8 0.00594286 0.000587779 149391 0
: 30 Minimum Test error found - save the configuration
: 30 | 23148.8 21722.6 0.00529878 0.000570919 169210 0
: 31 Minimum Test error found - save the configuration
: 31 | 22944.1 21527.3 0.00535369 0.000587019 167832 0
: 32 Minimum Test error found - save the configuration
: 32 | 22741.3 21333 0.00531274 0.000573379 168799 0
: 33 Minimum Test error found - save the configuration
: 33 | 22540.7 21139.8 0.00540978 0.000647879 168000 0
: 34 Minimum Test error found - save the configuration
: 34 | 22336.9 20955.6 0.00764498 0.000772682 116409 0
: 35 Minimum Test error found - save the configuration
: 35 | 22144.4 20766.5 0.00585377 0.00064814 153680 0
: 36 Minimum Test error found - save the configuration
: 36 | 21948.7 20580.9 0.0057126 0.000593799 156286 0
: 37 Minimum Test error found - save the configuration
: 37 | 21752.3 20402.7 0.00545514 0.000619579 165441 0
: 38 Minimum Test error found - save the configuration
: 38 | 21565.9 20219.8 0.00617649 0.000590169 143207 0
: 39 Minimum Test error found - save the configuration
: 39 | 21374.3 20043.1 0.00577746 0.000589289 154197 0
: 40 Minimum Test error found - save the configuration
: 40 | 21189.7 19865.3 0.00593146 0.000855503 157606 0
: 41 Minimum Test error found - save the configuration
: 41 | 21002.5 19692.6 0.00626503 0.00069372 143593 0
: 42 Minimum Test error found - save the configuration
: 42 | 20820.5 19520.3 0.00539921 0.000570458 165674 0
: 43 Minimum Test error found - save the configuration
: 43 | 20640 19349 0.00549485 0.000568808 162402 0
: 44 Minimum Test error found - save the configuration
: 44 | 20458.3 19183.1 0.00619946 0.000900113 150962 0
: 45 Minimum Test error found - save the configuration
: 45 | 20284.6 19013.3 0.00671619 0.000587139 130526 0
: 46 Minimum Test error found - save the configuration
: 46 | 20105.9 18849.9 0.00649868 0.000593089 135465 0
: 47 Minimum Test error found - save the configuration
: 47 | 19934.7 18684.2 0.00626063 0.000886293 148856 0
: 48 Minimum Test error found - save the configuration
: 48 | 19762.8 18520.2 0.00591483 0.000796712 156308 0
: 49 Minimum Test error found - save the configuration
: 49 | 19591.1 18359.8 0.00606601 0.000594639 146216 0
: 50 Minimum Test error found - save the configuration
: 50 | 19421.2 18203 0.00645106 0.000836513 142487 0
: 51 Minimum Test error found - save the configuration
: 51 | 19254.7 18047 0.00622853 0.00060076 142152 0
: 52 Minimum Test error found - save the configuration
: 52 | 19092.1 17888.7 0.00536718 0.000587249 167367 0
: 53 Minimum Test error found - save the configuration
: 53 | 18925.1 17736.9 0.00530062 0.000571509 169165 0
: 54 Minimum Test error found - save the configuration
: 54 | 18765.2 17583.4 0.00654125 0.00064733 135733 0
: 55 Minimum Test error found - save the configuration
: 55 | 18603.6 17433.2 0.00617522 0.00063635 144434 0
: 56 Minimum Test error found - save the configuration
: 56 | 18444.8 17284.5 0.00598341 0.000581078 148084 0
: 57 Minimum Test error found - save the configuration
: 57 | 18287.4 17137.3 0.00640729 0.000873173 144558 0
: 58 Minimum Test error found - save the configuration
: 58 | 18132.2 16990.4 0.00563251 0.000583238 158439 0
: 59 Minimum Test error found - save the configuration
: 59 | 17975.8 16846.2 0.00603672 0.000831393 153689 0
: 60 Minimum Test error found - save the configuration
: 60 | 17820.1 16690.3 0.00536278 0.000567338 166825 0
: 61 Minimum Test error found - save the configuration
: 61 | 17661.4 16541.7 0.00542536 0.000593249 165559 0
: 62 Minimum Test error found - save the configuration
: 62 | 17504.9 16401.6 0.00537907 0.000576298 166571 0
: 63 Minimum Test error found - save the configuration
: 63 | 17350.3 16247.3 0.00539602 0.00061128 167198 0
: 64 Minimum Test error found - save the configuration
: 64 | 17199.3 16097.8 0.00544434 0.000574058 164262 0
: 65 Minimum Test error found - save the configuration
: 65 | 17053.4 15971.2 0.00540443 0.000585248 166003 0
: 66 Minimum Test error found - save the configuration
: 66 | 16895.7 15814.2 0.00534798 0.000586629 168020 0
: 67 Minimum Test error found - save the configuration
: 67 | 16751 15660.1 0.00551566 0.000584568 162236 0
: 68 Minimum Test error found - save the configuration
: 68 | 16595.7 15531.9 0.00542027 0.000594429 165774 0
: 69 Minimum Test error found - save the configuration
: 69 | 16442.9 15371.7 0.0054668 0.000571639 163427 0
: 70 Minimum Test error found - save the configuration
: 70 | 16297.5 15232.3 0.00547337 0.000620049 164836 0
: 71 Minimum Test error found - save the configuration
: 71 | 16145.5 15093.8 0.00552602 0.000574478 161566 0
: 72 Minimum Test error found - save the configuration
: 72 | 16000.4 14960.9 0.00565391 0.00063835 159504 0
: 73 Minimum Test error found - save the configuration
: 73 | 15862.2 14820.2 0.00544319 0.000571388 164210 0
: 74 Minimum Test error found - save the configuration
: 74 | 15716.3 14685.4 0.00541652 0.000592969 165853 0
: 75 Minimum Test error found - save the configuration
: 75 | 15575.9 14554.4 0.00547491 0.000584809 163596 0
: 76 Minimum Test error found - save the configuration
: 76 | 15434.9 14420.1 0.00555396 0.000599599 161474 0
: 77 Minimum Test error found - save the configuration
: 77 | 15297.8 14286.8 0.00559037 0.000587449 159907 0
: 78 Minimum Test error found - save the configuration
: 78 | 15157.8 14160.4 0.00551247 0.000597298 162761 0
: 79 Minimum Test error found - save the configuration
: 79 | 15022.4 14030.4 0.00550799 0.000594799 162827 0
: 80 Minimum Test error found - save the configuration
: 80 | 14887.6 13898.9 0.00551578 0.000613188 163179 0
: 81 Minimum Test error found - save the configuration
: 81 | 14749.9 13774.2 0.00547202 0.000591879 163930 0
: 82 Minimum Test error found - save the configuration
: 82 | 14619.6 13647.9 0.00562715 0.000594109 158950 0
: 83 Minimum Test error found - save the configuration
: 83 | 14487 13523.5 0.00545595 0.000591559 164460 0
: 84 Minimum Test error found - save the configuration
: 84 | 14357.1 13400.5 0.00565251 0.000588368 157973 0
: 85 Minimum Test error found - save the configuration
: 85 | 14228.5 13279.1 0.00554623 0.00063769 162981 0
: 86 Minimum Test error found - save the configuration
: 86 | 14099.8 13158.8 0.00551526 0.000579858 162094 0
: 87 Minimum Test error found - save the configuration
: 87 | 13971.4 13042.9 0.00553724 0.00061062 162383 0
: 88 Minimum Test error found - save the configuration
: 88 | 13848.5 12924.3 0.0055559 0.000597379 161338 0
: 89 Minimum Test error found - save the configuration
: 89 | 13724.6 12805.4 0.00554453 0.000598299 161739 0
: 90 Minimum Test error found - save the configuration
: 90 | 13601 12688.4 0.00567062 0.00063069 158732 0
: 91 Minimum Test error found - save the configuration
: 91 | 13479.5 12571.7 0.00556748 0.000582059 160468 0
: 92 Minimum Test error found - save the configuration
: 92 | 13355.9 12459.9 0.00548172 0.000593858 163671 0
: 93 Minimum Test error found - save the configuration
: 93 | 13239.4 12344.3 0.00548343 0.000595808 163679 0
: 94 Minimum Test error found - save the configuration
: 94 | 13117.4 12234.3 0.00547358 0.000594659 163971 0
: 95 Minimum Test error found - save the configuration
: 95 | 13000.9 12123.2 0.00543539 0.000579878 164761 0
: 96 Minimum Test error found - save the configuration
: 96 | 12883 12015.1 0.00549932 0.000600399 163301 0
: 97 Minimum Test error found - save the configuration
: 97 | 12769.1 11905.2 0.0054616 0.000582299 163958 0
: 98 Minimum Test error found - save the configuration
: 98 | 12654.3 11796 0.00540793 0.000582939 165803 0
: 99 Minimum Test error found - save the configuration
: 99 | 12539.6 11689.5 0.00542 0.000590727 165656 0
: 100 Minimum Test error found - save the configuration
: 100 | 12426.3 11585.1 0.00553004 0.000597629 162192 0
: 101 Minimum Test error found - save the configuration
: 101 | 12316.5 11478.9 0.00545678 0.000594489 164531 0
: 102 Minimum Test error found - save the configuration
: 102 | 12204.1 11375.9 0.00542677 0.000575269 164897 0
: 103 Minimum Test error found - save the configuration
: 103 | 12095.9 11271.6 0.00550786 0.000600359 163016 0
: 104 Minimum Test error found - save the configuration
: 104 | 11985.7 11170.6 0.00545053 0.000576927 164150 0
: 105 Minimum Test error found - save the configuration
: 105 | 11878.2 11070.1 0.00550082 0.000629189 164216 0
: 106 Minimum Test error found - save the configuration
: 106 | 11770.9 10970.9 0.00556194 0.000590649 160924 0
: 107 Minimum Test error found - save the configuration
: 107 | 11665.9 10871.1 0.0055477 0.00060456 161840 0
: 108 Minimum Test error found - save the configuration
: 108 | 11562.5 10770.2 0.00547786 0.000589129 163642 0
: 109 Minimum Test error found - save the configuration
: 109 | 11456.4 10673.2 0.00557582 0.000607069 161006 0
: 110 Minimum Test error found - save the configuration
: 110 | 11353.7 10576.2 0.00555334 0.000604919 161668 0
: 111 Minimum Test error found - save the configuration
: 111 | 11250.2 10482 0.00548534 0.000591478 163470 0
: 112 Minimum Test error found - save the configuration
: 112 | 11151.1 10385.1 0.00575239 0.000617438 155795 0
: 113 Minimum Test error found - save the configuration
: 113 | 11049.7 10291 0.00605266 0.000620088 147260 0
: 114 Minimum Test error found - save the configuration
: 114 | 10948.8 10198.8 0.00568758 0.000620239 157874 0
: 115 Minimum Test error found - save the configuration
: 115 | 10851.3 10106.2 0.00553205 0.000590319 161887 0
: 116 Minimum Test error found - save the configuration
: 116 | 10753.3 10014.2 0.0055213 0.000595199 162400 0
: 117 Minimum Test error found - save the configuration
: 117 | 10656.7 9922.35 0.00551079 0.000591419 162622 0
: 118 Minimum Test error found - save the configuration
: 118 | 10559.4 9833.04 0.00549212 0.000594649 163350 0
: 119 Minimum Test error found - save the configuration
: 119 | 10465.4 9742.75 0.00557172 0.000617758 161487 0
: 120 Minimum Test error found - save the configuration
: 120 | 10369.5 9654.98 0.00546531 0.000594559 164246 0
: 121 Minimum Test error found - save the configuration
: 121 | 10277 9566.48 0.0054965 0.000579468 162700 0
: 122 Minimum Test error found - save the configuration
: 122 | 10183.6 9479.34 0.00557592 0.000596099 160648 0
: 123 Minimum Test error found - save the configuration
: 123 | 10091.9 9393.46 0.00555333 0.000594119 161316 0
: 124 Minimum Test error found - save the configuration
: 124 | 9999.56 9309.02 0.00545352 0.000589979 164489 0
: 125 Minimum Test error found - save the configuration
: 125 | 9910.11 9223.22 0.00544814 0.000581098 164371 0
: 126 Minimum Test error found - save the configuration
: 126 | 9819.9 9139.88 0.00562834 0.000663718 161140 0
: 127 Minimum Test error found - save the configuration
: 127 | 9731.26 9056.38 0.00588347 0.000620569 152008 0
: 128 Minimum Test error found - save the configuration
: 128 | 9644.47 8972.48 0.00561575 0.000625919 160326 0
: 129 Minimum Test error found - save the configuration
: 129 | 9556.57 8889.83 0.00558276 0.000593379 160340 0
: 130 Minimum Test error found - save the configuration
: 130 | 9468.36 8809.81 0.0055518 0.000607469 161801 0
: 131 Minimum Test error found - save the configuration
: 131 | 9383.68 8729.49 0.00562173 0.000586599 158884 0
: 132 Minimum Test error found - save the configuration
: 132 | 9297.97 8650.43 0.00556547 0.000621049 161798 0
: 133 Minimum Test error found - save the configuration
: 133 | 9215.78 8568.91 0.00575406 0.000606949 155427 0
: 134 Minimum Test error found - save the configuration
: 134 | 9129.02 8493.29 0.00559313 0.000599378 160200 0
: 135 Minimum Test error found - save the configuration
: 135 | 9048.12 8414.87 0.00561899 0.000609478 159696 0
: 136 Minimum Test error found - save the configuration
: 136 | 8965.84 8337.66 0.00565364 0.00062096 158961 0
: 137 Minimum Test error found - save the configuration
: 137 | 8884.66 8260.69 0.00559873 0.000595389 159893 0
: 138 Minimum Test error found - save the configuration
: 138 | 8803.96 8184.45 0.00551885 0.000597399 162554 0
: 139 Minimum Test error found - save the configuration
: 139 | 8723.14 8110.35 0.00550482 0.000594279 162915 0
: 140 Minimum Test error found - save the configuration
: 140 | 8644.63 8035.51 0.00556276 0.000605849 161391 0
: 141 Minimum Test error found - save the configuration
: 141 | 8565.56 7962.64 0.00549885 0.000581368 162685 0
: 142 Minimum Test error found - save the configuration
: 142 | 8487.68 7889.59 0.00552042 0.000607449 162834 0
: 143 Minimum Test error found - save the configuration
: 143 | 8410.96 7816.99 0.00548605 0.000582388 163143 0
: 144 Minimum Test error found - save the configuration
: 144 | 8334.13 7745.35 0.00549355 0.000595109 163317 0
: 145 Minimum Test error found - save the configuration
: 145 | 8259.05 7673.35 0.0056938 0.000638259 158242 0
: 146 Minimum Test error found - save the configuration
: 146 | 8182.52 7603.97 0.00568918 0.000598429 157148 0
: 147 Minimum Test error found - save the configuration
: 147 | 8108.87 7533.95 0.0055758 0.000623059 161527 0
: 148 Minimum Test error found - save the configuration
: 148 | 8034.85 7465.35 0.00552386 0.000588848 162107 0
: 149 Minimum Test error found - save the configuration
: 149 | 7961.15 7397.87 0.00548 0.000597768 163859 0
: 150 Minimum Test error found - save the configuration
: 150 | 7888.86 7330.44 0.00547422 0.000578909 163422 0
: 151 Minimum Test error found - save the configuration
: 151 | 7818.54 7260.43 0.00555185 0.0006261 162412 0
: 152 Minimum Test error found - save the configuration
: 152 | 7746.08 7193.6 0.00552348 0.000584479 161976 0
: 153 Minimum Test error found - save the configuration
: 153 | 7676.03 7126.73 0.0055507 0.000603109 161695 0
: 154 Minimum Test error found - save the configuration
: 154 | 7604.84 7061.59 0.0055404 0.000613069 162360 0
: 155 Minimum Test error found - save the configuration
: 155 | 7535.66 6997.57 0.00550362 0.000594798 162972 0
: 156 Minimum Test error found - save the configuration
: 156 | 7467.54 6932.87 0.00571288 0.00064487 157853 0
: 157 Minimum Test error found - save the configuration
: 157 | 7399.78 6868.58 0.0056212 0.000587639 158933 0
: 158 Minimum Test error found - save the configuration
: 158 | 7330.24 6806.88 0.00561593 0.000628559 160405 0
: 159 Minimum Test error found - save the configuration
: 159 | 7264.84 6743.79 0.00562012 0.00061796 159931 0
: 160 Minimum Test error found - save the configuration
: 160 | 7199.62 6681.28 0.00568599 0.000602159 157362 0
: 161 Minimum Test error found - save the configuration
: 161 | 7131.68 6620.25 0.00556562 0.000606189 161309 0
: 162 Minimum Test error found - save the configuration
: 162 | 7067.2 6557.83 0.00562097 0.000608729 159609 0
: 163 Minimum Test error found - save the configuration
: 163 | 7003.56 6496.06 0.00565166 0.000604218 158496 0
: 164 Minimum Test error found - save the configuration
: 164 | 6938.21 6437.15 0.00564291 0.000624908 159426 0
: 165 Minimum Test error found - save the configuration
: 165 | 6873.91 6378.81 0.00560296 0.000592978 159681 0
: 166 Minimum Test error found - save the configuration
: 166 | 6812.37 6319.47 0.00566266 0.00061367 158447 0
: 167 Minimum Test error found - save the configuration
: 167 | 6750.38 6260.75 0.00568763 0.000617959 157801 0
: 168 Minimum Test error found - save the configuration
: 168 | 6688.47 6201.01 0.00557475 0.000592169 160559 0
: 169 Minimum Test error found - save the configuration
: 169 | 6625.6 6144.97 0.00572317 0.000607679 156388 0
: 170 Minimum Test error found - save the configuration
: 170 | 6566.75 6087.17 0.00562622 0.000614919 159639 0
: 171 Minimum Test error found - save the configuration
: 171 | 6505.08 6031.42 0.00556834 0.000596398 160903 0
: 172 Minimum Test error found - save the configuration
: 172 | 6445.72 5975.05 0.0056031 0.000642949 161285 0
: 173 Minimum Test error found - save the configuration
: 173 | 6387.46 5919.21 0.00560123 0.000608129 160221 0
: 174 Minimum Test error found - save the configuration
: 174 | 6327.29 5865.21 0.00558602 0.000600199 160455 0
: 175 Minimum Test error found - save the configuration
: 175 | 6270.54 5809.98 0.00562073 0.000617959 159911 0
: 176 Minimum Test error found - save the configuration
: 176 | 6211.67 5757.04 0.0055793 0.000593569 160458 0
: 177 Minimum Test error found - save the configuration
: 177 | 6156.28 5701.91 0.005683 0.000615869 157880 0
: 178 Minimum Test error found - save the configuration
: 178 | 6098.25 5649.66 0.00567926 0.000623029 158221 0
: 179 Minimum Test error found - save the configuration
: 179 | 6042.18 5598.61 0.00568575 0.000604649 157446 0
: 180 Minimum Test error found - save the configuration
: 180 | 5987.26 5545.76 0.00564488 0.000614388 159030 0
: 181 Minimum Test error found - save the configuration
: 181 | 5932.11 5493.79 0.0058549 0.000691209 154928 0
: 182 Minimum Test error found - save the configuration
: 182 | 5877.08 5443.91 0.00567493 0.000602639 157720 0
: 183 Minimum Test error found - save the configuration
: 183 | 5824.53 5391.63 0.00561477 0.000604889 159684 0
: 184 Minimum Test error found - save the configuration
: 184 | 5769.47 5341.36 0.0056357 0.000637969 160073 0
: 185 Minimum Test error found - save the configuration
: 185 | 5716.99 5291.54 0.00561996 0.000609239 159658 0
: 186 Minimum Test error found - save the configuration
: 186 | 5663.38 5242.57 0.00607674 0.000609059 146314 0
: 187 Minimum Test error found - save the configuration
: 187 | 5612.72 5193.16 0.00584829 0.00061477 152861 0
: 188 Minimum Test error found - save the configuration
: 188 | 5559.83 5145.01 0.00568766 0.000667 159342 0
: 189 Minimum Test error found - save the configuration
: 189 | 5508.9 5096.79 0.00570605 0.00062373 157408 0
: 190 Minimum Test error found - save the configuration
: 190 | 5457.42 5051.3 0.00550811 0.000586919 162562 0
: 191 Minimum Test error found - save the configuration
: 191 | 5408.45 5003.19 0.00554736 0.000606099 161902 0
: 192 Minimum Test error found - save the configuration
: 192 | 5357.91 4956.86 0.00554868 0.000597209 161568 0
: 193 Minimum Test error found - save the configuration
: 193 | 5308.74 4910.67 0.00552142 0.000608469 162835 0
: 194 Minimum Test error found - save the configuration
: 194 | 5259.99 4864.86 0.00556151 0.000594979 161078 0
: 195 Minimum Test error found - save the configuration
: 195 | 5210.61 4820.21 0.00555299 0.000595789 161381 0
: 196 Minimum Test error found - save the configuration
: 196 | 5163.02 4775.62 0.00564819 0.000635129 159583 0
: 197 Minimum Test error found - save the configuration
: 197 | 5116.12 4730.6 0.00569261 0.00061422 157530 0
: 198 Minimum Test error found - save the configuration
: 198 | 5069.43 4685.36 0.00559011 0.000617339 160876 0
: 199 Minimum Test error found - save the configuration
: 199 | 5020.8 4643.14 0.00582803 0.000614308 153441 0
: 200 Minimum Test error found - save the configuration
: 200 | 4975.58 4600.27 0.00558384 0.000598529 160471 0
: 201 Minimum Test error found - save the configuration
: 201 | 4931.31 4554.83 0.00553477 0.000596509 162000 0
: 202 Minimum Test error found - save the configuration
: 202 | 4883.9 4513.34 0.00555454 0.000615399 161971 0
: 203 Minimum Test error found - save the configuration
: 203 | 4838.81 4472.05 0.00555584 0.000604289 161566 0
: 204 Minimum Test error found - save the configuration
: 204 | 4794.43 4429.71 0.00574708 0.000624609 156175 0
: 205 Minimum Test error found - save the configuration
: 205 | 4750.61 4389.07 0.00569244 0.000616629 157610 0
: 206 Minimum Test error found - save the configuration
: 206 | 4706.53 4348.44 0.0056762 0.000596499 157489 0
: 207 Minimum Test error found - save the configuration
: 207 | 4663.23 4307.66 0.00583556 0.000600088 152804 0
: 208 Minimum Test error found - save the configuration
: 208 | 4620.21 4268.16 0.00553869 0.000603498 162101 0
: 209 Minimum Test error found - save the configuration
: 209 | 4579.23 4227.13 0.00562377 0.000602079 159309 0
: 210 Minimum Test error found - save the configuration
: 210 | 4535.5 4188.04 0.00571764 0.00061593 156810 0
: 211 Minimum Test error found - save the configuration
: 211 | 4493.98 4149.43 0.00558822 0.000607299 160613 0
: 212 Minimum Test error found - save the configuration
: 212 | 4453.12 4110.69 0.00552987 0.000587849 161877 0
: 213 Minimum Test error found - save the configuration
: 213 | 4411.45 4073 0.00562077 0.000602939 159431 0
: 214 Minimum Test error found - save the configuration
: 214 | 4372.51 4033.85 0.0056022 0.00066334 161981 0
: 215 Minimum Test error found - save the configuration
: 215 | 4331 3996.78 0.00561204 0.000596118 159492 0
: 216 Minimum Test error found - save the configuration
: 216 | 4291.64 3959.69 0.00558798 0.000604639 160535 0
: 217 Minimum Test error found - save the configuration
: 217 | 4251.96 3923.28 0.00556342 0.000596929 161079 0
: 218 Minimum Test error found - save the configuration
: 218 | 4214 3886.66 0.00557522 0.000605249 160967 0
: 219 Minimum Test error found - save the configuration
: 219 | 4174.7 3850.37 0.00545967 0.000579058 163914 0
: 220 Minimum Test error found - save the configuration
: 220 | 4135.95 3814.83 0.00562791 0.000605989 159301 0
: 221 Minimum Test error found - save the configuration
: 221 | 4098.3 3779.77 0.00556411 0.000597519 161076 0
: 222 Minimum Test error found - save the configuration
: 222 | 4061.51 3743.91 0.00594863 0.00062513 150277 0
: 223 Minimum Test error found - save the configuration
: 223 | 4024.74 3708.65 0.00564783 0.000600338 158494 0
: 224 Minimum Test error found - save the configuration
: 224 | 3986.55 3674.54 0.00560201 0.000613638 160373 0
: 225 Minimum Test error found - save the configuration
: 225 | 3951.03 3640.22 0.00556625 0.000591079 160798 0
: 226 Minimum Test error found - save the configuration
: 226 | 3914.5 3606.35 0.0057192 0.000622059 156951 0
: 227 Minimum Test error found - save the configuration
: 227 | 3878.92 3573.01 0.00559273 0.000603629 160349 0
: 228 Minimum Test error found - save the configuration
: 228 | 3843.74 3539.57 0.00556393 0.000619179 161788 0
: 229 Minimum Test error found - save the configuration
: 229 | 3808.6 3506.29 0.00555036 0.00062263 162346 0
: 230 Minimum Test error found - save the configuration
: 230 | 3773.63 3474.28 0.00557354 0.000587958 160463 0
: 231 Minimum Test error found - save the configuration
: 231 | 3739.76 3441.98 0.00553794 0.000601348 162055 0
: 232 Minimum Test error found - save the configuration
: 232 | 3705.27 3409.88 0.00566161 0.00060631 158250 0
: 233 Minimum Test error found - save the configuration
: 233 | 3672.01 3378.07 0.00590772 0.000647559 152087 0
: 234 Minimum Test error found - save the configuration
: 234 | 3637.66 3347.6 0.0055525 0.000599809 161528 0
: 235 Minimum Test error found - save the configuration
: 235 | 3606.58 3316.47 0.00579089 0.0006177 154643 0
: 236 Minimum Test error found - save the configuration
: 236 | 3572.97 3284.56 0.00555022 0.000594479 161429 0
: 237 Minimum Test error found - save the configuration
: 237 | 3539.84 3254.78 0.00555616 0.00060337 161525 0
: 238 Minimum Test error found - save the configuration
: 238 | 3507.59 3225.18 0.00553301 0.00062428 162975 0
: 239 Minimum Test error found - save the configuration
: 239 | 3476.5 3194.23 0.00552484 0.000590668 162135 0
: 240 Minimum Test error found - save the configuration
: 240 | 3444.36 3165.23 0.00577556 0.000659439 156368 0
: 241 Minimum Test error found - save the configuration
: 241 | 3413.72 3135.41 0.00553432 0.000587179 161709 0
: 242 Minimum Test error found - save the configuration
: 242 | 3382.7 3106.44 0.00550307 0.000598089 163099 0
: 243 Minimum Test error found - save the configuration
: 243 | 3352.06 3077.92 0.00566657 0.000593019 157680 0
: 244 Minimum Test error found - save the configuration
: 244 | 3321.48 3049.25 0.00551601 0.000588579 162356 0
: 245 Minimum Test error found - save the configuration
: 245 | 3291.55 3021.19 0.00555882 0.000617089 161887 0
: 246 Minimum Test error found - save the configuration
: 246 | 3261.18 2992.61 0.00554718 0.000588047 161318 0
: 247 Minimum Test error found - save the configuration
: 247 | 3232.05 2964.26 0.00557111 0.000603208 161034 0
: 248 Minimum Test error found - save the configuration
: 248 | 3202.17 2937.23 0.00551785 0.000587019 162244 0
: 249 Minimum Test error found - save the configuration
: 249 | 3173.3 2912.14 0.00555234 0.000601139 161577 0
: 250 Minimum Test error found - save the configuration
: 250 | 3145.01 2882.94 0.00553221 0.000596379 162080 0
: 251 Minimum Test error found - save the configuration
: 251 | 3115.69 2856.9 0.00571048 0.000591099 156269 0
: 252 Minimum Test error found - save the configuration
: 252 | 3087.96 2830.7 0.00554006 0.000598879 161905 0
: 253 Minimum Test error found - save the configuration
: 253 | 3059.73 2804.93 0.00560826 0.000596338 159619 0
: 254 Minimum Test error found - save the configuration
: 254 | 3032.12 2778.16 0.00553692 0.000602998 162143 0
: 255 Minimum Test error found - save the configuration
: 255 | 3004.81 2752.31 0.00550061 0.000583679 162703 0
: 256 Minimum Test error found - save the configuration
: 256 | 2977.48 2726.82 0.00554832 0.000600629 161692 0
: 257 Minimum Test error found - save the configuration
: 257 | 2950.45 2701.17 0.00552819 0.000595229 162174 0
: 258 Minimum Test error found - save the configuration
: 258 | 2923.39 2676.24 0.00572203 0.000611569 156542 0
: 259 Minimum Test error found - save the configuration
: 259 | 2897.42 2651.63 0.0055561 0.000600269 161426 0
: 260 Minimum Test error found - save the configuration
: 260 | 2870.58 2627.62 0.00552605 0.000584079 161879 0
: 261 Minimum Test error found - save the configuration
: 261 | 2845.04 2603.47 0.00555707 0.000615088 161878 0
: 262 Minimum Test error found - save the configuration
: 262 | 2819.71 2578.76 0.00550262 0.000583769 162640 0
: 263 Minimum Test error found - save the configuration
: 263 | 2793.97 2554.3 0.00571107 0.000615109 156987 0
: 264 Minimum Test error found - save the configuration
: 264 | 2768.73 2530.45 0.00561255 0.0006413 160925 0
: 265 Minimum Test error found - save the configuration
: 265 | 2742.84 2508.26 0.00556235 0.000590739 160914 0
: 266 Minimum Test error found - save the configuration
: 266 | 2718.66 2484.75 0.0055527 0.000618669 162139 0
: 267 Minimum Test error found - save the configuration
: 267 | 2693.82 2462.2 0.00553629 0.000589118 161709 0
: 268 Minimum Test error found - save the configuration
: 268 | 2669.68 2440.32 0.005553 0.000601898 161580 0
: 269 Minimum Test error found - save the configuration
: 269 | 2646.33 2416.39 0.00554437 0.000592969 161570 0
: 270 Minimum Test error found - save the configuration
: 270 | 2621.23 2394.73 0.00556393 0.00062123 161855 0
: 271 Minimum Test error found - save the configuration
: 271 | 2598.22 2372.09 0.00579529 0.000660359 155796 0
: 272 Minimum Test error found - save the configuration
: 272 | 2573.8 2350.91 0.00566149 0.000598438 158007 0
: 273 Minimum Test error found - save the configuration
: 273 | 2551.8 2328.23 0.00575081 0.000603529 155422 0
: 274 Minimum Test error found - save the configuration
: 274 | 2527.38 2307.41 0.005614 0.000601659 159606 0
: 275 Minimum Test error found - save the configuration
: 275 | 2505.01 2286.06 0.00552959 0.000601049 162320 0
: 276 Minimum Test error found - save the configuration
: 276 | 2482.05 2265.76 0.00556088 0.000597628 161185 0
: 277 Minimum Test error found - save the configuration
: 277 | 2460.39 2243.89 0.00564108 0.000629598 159633 0
: 278 Minimum Test error found - save the configuration
: 278 | 2437.1 2223.74 0.0056432 0.000595979 158503 0
: 279 Minimum Test error found - save the configuration
: 279 | 2414.83 2203.75 0.00558298 0.000612879 160962 0
: 280 Minimum Test error found - save the configuration
: 280 | 2393.05 2184.16 0.0056044 0.000603259 159963 0
: 281 Minimum Test error found - save the configuration
: 281 | 2371.33 2164.11 0.00553818 0.000593039 161775 0
: 282 Minimum Test error found - save the configuration
: 282 | 2350.6 2143.64 0.00561836 0.000612339 159807 0
: 283 Minimum Test error found - save the configuration
: 283 | 2328.27 2124.15 0.00551027 0.000584739 162419 0
: 284 Minimum Test error found - save the configuration
: 284 | 2307.51 2104.32 0.00577422 0.000669189 156708 0
: 285 Minimum Test error found - save the configuration
: 285 | 2286.32 2085.09 0.00554626 0.000595869 161603 0
: 286 Minimum Test error found - save the configuration
: 286 | 2265.53 2065.77 0.00562867 0.000608469 159356 0
: 287 Minimum Test error found - save the configuration
: 287 | 2243.9 2048.18 0.0056796 0.000700861 160683 0
: 288 Minimum Test error found - save the configuration
: 288 | 2224.36 2029.2 0.00549913 0.000590049 162963 0
: 289 Minimum Test error found - save the configuration
: 289 | 2203.74 2010.05 0.00591378 0.000608209 150785 0
: 290 Minimum Test error found - save the configuration
: 290 | 2183.58 1991.93 0.00560382 0.000623659 160637 0
: 291 Minimum Test error found - save the configuration
: 291 | 2163.68 1973.67 0.00559136 0.000599969 160276 0
: 292 Minimum Test error found - save the configuration
: 292 | 2143.26 1955.38 0.0055342 0.000592568 161890 0
: 293 Minimum Test error found - save the configuration
: 293 | 2123.5 1937.47 0.00560431 0.000614408 160324 0
: 294 Minimum Test error found - save the configuration
: 294 | 2104.38 1919.43 0.00569662 0.000594409 156795 0
: 295 Minimum Test error found - save the configuration
: 295 | 2084.92 1901.56 0.00576782 0.000642509 156088 0
: 296 Minimum Test error found - save the configuration
: 296 | 2065.44 1884.12 0.00562722 0.000604279 159269 0
: 297 Minimum Test error found - save the configuration
: 297 | 2045.93 1867.51 0.00571348 0.000622739 157148 0
: 298 Minimum Test error found - save the configuration
: 298 | 2027.42 1850.46 0.00561791 0.000593359 159218 0
: 299 Minimum Test error found - save the configuration
: 299 | 2008.6 1833.59 0.00565828 0.00063023 159107 0
: 300 Minimum Test error found - save the configuration
: 300 | 1990.44 1816.35 0.00565693 0.00064957 159765 0
: 301 Minimum Test error found - save the configuration
: 301 | 1971.43 1799.6 0.00569767 0.000615128 157401 0
: 302 Minimum Test error found - save the configuration
: 302 | 1953.29 1783.5 0.00577926 0.000613988 154880 0
: 303 Minimum Test error found - save the configuration
: 303 | 1935.16 1767.36 0.0056419 0.000595948 158543 0
: 304 Minimum Test error found - save the configuration
: 304 | 1917.42 1751.09 0.00555431 0.000604619 161626 0
: 305 Minimum Test error found - save the configuration
: 305 | 1898.87 1736.17 0.00556246 0.000600358 161222 0
: 306 Minimum Test error found - save the configuration
: 306 | 1881.79 1719.96 0.00554157 0.000597129 161798 0
: 307 Minimum Test error found - save the configuration
: 307 | 1863.95 1703.81 0.00566171 0.00060942 158344 0
: 308 Minimum Test error found - save the configuration
: 308 | 1846.67 1688.04 0.00556102 0.000593629 161050 0
: 309 Minimum Test error found - save the configuration
: 309 | 1829.24 1672.64 0.00555691 0.000590947 161097 0
: 310 Minimum Test error found - save the configuration
: 310 | 1811.83 1657.83 0.0056073 0.000599458 159749 0
: 311 Minimum Test error found - save the configuration
: 311 | 1795.3 1642.53 0.00558795 0.000592629 160150 0
: 312 Minimum Test error found - save the configuration
: 312 | 1778.43 1627.2 0.00596141 0.000599739 149207 0
: 313 Minimum Test error found - save the configuration
: 313 | 1761.59 1611.72 0.00557748 0.000613009 161145 0
: 314 Minimum Test error found - save the configuration
: 314 | 1744.46 1598 0.00554519 0.000598879 161737 0
: 315 Minimum Test error found - save the configuration
: 315 | 1728.71 1582.78 0.00548333 0.0005995 163806 0
: 316 Minimum Test error found - save the configuration
: 316 | 1711.67 1568.79 0.00548849 0.000580059 162985 0
: 317 Minimum Test error found - save the configuration
: 317 | 1695.88 1554.6 0.00552694 0.000599428 162354 0
: 318 Minimum Test error found - save the configuration
: 318 | 1679.85 1539.94 0.00576162 0.000622588 155671 0
: 319 Minimum Test error found - save the configuration
: 319 | 1663.61 1526.24 0.0055007 0.000583819 162705 0
: 320 Minimum Test error found - save the configuration
: 320 | 1648.5 1511.98 0.00557499 0.00060575 160990 0
: 321 Minimum Test error found - save the configuration
: 321 | 1632.58 1498.73 0.00552349 0.000588108 162095 0
: 322 Minimum Test error found - save the configuration
: 322 | 1616.83 1485.09 0.00553999 0.00061969 162592 0
: 323 Minimum Test error found - save the configuration
: 323 | 1601.37 1471.49 0.00562862 0.000594059 158902 0
: 324 Minimum Test error found - save the configuration
: 324 | 1586.57 1457.39 0.00556482 0.000617139 161692 0
: 325 Minimum Test error found - save the configuration
: 325 | 1571.28 1443.77 0.00560345 0.000606249 160090 0
: 326 Minimum Test error found - save the configuration
: 326 | 1556.1 1430.83 0.00556206 0.000600949 161254 0
: 327 Minimum Test error found - save the configuration
: 327 | 1541.44 1417.92 0.00571613 0.00062713 157202 0
: 328 Minimum Test error found - save the configuration
: 328 | 1526.43 1404.89 0.00559275 0.000597609 160156 0
: 329 Minimum Test error found - save the configuration
: 329 | 1511.76 1391.94 0.00566401 0.000593659 157780 0
: 330 Minimum Test error found - save the configuration
: 330 | 1497.48 1379.11 0.00572684 0.000605829 156219 0
: 331 Minimum Test error found - save the configuration
: 331 | 1483.3 1367.35 0.00561204 0.000635079 160741 0
: 332 Minimum Test error found - save the configuration
: 332 | 1469.39 1354.05 0.005544 0.000591738 161542 0
: 333 Minimum Test error found - save the configuration
: 333 | 1454.89 1341.23 0.0055824 0.000603138 160666 0
: 334 Minimum Test error found - save the configuration
: 334 | 1440.71 1329.95 0.00571066 0.000603689 156649 0
: 335 Minimum Test error found - save the configuration
: 335 | 1427.37 1317.41 0.00569287 0.000602659 157164 0
: 336 Minimum Test error found - save the configuration
: 336 | 1413.19 1304.87 0.0056872 0.00061886 157843 0
: 337 Minimum Test error found - save the configuration
: 337 | 1400.13 1293.28 0.0055886 0.000599839 160360 0
: 338 Minimum Test error found - save the configuration
: 338 | 1386.18 1280.88 0.00579167 0.000605089 154244 0
: 339 Minimum Test error found - save the configuration
: 339 | 1373.06 1268.69 0.00573163 0.000617 156414 0
: 340 Minimum Test error found - save the configuration
: 340 | 1359.8 1256.83 0.00549313 0.000590679 163184 0
: 341 Minimum Test error found - save the configuration
: 341 | 1346.2 1245.94 0.00565782 0.000614549 158627 0
: 342 Minimum Test error found - save the configuration
: 342 | 1334.05 1234.05 0.00590776 0.00070873 153875 0
: 343 Minimum Test error found - save the configuration
: 343 | 1320.61 1223.05 0.00582342 0.000615878 153623 0
: 344 Minimum Test error found - save the configuration
: 344 | 1308.26 1210.94 0.00586838 0.000612078 152198 0
: 345 Minimum Test error found - save the configuration
: 345 | 1295.43 1199.92 0.00558901 0.000588569 159986 0
: 346 Minimum Test error found - save the configuration
: 346 | 1282.95 1188.37 0.00556229 0.000608939 161507 0
: 347 Minimum Test error found - save the configuration
: 347 | 1270.47 1177.75 0.00569948 0.000624339 157631 0
: 348 Minimum Test error found - save the configuration
: 348 | 1258.18 1166.69 0.00581053 0.00060581 153707 0
: 349 Minimum Test error found - save the configuration
: 349 | 1246.33 1155.23 0.00560113 0.000596249 159844 0
: 350 Minimum Test error found - save the configuration
: 350 | 1233.91 1144.56 0.00553774 0.000603389 162129 0
: 351 Minimum Test error found - save the configuration
: 351 | 1222.24 1133.56 0.00554296 0.000612469 162256 0
: 352 Minimum Test error found - save the configuration
: 352 | 1210.15 1123.59 0.00559784 0.000602088 160136 0
: 353 Minimum Test error found - save the configuration
: 353 | 1199.12 1112.5 0.00562227 0.000614469 159751 0
: 354 Minimum Test error found - save the configuration
: 354 | 1186.79 1102.74 0.00574539 0.00061668 155985 0
: 355 Minimum Test error found - save the configuration
: 355 | 1175.81 1092.19 0.00565531 0.000650259 159838 0
: 356 Minimum Test error found - save the configuration
: 356 | 1164.45 1081.52 0.00555843 0.000600809 161368 0
: 357 Minimum Test error found - save the configuration
: 357 | 1152.82 1071.49 0.0057377 0.000593059 155501 0
: 358 Minimum Test error found - save the configuration
: 358 | 1142.11 1061.15 0.00555405 0.000606559 161698 0
: 359 Minimum Test error found - save the configuration
: 359 | 1130.64 1051.18 0.00556564 0.000593059 160882 0
: 360 Minimum Test error found - save the configuration
: 360 | 1119.88 1041.98 0.00578405 0.000607198 154534 0
: 361 Minimum Test error found - save the configuration
: 361 | 1108.83 1031.46 0.00564258 0.000609648 158953 0
: 362 Minimum Test error found - save the configuration
: 362 | 1098.33 1021.27 0.00565784 0.000600429 158184 0
: 363 Minimum Test error found - save the configuration
: 363 | 1087.57 1011.33 0.00561823 0.000598789 159380 0
: 364 Minimum Test error found - save the configuration
: 364 | 1076.59 1002.05 0.00558837 0.00060645 160581 0
: 365 Minimum Test error found - save the configuration
: 365 | 1066.25 992.776 0.00568843 0.000591829 156967 0
: 366 Minimum Test error found - save the configuration
: 366 | 1056.19 982.722 0.00560183 0.000605799 160127 0
: 367 Minimum Test error found - save the configuration
: 367 | 1045.35 973.894 0.00563219 0.00061882 159573 0
: 368 Minimum Test error found - save the configuration
: 368 | 1035.4 964.406 0.0056446 0.000598579 158541 0
: 369 Minimum Test error found - save the configuration
: 369 | 1025.33 954.794 0.00572788 0.000611868 156372 0
: 370 Minimum Test error found - save the configuration
: 370 | 1015.21 946.232 0.00573314 0.000610988 156184 0
: 371 Minimum Test error found - save the configuration
: 371 | 1005.21 937.287 0.00569092 0.0006359 158258 0
: 372 Minimum Test error found - save the configuration
: 372 | 995.463 927.98 0.00577501 0.00061519 155044 0
: 373 Minimum Test error found - save the configuration
: 373 | 985.675 919.225 0.00569928 0.000636709 158022 0
: 374 Minimum Test error found - save the configuration
: 374 | 975.797 910.305 0.00585973 0.0006567 153757 0
: 375 Minimum Test error found - save the configuration
: 375 | 966.541 901.155 0.00577169 0.000613219 155085 0
: 376 Minimum Test error found - save the configuration
: 376 | 956.833 892.95 0.00569398 0.000601749 157102 0
: 377 Minimum Test error found - save the configuration
: 377 | 947.317 884.043 0.00557042 0.000610129 161281 0
: 378 Minimum Test error found - save the configuration
: 378 | 938.416 875.589 0.00566312 0.000611179 158355 0
: 379 Minimum Test error found - save the configuration
: 379 | 928.738 867.454 0.00564219 0.000602849 158751 0
: 380 Minimum Test error found - save the configuration
: 380 | 919.781 858.794 0.00556338 0.000599558 161166 0
: 381 Minimum Test error found - save the configuration
: 381 | 910.662 850.561 0.00558494 0.000584979 160001 0
: 382 Minimum Test error found - save the configuration
: 382 | 901.787 842.528 0.00574213 0.000601489 155622 0
: 383 Minimum Test error found - save the configuration
: 383 | 892.825 834.413 0.00585951 0.000617949 152626 0
: 384 Minimum Test error found - save the configuration
: 384 | 884.093 825.641 0.00632809 0.000618439 140114 0
: 385 Minimum Test error found - save the configuration
: 385 | 875.133 818.195 0.00591724 0.00065977 152165 0
: 386 Minimum Test error found - save the configuration
: 386 | 866.57 810.055 0.00614379 0.000623499 144920 0
: 387 Minimum Test error found - save the configuration
: 387 | 858.143 801.872 0.00575802 0.00061834 155652 0
: 388 Minimum Test error found - save the configuration
: 388 | 849.394 794.184 0.0057822 0.000618709 154934 0
: 389 Minimum Test error found - save the configuration
: 389 | 840.871 786.937 0.00562914 0.000599049 159043 0
: 390 Minimum Test error found - save the configuration
: 390 | 832.809 778.431 0.00594571 0.000632269 150562 0
: 391 Minimum Test error found - save the configuration
: 391 | 824.304 770.902 0.00562257 0.000597799 159211 0
: 392 Minimum Test error found - save the configuration
: 392 | 816.29 763.165 0.00561362 0.000606669 159778 0
: 393 Minimum Test error found - save the configuration
: 393 | 807.917 756.023 0.00559283 0.000590839 159936 0
: 394 Minimum Test error found - save the configuration
: 394 | 800.037 748.18 0.0058295 0.000602219 153043 0
: 395 Minimum Test error found - save the configuration
: 395 | 792.033 740.631 0.0057691 0.000610098 155069 0
: 396 Minimum Test error found - save the configuration
: 396 | 784.252 733.189 0.00563034 0.000615208 159517 0
: 397 Minimum Test error found - save the configuration
: 397 | 776.15 725.52 0.00557474 0.000584989 160329 0
: 398 Minimum Test error found - save the configuration
: 398 | 768.267 718.462 0.00555325 0.000602009 161576 0
: 399 Minimum Test error found - save the configuration
: 399 | 760.402 711.978 0.00555584 0.000585719 160962 0
: 400 Minimum Test error found - save the configuration
: 400 | 753.19 704.843 0.00549729 0.000606499 163573 0
: 401 Minimum Test error found - save the configuration
: 401 | 745.481 697.754 0.00564079 0.000596759 158603 0
: 402 Minimum Test error found - save the configuration
: 402 | 738.093 690.349 0.00552002 0.000587728 162196 0
: 403 Minimum Test error found - save the configuration
: 403 | 730.653 683.202 0.00570002 0.000631388 157833 0
: 404 Minimum Test error found - save the configuration
: 404 | 723.05 676.485 0.00555603 0.000583979 160899 0
: 405 Minimum Test error found - save the configuration
: 405 | 715.764 670.079 0.00552077 0.000606829 162802 0
: 406 Minimum Test error found - save the configuration
: 406 | 708.891 663.012 0.00568555 0.000604379 157444 0
: 407 Minimum Test error found - save the configuration
: 407 | 701.465 656.159 0.00554227 0.000587019 161445 0
: 408 Minimum Test error found - save the configuration
: 408 | 694.561 650.204 0.00563649 0.000609679 159147 0
: 409 Minimum Test error found - save the configuration
: 409 | 687.353 642.967 0.00591116 0.000819773 157128 0
: 410 Minimum Test error found - save the configuration
: 410 | 680.355 636.777 0.00557083 0.000640179 162250 0
: 411 Minimum Test error found - save the configuration
: 411 | 673.553 630.37 0.00570413 0.000611268 157082 0
: 412 Minimum Test error found - save the configuration
: 412 | 666.62 623.76 0.00583217 0.000719879 156486 0
: 413 Minimum Test error found - save the configuration
: 413 | 660.171 617.306 0.00579222 0.000621338 154712 0
: 414 Minimum Test error found - save the configuration
: 414 | 653.206 610.892 0.0056193 0.000606729 159599 0
: 415 Minimum Test error found - save the configuration
: 415 | 646.941 604.071 0.00562905 0.000620969 159742 0
: 416 Minimum Test error found - save the configuration
: 416 | 639.976 598.018 0.00569153 0.000606679 157330 0
: 417 Minimum Test error found - save the configuration
: 417 | 633.382 592.299 0.00577428 0.000589059 154285 0
: 418 Minimum Test error found - save the configuration
: 418 | 627.099 585.99 0.00602954 0.00065222 148773 0
: 419 Minimum Test error found - save the configuration
: 419 | 620.661 579.692 0.00708528 0.00075245 126326 0
: 420 Minimum Test error found - save the configuration
: 420 | 614.326 573.941 0.00650761 0.000628538 136076 0
: 421 Minimum Test error found - save the configuration
: 421 | 607.865 568.178 0.00569762 0.000661479 158852 0
: 422 Minimum Test error found - save the configuration
: 422 | 601.981 562.009 0.00561379 0.000588849 159206 0
: 423 Minimum Test error found - save the configuration
: 423 | 595.946 556.134 0.00568112 0.000607629 157682 0
: 424 Minimum Test error found - save the configuration
: 424 | 589.404 550.513 0.0062073 0.000613389 143013 0
: 425 Minimum Test error found - save the configuration
: 425 | 583.81 544.709 0.00566444 0.000607089 158185 0
: 426 Minimum Test error found - save the configuration
: 426 | 578.05 539.515 0.00552567 0.000593909 162214 0
: 427 Minimum Test error found - save the configuration
: 427 | 571.42 533.286 0.00561384 0.000597919 159492 0
: 428 Minimum Test error found - save the configuration
: 428 | 565.564 527.483 0.00573271 0.000759482 160861 0
: 429 Minimum Test error found - save the configuration
: 429 | 559.876 521.93 0.00710674 0.000763761 126124 0
: 430 Minimum Test error found - save the configuration
: 430 | 553.766 516.851 0.00725351 0.000948013 126874 0
: 431 Minimum Test error found - save the configuration
: 431 | 548.262 511.901 0.00765812 0.000614699 113581 0
: 432 Minimum Test error found - save the configuration
: 432 | 542.772 505.77 0.0057086 0.00062351 157323 0
: 433 Minimum Test error found - save the configuration
: 433 | 536.984 500.569 0.00595749 0.000628489 150122 0
: 434 Minimum Test error found - save the configuration
: 434 | 531.531 495.277 0.00586209 0.000619599 152599 0
: 435 Minimum Test error found - save the configuration
: 435 | 525.855 489.646 0.00570574 0.000602739 156770 0
: 436 Minimum Test error found - save the configuration
: 436 | 520.199 484.566 0.00596453 0.000654049 150646 0
: 437 Minimum Test error found - save the configuration
: 437 | 515.183 479.05 0.0058127 0.0006681 155503 0
: 438 Minimum Test error found - save the configuration
: 438 | 509.43 474.327 0.00568376 0.000614929 157827 0
: 439 Minimum Test error found - save the configuration
: 439 | 504.467 469.048 0.00562881 0.00060509 159244 0
: 440 Minimum Test error found - save the configuration
: 440 | 498.996 464.604 0.00579504 0.000600899 154020 0
: 441 Minimum Test error found - save the configuration
: 441 | 494.559 459.61 0.00579775 0.000631908 154863 0
: 442 Minimum Test error found - save the configuration
: 442 | 488.971 453.597 0.00595875 0.000636259 150306 0
: 443 Minimum Test error found - save the configuration
: 443 | 483.444 449.21 0.00569478 0.000619888 157639 0
: 444 Minimum Test error found - save the configuration
: 444 | 478.712 444.52 0.00576632 0.000603589 154957 0
: 445 Minimum Test error found - save the configuration
: 445 | 473.515 439.973 0.00578109 0.000603289 154506 0
: 446 Minimum Test error found - save the configuration
: 446 | 468.748 435.226 0.00581836 0.000615359 153757 0
: 447 Minimum Test error found - save the configuration
: 447 | 463.711 430.082 0.00576441 0.000759322 159838 0
: 448 Minimum Test error found - save the configuration
: 448 | 458.755 425.639 0.00628432 0.0006477 141929 0
: 449 Minimum Test error found - save the configuration
: 449 | 454.101 421.087 0.00565158 0.00063402 159440 0
: 450 Minimum Test error found - save the configuration
: 450 | 449.554 416.849 0.0055819 0.000588509 160212 0
: 451 Minimum Test error found - save the configuration
: 451 | 444.866 411.516 0.0059671 0.000814112 155250 0
: 452 Minimum Test error found - save the configuration
: 452 | 439.836 407.143 0.00585893 0.000608339 152364 0
: 453 Minimum Test error found - save the configuration
: 453 | 435.223 402.912 0.00561952 0.000604109 159508 0
: 454 Minimum Test error found - save the configuration
: 454 | 430.838 398.835 0.00598523 0.000955464 159053 0
: 455 Minimum Test error found - save the configuration
: 455 | 426.267 394.032 0.00632817 0.00060309 139736 0
: 456 Minimum Test error found - save the configuration
: 456 | 421.771 389.835 0.0060877 0.000612459 146112 0
: 457 Minimum Test error found - save the configuration
: 457 | 417.499 385.105 0.0057132 0.000709591 159884 0
: 458 Minimum Test error found - save the configuration
: 458 | 412.894 381.102 0.00565181 0.00062438 159127 0
: 459 Minimum Test error found - save the configuration
: 459 | 408.585 377.02 0.00575962 0.000615449 155516 0
: 460 Minimum Test error found - save the configuration
: 460 | 404.277 373.609 0.00565263 0.000624858 159116 0
: 461 Minimum Test error found - save the configuration
: 461 | 400.213 368.941 0.00574356 0.000610488 155852 0
: 462 Minimum Test error found - save the configuration
: 462 | 395.929 364.715 0.00556848 0.000588769 160652 0
: 463 Minimum Test error found - save the configuration
: 463 | 391.897 360.786 0.00600435 0.000712191 151167 0
: 464 Minimum Test error found - save the configuration
: 464 | 387.572 356.3 0.00563751 0.000606919 159027 0
: 465 Minimum Test error found - save the configuration
: 465 | 383.305 352.705 0.00590055 0.000624649 151633 0
: 466 Minimum Test error found - save the configuration
: 466 | 379.827 349.052 0.00579586 0.000617679 154494 0
: 467 Minimum Test error found - save the configuration
: 467 | 375.453 344.999 0.00585753 0.000617149 152661 0
: 468 Minimum Test error found - save the configuration
: 468 | 371.316 341.401 0.00613324 0.000775512 149317 0
: 469 Minimum Test error found - save the configuration
: 469 | 367.421 337.679 0.00672088 0.00072716 133473 0
: 470 Minimum Test error found - save the configuration
: 470 | 363.58 333.143 0.00678356 0.000760842 132830 0
: 471 Minimum Test error found - save the configuration
: 471 | 359.607 329.806 0.00600368 0.000619019 148570 0
: 472 Minimum Test error found - save the configuration
: 472 | 355.83 326.291 0.00648495 0.000629829 136632 0
: 473 Minimum Test error found - save the configuration
: 473 | 351.885 322.4 0.00573602 0.000639059 156956 0
: 474 Minimum Test error found - save the configuration
: 474 | 348.076 318.73 0.00580076 0.000596829 153730 0
: 475 Minimum Test error found - save the configuration
: 475 | 344.34 315.038 0.00577641 0.000611889 154903 0
: 476 Minimum Test error found - save the configuration
: 476 | 341.011 311.435 0.00586656 0.000642408 153135 0
: 477 Minimum Test error found - save the configuration
: 477 | 337.147 307.927 0.00566296 0.000605238 158174 0
: 478 Minimum Test error found - save the configuration
: 478 | 333.535 304.454 0.0058152 0.000604678 153536 0
: 479 Minimum Test error found - save the configuration
: 479 | 329.796 300.826 0.00563988 0.00060383 158855 0
: 480 Minimum Test error found - save the configuration
: 480 | 326.401 297.759 0.00602489 0.000729501 151075 0
: 481 Minimum Test error found - save the configuration
: 481 | 322.932 293.943 0.00562132 0.000612169 159708 0
: 482 Minimum Test error found - save the configuration
: 482 | 319.773 291.762 0.00592867 0.000613579 150515 0
: 483 Minimum Test error found - save the configuration
: 483 | 315.966 287.451 0.00590398 0.000623029 151488 0
: 484 Minimum Test error found - save the configuration
: 484 | 312.403 284.249 0.00579607 0.000597889 153900 0
: 485 Minimum Test error found - save the configuration
: 485 | 309.12 281.425 0.00584446 0.00061729 153047 0
: 486 Minimum Test error found - save the configuration
: 486 | 306.114 278.117 0.00588908 0.000628579 152077 0
: 487 Minimum Test error found - save the configuration
: 487 | 302.846 274.524 0.00589473 0.00060471 151228 0
: 488 Minimum Test error found - save the configuration
: 488 | 299.215 271.563 0.005585 0.000605069 160645 0
: 489 Minimum Test error found - save the configuration
: 489 | 296.075 268.289 0.00564336 0.000598559 158579 0
: 490 Minimum Test error found - save the configuration
: 490 | 292.828 265.331 0.00609675 0.00060969 145798 0
: 491 Minimum Test error found - save the configuration
: 491 | 289.852 262.121 0.00578045 0.000607489 154650 0
: 492 Minimum Test error found - save the configuration
: 492 | 286.434 259.045 0.0055853 0.000607428 160711 0
: 493 Minimum Test error found - save the configuration
: 493 | 283.342 256.524 0.00560307 0.000590307 159593 0
: 494 Minimum Test error found - save the configuration
: 494 | 280.596 253.002 0.00549591 0.000598859 163364 0
: 495 Minimum Test error found - save the configuration
: 495 | 277.339 250.158 0.00574835 0.000616609 155892 0
: 496 Minimum Test error found - save the configuration
: 496 | 274.162 247.059 0.00583152 0.000608279 153161 0
: 497 Minimum Test error found - save the configuration
: 497 | 271.223 244.043 0.00562681 0.000595089 158991 0
: 498 Minimum Test error found - save the configuration
: 498 | 268.228 241.24 0.0055859 0.000601529 160502 0
: 499 Minimum Test error found - save the configuration
: 499 | 265.273 238.808 0.00567391 0.00069625 160718 0
: 500 Minimum Test error found - save the configuration
: 500 | 262.44 236.071 0.00596071 0.000594039 149068 0
: 501 Minimum Test error found - save the configuration
: 501 | 259.525 233.513 0.00588256 0.000588149 151103 0
: 502 Minimum Test error found - save the configuration
: 502 | 257.154 230.969 0.00562263 0.000612399 159673 0
: 503 Minimum Test error found - save the configuration
: 503 | 254.423 228.67 0.00579066 0.000631398 155061 0
: 504 Minimum Test error found - save the configuration
: 504 | 251.463 225.107 0.00557618 0.000585189 160289 0
: 505 Minimum Test error found - save the configuration
: 505 | 248.475 222.589 0.00561545 0.000607439 159744 0
: 506 Minimum Test error found - save the configuration
: 506 | 245.845 220.076 0.00552643 0.000594549 162210 0
: 507 Minimum Test error found - save the configuration
: 507 | 242.949 217.281 0.00563951 0.000592779 158518 0
: 508 Minimum Test error found - save the configuration
: 508 | 240.149 214.673 0.00576224 0.000642339 156253 0
: 509 Minimum Test error found - save the configuration
: 509 | 237.687 212.692 0.00564733 0.000602029 158563 0
: 510 Minimum Test error found - save the configuration
: 510 | 235.269 209.458 0.00574321 0.000609959 155847 0
: 511 Minimum Test error found - save the configuration
: 511 | 232.28 207.822 0.00569777 0.000620239 157557 0
: 512 Minimum Test error found - save the configuration
: 512 | 230.302 205.258 0.00558711 0.000607728 160662 0
: 513 Minimum Test error found - save the configuration
: 513 | 227.489 202.579 0.00558824 0.00064018 161679 0
: 514 Minimum Test error found - save the configuration
: 514 | 224.793 200.096 0.0057502 0.000626899 156149 0
: 515 Minimum Test error found - save the configuration
: 515 | 222.266 197.957 0.00721272 0.000767711 124127 0
: 516 Minimum Test error found - save the configuration
: 516 | 219.67 195.328 0.00687403 0.000880313 133473 0
: 517 Minimum Test error found - save the configuration
: 517 | 217.537 193.17 0.00689401 0.000881193 133049 0
: 518 Minimum Test error found - save the configuration
: 518 | 214.984 190.885 0.00631751 0.00063525 140789 0
: 519 Minimum Test error found - save the configuration
: 519 | 212.953 188.314 0.00657391 0.000610189 134145 0
: 520 Minimum Test error found - save the configuration
: 520 | 210.701 186.361 0.0058207 0.000643439 154522 0
: 521 Minimum Test error found - save the configuration
: 521 | 208.05 183.842 0.00583796 0.000653619 154311 0
: 522 Minimum Test error found - save the configuration
: 522 | 205.52 182.047 0.00585805 0.000622279 152795 0
: 523 Minimum Test error found - save the configuration
: 523 | 203.363 179.544 0.0057133 0.000601849 156511 0
: 524 Minimum Test error found - save the configuration
: 524 | 200.907 177.443 0.00579534 0.00065959 155771 0
: 525 Minimum Test error found - save the configuration
: 525 | 198.8 175.423 0.0059363 0.000736891 153864 0
: 526 Minimum Test error found - save the configuration
: 526 | 196.767 173.092 0.0059976 0.0007 151012 0
: 527 Minimum Test error found - save the configuration
: 527 | 194.62 171.453 0.00571735 0.000602139 156396 0
: 528 Minimum Test error found - save the configuration
: 528 | 192.633 169.505 0.0059706 0.000606699 149145 0
: 529 Minimum Test error found - save the configuration
: 529 | 190.177 166.966 0.00569649 0.00067129 159198 0
: 530 Minimum Test error found - save the configuration
: 530 | 188.178 164.708 0.00586207 0.000743571 156296 0
: 531 Minimum Test error found - save the configuration
: 531 | 185.7 162.958 0.00582593 0.00063366 154075 0
: 532 Minimum Test error found - save the configuration
: 532 | 183.721 160.767 0.00589804 0.000642919 152233 0
: 533 Minimum Test error found - save the configuration
: 533 | 181.363 159.398 0.0058087 0.00061929 154160 0
: 534 Minimum Test error found - save the configuration
: 534 | 179.533 157.192 0.00565696 0.00061337 158617 0
: 535 Minimum Test error found - save the configuration
: 535 | 177.31 155.436 0.00571525 0.000609079 156673 0
: 536 Minimum Test error found - save the configuration
: 536 | 175.353 153.54 0.00573903 0.000644019 157016 0
: 537 Minimum Test error found - save the configuration
: 537 | 173.317 151.754 0.00566679 0.000603228 157991 0
: 538 Minimum Test error found - save the configuration
: 538 | 171.568 150.289 0.00684684 0.000749592 131207 0
: 539 Minimum Test error found - save the configuration
: 539 | 169.502 148.212 0.0057995 0.000593449 153667 0
: 540 Minimum Test error found - save the configuration
: 540 | 167.758 146.671 0.00579257 0.000598529 154023 0
: 541 Minimum Test error found - save the configuration
: 541 | 165.86 144.492 0.00558941 0.000608439 160611 0
: 542 Minimum Test error found - save the configuration
: 542 | 163.598 143.546 0.00587582 0.00071174 154916 0
: 543 Minimum Test error found - save the configuration
: 543 | 161.755 140.981 0.00575017 0.000632718 156328 0
: 544 Minimum Test error found - save the configuration
: 544 | 159.765 139.657 0.00592721 0.000646009 151481 0
: 545 Minimum Test error found - save the configuration
: 545 | 158.255 137.711 0.00593843 0.000628799 150670 0
: 546 Minimum Test error found - save the configuration
: 546 | 156.595 136.093 0.00571313 0.00064903 157975 0
: 547 Minimum Test error found - save the configuration
: 547 | 154.512 134.791 0.00580566 0.000617079 154185 0
: 548 Minimum Test error found - save the configuration
: 548 | 152.837 133.843 0.00567861 0.000594679 157358 0
: 549 Minimum Test error found - save the configuration
: 549 | 151.167 131.225 0.00570635 0.000599879 156664 0
: 550 Minimum Test error found - save the configuration
: 550 | 149.172 129.893 0.00579378 0.00067204 156197 0
: 551 Minimum Test error found - save the configuration
: 551 | 147.356 128.569 0.00565233 0.000607949 158592 0
: 552 Minimum Test error found - save the configuration
: 552 | 145.669 126.873 0.00582601 0.000719771 156671 0
: 553 Minimum Test error found - save the configuration
: 553 | 144.083 126.349 0.0059102 0.000761781 155388 0
: 554 Minimum Test error found - save the configuration
: 554 | 142.586 123.645 0.00588292 0.000602489 151503 0
: 555 Minimum Test error found - save the configuration
: 555 | 140.543 122.393 0.00582851 0.00063454 154025 0
: 556 Minimum Test error found - save the configuration
: 556 | 139.167 121.048 0.00576326 0.000615669 155412 0
: 557 Minimum Test error found - save the configuration
: 557 | 137.365 118.922 0.00577297 0.000611728 155001 0
: 558 | 136.063 119.041 0.00583531 0.000572437 152008 1
: 559 Minimum Test error found - save the configuration
: 559 | 134.652 116.572 0.00590652 0.000639218 151881 0
: 560 Minimum Test error found - save the configuration
: 560 | 132.604 115.35 0.00560721 0.000593449 159561 0
: 561 Minimum Test error found - save the configuration
: 561 | 131.269 113.641 0.00571458 0.000616949 156936 0
: 562 Minimum Test error found - save the configuration
: 562 | 129.444 112.175 0.0057435 0.00064913 157036 0
: 563 Minimum Test error found - save the configuration
: 563 | 127.916 110.598 0.00580632 0.000597599 153589 0
: 564 Minimum Test error found - save the configuration
: 564 | 126.411 109.538 0.00569818 0.000623389 157642 0
: 565 Minimum Test error found - save the configuration
: 565 | 124.918 108.299 0.00571107 0.000636099 157636 0
: 566 Minimum Test error found - save the configuration
: 566 | 123.401 107.277 0.00569256 0.000605159 157251 0
: 567 Minimum Test error found - save the configuration
: 567 | 122.095 105.532 0.00564675 0.000593779 158323 0
: 568 Minimum Test error found - save the configuration
: 568 | 120.614 104.04 0.00561066 0.000605058 159821 0
: 569 Minimum Test error found - save the configuration
: 569 | 119.067 102.594 0.00558281 0.000584048 160040 0
: 570 Minimum Test error found - save the configuration
: 570 | 117.694 101.468 0.00566646 0.000616659 158422 0
: 571 Minimum Test error found - save the configuration
: 571 | 116.235 100.125 0.00568947 0.00061813 157749 0
: 572 Minimum Test error found - save the configuration
: 572 | 114.816 99.0691 0.00576076 0.000606549 155213 0
: 573 Minimum Test error found - save the configuration
: 573 | 113.621 97.7284 0.00566998 0.000621509 158464 0
: 574 Minimum Test error found - save the configuration
: 574 | 112.071 96.427 0.00571747 0.0006461 157748 0
: 575 Minimum Test error found - save the configuration
: 575 | 110.79 95.3716 0.00574957 0.00064802 156815 0
: 576 Minimum Test error found - save the configuration
: 576 | 109.522 94.1649 0.00568478 0.00063239 158341 0
: 577 Minimum Test error found - save the configuration
: 577 | 108.195 93.6505 0.0058786 0.000600059 151557 0
: 578 Minimum Test error found - save the configuration
: 578 | 107.129 92.1843 0.00571912 0.000609009 156552 0
: 579 Minimum Test error found - save the configuration
: 579 | 105.983 90.7713 0.0056983 0.000612459 157299 0
: 580 Minimum Test error found - save the configuration
: 580 | 104.429 89.6778 0.00583996 0.000670949 154768 0
: 581 Minimum Test error found - save the configuration
: 581 | 103.293 88.2742 0.00569804 0.000623009 157634 0
: 582 Minimum Test error found - save the configuration
: 582 | 101.912 87.1376 0.00574514 0.00063775 156636 0
: 583 Minimum Test error found - save the configuration
: 583 | 100.702 86.3169 0.00560622 0.000598769 159762 0
: 584 Minimum Test error found - save the configuration
: 584 | 99.7314 85.0348 0.00569972 0.000594599 156705 0
: 585 Minimum Test error found - save the configuration
: 585 | 98.5261 84.5401 0.00564326 0.000613589 159056 0
: 586 Minimum Test error found - save the configuration
: 586 | 97.498 83.8365 0.00573065 0.000626499 156735 0
: 587 Minimum Test error found - save the configuration
: 587 | 96.0824 81.8087 0.00562426 0.000595569 159087 0
: 588 Minimum Test error found - save the configuration
: 588 | 94.9025 81.4644 0.00613528 0.000603489 144619 0
: 589 Minimum Test error found - save the configuration
: 589 | 93.9269 79.8536 0.0059251 0.00067364 152339 0
: 590 Minimum Test error found - save the configuration
: 590 | 92.5937 79.0802 0.00860174 0.000977754 104932 0
: 591 Minimum Test error found - save the configuration
: 591 | 91.4544 78.2155 0.00605312 0.000609299 146956 0
: 592 Minimum Test error found - save the configuration
: 592 | 90.921 77.3798 0.00579902 0.000621809 154524 0
: 593 Minimum Test error found - save the configuration
: 593 | 89.6151 76.1103 0.00582595 0.000617608 153600 0
: 594 Minimum Test error found - save the configuration
: 594 | 88.5723 74.8013 0.00603318 0.000678969 149415 0
: 595 Minimum Test error found - save the configuration
: 595 | 87.5543 74.2548 0.00579038 0.000630298 155036 0
: 596 Minimum Test error found - save the configuration
: 596 | 86.2702 72.9997 0.00578266 0.000605068 154512 0
: 597 Minimum Test error found - save the configuration
: 597 | 85.3143 72.1745 0.00587626 0.000601188 151657 0
: 598 Minimum Test error found - save the configuration
: 598 | 84.3266 71.806 0.00574521 0.000635139 156553 0
: 599 Minimum Test error found - save the configuration
: 599 | 83.3129 70.6227 0.00582002 0.00067916 155616 0
: 600 Minimum Test error found - save the configuration
: 600 | 82.3153 69.108 0.00586164 0.00061842 152578 0
: 601 Minimum Test error found - save the configuration
: 601 | 81.1314 68.4061 0.00577805 0.000631409 155441 0
: 602 Minimum Test error found - save the configuration
: 602 | 80.2266 67.5777 0.00596102 0.00062801 150009 0
: 603 Minimum Test error found - save the configuration
: 603 | 79.2168 66.8128 0.00570573 0.00063623 157806 0
: 604 Minimum Test error found - save the configuration
: 604 | 78.3834 65.5317 0.00591443 0.0006648 152392 0
: 605 Minimum Test error found - save the configuration
: 605 | 77.5001 64.5674 0.00584909 0.000617189 152908 0
: 606 Minimum Test error found - save the configuration
: 606 | 76.5509 64.2162 0.00592031 0.00066117 152116 0
: 607 Minimum Test error found - save the configuration
: 607 | 75.7941 63.4604 0.00580182 0.000628739 154647 0
: 608 Minimum Test error found - save the configuration
: 608 | 74.8004 62.8332 0.00572294 0.00068738 158870 0
: 609 Minimum Test error found - save the configuration
: 609 | 74.243 62.632 0.00602888 0.00060859 147594 0
: 610 Minimum Test error found - save the configuration
: 610 | 73.405 60.6878 0.00590052 0.00070139 153872 0
: 611 Minimum Test error found - save the configuration
: 611 | 72.0226 59.8357 0.00592891 0.000722731 153664 0
: 612 | 71.2268 59.9389 0.00566475 0.000562948 156807 1
: 613 Minimum Test error found - save the configuration
: 613 | 70.5825 58.777 0.00591824 0.000622709 151071 0
: 614 Minimum Test error found - save the configuration
: 614 | 69.472 58.0642 0.00620004 0.000617649 143308 0
: 615 Minimum Test error found - save the configuration
: 615 | 68.8433 56.9815 0.00601451 0.00062916 148551 0
: 616 Minimum Test error found - save the configuration
: 616 | 67.9586 56.0977 0.00597464 0.000616619 149309 0
: 617 Minimum Test error found - save the configuration
: 617 | 67.1064 55.353 0.00578338 0.0006492 155819 0
: 618 Minimum Test error found - save the configuration
: 618 | 66.4444 54.9573 0.00584836 0.000605049 152575 0
: 619 Minimum Test error found - save the configuration
: 619 | 65.688 54.9189 0.00564656 0.000605538 158698 0
: 620 Minimum Test error found - save the configuration
: 620 | 64.9172 53.4802 0.00572753 0.000622179 156698 0
: 621 Minimum Test error found - save the configuration
: 621 | 63.9387 53.3629 0.00593851 0.000771272 154822 0
: 622 Minimum Test error found - save the configuration
: 622 | 63.3109 51.9357 0.00583467 0.000638639 153964 0
: 623 Minimum Test error found - save the configuration
: 623 | 62.6445 51.779 0.00568184 0.00064291 158764 0
: 624 Minimum Test error found - save the configuration
: 624 | 61.7324 50.9133 0.00598631 0.000627769 149294 0
: 625 Minimum Test error found - save the configuration
: 625 | 61.0386 49.6928 0.00583949 0.000617039 153185 0
: 626 | 60.3645 49.9735 0.00566276 0.000599299 157995 1
: 627 Minimum Test error found - save the configuration
: 627 | 59.4348 48.6515 0.0058933 0.00065226 152642 0
: 628 Minimum Test error found - save the configuration
: 628 | 58.7358 47.867 0.00570874 0.000616449 157100 0
: 629 Minimum Test error found - save the configuration
: 629 | 58.1346 47.5366 0.00574286 0.000600539 155572 0
: 630 Minimum Test error found - save the configuration
: 630 | 57.5887 46.8838 0.00593013 0.000675371 152243 0
: 631 Minimum Test error found - save the configuration
: 631 | 56.8687 46.3683 0.00591925 0.000653919 151937 0
: 632 Minimum Test error found - save the configuration
: 632 | 56.2719 46.1784 0.00573656 0.00061894 156323 0
: 633 Minimum Test error found - save the configuration
: 633 | 55.3908 45.4149 0.00592455 0.000728581 153966 0
: 634 Minimum Test error found - save the configuration
: 634 | 54.9944 44.4162 0.00587927 0.00063045 152415 0
: 635 Minimum Test error found - save the configuration
: 635 | 54.2327 43.4935 0.00601036 0.00065193 149298 0
: 636 Minimum Test error found - save the configuration
: 636 | 53.4493 43.4653 0.00577013 0.000663699 156665 0
: 637 Minimum Test error found - save the configuration
: 637 | 52.8877 42.3692 0.00572522 0.000616479 156594 0
: 638 | 52.2849 43.132 0.00575529 0.000571647 154331 1
: 639 Minimum Test error found - save the configuration
: 639 | 51.8119 41.4935 0.005731 0.000605739 156090 0
: 640 Minimum Test error found - save the configuration
: 640 | 50.932 40.9912 0.00580811 0.000647339 155016 0
: 641 Minimum Test error found - save the configuration
: 641 | 50.3365 40.2399 0.0063828 0.000616738 138743 0
: 642 Minimum Test error found - save the configuration
: 642 | 50.014 39.9041 0.00565746 0.000614639 158641 0
: 643 Minimum Test error found - save the configuration
: 643 | 49.2768 39.585 0.00601494 0.00062947 148548 0
: 644 Minimum Test error found - save the configuration
: 644 | 48.6013 38.3325 0.00608788 0.000891723 153960 0
: 645 Minimum Test error found - save the configuration
: 645 | 47.7591 38.0394 0.00573201 0.000612819 156275 0
: 646 Minimum Test error found - save the configuration
: 646 | 47.4436 38.0078 0.00662358 0.000617219 133192 0
: 647 Minimum Test error found - save the configuration
: 647 | 46.8355 37.4973 0.00564711 0.000614219 158954 0
: 648 Minimum Test error found - save the configuration
: 648 | 46.2026 36.5993 0.00573731 0.00062071 156354 0
: 649 Minimum Test error found - save the configuration
: 649 | 45.6527 36.242 0.00564007 0.000603109 158826 0
: 650 Minimum Test error found - save the configuration
: 650 | 45.0792 35.6053 0.00577363 0.000729841 158611 0
: 651 Minimum Test error found - save the configuration
: 651 | 44.5915 35.0137 0.00577306 0.000610239 154954 0
: 652 Minimum Test error found - save the configuration
: 652 | 44.1369 34.3163 0.0056692 0.00061664 158335 0
: 653 | 43.3671 34.9316 0.00570559 0.000568908 155742 1
: 654 Minimum Test error found - save the configuration
: 654 | 42.8749 33.61 0.00563864 0.000619579 159392 0
: 655 Minimum Test error found - save the configuration
: 655 | 42.4276 33.2022 0.00570521 0.000615539 157181 0
: 656 Minimum Test error found - save the configuration
: 656 | 41.8938 32.956 0.00567805 0.000613518 157961 0
: 657 Minimum Test error found - save the configuration
: 657 | 41.4197 32.2984 0.00569407 0.000608578 157310 0
: 658 Minimum Test error found - save the configuration
: 658 | 40.8501 31.8061 0.00582445 0.00068684 155715 0
: 659 Minimum Test error found - save the configuration
: 659 | 40.4407 31.3462 0.00583791 0.00064086 153934 0
: 660 | 40.0856 31.3633 0.00579994 0.000591409 153594 1
: 661 Minimum Test error found - save the configuration
: 661 | 39.5157 30.6835 0.00566861 0.000591049 157556 0
: 662 Minimum Test error found - save the configuration
: 662 | 39.1626 30.1861 0.0063636 0.00101169 149479 0
: 663 Minimum Test error found - save the configuration
: 663 | 38.6602 29.3263 0.00587494 0.00062435 152364 0
: 664 Minimum Test error found - save the configuration
: 664 | 38.2378 28.7516 0.0057132 0.0006159 156946 0
: 665 Minimum Test error found - save the configuration
: 665 | 37.6232 28.4721 0.00563873 0.000597689 158697 0
: 666 | 37.1299 28.9045 0.00569345 0.000568639 156103 1
: 667 Minimum Test error found - save the configuration
: 667 | 36.8474 28.0709 0.00563739 0.000599318 158791 0
: 668 Minimum Test error found - save the configuration
: 668 | 36.4435 27.6575 0.0063299 0.000625319 140238 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.9565 27.4239 0.00566592 0.000598479 157871 0
: 670 Minimum Test error found - save the configuration
: 670 | 35.4219 26.6907 0.00581898 0.00063813 154415 0
: 671 Minimum Test error found - save the configuration
: 671 | 35.1411 25.9059 0.00625669 0.00068249 143518 0
: 672 Minimum Test error found - save the configuration
: 672 | 34.4472 25.5794 0.00603021 0.000619429 147853 0
: 673 Minimum Test error found - save the configuration
: 673 | 34.1395 25.5214 0.00584756 0.000596319 152345 0
: 674 Minimum Test error found - save the configuration
: 674 | 33.6636 24.7047 0.00576123 0.00063946 156196 0
: 675 Minimum Test error found - save the configuration
: 675 | 33.2569 24.3086 0.00608021 0.000613889 146351 0
: 676 Minimum Test error found - save the configuration
: 676 | 32.8585 24.1 0.00719784 0.000918634 127405 0
: 677 Minimum Test error found - save the configuration
: 677 | 32.3768 23.5326 0.00845161 0.000993005 107259 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.9959 23.047 0.00743213 0.000613749 117330 0
: 679 | 31.6971 23.3002 0.00604217 0.000578047 146410 1
: 680 Minimum Test error found - save the configuration
: 680 | 31.3105 22.4421 0.00683673 0.000635769 129012 0
: 681 | 30.887 23.1061 0.00598725 0.000571539 147718 1
: 682 Minimum Test error found - save the configuration
: 682 | 30.6336 22.2311 0.00577283 0.000616829 155159 0
: 683 Minimum Test error found - save the configuration
: 683 | 30.0506 22.0623 0.00568197 0.000619249 158018 0
: 684 Minimum Test error found - save the configuration
: 684 | 29.8613 21.3899 0.00566201 0.000617028 158573 0
: 685 Minimum Test error found - save the configuration
: 685 | 29.4287 20.7716 0.00599348 0.000625438 149030 0
: 686 | 29.1673 21.8221 0.00593091 0.000592338 149853 1
: 687 Minimum Test error found - save the configuration
: 687 | 28.657 20.177 0.00609808 0.000649779 146835 0
: 688 | 28.2011 20.5137 0.00565334 0.000572658 157459 1
: 689 Minimum Test error found - save the configuration
: 689 | 27.8494 19.5578 0.00569379 0.000611999 157425 0
: 690 | 27.7159 20.3393 0.00572227 0.000557178 154886 1
: 691 | 27.5966 19.6077 0.00596835 0.00069035 151573 2
: 692 Minimum Test error found - save the configuration
: 692 | 27.0987 19.3405 0.00611319 0.000750581 149181 0
: 693 Minimum Test error found - save the configuration
: 693 | 26.7355 18.9991 0.00596136 0.00064224 150401 0
: 694 Minimum Test error found - save the configuration
: 694 | 26.681 18.6587 0.00559126 0.000589329 159938 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.9688 18.1534 0.00565453 0.000613549 158699 0
: 696 Minimum Test error found - save the configuration
: 696 | 25.4856 17.7242 0.00559724 0.00061038 160422 0
: 697 Minimum Test error found - save the configuration
: 697 | 25.1739 17.5733 0.00576638 0.000604459 154981 0
: 698 Minimum Test error found - save the configuration
: 698 | 24.9857 17.0578 0.00562704 0.00061564 159636 0
: 699 Minimum Test error found - save the configuration
: 699 | 24.3379 16.4537 0.00567189 0.000622409 158432 0
: 700 Minimum Test error found - save the configuration
: 700 | 24.1166 16.3587 0.00574273 0.000614718 156006 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.8358 15.9102 0.00577552 0.000616709 155075 0
: 702 | 23.6675 16.3698 0.00566263 0.000573769 157206 1
: 703 Minimum Test error found - save the configuration
: 703 | 23.4659 15.8921 0.00569378 0.000611499 157410 0
: 704 Minimum Test error found - save the configuration
: 704 | 22.8502 15.3509 0.00566559 0.000597979 157865 0
: 705 Minimum Test error found - save the configuration
: 705 | 22.6715 14.8592 0.00582225 0.000623769 153891 0
: 706 | 22.4222 15.2805 0.00579335 0.000584389 153582 1
: 707 | 22.1666 14.9549 0.0057855 0.000591149 154013 2
: 708 Minimum Test error found - save the configuration
: 708 | 21.8818 14.8292 0.00575272 0.000603319 155358 0
: 709 | 21.6282 15.0997 0.00571925 0.000555178 154916 1
: 710 Minimum Test error found - save the configuration
: 710 | 21.1117 13.7362 0.00568601 0.00064545 158712 0
: 711 Minimum Test error found - save the configuration
: 711 | 21.0593 13.3945 0.00589307 0.000618509 151672 0
: 712 Minimum Test error found - save the configuration
: 712 | 20.4547 13.3696 0.0059392 0.000613539 150216 0
: 713 | 20.2406 13.5076 0.00567783 0.000564147 156443 1
: 714 Minimum Test error found - save the configuration
: 714 | 19.9148 13.2078 0.00561788 0.000600188 159436 0
: 715 Minimum Test error found - save the configuration
: 715 | 19.6827 12.8536 0.00569168 0.000648069 158616 0
: 716 Minimum Test error found - save the configuration
: 716 | 19.392 12.671 0.00574891 0.000601379 155414 0
: 717 Minimum Test error found - save the configuration
: 717 | 19.1793 12.1271 0.00565896 0.00061901 158732 0
: 718 | 18.8449 12.1902 0.00565967 0.000568329 157129 1
: 719 Minimum Test error found - save the configuration
: 719 | 18.7836 11.8758 0.00580758 0.000616699 154116 0
: 720 Minimum Test error found - save the configuration
: 720 | 18.5899 11.8329 0.00564533 0.000592199 158318 0
: 721 Minimum Test error found - save the configuration
: 721 | 18.1959 11.4177 0.00581836 0.000619619 153883 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.9317 11.1225 0.00589185 0.000785581 156670 0
: 723 Minimum Test error found - save the configuration
: 723 | 17.6619 10.8032 0.00581984 0.000609619 153544 0
: 724 Minimum Test error found - save the configuration
: 724 | 17.4808 10.4445 0.00565622 0.000605098 158381 0
: 725 | 17.1773 10.7998 0.00574818 0.000554847 154044 1
: 726 | 16.9418 10.5774 0.00562086 0.000554759 157912 2
: 727 Minimum Test error found - save the configuration
: 727 | 16.7804 9.92279 0.00572589 0.00061525 156536 0
: 728 | 16.59 10.0583 0.0056721 0.000548748 156148 1
: 729 | 16.2915 10.1026 0.00572103 0.000567809 155243 2
: 730 Minimum Test error found - save the configuration
: 730 | 16.1968 9.85129 0.00594199 0.00067801 151976 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.9712 9.78617 0.00564298 0.000628149 159527 0
: 732 Minimum Test error found - save the configuration
: 732 | 15.8207 9.33864 0.00580235 0.000620189 154376 0
: 733 | 15.399 9.5933 0.00559939 0.000547658 158361 1
: 734 Minimum Test error found - save the configuration
: 734 | 15.3172 8.95184 0.0058413 0.00063437 153642 0
: 735 | 15.045 9.37833 0.00566147 0.000572929 157216 1
: 736 Minimum Test error found - save the configuration
: 736 | 14.8612 8.4608 0.00581894 0.000629488 154159 0
: 737 | 14.5046 8.92198 0.005669 0.000581117 157236 1
: 738 Minimum Test error found - save the configuration
: 738 | 14.4441 8.20264 0.00589542 0.000616788 151555 0
: 739 Minimum Test error found - save the configuration
: 739 | 14.1707 8.04519 0.00568325 0.000611309 157730 0
: 740 | 14.076 8.64974 0.00560363 0.000566748 158828 1
: 741 Minimum Test error found - save the configuration
: 741 | 14.0884 7.91028 0.00565871 0.000598839 158107 0
: 742 Minimum Test error found - save the configuration
: 742 | 13.6117 7.83861 0.00570314 0.000611509 157120 0
: 743 Minimum Test error found - save the configuration
: 743 | 13.402 7.72515 0.00583179 0.000609889 153201 0
: 744 Minimum Test error found - save the configuration
: 744 | 13.174 7.69197 0.00581238 0.000626619 154268 0
: 745 Minimum Test error found - save the configuration
: 745 | 13.1392 7.67258 0.00564758 0.000609949 158805 0
: 746 Minimum Test error found - save the configuration
: 746 | 13.0741 7.52904 0.00570509 0.000615569 157186 0
: 747 Minimum Test error found - save the configuration
: 747 | 12.7174 7.26896 0.00582429 0.00062999 154015 0
: 748 | 12.5294 7.53373 0.00575519 0.000574227 154411 1
: 749 | 12.4408 7.44817 0.00560202 0.000573528 159093 2
: 750 Minimum Test error found - save the configuration
: 750 | 12.3922 7.21768 0.00575723 0.00066055 156965 0
: 751 | 12.0355 7.45621 0.00599452 0.000578839 147719 1
: 752 Minimum Test error found - save the configuration
: 752 | 11.8568 6.68141 0.00563003 0.000612859 159452 0
: 753 Minimum Test error found - save the configuration
: 753 | 11.7922 6.48639 0.00607483 0.00064335 147290 0
: 754 | 11.5627 6.63998 0.00577418 0.000591889 154372 1
: 755 | 11.4085 7.12489 0.00570613 0.000569738 155751 2
: 756 Minimum Test error found - save the configuration
: 756 | 11.3948 6.31901 0.00580931 0.000708371 156834 0
: 757 | 11.0958 6.6579 0.00594236 0.000583419 149283 1
: 758 Minimum Test error found - save the configuration
: 758 | 10.9339 6.03993 0.00587556 0.00065473 153232 0
: 759 | 10.7946 6.15515 0.00625057 0.000902313 149581 1
: 760 | 10.6548 6.05155 0.00712902 0.000696809 124374 2
: 761 Minimum Test error found - save the configuration
: 761 | 10.5577 5.98054 0.00601221 0.000634869 148772 0
: 762 | 10.4333 6.13895 0.0056525 0.000567269 157318 1
: 763 | 10.2312 6.30475 0.00597808 0.00061042 149041 2
: 764 Minimum Test error found - save the configuration
: 764 | 10.1337 5.80309 0.00623767 0.000667019 143610 0
: 765 Minimum Test error found - save the configuration
: 765 | 10.0244 5.70369 0.00643299 0.000677029 138986 0
: 766 Minimum Test error found - save the configuration
: 766 | 10.0156 5.54913 0.0062086 0.00068502 144834 0
: 767 | 10.0304 5.95948 0.0056384 0.000572938 157932 1
: 768 Minimum Test error found - save the configuration
: 768 | 9.7471 5.27602 0.00605251 0.000663309 148445 0
: 769 | 9.54434 5.58332 0.00604713 0.000568479 146021 1
: 770 | 9.46361 5.6345 0.00582857 0.000565387 151999 2
: 771 | 9.35203 5.31187 0.00565243 0.000574507 157545 3
: 772 | 9.21732 5.85417 0.00584622 0.000603049 152580 4
: 773 | 9.14866 5.27878 0.00600245 0.000591168 147839 5
: 774 | 9.08651 5.50994 0.00580007 0.00062131 154477 6
: 775 | 8.7595 5.51268 0.00583425 0.000585119 152406 7
: 776 Minimum Test error found - save the configuration
: 776 | 8.64561 4.77811 0.00584969 0.000642459 153633 0
: 777 | 8.71956 5.1436 0.0057261 0.000563018 154946 1
: 778 Minimum Test error found - save the configuration
: 778 | 8.50478 4.6684 0.00575607 0.00064502 156524 0
: 779 Minimum Test error found - save the configuration
: 779 | 8.31778 4.66371 0.00587344 0.00064104 152894 0
: 780 | 8.10131 4.90651 0.00566603 0.000571019 157016 1
: 781 | 8.0483 5.01203 0.00557049 0.000556129 159542 2
: 782 | 8.12044 5.15023 0.00557888 0.000573309 159822 3
: 783 | 7.87075 4.90455 0.00562315 0.000555157 157853 4
: 784 Minimum Test error found - save the configuration
: 784 | 7.71472 4.45454 0.0058854 0.000596398 151257 0
: 785 | 7.81463 5.20154 0.00560807 0.000567069 158699 1
: 786 | 7.50333 4.5966 0.00558042 0.000594909 160465 2
: 787 Minimum Test error found - save the configuration
: 787 | 7.41172 4.37052 0.00610438 0.00067463 147336 0
: 788 | 7.35002 4.48389 0.00589636 0.000563799 150022 1
: 789 | 7.26438 4.88587 0.00555908 0.000555928 159899 2
: 790 | 7.24249 4.48999 0.00560382 0.000569029 158894 3
: 791 | 7.14726 4.37558 0.00562511 0.000556218 157825 4
: 792 | 7.12472 5.17837 0.00566848 0.000569498 156894 5
: 793 Minimum Test error found - save the configuration
: 793 | 6.99298 4.18251 0.00575292 0.00064895 156741 0
: 794 | 6.84863 4.74802 0.00556173 0.000549007 159594 1
: 795 Minimum Test error found - save the configuration
: 795 | 6.94202 3.90909 0.00557679 0.000605758 160932 0
: 796 | 6.69757 4.35753 0.00553281 0.000569589 161186 1
: 797 Minimum Test error found - save the configuration
: 797 | 6.70439 3.84451 0.00574664 0.000597799 155375 0
: 798 | 6.59611 4.39265 0.00559274 0.000571718 159330 1
: 799 | 6.47962 5.18269 0.00568388 0.000582279 156813 2
: 800 | 6.54976 3.93244 0.00563482 0.000548688 157290 3
: 801 | 6.45 4.27215 0.00563457 0.000571429 158005 4
: 802 | 6.24872 4.05556 0.00563893 0.000563429 157620 5
: 803 | 6.16493 4.27287 0.00579959 0.000547427 152318 6
: 804 | 6.0971 3.97977 0.00567989 0.000693489 160436 7
: 805 | 6.28443 4.0599 0.00575441 0.000586829 154811 8
: 806 | 5.98315 4.42919 0.00562072 0.000568629 158350 9
: 807 Minimum Test error found - save the configuration
: 807 | 5.94339 3.60262 0.00570594 0.000628329 157554 0
: 808 Minimum Test error found - save the configuration
: 808 | 5.72696 3.49108 0.00568499 0.000613399 157741 0
: 809 | 5.76764 4.1858 0.00562905 0.000565708 157998 1
: 810 | 5.66933 4.09823 0.00577479 0.000573269 153801 2
: 811 | 5.56404 3.84532 0.00567547 0.000601749 157675 3
: 812 | 5.47684 3.99321 0.00578602 0.000597759 154194 4
: 813 | 5.38715 4.12786 0.00573521 0.000576228 155069 5
: 814 | 5.36572 4.68491 0.00589535 0.000563058 150029 6
: 815 | 5.38046 3.95723 0.00562425 0.000555698 157836 7
: 816 | 5.23776 4.15247 0.00584793 0.000571808 151627 8
: 817 | 5.28851 4.498 0.00576623 0.000581778 154307 9
: 818 Minimum Test error found - save the configuration
: 818 | 5.27361 3.20392 0.00561044 0.00061625 160186 0
: 819 | 5.0104 4.00053 0.00576842 0.000555798 153474 1
: 820 | 5.01823 3.80363 0.0056338 0.000564949 157827 2
: 821 | 5.08524 3.80636 0.00568668 0.000578148 156601 3
: 822 | 4.93647 5.33849 0.0059571 0.000600389 149345 4
: 823 | 5.02558 3.85464 0.0056373 0.000555129 157413 5
: 824 | 4.91854 4.06139 0.00569187 0.000584619 156640 6
: 825 | 4.77085 3.95789 0.00559212 0.000559868 158974 7
: 826 | 4.65664 3.8118 0.0059589 0.000558828 148146 8
: 827 | 4.58492 4.08077 0.00567144 0.000598158 157689 9
: 828 | 4.56297 4.363 0.00571144 0.000565199 155453 10
: 829 | 4.58957 4.92106 0.00648477 0.000557517 134970 11
: 830 | 4.52938 4.51558 0.00565594 0.000557637 156915 12
: 831 | 4.39286 3.54426 0.00558989 0.000595309 160174 13
: 832 | 4.39267 4.52353 0.0059902 0.000602289 148481 14
: 833 | 4.25967 4.45463 0.00555465 0.000549308 159829 15
: 834 | 4.20228 4.29108 0.00556163 0.000571239 160308 16
: 835 | 4.20447 3.81605 0.00565291 0.000558199 157025 17
: 836 | 4.1877 5.53751 0.00554262 0.000556218 160436 18
: 837 | 4.43276 4.40261 0.00576415 0.000627339 155739 19
: 838 | 4.12555 4.23734 0.00561603 0.000558688 158186 20
: 839 | 3.98907 3.65638 0.00578466 0.000552897 152912 21
:
: Elapsed time for training with 1000 events: 4.83 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00955 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 1.01 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.171 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.34607e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.11892e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0434 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.046 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00171 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0896 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 1.03 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0243 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00296 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0464 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00526 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00178 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000368 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0785 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00891 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.991 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.113 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.604 0.303 5.90 1.63 | 3.199 3.221
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.125 0.337 2.19 1.19 | 3.381 3.369
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.