Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.254 sec
: Elapsed time for training with 1000 events: 0.257 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00247 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000737 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0039 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000213 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000342 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31486.3
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33035.4 31134.8 0.00423296 0.000499044 214252 0
: 2 Minimum Test error found - save the configuration
: 2 | 32520.2 30548.5 0.00423977 0.000474312 212458 0
: 3 Minimum Test error found - save the configuration
: 3 | 31806.2 29868.6 0.00437899 0.000484143 205400 0
: 4 Minimum Test error found - save the configuration
: 4 | 31068.6 29232.6 0.00440695 0.000487123 204091 0
: 5 Minimum Test error found - save the configuration
: 5 | 30334 28537.7 0.00458326 0.000494563 195661 0
: 6 Minimum Test error found - save the configuration
: 6 | 29570.1 27673.9 0.00439709 0.000482414 204359 0
: 7 Minimum Test error found - save the configuration
: 7 | 28861.6 27035.1 0.00423578 0.000451733 211414 0
: 8 Minimum Test error found - save the configuration
: 8 | 28393.3 26652.6 0.00412443 0.000442403 217272 0
: 9 Minimum Test error found - save the configuration
: 9 | 28036.6 26330.9 0.00411491 0.000445622 218026 0
: 10 Minimum Test error found - save the configuration
: 10 | 27714.5 26036.7 0.00411169 0.000445973 218238 0
: 11 Minimum Test error found - save the configuration
: 11 | 27413.7 25756.3 0.00409531 0.000451323 219540 0
: 12 Minimum Test error found - save the configuration
: 12 | 27126.8 25485.9 0.00407901 0.000447283 220281 0
: 13 Minimum Test error found - save the configuration
: 13 | 26850.3 25223.5 0.0040946 0.000445812 219251 0
: 14 Minimum Test error found - save the configuration
: 14 | 26580.7 24969.8 0.00407244 0.000446912 220658 0
: 15 Minimum Test error found - save the configuration
: 15 | 26321 24719.9 0.00408502 0.000446113 219846 0
: 16 Minimum Test error found - save the configuration
: 16 | 26062.9 24479.3 0.00406757 0.000438243 220427 0
: 17 Minimum Test error found - save the configuration
: 17 | 25816 24239.9 0.00407654 0.000436403 219772 0
: 18 Minimum Test error found - save the configuration
: 18 | 25566 24011.8 0.00407768 0.000435673 219659 0
: 19 Minimum Test error found - save the configuration
: 19 | 25328.1 23783.5 0.00409088 0.000436623 218923 0
: 20 Minimum Test error found - save the configuration
: 20 | 25093.5 23556.4 0.00409214 0.000441103 219116 0
: 21 Minimum Test error found - save the configuration
: 21 | 24856 23339.8 0.00407274 0.000440474 220248 0
: 22 Minimum Test error found - save the configuration
: 22 | 24630.6 23120.4 0.00407317 0.000443583 220411 0
: 23 Minimum Test error found - save the configuration
: 23 | 24403.5 22905.8 0.00408079 0.000449694 220319 0
: 24 Minimum Test error found - save the configuration
: 24 | 24179.9 22695.4 0.00408159 0.000449633 220267 0
: 25 Minimum Test error found - save the configuration
: 25 | 23960.9 22486.5 0.00408398 0.000443533 219753 0
: 26 Minimum Test error found - save the configuration
: 26 | 23743.2 22281.4 0.0040718 0.000442243 220413 0
: 27 Minimum Test error found - save the configuration
: 27 | 23530.2 22077.1 0.00416042 0.000444962 215317 0
: 28 Minimum Test error found - save the configuration
: 28 | 23315.1 21880 0.00411857 0.000441383 217558 0
: 29 Minimum Test error found - save the configuration
: 29 | 23107.2 21683.2 0.00411833 0.000441752 217594 0
: 30 Minimum Test error found - save the configuration
: 30 | 22902.9 21485.1 0.00415783 0.000456373 216131 0
: 31 Minimum Test error found - save the configuration
: 31 | 22699.2 21288.7 0.00408366 0.000444503 219831 0
: 32 Minimum Test error found - save the configuration
: 32 | 22493.2 21100.4 0.00408316 0.000449563 220168 0
: 33 Minimum Test error found - save the configuration
: 33 | 22295.8 20910.7 0.0040785 0.000451713 220581 0
: 34 Minimum Test error found - save the configuration
: 34 | 22096.4 20726 0.00414762 0.000459282 216900 0
: 35 Minimum Test error found - save the configuration
: 35 | 21903.5 20539.5 0.00414023 0.000447143 216621 0
: 36 Minimum Test error found - save the configuration
: 36 | 21709.7 20356.1 0.00417991 0.000443783 214126 0
: 37 Minimum Test error found - save the configuration
: 37 | 21518.1 20175.4 0.00436996 0.000457633 204482 0
: 38 Minimum Test error found - save the configuration
: 38 | 21329.8 19995.5 0.00411664 0.000466304 219158 0
: 39 Minimum Test error found - save the configuration
: 39 | 21139.9 19821.6 0.00409605 0.000445623 219153 0
: 40 Minimum Test error found - save the configuration
: 40 | 20957.3 19645.9 0.00408741 0.000443843 219565 0
: 41 Minimum Test error found - save the configuration
: 41 | 20771.6 19475.6 0.00414484 0.000441363 216013 0
: 42 Minimum Test error found - save the configuration
: 42 | 20592.8 19303.3 0.004116 0.000441113 217694 0
: 43 Minimum Test error found - save the configuration
: 43 | 20412 19135 0.00411562 0.000446153 218015 0
: 44 Minimum Test error found - save the configuration
: 44 | 20236.4 18965.5 0.00418023 0.000454804 214741 0
: 45 Minimum Test error found - save the configuration
: 45 | 20058.5 18800.9 0.00415717 0.000453843 216022 0
: 46 Minimum Test error found - save the configuration
: 46 | 19884.4 18638 0.00410972 0.000450434 218622 0
: 47 Minimum Test error found - save the configuration
: 47 | 19712.3 18476.6 0.00412021 0.000455574 218303 0
: 48 Minimum Test error found - save the configuration
: 48 | 19541.6 18317.1 0.00413316 0.000440613 216653 0
: 49 Minimum Test error found - save the configuration
: 49 | 19373.7 18157.8 0.00416682 0.000467583 216261 0
: 50 Minimum Test error found - save the configuration
: 50 | 19204.8 18002.8 0.0041819 0.000447032 214198 0
: 51 Minimum Test error found - save the configuration
: 51 | 19042.5 17844.7 0.00410632 0.000442613 218358 0
: 52 Minimum Test error found - save the configuration
: 52 | 18877.8 17689.6 0.00412003 0.000454193 218231 0
: 53 Minimum Test error found - save the configuration
: 53 | 18715.1 17537 0.00410917 0.000445423 218356 0
: 54 Minimum Test error found - save the configuration
: 54 | 18553.2 17388.2 0.00416693 0.000449763 215218 0
: 55 Minimum Test error found - save the configuration
: 55 | 18396.5 17237.7 0.00412053 0.000441663 217458 0
: 56 Minimum Test error found - save the configuration
: 56 | 18237.2 17091.7 0.00418604 0.000449844 214122 0
: 57 Minimum Test error found - save the configuration
: 57 | 18082.9 16945.3 0.00414439 0.000446803 216357 0
: 58 Minimum Test error found - save the configuration
: 58 | 17928.1 16801.4 0.00411767 0.000447893 217997 0
: 59 Minimum Test error found - save the configuration
: 59 | 17774.5 16660.5 0.00411897 0.000453513 218254 0
: 60 Minimum Test error found - save the configuration
: 60 | 17624.7 16519 0.00409795 0.000444873 218994 0
: 61 Minimum Test error found - save the configuration
: 61 | 17476.1 16377.5 0.00412641 0.000449934 217600 0
: 62 Minimum Test error found - save the configuration
: 62 | 17326.3 16240 0.00413397 0.000451994 217275 0
: 63 Minimum Test error found - save the configuration
: 63 | 17181.7 16101.1 0.00411257 0.000440983 217890 0
: 64 Minimum Test error found - save the configuration
: 64 | 17035.2 15965.6 0.00409612 0.000438523 218723 0
: 65 Minimum Test error found - save the configuration
: 65 | 16891.7 15831.4 0.00410366 0.000445883 218712 0
: 66 Minimum Test error found - save the configuration
: 66 | 16748.9 15699.4 0.00410141 0.000444153 218743 0
: 67 Minimum Test error found - save the configuration
: 67 | 16608 15568.9 0.00414518 0.000464793 217369 0
: 68 Minimum Test error found - save the configuration
: 68 | 16471.7 15435.4 0.00413328 0.000456023 217554 0
: 69 Minimum Test error found - save the configuration
: 69 | 16328.9 15309.9 0.00411506 0.000451033 218339 0
: 70 Minimum Test error found - save the configuration
: 70 | 16194 15181.6 0.00412288 0.000452443 217958 0
: 71 Minimum Test error found - save the configuration
: 71 | 16056.1 15042.8 0.00415822 0.000449173 215689 0
: 72 Minimum Test error found - save the configuration
: 72 | 15907.4 14904.1 0.00420396 0.000459393 213643 0
: 73 Minimum Test error found - save the configuration
: 73 | 15761.5 14762.5 0.00420978 0.000466513 213717 0
: 74 Minimum Test error found - save the configuration
: 74 | 15631.6 14633.1 0.00422152 0.000459952 212677 0
: 75 Minimum Test error found - save the configuration
: 75 | 15492.2 14517.3 0.00421742 0.000457413 212766 0
: 76 Minimum Test error found - save the configuration
: 76 | 15343.8 14345 0.00442898 0.000483563 202767 0
: 77 Minimum Test error found - save the configuration
: 77 | 15198.6 14204.6 0.00426578 0.000475684 211077 0
: 78 Minimum Test error found - save the configuration
: 78 | 15050.9 14057.9 0.00425452 0.000469463 211358 0
: 79 Minimum Test error found - save the configuration
: 79 | 14915.1 13928.4 0.00429946 0.000467074 208747 0
: 80 Minimum Test error found - save the configuration
: 80 | 14776.4 13799.5 0.00427876 0.000474884 210312 0
: 81 Minimum Test error found - save the configuration
: 81 | 14640.4 13672.9 0.00430767 0.000477124 208848 0
: 82 Minimum Test error found - save the configuration
: 82 | 14505.7 13556.1 0.00429217 0.000462573 208899 0
: 83 Minimum Test error found - save the configuration
: 83 | 14377.9 13426.3 0.00430599 0.000469713 208536 0
: 84 Minimum Test error found - save the configuration
: 84 | 14246.2 13304.6 0.0043189 0.000483012 208557 0
: 85 Minimum Test error found - save the configuration
: 85 | 14116.4 13185.2 0.00434177 0.000469272 206585 0
: 86 Minimum Test error found - save the configuration
: 86 | 13990.1 13061.4 0.00436286 0.000476235 205834 0
: 87 Minimum Test error found - save the configuration
: 87 | 13863.6 12935.5 0.0044586 0.000493723 201772 0
: 88 Minimum Test error found - save the configuration
: 88 | 13736.8 12820.8 0.00439503 0.000477513 204211 0
: 89 Minimum Test error found - save the configuration
: 89 | 13612 12698.2 0.00455767 0.000484054 196386 0
: 90 Minimum Test error found - save the configuration
: 90 | 13488 12579.1 0.00437647 0.000476413 205125 0
: 91 Minimum Test error found - save the configuration
: 91 | 13364.2 12464.6 0.00438543 0.000495453 205657 0
: 92 Minimum Test error found - save the configuration
: 92 | 13241 12351.7 0.00433801 0.000472663 206967 0
: 93 Minimum Test error found - save the configuration
: 93 | 13119.6 12232.4 0.00433698 0.000482753 207564 0
: 94 Minimum Test error found - save the configuration
: 94 | 12999.6 12117.3 0.00439716 0.000478804 204167 0
: 95 Minimum Test error found - save the configuration
: 95 | 12878.6 12005.5 0.00453587 0.000496944 198072 0
: 96 Minimum Test error found - save the configuration
: 96 | 12760.8 11896.1 0.00453853 0.000500774 198130 0
: 97 Minimum Test error found - save the configuration
: 97 | 12643.8 11786.3 0.00442072 0.000482233 203124 0
: 98 Minimum Test error found - save the configuration
: 98 | 12529.8 11676.7 0.00439404 0.000481163 204453 0
: 99 Minimum Test error found - save the configuration
: 99 | 12413.2 11570.8 0.00435676 0.000476643 206179 0
: 100 Minimum Test error found - save the configuration
: 100 | 12302.6 11462.4 0.00434572 0.000472993 206573 0
: 101 Minimum Test error found - save the configuration
: 101 | 12189 11358 0.00465465 0.000689325 201749 0
: 102 Minimum Test error found - save the configuration
: 102 | 12078.6 11253.9 0.00547822 0.000669805 166375 0
: 103 Minimum Test error found - save the configuration
: 103 | 11968 11151.4 0.00458577 0.000496423 195630 0
: 104 Minimum Test error found - save the configuration
: 104 | 11860.5 11048.2 0.00435214 0.000485633 206905 0
: 105 Minimum Test error found - save the configuration
: 105 | 11752.1 10947.1 0.00437574 0.000474074 205041 0
: 106 Minimum Test error found - save the configuration
: 106 | 11644.3 10848.3 0.00439484 0.000500934 205449 0
: 107 Minimum Test error found - save the configuration
: 107 | 11538.6 10750.3 0.0046178 0.000499862 194272 0
: 108 Minimum Test error found - save the configuration
: 108 | 11436.3 10649.5 0.00458811 0.000650445 203166 0
: 109 Minimum Test error found - save the configuration
: 109 | 11330.3 10553 0.00438716 0.000482873 204903 0
: 110 Minimum Test error found - save the configuration
: 110 | 11229.9 10453.8 0.00436704 0.000498373 206790 0
: 111 Minimum Test error found - save the configuration
: 111 | 11125.4 10359.1 0.00436453 0.000483942 206154 0
: 112 Minimum Test error found - save the configuration
: 112 | 11024.1 10265.8 0.00431943 0.000464693 207537 0
: 113 Minimum Test error found - save the configuration
: 113 | 10925.6 10170.9 0.00432528 0.000470793 207550 0
: 114 Minimum Test error found - save the configuration
: 114 | 10825.6 10078 0.00434018 0.000475352 206995 0
: 115 Minimum Test error found - save the configuration
: 115 | 10726.8 9986.69 0.00431723 0.000467313 207797 0
: 116 Minimum Test error found - save the configuration
: 116 | 10630.6 9894.17 0.00436144 0.000473433 205761 0
: 117 Minimum Test error found - save the configuration
: 117 | 10532.6 9804.86 0.00436182 0.000481064 206145 0
: 118 Minimum Test error found - save the configuration
: 118 | 10438.6 9713.77 0.00437788 0.000473343 204890 0
: 119 Minimum Test error found - save the configuration
: 119 | 10343.1 9624.37 0.00438871 0.000485793 204975 0
: 120 Minimum Test error found - save the configuration
: 120 | 10248.7 9536.38 0.00435238 0.000476233 206391 0
: 121 Minimum Test error found - save the configuration
: 121 | 10154.4 9451.1 0.00433709 0.000472532 207010 0
: 122 Minimum Test error found - save the configuration
: 122 | 10062.9 9365.07 0.00435701 0.000483923 206554 0
: 123 Minimum Test error found - save the configuration
: 123 | 9971.56 9279.52 0.00437997 0.000471214 204669 0
: 124 Minimum Test error found - save the configuration
: 124 | 9882.16 9192.59 0.0043808 0.000477213 204940 0
: 125 Minimum Test error found - save the configuration
: 125 | 9791.8 9107.39 0.0043472 0.000477203 206719 0
: 126 Minimum Test error found - save the configuration
: 126 | 9701.81 9024.04 0.00442013 0.000482163 203151 0
: 127 Minimum Test error found - save the configuration
: 127 | 9613.36 8941.66 0.00438736 0.000486133 205064 0
: 128 Minimum Test error found - save the configuration
: 128 | 9525.68 8860.33 0.00436884 0.000491222 206312 0
: 129 Minimum Test error found - save the configuration
: 129 | 9439.44 8778.96 0.00445201 0.000488564 201845 0
: 130 Minimum Test error found - save the configuration
: 130 | 9354.19 8697.2 0.00437471 0.000479633 205388 0
: 131 Minimum Test error found - save the configuration
: 131 | 9268.15 8617.4 0.00437892 0.000470442 204683 0
: 132 Minimum Test error found - save the configuration
: 132 | 9183.13 8539.26 0.00461431 0.000492033 194068 0
: 133 Minimum Test error found - save the configuration
: 133 | 9099.88 8461.11 0.0045863 0.000482364 194935 0
: 134 Minimum Test error found - save the configuration
: 134 | 9018.77 8381 0.00435141 0.000481133 206704 0
: 135 Minimum Test error found - save the configuration
: 135 | 8934.13 8305.13 0.00437935 0.000471192 204700 0
: 136 Minimum Test error found - save the configuration
: 136 | 8853.24 8228.96 0.00436249 0.000475383 205809 0
: 137 Minimum Test error found - save the configuration
: 137 | 8773.31 8152.27 0.00443941 0.000489234 202523 0
: 138 Minimum Test error found - save the configuration
: 138 | 8692.56 8077.37 0.00444549 0.000486923 202093 0
: 139 Minimum Test error found - save the configuration
: 139 | 8612.46 8004.27 0.00439698 0.000487095 204610 0
: 140 Minimum Test error found - save the configuration
: 140 | 8535.28 7929.64 0.00436159 0.000473273 205745 0
: 141 Minimum Test error found - save the configuration
: 141 | 8457.05 7856.42 0.00459706 0.000529194 196663 0
: 142 Minimum Test error found - save the configuration
: 142 | 8380.12 7783.16 0.00447999 0.000494093 200708 0
: 143 Minimum Test error found - save the configuration
: 143 | 8301.73 7713.31 0.00444404 0.000492173 202436 0
: 144 Minimum Test error found - save the configuration
: 144 | 8226.75 7642.81 0.00441303 0.000471613 202973 0
: 145 Minimum Test error found - save the configuration
: 145 | 8152.69 7571.25 0.00441388 0.000487843 203768 0
: 146 Minimum Test error found - save the configuration
: 146 | 8078.26 7500.07 0.00435824 0.000479883 206273 0
: 147 Minimum Test error found - save the configuration
: 147 | 8002.9 7431.74 0.00437644 0.000494764 206097 0
: 148 Minimum Test error found - save the configuration
: 148 | 7930.84 7362.17 0.00457802 0.000510774 196693 0
: 149 Minimum Test error found - save the configuration
: 149 | 7857.25 7294.86 0.00443258 0.000486033 202709 0
: 150 Minimum Test error found - save the configuration
: 150 | 7786.34 7226.63 0.00441364 0.000484324 203598 0
: 151 Minimum Test error found - save the configuration
: 151 | 7714.15 7160.34 0.00436228 0.000471913 205636 0
: 152 Minimum Test error found - save the configuration
: 152 | 7644 7093.96 0.00475965 0.000608275 192707 0
: 153 Minimum Test error found - save the configuration
: 153 | 7573.94 7028.24 0.00438437 0.000476453 204713 0
: 154 Minimum Test error found - save the configuration
: 154 | 7504.35 6963.32 0.004612 0.000511004 195075 0
: 155 Minimum Test error found - save the configuration
: 155 | 7435.08 6899.79 0.0044327 0.000481413 202466 0
: 156 Minimum Test error found - save the configuration
: 156 | 7367.77 6835.54 0.00443947 0.000481934 202146 0
: 157 Minimum Test error found - save the configuration
: 157 | 7299.85 6772.36 0.00436687 0.000470812 205336 0
: 158 Minimum Test error found - save the configuration
: 158 | 7233.42 6709.1 0.00440196 0.000490842 204545 0
: 159 Minimum Test error found - save the configuration
: 159 | 7166.49 6647.29 0.00436509 0.000481694 206005 0
: 160 Minimum Test error found - save the configuration
: 160 | 7100.21 6586.78 0.00438317 0.000495684 205789 0
: 161 Minimum Test error found - save the configuration
: 161 | 7036.62 6524.41 0.00439205 0.000482203 204612 0
: 162 Minimum Test error found - save the configuration
: 162 | 6971.45 6463.62 0.0043813 0.000476662 204885 0
: 163 Minimum Test error found - save the configuration
: 163 | 6907.65 6403.11 0.00463815 0.000487024 192719 0
: 164 Minimum Test error found - save the configuration
: 164 | 6843.28 6344.43 0.00498485 0.000553724 180541 0
: 165 Minimum Test error found - save the configuration
: 165 | 6780.22 6286.57 0.00438098 0.000471593 204636 0
: 166 Minimum Test error found - save the configuration
: 166 | 6719.47 6226.95 0.00447715 0.000509133 201612 0
: 167 Minimum Test error found - save the configuration
: 167 | 6656.29 6170.08 0.00437676 0.000471103 204831 0
: 168 Minimum Test error found - save the configuration
: 168 | 6595.71 6112.89 0.00438002 0.000476104 204922 0
: 169 Minimum Test error found - save the configuration
: 169 | 6534.98 6056.25 0.00445046 0.000484583 201721 0
: 170 Minimum Test error found - save the configuration
: 170 | 6475.76 5998.66 0.00444911 0.000482924 201705 0
: 171 Minimum Test error found - save the configuration
: 171 | 6415.01 5943.41 0.0044873 0.000490983 200184 0
: 172 Minimum Test error found - save the configuration
: 172 | 6356.2 5888.36 0.00485339 0.000500183 183772 0
: 173 Minimum Test error found - save the configuration
: 173 | 6297.69 5833.71 0.0044383 0.000489274 202582 0
: 174 Minimum Test error found - save the configuration
: 174 | 6239.64 5779.52 0.0044126 0.000489143 203902 0
: 175 Minimum Test error found - save the configuration
: 175 | 6182.86 5724.82 0.00441044 0.000494154 204275 0
: 176 Minimum Test error found - save the configuration
: 176 | 6124.29 5673.06 0.00444398 0.000483873 202015 0
: 177 Minimum Test error found - save the configuration
: 177 | 6068.69 5620.43 0.00462975 0.000495614 193511 0
: 178 Minimum Test error found - save the configuration
: 178 | 6012.98 5567.76 0.00441172 0.000488833 203931 0
: 179 Minimum Test error found - save the configuration
: 179 | 5957.72 5515.59 0.00440937 0.000484703 203839 0
: 180 Minimum Test error found - save the configuration
: 180 | 5902.85 5463.39 0.00442093 0.000489524 203490 0
: 181 Minimum Test error found - save the configuration
: 181 | 5847.52 5413.16 0.00469527 0.000509945 191144 0
: 182 Minimum Test error found - save the configuration
: 182 | 5794.56 5361.91 0.00443363 0.000482413 202469 0
: 183 Minimum Test error found - save the configuration
: 183 | 5740.89 5311.33 0.00442138 0.000487153 203344 0
: 184 Minimum Test error found - save the configuration
: 184 | 5687.67 5261.63 0.00442859 0.000496152 203436 0
: 185 Minimum Test error found - save the configuration
: 185 | 5634.81 5213 0.00441292 0.000482882 203560 0
: 186 Minimum Test error found - save the configuration
: 186 | 5582.4 5165.21 0.00470005 0.000486853 189880 0
: 187 Minimum Test error found - save the configuration
: 187 | 5531.98 5116.17 0.0046632 0.000554395 194704 0
: 188 Minimum Test error found - save the configuration
: 188 | 5479.92 5069.28 0.00448934 0.000499474 200508 0
: 189 Minimum Test error found - save the configuration
: 189 | 5429.93 5021.55 0.0044099 0.000482643 203705 0
: 190 Minimum Test error found - save the configuration
: 190 | 5380.22 4973.77 0.00460762 0.000494923 194520 0
: 191 Minimum Test error found - save the configuration
: 191 | 5329.96 4927.21 0.00451101 0.000474622 198197 0
: 192 Minimum Test error found - save the configuration
: 192 | 5280.58 4881.43 0.00442369 0.000504304 204114 0
: 193 Minimum Test error found - save the configuration
: 193 | 5231.19 4837.07 0.00441566 0.000478223 203178 0
: 194 Minimum Test error found - save the configuration
: 194 | 5183.69 4791.78 0.00449477 0.000518253 201181 0
: 195 Minimum Test error found - save the configuration
: 195 | 5135.45 4747.64 0.00446466 0.000481544 200848 0
: 196 Minimum Test error found - save the configuration
: 196 | 5088.75 4702.32 0.00458166 0.000500383 196017 0
: 197 Minimum Test error found - save the configuration
: 197 | 5041.04 4658.92 0.00456004 0.000483863 196262 0
: 198 Minimum Test error found - save the configuration
: 198 | 4995.18 4614.31 0.00458231 0.000495803 195766 0
: 199 Minimum Test error found - save the configuration
: 199 | 4948.04 4572.08 0.00441292 0.000478674 203343 0
: 200 Minimum Test error found - save the configuration
: 200 | 4902.81 4529.42 0.00442659 0.000489513 203196 0
: 201 Minimum Test error found - save the configuration
: 201 | 4857.9 4486.85 0.0044013 0.000479004 203962 0
: 202 Minimum Test error found - save the configuration
: 202 | 4813.02 4444.52 0.00441466 0.000481233 203385 0
: 203 Minimum Test error found - save the configuration
: 203 | 4768.22 4403.21 0.00451592 0.000486622 198546 0
: 204 Minimum Test error found - save the configuration
: 204 | 4725.05 4361.28 0.00447208 0.000494044 201104 0
: 205 Minimum Test error found - save the configuration
: 205 | 4679.96 4321.96 0.00453187 0.000485514 197709 0
: 206 Minimum Test error found - save the configuration
: 206 | 4637.6 4281.77 0.00468748 0.000505923 191316 0
: 207 Minimum Test error found - save the configuration
: 207 | 4595.01 4241.61 0.00455 0.000574662 201241 0
: 208 Minimum Test error found - save the configuration
: 208 | 4552.49 4202.29 0.00445283 0.000491883 201972 0
: 209 Minimum Test error found - save the configuration
: 209 | 4510.71 4163.1 0.00454775 0.000498263 197556 0
: 210 Minimum Test error found - save the configuration
: 210 | 4468.93 4124.49 0.00502618 0.000490174 176366 0
: 211 Minimum Test error found - save the configuration
: 211 | 4428.2 4085.65 0.00446927 0.000509703 202042 0
: 212 Minimum Test error found - save the configuration
: 212 | 4387.03 4047.9 0.00465753 0.000545294 194541 0
: 213 Minimum Test error found - save the configuration
: 213 | 4347.51 4009.42 0.0044778 0.000487974 200510 0
: 214 Minimum Test error found - save the configuration
: 214 | 4306.67 3972.3 0.00450854 0.000530443 201101 0
: 215 Minimum Test error found - save the configuration
: 215 | 4267.2 3935.31 0.00496603 0.000511124 179577 0
: 216 Minimum Test error found - save the configuration
: 216 | 4228.04 3898.76 0.00449014 0.000521774 201594 0
: 217 Minimum Test error found - save the configuration
: 217 | 4189.11 3862.82 0.00445273 0.000488752 201818 0
: 218 Minimum Test error found - save the configuration
: 218 | 4150.7 3827.1 0.00451951 0.000483902 198235 0
: 219 Minimum Test error found - save the configuration
: 219 | 4113.49 3790.82 0.00452276 0.000492134 198480 0
: 220 Minimum Test error found - save the configuration
: 220 | 4075.29 3754.71 0.00452711 0.000518974 199594 0
: 221 Minimum Test error found - save the configuration
: 221 | 4036.96 3721.16 0.00457762 0.000553093 198781 0
: 222 Minimum Test error found - save the configuration
: 222 | 4000.19 3687.5 0.00445852 0.000505904 202398 0
: 223 Minimum Test error found - save the configuration
: 223 | 3964.56 3651.98 0.00458752 0.000502503 195838 0
: 224 Minimum Test error found - save the configuration
: 224 | 3927.76 3617.82 0.00466915 0.000499423 191859 0
: 225 Minimum Test error found - save the configuration
: 225 | 3892 3583.64 0.00450547 0.000498323 199643 0
: 226 Minimum Test error found - save the configuration
: 226 | 3856.4 3549.92 0.00447174 0.000514413 202157 0
: 227 Minimum Test error found - save the configuration
: 227 | 3821.07 3516.64 0.00443799 0.000493984 202839 0
: 228 Minimum Test error found - save the configuration
: 228 | 3785.74 3484.15 0.00445501 0.000481003 201308 0
: 229 Minimum Test error found - save the configuration
: 229 | 3751.14 3451.98 0.00451323 0.000509443 199811 0
: 230 Minimum Test error found - save the configuration
: 230 | 3718.05 3418.84 0.00449946 0.000483973 199229 0
: 231 Minimum Test error found - save the configuration
: 231 | 3682.84 3387.93 0.00478897 0.000495423 186326 0
: 232 Minimum Test error found - save the configuration
: 232 | 3649.65 3356.41 0.00448201 0.000490973 200449 0
: 233 Minimum Test error found - save the configuration
: 233 | 3616.2 3325.6 0.00491119 0.000689644 189504 0
: 234 Minimum Test error found - save the configuration
: 234 | 3583.78 3294.15 0.00488437 0.000503834 182626 0
: 235 Minimum Test error found - save the configuration
: 235 | 3550.94 3263.61 0.00456682 0.000586244 200976 0
: 236 Minimum Test error found - save the configuration
: 236 | 3518.19 3233.71 0.00474667 0.000528834 189671 0
: 237 Minimum Test error found - save the configuration
: 237 | 3487.04 3203.04 0.0047091 0.000492724 189736 0
: 238 Minimum Test error found - save the configuration
: 238 | 3454.54 3173.61 0.00452217 0.000493674 198585 0
: 239 Minimum Test error found - save the configuration
: 239 | 3423.89 3143.38 0.00452282 0.000492804 198510 0
: 240 Minimum Test error found - save the configuration
: 240 | 3391.47 3115.34 0.00565622 0.000702084 161481 0
: 241 Minimum Test error found - save the configuration
: 241 | 3361.2 3087.12 0.00558057 0.000505704 157640 0
: 242 Minimum Test error found - save the configuration
: 242 | 3330.88 3058.02 0.00447717 0.000487873 200537 0
: 243 Minimum Test error found - save the configuration
: 243 | 3300.5 3029.94 0.00443749 0.000494854 202910 0
: 244 Minimum Test error found - save the configuration
: 244 | 3271.24 3000.67 0.00443348 0.000480063 202357 0
: 245 Minimum Test error found - save the configuration
: 245 | 3241.43 2971.86 0.00446053 0.000497144 201848 0
: 246 Minimum Test error found - save the configuration
: 246 | 3210.47 2945.4 0.00444026 0.000484683 202246 0
: 247 Minimum Test error found - save the configuration
: 247 | 3182.24 2918 0.00443425 0.000482543 202444 0
: 248 Minimum Test error found - save the configuration
: 248 | 3153.55 2890.69 0.00440454 0.000483174 204011 0
: 249 Minimum Test error found - save the configuration
: 249 | 3124.17 2864.25 0.00450779 0.000490523 199140 0
: 250 Minimum Test error found - save the configuration
: 250 | 3096.63 2837.32 0.00442198 0.000485604 203233 0
: 251 Minimum Test error found - save the configuration
: 251 | 3067.36 2811.76 0.00441322 0.000477952 203290 0
: 252 Minimum Test error found - save the configuration
: 252 | 3041.04 2784.32 0.00443661 0.000501843 203316 0
: 253 Minimum Test error found - save the configuration
: 253 | 3012.02 2759.34 0.00440807 0.000476284 203470 0
: 254 Minimum Test error found - save the configuration
: 254 | 2985.64 2733.22 0.0044698 0.000495144 201275 0
: 255 Minimum Test error found - save the configuration
: 255 | 2958.14 2707.7 0.00440963 0.000485263 203855 0
: 256 Minimum Test error found - save the configuration
: 256 | 2931.11 2682.92 0.0044483 0.000487733 201991 0
: 257 Minimum Test error found - save the configuration
: 257 | 2904.11 2659.14 0.00443124 0.000489533 202958 0
: 258 Minimum Test error found - save the configuration
: 258 | 2878.25 2634.57 0.00443066 0.000484613 202735 0
: 259 Minimum Test error found - save the configuration
: 259 | 2853.32 2608.95 0.00442846 0.000489102 203079 0
: 260 Minimum Test error found - save the configuration
: 260 | 2826.53 2585.04 0.00444799 0.000478034 201514 0
: 261 Minimum Test error found - save the configuration
: 261 | 2800.75 2561.27 0.00434083 0.000483734 207410 0
: 262 Minimum Test error found - save the configuration
: 262 | 2775.68 2537.43 0.00442106 0.000515603 204842 0
: 263 Minimum Test error found - save the configuration
: 263 | 2750.17 2514.24 0.00456915 0.000486102 195932 0
: 264 Minimum Test error found - save the configuration
: 264 | 2725.43 2490.9 0.00434638 0.000479784 206900 0
: 265 Minimum Test error found - save the configuration
: 265 | 2701.03 2467.52 0.00442587 0.000481332 202812 0
: 266 Minimum Test error found - save the configuration
: 266 | 2675.62 2445.74 0.00433462 0.000480733 207583 0
: 267 Minimum Test error found - save the configuration
: 267 | 2652.99 2422.34 0.00435489 0.000471643 206013 0
: 268 Minimum Test error found - save the configuration
: 268 | 2628.52 2399.78 0.00433522 0.000470812 207018 0
: 269 Minimum Test error found - save the configuration
: 269 | 2604.21 2377.71 0.00443192 0.000487945 202841 0
: 270 Minimum Test error found - save the configuration
: 270 | 2580.34 2356.27 0.00480963 0.000701015 194713 0
: 271 Minimum Test error found - save the configuration
: 271 | 2557.48 2334.23 0.00464986 0.000499853 192771 0
: 272 Minimum Test error found - save the configuration
: 272 | 2533.46 2313.73 0.00437454 0.000485463 205704 0
: 273 Minimum Test error found - save the configuration
: 273 | 2511.62 2291.55 0.00436833 0.000472283 205336 0
: 274 Minimum Test error found - save the configuration
: 274 | 2488.59 2270.11 0.00436487 0.000479203 205885 0
: 275 Minimum Test error found - save the configuration
: 275 | 2465.67 2249.57 0.00433539 0.000477482 207366 0
: 276 Minimum Test error found - save the configuration
: 276 | 2443.19 2228.76 0.00434436 0.000471443 206563 0
: 277 Minimum Test error found - save the configuration
: 277 | 2421.35 2208.13 0.00435013 0.000477883 206598 0
: 278 Minimum Test error found - save the configuration
: 278 | 2398.73 2188.55 0.00432206 0.000475823 207996 0
: 279 Minimum Test error found - save the configuration
: 279 | 2376.95 2168.89 0.00430802 0.000471133 208502 0
: 280 Minimum Test error found - save the configuration
: 280 | 2356.2 2148.24 0.00435057 0.000476643 206509 0
: 281 Minimum Test error found - save the configuration
: 281 | 2334.27 2128.49 0.00432005 0.000482554 208469 0
: 282 Minimum Test error found - save the configuration
: 282 | 2312.6 2109.79 0.0043488 0.000469323 206213 0
: 283 Minimum Test error found - save the configuration
: 283 | 2292.26 2089.68 0.0043149 0.000472123 208183 0
: 284 Minimum Test error found - save the configuration
: 284 | 2270.75 2071.02 0.00435001 0.000477013 206558 0
: 285 Minimum Test error found - save the configuration
: 285 | 2250.09 2051.6 0.00434163 0.000469473 206603 0
: 286 Minimum Test error found - save the configuration
: 286 | 2229.18 2033.06 0.00437108 0.000487823 206013 0
: 287 Minimum Test error found - save the configuration
: 287 | 2209.3 2014 0.00446336 0.000525083 203135 0
: 288 Minimum Test error found - save the configuration
: 288 | 2188.4 1995.96 0.00437955 0.000483204 205321 0
: 289 Minimum Test error found - save the configuration
: 289 | 2168.77 1977.26 0.00442479 0.000495344 203591 0
: 290 Minimum Test error found - save the configuration
: 290 | 2148.61 1959.17 0.0044298 0.000494544 203290 0
: 291 Minimum Test error found - save the configuration
: 291 | 2128.76 1941.37 0.00435206 0.000495144 207420 0
: 292 Minimum Test error found - save the configuration
: 292 | 2109.15 1923.71 0.0043405 0.000499003 208252 0
: 293 Minimum Test error found - save the configuration
: 293 | 2090.35 1905.34 0.00440525 0.000484383 204037 0
: 294 Minimum Test error found - save the configuration
: 294 | 2070.48 1887.89 0.00437853 0.000478832 205144 0
: 295 Minimum Test error found - save the configuration
: 295 | 2050.88 1871.43 0.00482517 0.000596304 189176 0
: 296 Minimum Test error found - save the configuration
: 296 | 2032.52 1853.85 0.00466169 0.000505763 192496 0
: 297 Minimum Test error found - save the configuration
: 297 | 2013.61 1836.79 0.00449383 0.000486203 199619 0
: 298 Minimum Test error found - save the configuration
: 298 | 1994.65 1820.34 0.00443812 0.000494864 202878 0
: 299 Minimum Test error found - save the configuration
: 299 | 1976.5 1803.58 0.00447412 0.000493453 200971 0
: 300 Minimum Test error found - save the configuration
: 300 | 1958.03 1786.87 0.00451175 0.000531403 200988 0
: 301 Minimum Test error found - save the configuration
: 301 | 1939.61 1770.95 0.00439883 0.000507734 205598 0
: 302 Minimum Test error found - save the configuration
: 302 | 1921.82 1754.5 0.00436639 0.000470023 205320 0
: 303 Minimum Test error found - save the configuration
: 303 | 1903.94 1738.71 0.00446481 0.000528823 203253 0
: 304 Minimum Test error found - save the configuration
: 304 | 1886.23 1722.25 0.0044016 0.000481492 204076 0
: 305 Minimum Test error found - save the configuration
: 305 | 1868.23 1707.1 0.00434254 0.000481403 207193 0
: 306 Minimum Test error found - save the configuration
: 306 | 1850.84 1691.4 0.00496541 0.000493073 178877 0
: 307 Minimum Test error found - save the configuration
: 307 | 1833.69 1675.91 0.00439053 0.000491683 205189 0
: 308 Minimum Test error found - save the configuration
: 308 | 1816.3 1660.58 0.0043657 0.000478933 205827 0
: 309 Minimum Test error found - save the configuration
: 309 | 1799.71 1645.33 0.00449579 0.000491043 199763 0
: 310 Minimum Test error found - save the configuration
: 310 | 1782.01 1631.21 0.00497198 0.000492844 178606 0
: 311 Minimum Test error found - save the configuration
: 311 | 1766.02 1616.22 0.00437657 0.000505913 206683 0
: 312 Minimum Test error found - save the configuration
: 312 | 1749.86 1600.24 0.00521516 0.000704234 177347 0
: 313 Minimum Test error found - save the configuration
: 313 | 1732.42 1586.3 0.00473957 0.000492643 188371 0
: 314 Minimum Test error found - save the configuration
: 314 | 1716.25 1571.97 0.00446244 0.000482993 201033 0
: 315 Minimum Test error found - save the configuration
: 315 | 1699.96 1557.04 0.00437171 0.000489693 206078 0
: 316 Minimum Test error found - save the configuration
: 316 | 1683.93 1542.51 0.00436245 0.000472452 205656 0
: 317 Minimum Test error found - save the configuration
: 317 | 1667.72 1528.9 0.00433554 0.000473782 207160 0
: 318 Minimum Test error found - save the configuration
: 318 | 1652.09 1515.02 0.00435874 0.000489192 206743 0
: 319 Minimum Test error found - save the configuration
: 319 | 1636.37 1500.7 0.00437391 0.000473653 205115 0
: 320 Minimum Test error found - save the configuration
: 320 | 1620.68 1486.97 0.0043268 0.000478564 207888 0
: 321 Minimum Test error found - save the configuration
: 321 | 1605.33 1473.36 0.00443438 0.000484104 202517 0
: 322 Minimum Test error found - save the configuration
: 322 | 1589.74 1460.17 0.00441409 0.000488115 203771 0
: 323 Minimum Test error found - save the configuration
: 323 | 1574.93 1446.75 0.0043749 0.000484274 205622 0
: 324 Minimum Test error found - save the configuration
: 324 | 1559.53 1434 0.00438036 0.000473033 204744 0
: 325 Minimum Test error found - save the configuration
: 325 | 1545.42 1419.97 0.00439924 0.000491102 204701 0
: 326 Minimum Test error found - save the configuration
: 326 | 1530.12 1407.01 0.0043298 0.000479033 207751 0
: 327 Minimum Test error found - save the configuration
: 327 | 1515.41 1394.26 0.00433037 0.000469143 207188 0
: 328 Minimum Test error found - save the configuration
: 328 | 1501.44 1381.23 0.00433243 0.000481483 207741 0
: 329 Minimum Test error found - save the configuration
: 329 | 1486.57 1368.73 0.0043679 0.000476154 205563 0
: 330 Minimum Test error found - save the configuration
: 330 | 1472.44 1355.68 0.00432043 0.000466164 207562 0
: 331 Minimum Test error found - save the configuration
: 331 | 1458.44 1342.79 0.0049731 0.000682904 186472 0
: 332 Minimum Test error found - save the configuration
: 332 | 1444.04 1330.4 0.00440346 0.000489023 204372 0
: 333 Minimum Test error found - save the configuration
: 333 | 1430.02 1318.54 0.0043641 0.000470993 205491 0
: 334 Minimum Test error found - save the configuration
: 334 | 1416.37 1306.45 0.00439474 0.000486904 204717 0
: 335 Minimum Test error found - save the configuration
: 335 | 1403.11 1293.89 0.0043814 0.000479903 205050 0
: 336 Minimum Test error found - save the configuration
: 336 | 1389.2 1282.18 0.00435198 0.000472793 206229 0
: 337 Minimum Test error found - save the configuration
: 337 | 1376.19 1270.5 0.00436075 0.000488862 206618 0
: 338 Minimum Test error found - save the configuration
: 338 | 1363.14 1257.83 0.00435001 0.000478923 206660 0
: 339 Minimum Test error found - save the configuration
: 339 | 1349.22 1246.99 0.00433204 0.000472834 207297 0
: 340 Minimum Test error found - save the configuration
: 340 | 1336.92 1234.93 0.0043588 0.000515454 208152 0
: 341 Minimum Test error found - save the configuration
: 341 | 1323.56 1223.74 0.00437965 0.000483404 205326 0
: 342 Minimum Test error found - save the configuration
: 342 | 1311.16 1212.07 0.00437284 0.000500843 206612 0
: 343 Minimum Test error found - save the configuration
: 343 | 1298.03 1201.26 0.00450235 0.000481772 198976 0
: 344 Minimum Test error found - save the configuration
: 344 | 1286.12 1189.38 0.00441347 0.000527523 205870 0
: 345 Minimum Test error found - save the configuration
: 345 | 1273.01 1179.09 0.00440745 0.000505204 205010 0
: 346 Minimum Test error found - save the configuration
: 346 | 1261.46 1167.95 0.00435591 0.000471253 205938 0
: 347 Minimum Test error found - save the configuration
: 347 | 1248.71 1157.2 0.0044313 0.000513643 204204 0
: 348 Minimum Test error found - save the configuration
: 348 | 1237.45 1145.85 0.00602941 0.000686506 149731 0
: 349 Minimum Test error found - save the configuration
: 349 | 1225.15 1135.3 0.00559446 0.000480593 156437 0
: 350 Minimum Test error found - save the configuration
: 350 | 1213.67 1123.79 0.00436171 0.000498542 207084 0
: 351 Minimum Test error found - save the configuration
: 351 | 1200.93 1114.07 0.00432642 0.000489633 208508 0
: 352 Minimum Test error found - save the configuration
: 352 | 1190.27 1104.64 0.00434655 0.000469554 206345 0
: 353 Minimum Test error found - save the configuration
: 353 | 1178.21 1093.52 0.00437819 0.000491373 205824 0
: 354 Minimum Test error found - save the configuration
: 354 | 1167.42 1082.66 0.00435666 0.000484443 206600 0
: 355 Minimum Test error found - save the configuration
: 355 | 1155.03 1073.28 0.00441766 0.000497404 204068 0
: 356 Minimum Test error found - save the configuration
: 356 | 1144.41 1063.58 0.00447321 0.000526844 202718 0
: 357 Minimum Test error found - save the configuration
: 357 | 1133.23 1053.09 0.0044695 0.000514013 202251 0
: 358 Minimum Test error found - save the configuration
: 358 | 1122.34 1042.29 0.00439333 0.000499554 205456 0
: 359 Minimum Test error found - save the configuration
: 359 | 1111.18 1032.44 0.004511 0.000507324 199816 0
: 360 Minimum Test error found - save the configuration
: 360 | 1100.17 1023.08 0.00448013 0.000486893 200339 0
: 361 Minimum Test error found - save the configuration
: 361 | 1089.73 1013.01 0.00576874 0.000726764 158668 0
: 362 Minimum Test error found - save the configuration
: 362 | 1078.92 1003.5 0.00450798 0.000475903 198409 0
: 363 Minimum Test error found - save the configuration
: 363 | 1068.31 994.369 0.00442964 0.000488604 202992 0
: 364 Minimum Test error found - save the configuration
: 364 | 1058.18 984.697 0.00439397 0.000478663 204326 0
: 365 Minimum Test error found - save the configuration
: 365 | 1047.69 975.147 0.00438288 0.000493533 205690 0
: 366 Minimum Test error found - save the configuration
: 366 | 1037.75 965.498 0.00439633 0.000485854 204579 0
: 367 Minimum Test error found - save the configuration
: 367 | 1027.26 956.614 0.00438636 0.000471763 204363 0
: 368 Minimum Test error found - save the configuration
: 368 | 1017.27 947.424 0.00435952 0.000481083 206269 0
: 369 Minimum Test error found - save the configuration
: 369 | 1007.16 938.664 0.00438907 0.000494353 205407 0
: 370 Minimum Test error found - save the configuration
: 370 | 997.583 929.556 0.00431028 0.000466923 208151 0
: 371 Minimum Test error found - save the configuration
: 371 | 988.068 921.041 0.00432716 0.000480453 207970 0
: 372 Minimum Test error found - save the configuration
: 372 | 978.322 911.472 0.00549099 0.000693465 166753 0
: 373 Minimum Test error found - save the configuration
: 373 | 968.355 902.911 0.00538986 0.000507313 163849 0
: 374 Minimum Test error found - save the configuration
: 374 | 959.177 893.856 0.00475259 0.000705914 197693 0
: 375 Minimum Test error found - save the configuration
: 375 | 949.35 885.816 0.00471134 0.000504073 190147 0
: 376 Minimum Test error found - save the configuration
: 376 | 940.229 877.21 0.00440334 0.000484293 204131 0
: 377 Minimum Test error found - save the configuration
: 377 | 930.973 868.843 0.00437435 0.000482594 205563 0
: 378 Minimum Test error found - save the configuration
: 378 | 921.776 860.071 0.00500814 0.000685475 185071 0
: 379 Minimum Test error found - save the configuration
: 379 | 912.957 851.518 0.00499935 0.000494443 177584 0
: 380 Minimum Test error found - save the configuration
: 380 | 903.598 843.301 0.00451398 0.000488033 198711 0
: 381 Minimum Test error found - save the configuration
: 381 | 894.958 835.046 0.00450005 0.000496163 199806 0
: 382 Minimum Test error found - save the configuration
: 382 | 885.969 827.576 0.0044362 0.000479392 202183 0
: 383 Minimum Test error found - save the configuration
: 383 | 877.234 818.693 0.00465279 0.000491143 192232 0
: 384 Minimum Test error found - save the configuration
: 384 | 868.389 810.793 0.0043744 0.000480003 205423 0
: 385 Minimum Test error found - save the configuration
: 385 | 859.773 803.244 0.00434663 0.000482833 207050 0
: 386 Minimum Test error found - save the configuration
: 386 | 851.585 795.103 0.00431744 0.000474423 208170 0
: 387 Minimum Test error found - save the configuration
: 387 | 842.767 787.16 0.00435581 0.000477454 206273 0
: 388 Minimum Test error found - save the configuration
: 388 | 834.022 780.142 0.00432988 0.000483064 207964 0
: 389 Minimum Test error found - save the configuration
: 389 | 826.375 772.117 0.00468346 0.000595274 195686 0
: 390 Minimum Test error found - save the configuration
: 390 | 818.071 764.954 0.00437379 0.000486703 205810 0
: 391 Minimum Test error found - save the configuration
: 391 | 809.726 756.824 0.00435698 0.000476144 206141 0
: 392 Minimum Test error found - save the configuration
: 392 | 801.513 749.477 0.00435963 0.000482924 206361 0
: 393 Minimum Test error found - save the configuration
: 393 | 793.618 742.07 0.00431407 0.000481964 208763 0
: 394 Minimum Test error found - save the configuration
: 394 | 785.676 734.673 0.00431406 0.000467543 207980 0
: 395 Minimum Test error found - save the configuration
: 395 | 778.16 727.616 0.00429802 0.000472243 209108 0
: 396 Minimum Test error found - save the configuration
: 396 | 770.594 719.594 0.00432948 0.000483344 208001 0
: 397 Minimum Test error found - save the configuration
: 397 | 762.026 713.009 0.00435238 0.000476144 206386 0
: 398 Minimum Test error found - save the configuration
: 398 | 754.687 705.88 0.00435728 0.000478804 206267 0
: 399 Minimum Test error found - save the configuration
: 399 | 747.286 698.334 0.00432139 0.000477094 208101 0
: 400 Minimum Test error found - save the configuration
: 400 | 739.524 691.648 0.00432997 0.000468673 207184 0
: 401 Minimum Test error found - save the configuration
: 401 | 732.144 684.868 0.00460892 0.000497702 194590 0
: 402 Minimum Test error found - save the configuration
: 402 | 725.019 677.833 0.00458774 0.000495813 195507 0
: 403 Minimum Test error found - save the configuration
: 403 | 717.833 670.891 0.00436755 0.000489033 206264 0
: 404 Minimum Test error found - save the configuration
: 404 | 710.473 663.691 0.00464084 0.000667944 201364 0
: 405 Minimum Test error found - save the configuration
: 405 | 703.134 657.751 0.00441682 0.000484764 203456 0
: 406 Minimum Test error found - save the configuration
: 406 | 696.148 650.664 0.00461028 0.000485483 193949 0
: 407 Minimum Test error found - save the configuration
: 407 | 688.897 643.943 0.00458821 0.000484433 194942 0
: 408 Minimum Test error found - save the configuration
: 408 | 682.3 637.632 0.00465901 0.000493604 192058 0
: 409 Minimum Test error found - save the configuration
: 409 | 674.982 630.914 0.00443875 0.000477072 201935 0
: 410 Minimum Test error found - save the configuration
: 410 | 668.508 624.2 0.00452783 0.000492073 198228 0
: 411 Minimum Test error found - save the configuration
: 411 | 661.428 617.713 0.00444083 0.000474133 201679 0
: 412 Minimum Test error found - save the configuration
: 412 | 654.617 611.545 0.00448078 0.000491084 200517 0
: 413 Minimum Test error found - save the configuration
: 413 | 648.08 605.404 0.00437227 0.000478063 205433 0
: 414 Minimum Test error found - save the configuration
: 414 | 641.907 599.042 0.00436147 0.000471523 205658 0
: 415 Minimum Test error found - save the configuration
: 415 | 635.006 592.913 0.00442215 0.000495574 203740 0
: 416 Minimum Test error found - save the configuration
: 416 | 628.41 587.053 0.00436231 0.000513744 207870 0
: 417 Minimum Test error found - save the configuration
: 417 | 622.097 580.456 0.00438336 0.000484083 205166 0
: 418 Minimum Test error found - save the configuration
: 418 | 615.713 575.328 0.00434153 0.000482233 207292 0
: 419 Minimum Test error found - save the configuration
: 419 | 609.354 569.029 0.00434266 0.000472533 206712 0
: 420 Minimum Test error found - save the configuration
: 420 | 603.133 562.914 0.0043776 0.000488803 205719 0
: 421 Minimum Test error found - save the configuration
: 421 | 596.951 557.401 0.00434877 0.000476874 206617 0
: 422 Minimum Test error found - save the configuration
: 422 | 590.999 551.383 0.00435293 0.000486835 206927 0
: 423 Minimum Test error found - save the configuration
: 423 | 584.985 545.66 0.00451602 0.000497514 199079 0
: 424 Minimum Test error found - save the configuration
: 424 | 578.625 539.673 0.0043403 0.000470143 206710 0
: 425 Minimum Test error found - save the configuration
: 425 | 572.897 534.428 0.00443871 0.000485894 202387 0
: 426 Minimum Test error found - save the configuration
: 426 | 567.03 528.536 0.00435661 0.000484662 206614 0
: 427 Minimum Test error found - save the configuration
: 427 | 560.811 523.198 0.00446242 0.000483183 201044 0
: 428 Minimum Test error found - save the configuration
: 428 | 555.367 517.406 0.00453517 0.000525544 199520 0
: 429 Minimum Test error found - save the configuration
: 429 | 549.726 512.353 0.00446438 0.000497404 201665 0
: 430 Minimum Test error found - save the configuration
: 430 | 543.942 507.07 0.00441197 0.000488203 203886 0
: 431 Minimum Test error found - save the configuration
: 431 | 538.61 501.735 0.00444014 0.000498223 202947 0
: 432 Minimum Test error found - save the configuration
: 432 | 533.011 495.84 0.00439216 0.000497093 205388 0
: 433 Minimum Test error found - save the configuration
: 433 | 526.989 490.597 0.00437233 0.000472823 205154 0
: 434 Minimum Test error found - save the configuration
: 434 | 521.784 485.143 0.00444708 0.000528694 204166 0
: 435 Minimum Test error found - save the configuration
: 435 | 516.247 480.252 0.0044294 0.000479344 202529 0
: 436 Minimum Test error found - save the configuration
: 436 | 510.997 475.33 0.00446412 0.000478003 200697 0
: 437 Minimum Test error found - save the configuration
: 437 | 505.759 470.387 0.00441588 0.000505923 204606 0
: 438 Minimum Test error found - save the configuration
: 438 | 500.531 464.863 0.00459056 0.000500774 195609 0
: 439 Minimum Test error found - save the configuration
: 439 | 495.135 460.386 0.00457921 0.000514264 196805 0
: 440 Minimum Test error found - save the configuration
: 440 | 490.332 454.828 0.00629053 0.000730255 143878 0
: 441 Minimum Test error found - save the configuration
: 441 | 485.038 451.118 0.00511818 0.000517093 173872 0
: 442 Minimum Test error found - save the configuration
: 442 | 479.91 445.405 0.00442365 0.000495054 203635 0
: 443 Minimum Test error found - save the configuration
: 443 | 474.844 440.61 0.00447188 0.000501273 201481 0
: 444 Minimum Test error found - save the configuration
: 444 | 469.826 436.383 0.00441999 0.000488813 203501 0
: 445 Minimum Test error found - save the configuration
: 445 | 465.482 430.967 0.00446404 0.000496704 201647 0
: 446 Minimum Test error found - save the configuration
: 446 | 460.243 426.257 0.0043794 0.000498053 206114 0
: 447 Minimum Test error found - save the configuration
: 447 | 455.223 422.127 0.00437835 0.000473682 204883 0
: 448 Minimum Test error found - save the configuration
: 448 | 450.57 417.453 0.00439145 0.000486312 204858 0
: 449 Minimum Test error found - save the configuration
: 449 | 446.052 412.73 0.0044886 0.000508073 200978 0
: 450 Minimum Test error found - save the configuration
: 450 | 441.05 408.143 0.00442038 0.000484654 203266 0
: 451 Minimum Test error found - save the configuration
: 451 | 436.694 403.828 0.00436592 0.000489533 206378 0
: 452 Minimum Test error found - save the configuration
: 452 | 432.25 399.955 0.00449054 0.000489334 199940 0
: 453 Minimum Test error found - save the configuration
: 453 | 427.608 394.727 0.00446813 0.000491543 201178 0
: 454 Minimum Test error found - save the configuration
: 454 | 423.001 390.709 0.00438525 0.000479334 204818 0
: 455 Minimum Test error found - save the configuration
: 455 | 418.905 386.684 0.00441291 0.000489953 203928 0
: 456 Minimum Test error found - save the configuration
: 456 | 414.183 382.623 0.00438863 0.000481403 204749 0
: 457 Minimum Test error found - save the configuration
: 457 | 410.213 377.554 0.00439748 0.000488064 204634 0
: 458 Minimum Test error found - save the configuration
: 458 | 405.557 373.71 0.00447787 0.000492063 200712 0
: 459 Minimum Test error found - save the configuration
: 459 | 401.064 369.542 0.00439429 0.000484504 204615 0
: 460 Minimum Test error found - save the configuration
: 460 | 397.146 365.624 0.00439482 0.000485213 204624 0
: 461 Minimum Test error found - save the configuration
: 461 | 392.689 361.542 0.00439872 0.000473143 203792 0
: 462 Minimum Test error found - save the configuration
: 462 | 389.049 357.425 0.00443448 0.000528634 204821 0
: 463 Minimum Test error found - save the configuration
: 463 | 384.6 353.705 0.00444645 0.000487244 202061 0
: 464 Minimum Test error found - save the configuration
: 464 | 380.57 350.412 0.00441979 0.000481824 203151 0
: 465 Minimum Test error found - save the configuration
: 465 | 376.43 345.447 0.0044236 0.000499093 203847 0
: 466 Minimum Test error found - save the configuration
: 466 | 372.374 342.125 0.00454719 0.000486964 197033 0
: 467 Minimum Test error found - save the configuration
: 467 | 368.471 338.188 0.00447936 0.000489423 200504 0
: 468 Minimum Test error found - save the configuration
: 468 | 364.474 334.248 0.00445216 0.000484703 201640 0
: 469 Minimum Test error found - save the configuration
: 469 | 360.895 330.587 0.00439661 0.000487513 204651 0
: 470 Minimum Test error found - save the configuration
: 470 | 356.793 326.475 0.00446151 0.000515324 202727 0
: 471 Minimum Test error found - save the configuration
: 471 | 353.045 323.033 0.00436406 0.000483323 206146 0
: 472 Minimum Test error found - save the configuration
: 472 | 349.2 319.477 0.00441003 0.000480924 203609 0
: 473 Minimum Test error found - save the configuration
: 473 | 345.577 315.73 0.00441003 0.000483423 203738 0
: 474 Minimum Test error found - save the configuration
: 474 | 341.896 312.161 0.00484014 0.000688815 192709 0
: 475 Minimum Test error found - save the configuration
: 475 | 338.021 308.695 0.00484905 0.000496743 183810 0
: 476 Minimum Test error found - save the configuration
: 476 | 334.619 305.482 0.00487129 0.000497044 182889 0
: 477 Minimum Test error found - save the configuration
: 477 | 330.796 302.121 0.00438761 0.000486762 205084 0
: 478 Minimum Test error found - save the configuration
: 478 | 327.323 298.382 0.00457813 0.000490343 195705 0
: 479 Minimum Test error found - save the configuration
: 479 | 323.921 295.132 0.00468312 0.000590475 195473 0
: 480 Minimum Test error found - save the configuration
: 480 | 320.528 291.329 0.00461731 0.000486363 193660 0
: 481 Minimum Test error found - save the configuration
: 481 | 316.78 288.106 0.00438089 0.000481004 205134 0
: 482 Minimum Test error found - save the configuration
: 482 | 313.513 284.821 0.00439836 0.000484753 204415 0
: 483 Minimum Test error found - save the configuration
: 483 | 310.122 281.982 0.00444611 0.000489224 202179 0
: 484 Minimum Test error found - save the configuration
: 484 | 306.64 278.581 0.00472733 0.000579644 192879 0
: 485 Minimum Test error found - save the configuration
: 485 | 303.534 275.183 0.00436363 0.000483345 206170 0
: 486 Minimum Test error found - save the configuration
: 486 | 300.171 271.937 0.00456351 0.000514604 197584 0
: 487 Minimum Test error found - save the configuration
: 487 | 296.918 268.633 0.00439405 0.000489143 204870 0
: 488 Minimum Test error found - save the configuration
: 488 | 293.757 265.836 0.00434959 0.000469983 206207 0
: 489 Minimum Test error found - save the configuration
: 489 | 290.604 263.439 0.00435788 0.000477503 206166 0
: 490 Minimum Test error found - save the configuration
: 490 | 287.37 260.415 0.00442402 0.000484543 203073 0
: 491 Minimum Test error found - save the configuration
: 491 | 284.254 257.207 0.00442633 0.000488863 203176 0
: 492 Minimum Test error found - save the configuration
: 492 | 280.962 254.288 0.00449707 0.000485393 199418 0
: 493 Minimum Test error found - save the configuration
: 493 | 278.226 250.976 0.00437121 0.000485753 205896 0
: 494 Minimum Test error found - save the configuration
: 494 | 275.028 248.038 0.00450295 0.000500322 199869 0
: 495 Minimum Test error found - save the configuration
: 495 | 271.971 245.277 0.00437143 0.000476873 205415 0
: 496 Minimum Test error found - save the configuration
: 496 | 269.109 242.203 0.00432481 0.000473683 207732 0
: 497 Minimum Test error found - save the configuration
: 497 | 266.241 239.345 0.00445746 0.000488693 201574 0
: 498 Minimum Test error found - save the configuration
: 498 | 263.251 236.738 0.00435201 0.000472143 206193 0
: 499 Minimum Test error found - save the configuration
: 499 | 260.062 234.07 0.00431654 0.000479003 208467 0
: 500 Minimum Test error found - save the configuration
: 500 | 257.687 231.671 0.004334 0.000490543 208146 0
: 501 Minimum Test error found - save the configuration
: 501 | 254.835 228.799 0.00436713 0.000470933 205328 0
: 502 Minimum Test error found - save the configuration
: 502 | 251.791 225.949 0.00438739 0.000491273 205333 0
: 503 Minimum Test error found - save the configuration
: 503 | 249.198 223.277 0.00436634 0.000488383 206294 0
: 504 Minimum Test error found - save the configuration
: 504 | 246.438 221.013 0.00439269 0.000475933 204251 0
: 505 Minimum Test error found - save the configuration
: 505 | 243.593 218.083 0.00439683 0.000486494 204586 0
: 506 Minimum Test error found - save the configuration
: 506 | 240.823 216.066 0.00437999 0.000475423 204888 0
: 507 Minimum Test error found - save the configuration
: 507 | 238.314 212.966 0.00437524 0.000485943 205693 0
: 508 Minimum Test error found - save the configuration
: 508 | 235.689 210.957 0.00439257 0.000483793 204668 0
: 509 Minimum Test error found - save the configuration
: 509 | 233.171 208.283 0.0044504 0.000512604 203159 0
: 510 Minimum Test error found - save the configuration
: 510 | 230.719 206.381 0.00440196 0.000479703 203964 0
: 511 Minimum Test error found - save the configuration
: 511 | 228.307 204.189 0.00438859 0.000475994 204468 0
: 512 Minimum Test error found - save the configuration
: 512 | 225.745 201.64 0.00437824 0.000490884 205795 0
: 513 Minimum Test error found - save the configuration
: 513 | 223.01 199.217 0.0044381 0.000523593 204368 0
: 514 Minimum Test error found - save the configuration
: 514 | 220.296 197.894 0.00443104 0.000497934 203402 0
: 515 Minimum Test error found - save the configuration
: 515 | 218.137 194.721 0.00440464 0.000476403 203654 0
: 516 Minimum Test error found - save the configuration
: 516 | 215.686 192.034 0.00436767 0.000472253 205370 0
: 517 Minimum Test error found - save the configuration
: 517 | 213.41 189.835 0.00444099 0.000493203 202645 0
: 518 Minimum Test error found - save the configuration
: 518 | 211.067 188.114 0.00439854 0.000475843 203941 0
: 519 Minimum Test error found - save the configuration
: 519 | 208.475 185.484 0.00439897 0.000485254 204409 0
: 520 Minimum Test error found - save the configuration
: 520 | 206.103 183.908 0.004372 0.000484474 205786 0
: 521 Minimum Test error found - save the configuration
: 521 | 204.008 182.083 0.00438249 0.000474863 204728 0
: 522 Minimum Test error found - save the configuration
: 522 | 201.807 178.996 0.00435762 0.000480463 206337 0
: 523 Minimum Test error found - save the configuration
: 523 | 199.46 177.821 0.00438253 0.000478414 204912 0
: 524 Minimum Test error found - save the configuration
: 524 | 197.189 175.079 0.00437319 0.000476983 205328 0
: 525 Minimum Test error found - save the configuration
: 525 | 195.077 172.835 0.00435592 0.000476043 206192 0
: 526 Minimum Test error found - save the configuration
: 526 | 193.166 172.159 0.00435764 0.000474194 206003 0
: 527 Minimum Test error found - save the configuration
: 527 | 190.945 169.443 0.00438985 0.000483493 204794 0
: 528 Minimum Test error found - save the configuration
: 528 | 188.642 167.048 0.00436223 0.000473443 205720 0
: 529 Minimum Test error found - save the configuration
: 529 | 186.678 165.435 0.00435757 0.000480723 206353 0
: 530 Minimum Test error found - save the configuration
: 530 | 184.345 162.756 0.00434993 0.000486644 207078 0
: 531 Minimum Test error found - save the configuration
: 531 | 182.285 161.314 0.00434919 0.000465003 205963 0
: 532 Minimum Test error found - save the configuration
: 532 | 180.275 159.626 0.00439335 0.000488184 204857 0
: 533 Minimum Test error found - save the configuration
: 533 | 178.046 157.002 0.00437669 0.000483943 205510 0
: 534 Minimum Test error found - save the configuration
: 534 | 176.294 156.536 0.00449674 0.000483732 199352 0
: 535 Minimum Test error found - save the configuration
: 535 | 174.102 154.596 0.00441518 0.000492894 203963 0
: 536 Minimum Test error found - save the configuration
: 536 | 172.278 151.955 0.00436919 0.000465723 204946 0
: 537 Minimum Test error found - save the configuration
: 537 | 169.935 150.652 0.00435382 0.000476914 206350 0
: 538 Minimum Test error found - save the configuration
: 538 | 168.186 148.102 0.00438223 0.000484304 205237 0
: 539 Minimum Test error found - save the configuration
: 539 | 166.231 147.891 0.00461927 0.000493844 193919 0
: 540 Minimum Test error found - save the configuration
: 540 | 164.495 144.798 0.00443535 0.000490543 202798 0
: 541 Minimum Test error found - save the configuration
: 541 | 162.272 143.308 0.0043533 0.000479373 206509 0
: 542 Minimum Test error found - save the configuration
: 542 | 160.413 142.635 0.0043739 0.000481364 205522 0
: 543 Minimum Test error found - save the configuration
: 543 | 158.619 140.285 0.00436307 0.000475503 205784 0
: 544 Minimum Test error found - save the configuration
: 544 | 156.772 138.379 0.00438269 0.000484983 205249 0
: 545 Minimum Test error found - save the configuration
: 545 | 154.907 136.972 0.00436623 0.000477494 205722 0
: 546 Minimum Test error found - save the configuration
: 546 | 153.12 135.279 0.0043586 0.000471544 205811 0
: 547 Minimum Test error found - save the configuration
: 547 | 151.343 133.689 0.00434314 0.000479173 207041 0
: 548 Minimum Test error found - save the configuration
: 548 | 149.717 132.358 0.00436017 0.000474093 205863 0
: 549 Minimum Test error found - save the configuration
: 549 | 147.766 130.501 0.00436506 0.000467153 205238 0
: 550 Minimum Test error found - save the configuration
: 550 | 146.091 129.77 0.00436182 0.000490673 206657 0
: 551 Minimum Test error found - save the configuration
: 551 | 144.317 128.165 0.00437009 0.000477272 205507 0
: 552 Minimum Test error found - save the configuration
: 552 | 142.574 126.749 0.00437217 0.000474694 205261 0
: 553 Minimum Test error found - save the configuration
: 553 | 141 124.625 0.00435556 0.000481252 206489 0
: 554 | 139.453 124.788 0.00445032 0.000564983 205902 1
: 555 Minimum Test error found - save the configuration
: 555 | 137.878 123.795 0.00454659 0.000480742 196761 0
: 556 Minimum Test error found - save the configuration
: 556 | 136.455 120.695 0.00429997 0.000465582 208638 0
: 557 Minimum Test error found - save the configuration
: 557 | 134.463 118.801 0.00431529 0.000470382 208068 0
: 558 Minimum Test error found - save the configuration
: 558 | 132.841 117.125 0.00430947 0.000478033 208799 0
: 559 Minimum Test error found - save the configuration
: 559 | 131.457 117.003 0.00454442 0.000477572 196713 0
: 560 Minimum Test error found - save the configuration
: 560 | 130.12 114.605 0.00433056 0.000481062 207819 0
: 561 Minimum Test error found - save the configuration
: 561 | 128.385 114.134 0.00434177 0.000475603 206923 0
: 562 Minimum Test error found - save the configuration
: 562 | 126.835 111.52 0.0043283 0.000475813 207658 0
: 563 Minimum Test error found - save the configuration
: 563 | 125.202 110.938 0.0043511 0.000485453 206951 0
: 564 Minimum Test error found - save the configuration
: 564 | 123.805 109.292 0.00441134 0.000520724 205623 0
: 565 Minimum Test error found - save the configuration
: 565 | 122.148 108.261 0.00454686 0.000639434 204738 0
: 566 Minimum Test error found - save the configuration
: 566 | 120.918 108.059 0.0044729 0.000487433 200729 0
: 567 Minimum Test error found - save the configuration
: 567 | 119.579 106.086 0.00432365 0.000471293 207665 0
: 568 Minimum Test error found - save the configuration
: 568 | 118.079 105.133 0.0043113 0.000473773 208468 0
: 569 Minimum Test error found - save the configuration
: 569 | 116.595 104.388 0.00431019 0.000468283 208230 0
: 570 Minimum Test error found - save the configuration
: 570 | 115.195 102.395 0.0043309 0.000477783 207624 0
: 571 Minimum Test error found - save the configuration
: 571 | 113.837 101.06 0.0046104 0.000471343 193281 0
: 572 Minimum Test error found - save the configuration
: 572 | 112.379 99.785 0.00431901 0.000474214 208074 0
: 573 Minimum Test error found - save the configuration
: 573 | 111.3 98.361 0.0054795 0.000586724 163506 0
: 574 Minimum Test error found - save the configuration
: 574 | 109.643 96.823 0.00471067 0.000523102 191042 0
: 575 Minimum Test error found - save the configuration
: 575 | 108.254 96.0125 0.00473485 0.000505504 189154 0
: 576 Minimum Test error found - save the configuration
: 576 | 107.164 94.7027 0.00496777 0.000501793 179132 0
: 577 Minimum Test error found - save the configuration
: 577 | 105.848 93.8621 0.00438709 0.000486113 205077 0
: 578 Minimum Test error found - save the configuration
: 578 | 104.579 92.6349 0.0044375 0.000499232 203135 0
: 579 Minimum Test error found - save the configuration
: 579 | 103.217 91.313 0.00442445 0.000495933 203639 0
: 580 Minimum Test error found - save the configuration
: 580 | 101.905 90.7056 0.00449766 0.000483943 199317 0
: 581 Minimum Test error found - save the configuration
: 581 | 100.97 89.2484 0.00442903 0.000507434 203999 0
: 582 Minimum Test error found - save the configuration
: 582 | 100.176 88.113 0.00442162 0.000490003 203479 0
: 583 Minimum Test error found - save the configuration
: 583 | 98.5602 86.6633 0.0043892 0.000476994 204488 0
: 584 Minimum Test error found - save the configuration
: 584 | 97.5038 85.6634 0.00435546 0.000489544 206937 0
: 585 Minimum Test error found - save the configuration
: 585 | 96.2547 85.3087 0.00435673 0.000468723 205761 0
: 586 Minimum Test error found - save the configuration
: 586 | 95.1966 84.0027 0.0043556 0.000477192 206270 0
: 587 Minimum Test error found - save the configuration
: 587 | 93.7633 82.9594 0.00436782 0.000483483 205955 0
: 588 Minimum Test error found - save the configuration
: 588 | 92.6021 82.0911 0.0043524 0.000467213 205910 0
: 589 Minimum Test error found - save the configuration
: 589 | 91.5331 81.2204 0.00437208 0.000481633 205632 0
: 590 Minimum Test error found - save the configuration
: 590 | 90.6773 80.4829 0.00436181 0.000484945 206352 0
: 591 Minimum Test error found - save the configuration
: 591 | 89.4303 78.4752 0.00438577 0.000487354 205212 0
: 592 Minimum Test error found - save the configuration
: 592 | 88.3251 77.7698 0.00447937 0.000485604 200312 0
: 593 Minimum Test error found - save the configuration
: 593 | 87.2033 76.3431 0.00438693 0.000482323 204886 0
: 594 Minimum Test error found - save the configuration
: 594 | 86.2905 75.2441 0.00441 0.000488923 204026 0
: 595 Minimum Test error found - save the configuration
: 595 | 85.0851 74.3928 0.00433577 0.000477302 207336 0
: 596 Minimum Test error found - save the configuration
: 596 | 84.1475 73.7248 0.00433596 0.000485223 207753 0
: 597 Minimum Test error found - save the configuration
: 597 | 83.157 73.0749 0.00432765 0.000485814 208234 0
: 598 Minimum Test error found - save the configuration
: 598 | 82.1166 72.0252 0.00476595 0.000516384 188254 0
: 599 Minimum Test error found - save the configuration
: 599 | 81.37 71.6961 0.00454322 0.000478204 196801 0
: 600 Minimum Test error found - save the configuration
: 600 | 80.361 69.8141 0.00437969 0.000482523 205277 0
: 601 Minimum Test error found - save the configuration
: 601 | 79.7809 69.0124 0.0043456 0.000488833 207428 0
: 602 Minimum Test error found - save the configuration
: 602 | 78.7578 68.8907 0.00434049 0.000468043 206588 0
: 603 Minimum Test error found - save the configuration
: 603 | 77.4915 67.2605 0.00435158 0.000472193 206218 0
: 604 Minimum Test error found - save the configuration
: 604 | 76.4966 66.4503 0.00436663 0.000483353 206012 0
: 605 Minimum Test error found - save the configuration
: 605 | 75.5019 65.6249 0.00438368 0.000467303 204270 0
: 606 Minimum Test error found - save the configuration
: 606 | 74.5906 65.1874 0.00440063 0.000507593 205495 0
: 607 Minimum Test error found - save the configuration
: 607 | 73.8847 64.171 0.00437469 0.000485913 205720 0
: 608 Minimum Test error found - save the configuration
: 608 | 73.0307 64.0693 0.00443488 0.000479223 202242 0
: 609 Minimum Test error found - save the configuration
: 609 | 72.4425 62.5749 0.0043644 0.000480903 206000 0
: 610 Minimum Test error found - save the configuration
: 610 | 71.2709 61.0845 0.00445509 0.000481584 201334 0
: 611 | 70.4354 61.1687 0.00436436 0.000460823 204942 1
: 612 Minimum Test error found - save the configuration
: 612 | 69.4844 59.3287 0.00440523 0.000491233 204395 0
: 613 Minimum Test error found - save the configuration
: 613 | 68.5361 59.0552 0.00438874 0.000479614 204649 0
: 614 Minimum Test error found - save the configuration
: 614 | 67.7429 58.3162 0.00432679 0.000478223 207870 0
: 615 Minimum Test error found - save the configuration
: 615 | 66.909 57.1645 0.00461168 0.000497364 194443 0
: 616 Minimum Test error found - save the configuration
: 616 | 66.1673 56.8975 0.00438564 0.000482043 204939 0
: 617 Minimum Test error found - save the configuration
: 617 | 65.4106 55.8094 0.00438604 0.000472424 204415 0
: 618 Minimum Test error found - save the configuration
: 618 | 64.898 55.1469 0.00435827 0.000482714 206422 0
: 619 Minimum Test error found - save the configuration
: 619 | 63.8086 54.4553 0.00439119 0.000483483 204724 0
: 620 Minimum Test error found - save the configuration
: 620 | 62.9951 54.0215 0.00439262 0.000476803 204300 0
: 621 Minimum Test error found - save the configuration
: 621 | 62.2393 52.8867 0.00440351 0.000498013 204839 0
: 622 Minimum Test error found - save the configuration
: 622 | 61.4433 52.7613 0.00440887 0.000473203 203269 0
: 623 Minimum Test error found - save the configuration
: 623 | 60.8386 51.7012 0.00444806 0.000508284 203057 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.9835 51.3014 0.00441917 0.000480413 203110 0
: 625 Minimum Test error found - save the configuration
: 625 | 59.2041 50.3115 0.00443161 0.000482974 202602 0
: 626 Minimum Test error found - save the configuration
: 626 | 58.5828 49.781 0.00443568 0.000490973 202803 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.8828 48.7947 0.00438419 0.000484293 205134 0
: 628 Minimum Test error found - save the configuration
: 628 | 57.1346 47.9711 0.00456006 0.000489724 196544 0
: 629 Minimum Test error found - save the configuration
: 629 | 56.3672 46.8826 0.00438298 0.000481193 205034 0
: 630 Minimum Test error found - save the configuration
: 630 | 55.7503 46.7525 0.00439552 0.000487663 204716 0
: 631 Minimum Test error found - save the configuration
: 631 | 55.1092 45.6895 0.00443959 0.000480274 202055 0
: 632 Minimum Test error found - save the configuration
: 632 | 54.7501 44.9599 0.004484 0.000561104 203931 0
: 633 | 54.0052 45.9761 0.0043524 0.000452664 205142 1
: 634 Minimum Test error found - save the configuration
: 634 | 53.3388 44.6294 0.00448217 0.000512683 201537 0
: 635 Minimum Test error found - save the configuration
: 635 | 52.6266 43.6374 0.00445992 0.000483963 201209 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.841 43.2715 0.00444982 0.000497295 202402 0
: 637 Minimum Test error found - save the configuration
: 637 | 51.2394 42.1248 0.00441306 0.000490344 203940 0
: 638 Minimum Test error found - save the configuration
: 638 | 50.6245 41.9891 0.00436764 0.000474883 205510 0
: 639 Minimum Test error found - save the configuration
: 639 | 49.9822 41.2296 0.00440535 0.000508714 205305 0
: 640 Minimum Test error found - save the configuration
: 640 | 49.3248 40.71 0.00440233 0.000497932 204897 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.7888 40.1233 0.00438837 0.000479472 204661 0
: 642 Minimum Test error found - save the configuration
: 642 | 48.067 39.1433 0.00441832 0.000490284 203664 0
: 643 Minimum Test error found - save the configuration
: 643 | 47.6063 39.0739 0.00437107 0.000475233 205347 0
: 644 Minimum Test error found - save the configuration
: 644 | 46.968 38.5664 0.00446401 0.000490274 201322 0
: 645 Minimum Test error found - save the configuration
: 645 | 46.4319 38.4387 0.00440695 0.000485653 204014 0
: 646 Minimum Test error found - save the configuration
: 646 | 45.9136 37.5737 0.00446639 0.000493674 201374 0
: 647 Minimum Test error found - save the configuration
: 647 | 45.5154 36.8838 0.00441326 0.000484163 203609 0
: 648 Minimum Test error found - save the configuration
: 648 | 44.7977 36.0794 0.00440656 0.000486573 204082 0
: 649 Minimum Test error found - save the configuration
: 649 | 44.2114 35.6575 0.00444071 0.000483923 202184 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.6521 35.4027 0.0044385 0.000490054 202611 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.2287 34.5827 0.00440713 0.000494163 204448 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.6989 33.8796 0.0043641 0.000470693 205476 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.2467 33.8735 0.00456084 0.000543982 199161 0
: 654 Minimum Test error found - save the configuration
: 654 | 41.7233 32.9158 0.00439158 0.000472304 204119 0
: 655 | 41.2211 33.4393 0.0045151 0.000496774 199088 1
: 656 Minimum Test error found - save the configuration
: 656 | 40.8653 32.867 0.00439345 0.000489732 204933 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.2179 32.2287 0.00438787 0.000486213 205041 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.9258 31.207 0.00450366 0.000501233 199879 0
: 659 | 39.2021 31.278 0.00433495 0.000448872 205863 1
: 660 Minimum Test error found - save the configuration
: 660 | 38.726 30.6551 0.00446378 0.000495334 201590 0
: 661 | 38.1626 30.9946 0.00438072 0.000444372 203234 1
: 662 Minimum Test error found - save the configuration
: 662 | 37.9019 29.4613 0.00445323 0.000491494 201932 0
: 663 Minimum Test error found - save the configuration
: 663 | 37.3226 28.9683 0.00435459 0.000475983 206260 0
: 664 Minimum Test error found - save the configuration
: 664 | 36.8696 28.473 0.00441259 0.000511503 205071 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.3181 28.409 0.00441852 0.000483934 203325 0
: 666 Minimum Test error found - save the configuration
: 666 | 35.9399 27.7365 0.00442141 0.000480253 202986 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.5876 27.5924 0.00445896 0.000498203 201982 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.1579 26.6472 0.0044388 0.000475413 201848 0
: 669 Minimum Test error found - save the configuration
: 669 | 34.7428 26.3489 0.00447995 0.000493963 200703 0
: 670 | 34.2933 26.6392 0.004353 0.000450452 204994 1
: 671 Minimum Test error found - save the configuration
: 671 | 34.069 26.0684 0.00445684 0.000494923 201923 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.5384 25.4663 0.00440811 0.000503024 204861 0
: 673 Minimum Test error found - save the configuration
: 673 | 33.0803 24.5739 0.00433778 0.000469674 206820 0
: 674 Minimum Test error found - save the configuration
: 674 | 32.6791 24.5308 0.00443208 0.000489772 202927 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.2983 24.3769 0.00432378 0.000469664 207570 0
: 676 Minimum Test error found - save the configuration
: 676 | 31.8755 24.2904 0.00448029 0.000489693 200471 0
: 677 Minimum Test error found - save the configuration
: 677 | 31.7181 23.2947 0.00435577 0.000477482 206277 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.0001 22.7376 0.00444782 0.000501613 202726 0
: 679 | 30.6354 22.9019 0.00433467 0.000464934 206732 1
: 680 Minimum Test error found - save the configuration
: 680 | 30.2607 21.7216 0.00440943 0.000493183 204277 0
: 681 | 30.0482 22.2078 0.00437074 0.000443794 203721 1
: 682 Minimum Test error found - save the configuration
: 682 | 29.6479 21.568 0.0043482 0.000477334 206672 0
: 683 Minimum Test error found - save the configuration
: 683 | 29.2349 21.5223 0.00550928 0.000706305 166564 0
: 684 Minimum Test error found - save the configuration
: 684 | 28.6877 20.6367 0.00612408 0.000696755 147402 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.2607 20.5238 0.00447052 0.000486184 200786 0
: 686 Minimum Test error found - save the configuration
: 686 | 27.9202 19.8724 0.00437877 0.000482713 205336 0
: 687 Minimum Test error found - save the configuration
: 687 | 27.5633 19.6822 0.00437641 0.000506653 206731 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.1824 19.4014 0.00437163 0.000472753 205187 0
: 689 Minimum Test error found - save the configuration
: 689 | 26.8655 19.0552 0.00433499 0.000473693 207184 0
: 690 | 26.5293 19.075 0.00436992 0.000446514 203904 1
: 691 Minimum Test error found - save the configuration
: 691 | 26.2895 18.8367 0.00431361 0.000468143 208037 0
: 692 | 26.1258 18.9941 0.00433364 0.000449693 205976 1
: 693 Minimum Test error found - save the configuration
: 693 | 25.7428 18.0211 0.00434908 0.000478844 206706 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.3803 17.7605 0.00438436 0.000474274 204599 0
: 695 Minimum Test error found - save the configuration
: 695 | 24.9828 17.5625 0.00434516 0.000500024 208055 0
: 696 Minimum Test error found - save the configuration
: 696 | 24.5853 17.1837 0.0043705 0.000481603 205714 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.1703 16.7438 0.00435369 0.000480293 206537 0
: 698 Minimum Test error found - save the configuration
: 698 | 23.9371 16.6605 0.00437096 0.000497133 206514 0
: 699 Minimum Test error found - save the configuration
: 699 | 23.6458 16.5906 0.00435481 0.000469374 205897 0
: 700 Minimum Test error found - save the configuration
: 700 | 23.4325 16.3893 0.00441287 0.000485342 203691 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.0704 16.2604 0.00444675 0.000499144 202654 0
: 702 Minimum Test error found - save the configuration
: 702 | 22.9462 15.3554 0.00435189 0.000476204 206415 0
: 703 | 22.6807 15.7922 0.0043834 0.000456613 203729 1
: 704 Minimum Test error found - save the configuration
: 704 | 22.1608 14.8208 0.00433215 0.000471163 207201 0
: 705 Minimum Test error found - save the configuration
: 705 | 21.7761 14.6065 0.00441437 0.000481223 203399 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.489 14.2788 0.00437234 0.000476674 205356 0
: 707 Minimum Test error found - save the configuration
: 707 | 21.1203 14.1219 0.00433592 0.000466883 206770 0
: 708 Minimum Test error found - save the configuration
: 708 | 20.9292 13.9986 0.00437031 0.000483343 205816 0
: 709 Minimum Test error found - save the configuration
: 709 | 21.1007 13.9786 0.00434312 0.000478393 207000 0
: 710 Minimum Test error found - save the configuration
: 710 | 20.6076 13.5706 0.00470954 0.000498494 189977 0
: 711 Minimum Test error found - save the configuration
: 711 | 20.1967 13.348 0.00445599 0.000480333 201225 0
: 712 | 19.9669 13.6294 0.00458232 0.000472963 194678 1
: 713 Minimum Test error found - save the configuration
: 713 | 19.6036 13.1662 0.00446313 0.000478243 200759 0
: 714 Minimum Test error found - save the configuration
: 714 | 19.3208 12.7198 0.00444136 0.000511312 203560 0
: 715 Minimum Test error found - save the configuration
: 715 | 19.0037 12.6919 0.00445828 0.000487894 201492 0
: 716 Minimum Test error found - save the configuration
: 716 | 18.7805 12.6434 0.00444354 0.000501113 202921 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.5664 11.8449 0.00444534 0.000526744 204155 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.2235 11.7851 0.00440878 0.000479963 203624 0
: 719 | 18.081 11.9144 0.00447101 0.000447763 198844 1
: 720 Minimum Test error found - save the configuration
: 720 | 17.9584 11.7733 0.00443132 0.000488432 202897 0
: 721 Minimum Test error found - save the configuration
: 721 | 17.5187 11.1644 0.00456943 0.000500154 196595 0
: 722 | 17.3709 11.3285 0.00443135 0.000459092 201397 1
: 723 Minimum Test error found - save the configuration
: 723 | 17.1012 10.5406 0.00437753 0.000481974 205362 0
: 724 | 16.9231 10.9401 0.0043434 0.000440914 204998 1
: 725 | 16.7611 10.633 0.00441922 0.000458513 201984 2
: 726 Minimum Test error found - save the configuration
: 726 | 16.4903 10.1243 0.00442447 0.000488624 203260 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.0369 10.0112 0.0043614 0.000476203 205910 0
: 728 Minimum Test error found - save the configuration
: 728 | 15.8518 9.81652 0.00458535 0.000498213 195736 0
: 729 | 15.6709 9.92566 0.0043641 0.000447843 204277 1
: 730 Minimum Test error found - save the configuration
: 730 | 15.4529 9.55384 0.00439513 0.000508774 205848 0
: 731 | 15.2432 9.60855 0.00436823 0.000437243 203511 1
: 732 Minimum Test error found - save the configuration
: 732 | 15.0637 8.82217 0.00441357 0.000485583 203667 0
: 733 | 15.1752 9.87768 0.00439275 0.000462864 203568 1
: 734 | 15.0155 9.10065 0.00440084 0.000445053 202235 2
: 735 | 14.6098 9.11833 0.00440029 0.000470493 203573 3
: 736 Minimum Test error found - save the configuration
: 736 | 14.3014 8.45004 0.00448319 0.000523492 202036 0
: 737 | 14.0229 8.68187 0.00441834 0.000459534 202081 1
: 738 | 13.994 8.72458 0.00433662 0.000440782 205347 2
: 739 Minimum Test error found - save the configuration
: 739 | 13.9247 8.20291 0.00435054 0.000476332 206494 0
: 740 Minimum Test error found - save the configuration
: 740 | 13.7005 7.75369 0.00440032 0.000484683 204309 0
: 741 | 13.7035 7.80307 0.00435161 0.000440543 204548 1
: 742 Minimum Test error found - save the configuration
: 742 | 13.3861 7.60149 0.00445908 0.000527754 203494 0
: 743 | 13.3333 8.42948 0.00435812 0.000442033 204286 1
: 744 Minimum Test error found - save the configuration
: 744 | 12.7814 7.17751 0.00437161 0.000483083 205733 0
: 745 Minimum Test error found - save the configuration
: 745 | 12.6433 7.14619 0.00465443 0.000500772 192601 0
: 746 Minimum Test error found - save the configuration
: 746 | 12.4649 6.74004 0.00446262 0.000522054 203017 0
: 747 | 12.2619 6.89004 0.00438853 0.000465753 203937 1
: 748 | 12.3205 7.43244 0.00467419 0.000534754 193263 2
: 749 | 12.1684 6.97319 0.0044299 0.000441313 200572 3
: 750 Minimum Test error found - save the configuration
: 750 | 11.8207 6.37094 0.0044967 0.000502052 200268 0
: 751 | 11.6341 6.74691 0.00455315 0.000442373 194610 1
: 752 | 11.4084 6.40442 0.00450886 0.000457202 197450 2
: 753 Minimum Test error found - save the configuration
: 753 | 11.2978 6.21307 0.00437303 0.000475033 205234 0
: 754 Minimum Test error found - save the configuration
: 754 | 11.2618 5.95645 0.00443641 0.000497182 203086 0
: 755 | 11.0083 6.13427 0.00433896 0.000447503 205579 1
: 756 | 10.8278 6.01801 0.00451179 0.000565504 202722 2
: 757 | 10.7378 6.04463 0.00451783 0.000440633 196213 3
: 758 Minimum Test error found - save the configuration
: 758 | 10.5988 5.44516 0.00445141 0.000486053 201747 0
: 759 Minimum Test error found - save the configuration
: 759 | 10.6247 5.38095 0.00434867 0.000477783 206671 0
: 760 Minimum Test error found - save the configuration
: 760 | 10.3916 5.32083 0.00439307 0.000480093 204448 0
: 761 | 10.2716 5.32725 0.0043282 0.000451752 206375 1
: 762 Minimum Test error found - save the configuration
: 762 | 10.0601 4.94075 0.00432697 0.000473422 207601 0
: 763 Minimum Test error found - save the configuration
: 763 | 9.79476 4.86203 0.00432382 0.000469702 207570 0
: 764 Minimum Test error found - save the configuration
: 764 | 9.65674 4.67725 0.00434514 0.000480693 207015 0
: 765 | 9.68028 4.91701 0.00431296 0.000448672 207024 1
: 766 | 9.51826 5.00728 0.0043908 0.000448882 202947 2
: 767 Minimum Test error found - save the configuration
: 767 | 9.33466 4.48865 0.00435326 0.000492914 207235 0
: 768 | 9.24083 5.42389 0.0043299 0.000439793 205650 1
: 769 Minimum Test error found - save the configuration
: 769 | 9.15681 4.08812 0.00436964 0.000499413 206706 0
: 770 | 9.06833 4.49509 0.00435355 0.000445683 204715 1
: 771 | 8.8797 4.13326 0.00433003 0.000439963 205652 2
: 772 | 8.74551 4.14555 0.0043132 0.000444172 206770 3
: 773 Minimum Test error found - save the configuration
: 773 | 8.7242 3.854 0.00435619 0.000476702 206213 0
: 774 Minimum Test error found - save the configuration
: 774 | 8.61038 3.84693 0.00431676 0.000470732 208007 0
: 775 | 8.43505 4.06265 0.00432151 0.000466013 207496 1
: 776 | 8.51871 3.85473 0.00435361 0.000445482 204702 2
: 777 Minimum Test error found - save the configuration
: 777 | 8.22621 3.44487 0.0043404 0.000470982 206749 0
: 778 | 8.10029 3.64076 0.00430779 0.000442763 206984 1
: 779 | 8.16649 3.79947 0.00433489 0.000446793 205756 2
: 780 | 8.09045 3.95785 0.00430497 0.000439723 206973 3
: 781 Minimum Test error found - save the configuration
: 781 | 7.80237 3.14901 0.00444569 0.000491513 202318 0
: 782 | 7.68253 3.36995 0.00430297 0.000447863 207517 1
: 783 Minimum Test error found - save the configuration
: 783 | 7.66285 3.11026 0.00441756 0.000491073 203745 0
: 784 | 7.52718 3.23632 0.00431597 0.000453212 207106 1
: 785 | 7.37502 3.11598 0.00433361 0.000439683 205448 2
: 786 | 7.46765 3.28211 0.00432589 0.000446413 206213 3
: 787 | 7.41251 3.12582 0.0043195 0.000455223 207025 4
: 788 Minimum Test error found - save the configuration
: 788 | 7.1538 2.93661 0.00434962 0.000469833 206197 0
: 789 | 7.10203 3.28584 0.0043529 0.000444353 204680 1
: 790 Minimum Test error found - save the configuration
: 790 | 7.01032 2.49749 0.00454866 0.000492414 197227 0
: 791 | 6.99775 3.29891 0.00428642 0.000437574 207855 1
: 792 | 6.86078 2.60015 0.00428668 0.000448203 208416 2
: 793 | 6.72387 2.64183 0.00433669 0.000446953 205669 3
: 794 | 6.57582 2.68062 0.00431014 0.000436673 206533 4
: 795 | 6.49821 2.56018 0.00430601 0.000448513 207388 5
: 796 Minimum Test error found - save the configuration
: 796 | 6.51639 2.38389 0.00436245 0.000479582 206033 0
: 797 | 6.62026 3.29709 0.00430168 0.000437093 207008 1
: 798 Minimum Test error found - save the configuration
: 798 | 6.37991 2.18326 0.00445317 0.000493263 202025 0
: 799 | 6.32719 3.05296 0.00429642 0.000436394 207252 1
: 800 | 6.2646 3.0436 0.00434127 0.000444963 205323 2
: 801 | 6.00095 2.30767 0.00430703 0.000452493 207548 3
: 802 | 6.19551 3.08361 0.00430982 0.000437323 206585 4
: 803 | 5.94659 2.7693 0.00430203 0.000442173 207262 5
: 804 | 5.9743 3.1171 0.00431291 0.000450264 207112 6
: 805 | 5.93409 2.73429 0.00434246 0.000448513 205447 7
: 806 | 5.83772 2.90583 0.00430243 0.000443554 207314 8
: 807 | 5.64776 2.59756 0.00431301 0.000460893 207678 9
: 808 | 5.55351 2.4624 0.00429258 0.000442753 207802 10
: 809 | 5.46447 2.67766 0.00433489 0.000445183 205671 11
: 810 | 5.45494 2.51497 0.00432326 0.000456113 206871 12
: 811 | 5.31493 2.20309 0.00431429 0.000443993 206703 13
: 812 | 5.16773 2.35762 0.00437912 0.000444342 203315 14
: 813 | 5.17476 2.2933 0.00430323 0.000449594 207596 15
: 814 | 5.17825 2.20702 0.00430285 0.000444905 207364 16
: 815 | 5.28617 2.93965 0.0042825 0.000436852 208027 17
: 816 | 5.2606 2.51178 0.00437036 0.000466094 204904 18
: 817 | 5.02067 2.60237 0.00430428 0.000444923 207289 19
: 818 | 4.86889 2.92423 0.00431645 0.000442823 206525 20
: 819 | 4.9765 3.29811 0.00430158 0.000450983 207760 21
:
: Elapsed time for training with 1000 events: 3.63 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00596 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.841 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.166 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.30791e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.08338e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0395 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0377 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00137 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0499 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.924 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0223 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00352 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0362 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.0042 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00185 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00039 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0496 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00591 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.906 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.103 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.640 0.258 6.09 1.60 | 3.219 3.219
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.0644 0.313 2.33 1.11 | 3.365 3.353
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.