Logo ROOT  
Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example:

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.263 sec
: Elapsed time for training with 1000 events: 0.267 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0026 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000782 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00416 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000304 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000335 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31507.4
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33059.5 31150 0.00432285 0.000584301 213987 0
: 2 Minimum Test error found - save the configuration
: 2 | 32579 30587.3 0.00425306 0.00046889 211407 0
: 3 Minimum Test error found - save the configuration
: 3 | 31858.4 29879.9 0.0045264 0.00053237 200299 0
: 4 Minimum Test error found - save the configuration
: 4 | 31084.5 29207.4 0.00466693 0.00048905 191485 0
: 5 Minimum Test error found - save the configuration
: 5 | 30307.4 28465.6 0.0045714 0.000506382 196801 0
: 6 Minimum Test error found - save the configuration
: 6 | 29492.4 27551.8 0.00450823 0.00055354 202292 0
: 7 Minimum Test error found - save the configuration
: 7 | 28770 26957.7 0.00434134 0.000477581 207052 0
: 8 Minimum Test error found - save the configuration
: 8 | 28312.4 26578.4 0.00433707 0.000452612 205949 0
: 9 Minimum Test error found - save the configuration
: 9 | 27956.5 26251.8 0.00429218 0.000445461 207970 0
: 10 Minimum Test error found - save the configuration
: 10 | 27633.2 25951.3 0.00431936 0.000460611 207321 0
: 11 Minimum Test error found - save the configuration
: 11 | 27327.3 25670.8 0.00420997 0.00047176 214006 0
: 12 Minimum Test error found - save the configuration
: 12 | 27041 25398.2 0.00428628 0.000443851 208202 0
: 13 Minimum Test error found - save the configuration
: 13 | 26760.8 25137.7 0.00428091 0.00049172 211127 0
: 14 Minimum Test error found - save the configuration
: 14 | 26490.5 24885.5 0.00415352 0.000452311 216146 0
: 15 Minimum Test error found - save the configuration
: 15 | 26231.3 24635.4 0.00425066 0.000455691 210806 0
: 16 Minimum Test error found - save the configuration
: 16 | 25973.2 24394.1 0.00423085 0.000521182 215653 0
: 17 Minimum Test error found - save the configuration
: 17 | 25724.3 24155.7 0.00417416 0.000441061 214299 0
: 18 Minimum Test error found - save the configuration
: 18 | 25476.4 23925.1 0.0042526 0.000456681 210753 0
: 19 Minimum Test error found - save the configuration
: 19 | 25238.6 23694.5 0.00422726 0.000530021 216378 0
: 20 Minimum Test error found - save the configuration
: 20 | 24998.3 23472.7 0.00418576 0.000441571 213665 0
: 21 Minimum Test error found - save the configuration
: 21 | 24767.6 23250.8 0.00424244 0.000439461 210362 0
: 22 Minimum Test error found - save the configuration
: 22 | 24537.7 23033.3 0.00427513 0.000456131 209479 0
: 23 Minimum Test error found - save the configuration
: 23 | 24312.1 22818.6 0.00415752 0.000462071 216483 0
: 24 Minimum Test error found - save the configuration
: 24 | 24087.7 22609 0.00424578 0.000458089 211211 0
: 25 Minimum Test error found - save the configuration
: 25 | 23867.9 22402.2 0.00426989 0.000441551 208968 0
: 26 Minimum Test error found - save the configuration
: 26 | 23653.6 22194.2 0.00426322 0.00054306 215045 0
: 27 Minimum Test error found - save the configuration
: 27 | 23436.3 21993.7 0.00419289 0.000455941 214079 0
: 28 Minimum Test error found - save the configuration
: 28 | 23227.8 21791.1 0.00426389 0.00044409 209435 0
: 29 Minimum Test error found - save the configuration
: 29 | 23017.1 21593.9 0.00428584 0.00044188 208119 0
: 30 Minimum Test error found - save the configuration
: 30 | 22810.8 21398.9 0.00430056 0.000474691 209103 0
: 31 Minimum Test error found - save the configuration
: 31 | 22606.5 21206.5 0.00426967 0.00045891 209932 0
: 32 Minimum Test error found - save the configuration
: 32 | 22405 21016 0.004295 0.000442371 207651 0
: 33 Minimum Test error found - save the configuration
: 33 | 22206.1 20827.1 0.00426391 0.000516982 213508 0
: 34 Minimum Test error found - save the configuration
: 34 | 22009.2 20640 0.00431958 0.000466171 207609 0
: 35 Minimum Test error found - save the configuration
: 35 | 21813.9 20455.4 0.00428799 0.000444461 208142 0
: 36 Minimum Test error found - save the configuration
: 36 | 21622.4 20271 0.00432864 0.000478951 207809 0
: 37 Minimum Test error found - save the configuration
: 37 | 21428.5 20093.4 0.00422689 0.000456342 212171 0
: 38 Minimum Test error found - save the configuration
: 38 | 21241.2 19915.6 0.00428356 0.000457562 209096 0
: 39 Minimum Test error found - save the configuration
: 39 | 21055.3 19738.5 0.00430788 0.000443532 207021 0
: 40 Minimum Test error found - save the configuration
: 40 | 20868.8 19565.9 0.00421017 0.000448771 212687 0
: 41 Minimum Test error found - save the configuration
: 41 | 20687.5 19392.8 0.00430499 0.000458241 207968 0
: 42 Minimum Test error found - save the configuration
: 42 | 20506.2 19222.3 0.00429176 0.000447241 208089 0
: 43 Minimum Test error found - save the configuration
: 43 | 20327.4 19053.3 0.0043231 0.00053495 211185 0
: 44 Minimum Test error found - save the configuration
: 44 | 20150.7 18885.4 0.00423163 0.00046154 212197 0
: 45 Minimum Test error found - save the configuration
: 45 | 19974.5 18720.6 0.00431718 0.00044764 206743 0
: 46 Minimum Test error found - save the configuration
: 46 | 19801.2 18557.1 0.00431184 0.000446661 206976 0
: 47 Minimum Test error found - save the configuration
: 47 | 19628.3 18397 0.00424358 0.00047459 212259 0
: 48 Minimum Test error found - save the configuration
: 48 | 19460.7 18235.3 0.00424036 0.00044981 211051 0
: 49 Minimum Test error found - save the configuration
: 49 | 19289 18080 0.00422829 0.000435371 210920 0
: 50 Minimum Test error found - save the configuration
: 50 | 19127.5 17919.1 0.00422735 0.00049834 214534 0
: 51 Minimum Test error found - save the configuration
: 51 | 18955.7 17769.9 0.00416792 0.000433831 214243 0
: 52 Minimum Test error found - save the configuration
: 52 | 18796.9 17615.1 0.00426678 0.000475692 211021 0
: 53 Minimum Test error found - save the configuration
: 53 | 18635 17461.7 0.00417237 0.000448841 214850 0
: 54 Minimum Test error found - save the configuration
: 54 | 18473.1 17311.5 0.00424269 0.00043563 210136 0
: 55 Minimum Test error found - save the configuration
: 55 | 18314.5 17158.4 0.00428024 0.00051614 212534 0
: 56 Minimum Test error found - save the configuration
: 56 | 18149.1 17003.5 0.00420402 0.000458871 213610 0
: 57 Minimum Test error found - save the configuration
: 57 | 18001.1 16857.8 0.00434502 0.000463241 206091 0
: 58 Minimum Test error found - save the configuration
: 58 | 17836.7 16715.4 0.00428913 0.00046154 209009 0
: 59 Minimum Test error found - save the configuration
: 59 | 17681.3 16563.5 0.00424539 0.000457961 211225 0
: 60 Minimum Test error found - save the configuration
: 60 | 17521.2 16408.8 0.00434252 0.000469981 206583 0
: 61 Minimum Test error found - save the configuration
: 61 | 17367.3 16265.3 0.00431383 0.00044793 206938 0
: 62 Minimum Test error found - save the configuration
: 62 | 17213.6 16123.1 0.00428275 0.000467091 209663 0
: 63 Minimum Test error found - save the configuration
: 63 | 17060.2 15965.3 0.00433088 0.000473161 207377 0
: 64 Minimum Test error found - save the configuration
: 64 | 16910.7 15823.6 0.00433905 0.00047126 206837 0
: 65 Minimum Test error found - save the configuration
: 65 | 16758.5 15678.5 0.00427477 0.00045696 209544 0
: 66 Minimum Test error found - save the configuration
: 66 | 16606.3 15529.2 0.00436514 0.00047897 205858 0
: 67 Minimum Test error found - save the configuration
: 67 | 16454.6 15388.4 0.00442165 0.000490942 203526 0
: 68 Minimum Test error found - save the configuration
: 68 | 16306.5 15247.5 0.00431247 0.000468672 208128 0
: 69 Minimum Test error found - save the configuration
: 69 | 16161.6 15105.2 0.00439786 0.00046196 203257 0
: 70 Minimum Test error found - save the configuration
: 70 | 16014.4 14968.2 0.00438666 0.00051135 206435 0
: 71 Minimum Test error found - save the configuration
: 71 | 15869.6 14831.9 0.00434262 0.000485581 207413 0
: 72 Minimum Test error found - save the configuration
: 72 | 15727.8 14696.1 0.00438878 0.000459942 203623 0
: 73 Minimum Test error found - save the configuration
: 73 | 15586.8 14561.3 0.00439768 0.000473121 203845 0
: 74 Minimum Test error found - save the configuration
: 74 | 15443.6 14427.7 0.00437318 0.00050436 206782 0
: 75 Minimum Test error found - save the configuration
: 75 | 15308 14292.1 0.00438553 0.000461341 203864 0
: 76 Minimum Test error found - save the configuration
: 76 | 15164.5 14164.6 0.00444433 0.000477132 201654 0
: 77 Minimum Test error found - save the configuration
: 77 | 15030 14033.5 0.00439734 0.00049394 204950 0
: 78 Minimum Test error found - save the configuration
: 78 | 14892.1 13905.9 0.00438378 0.000483571 205117 0
: 79 Minimum Test error found - save the configuration
: 79 | 14758.7 13778.3 0.00442043 0.00046413 202209 0
: 80 Minimum Test error found - save the configuration
: 80 | 14624.5 13652.7 0.00442314 0.000465261 202129 0
: 81 Minimum Test error found - save the configuration
: 81 | 14493.2 13527.5 0.004447 0.000483931 201864 0
: 82 Minimum Test error found - save the configuration
: 82 | 14362.3 13403.5 0.00442095 0.000531291 205674 0
: 83 Minimum Test error found - save the configuration
: 83 | 14231.8 13282.6 0.00439305 0.000479661 204427 0
: 84 Minimum Test error found - save the configuration
: 84 | 14103.2 13163.1 0.00441073 0.000462571 202626 0
: 85 Minimum Test error found - save the configuration
: 85 | 13977 13042.6 0.00446422 0.00048092 200839 0
: 86 Minimum Test error found - save the configuration
: 86 | 13852.9 12921.5 0.00445794 0.00054638 204522 0
: 87 Minimum Test error found - save the configuration
: 87 | 13727.1 12802.8 0.00436477 0.0004636 205067 0
: 88 Minimum Test error found - save the configuration
: 88 | 13600.6 12688.9 0.00444585 0.00047911 201677 0
: 89 Minimum Test error found - save the configuration
: 89 | 13479.7 12574.3 0.00452049 0.00046775 197398 0
: 90 Minimum Test error found - save the configuration
: 90 | 13358.9 12459.7 0.00452323 0.000472661 197503 0
: 91 Minimum Test error found - save the configuration
: 91 | 13238.7 12345.9 0.00425593 0.000456891 210580 0
: 92 Minimum Test error found - save the configuration
: 92 | 13118.7 12234.2 0.00426072 0.00046702 210876 0
: 93 Minimum Test error found - save the configuration
: 93 | 13000.9 12123.1 0.00425342 0.00047616 211793 0
: 94 Minimum Test error found - save the configuration
: 94 | 12883.1 12013.7 0.00425374 0.00046136 210950 0
: 95 Minimum Test error found - save the configuration
: 95 | 12768.3 11903.8 0.00426427 0.00046322 210468 0
: 96 Minimum Test error found - save the configuration
: 96 | 12653.4 11794.5 0.00439801 0.00048664 204532 0
: 97 Minimum Test error found - save the configuration
: 97 | 12537.9 11688.4 0.00447116 0.0004992 201412 0
: 98 Minimum Test error found - save the configuration
: 98 | 12426.1 11581.8 0.00437768 0.000477951 205143 0
: 99 Minimum Test error found - save the configuration
: 99 | 12313.7 11475.7 0.00444457 0.000464081 200980 0
: 100 Minimum Test error found - save the configuration
: 100 | 12202.2 11371.3 0.00443974 0.00046342 201191 0
: 101 Minimum Test error found - save the configuration
: 101 | 12091.8 11268.5 0.00447731 0.00055993 204218 0
: 102 Minimum Test error found - save the configuration
: 102 | 11982.3 11167.4 0.00436132 0.000466092 205380 0
: 103 Minimum Test error found - save the configuration
: 103 | 11876.3 11063.6 0.00448895 0.000497591 200433 0
: 104 Minimum Test error found - save the configuration
: 104 | 11766.7 10964.5 0.00444532 0.00054606 205167 0
: 105 Minimum Test error found - save the configuration
: 105 | 11661.5 10864.3 0.00441943 0.00048988 203586 0
: 106 Minimum Test error found - save the configuration
: 106 | 11555.5 10766.2 0.00447617 0.00046368 199378 0
: 107 Minimum Test error found - save the configuration
: 107 | 11453.6 10665.5 0.00446252 0.000537002 203795 0
: 108 Minimum Test error found - save the configuration
: 108 | 11346.8 10570.4 0.00437944 0.000468661 204563 0
: 109 Minimum Test error found - save the configuration
: 109 | 11246.7 10472.5 0.00445321 0.00047374 201032 0
: 110 Minimum Test error found - save the configuration
: 110 | 11142.1 10380 0.00444447 0.00053829 204804 0
: 111 Minimum Test error found - save the configuration
: 111 | 11043.9 10284 0.0043686 0.000461921 204778 0
: 112 Minimum Test error found - save the configuration
: 112 | 10943.8 10189.3 0.00448296 0.00049194 200450 0
: 113 Minimum Test error found - save the configuration
: 113 | 10844.1 10096.7 0.00443641 0.00046643 201513 0
: 114 Minimum Test error found - save the configuration
: 114 | 10746.1 10004.5 0.00449499 0.000564811 203553 0
: 115 Minimum Test error found - save the configuration
: 115 | 10649.5 9912.2 0.00438914 0.0004658 203908 0
: 116 Minimum Test error found - save the configuration
: 116 | 10551.3 9823.24 0.00449514 0.0004922 199853 0
: 117 Minimum Test error found - save the configuration
: 117 | 10456 9734.79 0.00448643 0.000469991 199182 0
: 118 Minimum Test error found - save the configuration
: 118 | 10362.5 9645.15 0.00446504 0.000561091 204921 0
: 119 Minimum Test error found - save the configuration
: 119 | 10268.3 9556.73 0.0044184 0.00046964 202595 0
: 120 Minimum Test error found - save the configuration
: 120 | 10175.6 9468.47 0.0044633 0.000486131 201148 0
: 121 Minimum Test error found - save the configuration
: 121 | 10081.9 9383.09 0.00447939 0.00048146 200104 0
: 122 Minimum Test error found - save the configuration
: 122 | 9990.67 9298.5 0.00446155 0.000546151 204322 0
: 123 Minimum Test error found - save the configuration
: 123 | 9902.65 9210.44 0.00441386 0.000482741 203505 0
: 124 Minimum Test error found - save the configuration
: 124 | 9809.68 9127.88 0.00453094 0.000468322 196917 0
: 125 Minimum Test error found - save the configuration
: 125 | 9722.01 9043.95 0.0045373 0.00047204 196790 0
: 126 Minimum Test error found - save the configuration
: 126 | 9633.73 8960.8 0.00452474 0.000563962 201981 0
: 127 Minimum Test error found - save the configuration
: 127 | 9544.75 8880.59 0.00455611 0.000472781 195919 0
: 128 Minimum Test error found - save the configuration
: 128 | 9460.17 8797.76 0.00459321 0.000509521 195901 0
: 129 Minimum Test error found - save the configuration
: 129 | 9372.5 8718.26 0.00451819 0.00046983 197611 0
: 130 Minimum Test error found - save the configuration
: 130 | 9289.26 8636.32 0.00453378 0.000501061 198378 0
: 131 Minimum Test error found - save the configuration
: 131 | 9202.86 8558.12 0.00451954 0.000552291 201651 0
: 132 Minimum Test error found - save the configuration
: 132 | 9118.9 8480.9 0.00444314 0.00048285 202006 0
: 133 Minimum Test error found - save the configuration
: 133 | 9037.07 8402.4 0.00452465 0.0004665 197134 0
: 134 Minimum Test error found - save the configuration
: 134 | 8954.8 8324.68 0.00455239 0.000487412 196803 0
: 135 Minimum Test error found - save the configuration
: 135 | 8872.94 8248.09 0.00452909 0.00046928 197054 0
: 136 Minimum Test error found - save the configuration
: 136 | 8792.4 8171.72 0.0045498 0.000550042 200012 0
: 137 Minimum Test error found - save the configuration
: 137 | 8711.87 8096.75 0.00448692 0.00049269 200289 0
: 138 Minimum Test error found - save the configuration
: 138 | 8631.75 8023.45 0.00445227 0.00048732 201768 0
: 139 Minimum Test error found - save the configuration
: 139 | 8554.59 7948.55 0.00449605 0.00047539 198973 0
: 140 Minimum Test error found - save the configuration
: 140 | 8475.57 7875.69 0.00448367 0.000486571 200145 0
: 141 Minimum Test error found - save the configuration
: 141 | 8399.35 7802.15 0.00448243 0.000542561 203053 0
: 142 Minimum Test error found - save the configuration
: 142 | 8320.68 7732.12 0.00442159 0.000500061 204002 0
: 143 Minimum Test error found - save the configuration
: 143 | 8246.3 7660.42 0.00443519 0.00046652 201579 0
: 144 Minimum Test error found - save the configuration
: 144 | 8170.45 7589.85 0.00445565 0.000484841 201470 0
: 145 Minimum Test error found - save the configuration
: 145 | 8095.66 7520.35 0.00442919 0.000467031 201910 0
: 146 Minimum Test error found - save the configuration
: 146 | 8022.42 7450.24 0.00448841 0.00055685 203482 0
: 147 Minimum Test error found - save the configuration
: 147 | 7949.51 7380.24 0.00436199 0.00046949 205524 0
: 148 Minimum Test error found - save the configuration
: 148 | 7875.86 7312.32 0.00445789 0.00047852 201037 0
: 149 Minimum Test error found - save the configuration
: 149 | 7803.9 7244.95 0.00472966 0.000478571 188187 0
: 150 Minimum Test error found - save the configuration
: 150 | 7732.35 7178.45 0.00486877 0.00058952 186949 0
: 151 Minimum Test error found - save the configuration
: 151 | 7661.9 7112.19 0.00478547 0.000520312 187566 0
: 152 Minimum Test error found - save the configuration
: 152 | 7591.54 7046.81 0.00465839 0.000491822 192005 0
: 153 Minimum Test error found - save the configuration
: 153 | 7522.44 6981.53 0.0044743 0.000479201 200246 0
: 154 Minimum Test error found - save the configuration
: 154 | 7453.75 6916.66 0.0044408 0.000528531 204485 0
: 155 Minimum Test error found - save the configuration
: 155 | 7385.29 6852.62 0.00443335 0.00049517 203140 0
: 156 Minimum Test error found - save the configuration
: 156 | 7317.29 6789.85 0.00447607 0.000477191 200056 0
: 157 Minimum Test error found - save the configuration
: 157 | 7249.92 6727.89 0.004484 0.00048884 200242 0
: 158 Minimum Test error found - save the configuration
: 158 | 7185.52 6663.65 0.0044676 0.000471141 200177 0
: 159 Minimum Test error found - save the configuration
: 159 | 7118.57 6601.54 0.00448148 0.000507321 201301 0
: 160 Minimum Test error found - save the configuration
: 160 | 7052.6 6541.24 0.00444741 0.00054341 204918 0
: 161 Minimum Test error found - save the configuration
: 161 | 6989.02 6479.77 0.00480263 0.00068633 194349 0
: 162 Minimum Test error found - save the configuration
: 162 | 6924.16 6420.22 0.00444761 0.00048519 201897 0
: 163 Minimum Test error found - save the configuration
: 163 | 6859.83 6362.21 0.00448641 0.000473821 199373 0
: 164 Minimum Test error found - save the configuration
: 164 | 6799.2 6301.19 0.00447059 0.00048309 200627 0
: 165 Minimum Test error found - save the configuration
: 165 | 6735.72 6242.56 0.00445121 0.000528461 203939 0
: 166 Minimum Test error found - save the configuration
: 166 | 6674 6183.96 0.0055633 0.00066434 163300 0
: 167 Minimum Test error found - save the configuration
: 167 | 6611.9 6127.32 0.00600218 0.000662871 149832 0
: 168 Minimum Test error found - save the configuration
: 168 | 6552.27 6069.8 0.00616152 0.000697862 146422 0
: 169 Minimum Test error found - save the configuration
: 169 | 6490.83 6014.3 0.00619488 0.00069729 145518 0
: 170 Minimum Test error found - save the configuration
: 170 | 6431.44 5958.9 0.00534376 0.000481341 164527 0
: 171 Minimum Test error found - save the configuration
: 171 | 6372.7 5903.45 0.0043335 0.00048116 207666 0
: 172 Minimum Test error found - save the configuration
: 172 | 6314.24 5848.22 0.00427819 0.000465661 209835 0
: 173 Minimum Test error found - save the configuration
: 173 | 6255.3 5794.75 0.00431244 0.00047186 208302 0
: 174 Minimum Test error found - save the configuration
: 174 | 6198.21 5741.03 0.00431997 0.000482201 208455 0
: 175 Minimum Test error found - save the configuration
: 175 | 6141.53 5687.02 0.00429707 0.00048242 209718 0
: 176 Minimum Test error found - save the configuration
: 176 | 6083.54 5636.03 0.0043023 0.000466931 208585 0
: 177 Minimum Test error found - save the configuration
: 177 | 6030.14 5581.28 0.00429512 0.00047582 209463 0
: 178 Minimum Test error found - save the configuration
: 178 | 5973.1 5529.6 0.00426996 0.000482711 211235 0
: 179 Minimum Test error found - save the configuration
: 179 | 5918.9 5476.51 0.00430849 0.00046923 208374 0
: 180 Minimum Test error found - save the configuration
: 180 | 5862.5 5426.88 0.00427859 0.000463811 209711 0
: 181 Minimum Test error found - save the configuration
: 181 | 5809.29 5376.65 0.00428396 0.000475661 210068 0
: 182 Minimum Test error found - save the configuration
: 182 | 5755.57 5326.84 0.00431379 0.000467221 207978 0
: 183 Minimum Test error found - save the configuration
: 183 | 5702.84 5277.1 0.00431002 0.00046864 208259 0
: 184 Minimum Test error found - save the configuration
: 184 | 5650.04 5228.8 0.00434377 0.00048632 207391 0
: 185 Minimum Test error found - save the configuration
: 185 | 5599.63 5177.25 0.00430599 0.00046444 208249 0
: 186 Minimum Test error found - save the configuration
: 186 | 5545.32 5130.92 0.00436979 0.000472052 205247 0
: 187 Minimum Test error found - save the configuration
: 187 | 5496.66 5080.72 0.00440003 0.00050362 205317 0
: 188 Minimum Test error found - save the configuration
: 188 | 5444.62 5033.27 0.00452561 0.000496462 198553 0
: 189 Minimum Test error found - save the configuration
: 189 | 5394.45 4986.36 0.00450449 0.000484731 199017 0
: 190 Minimum Test error found - save the configuration
: 190 | 5343.84 4941.12 0.00431133 0.0004702 208272 0
: 191 Minimum Test error found - save the configuration
: 191 | 5295.22 4894.71 0.00439455 0.000485351 204646 0
: 192 Minimum Test error found - save the configuration
: 192 | 5245.98 4849.95 0.00431911 0.00048627 208723 0
: 193 Minimum Test error found - save the configuration
: 193 | 5197.58 4805.33 0.00434672 0.000472811 206510 0
: 194 Minimum Test error found - save the configuration
: 194 | 5150.52 4759.4 0.00435819 0.000488172 206718 0
: 195 Minimum Test error found - save the configuration
: 195 | 5101.58 4716.33 0.00427965 0.000479771 210533 0
: 196 Minimum Test error found - save the configuration
: 196 | 5056.08 4671.26 0.00430577 0.00047044 208587 0
: 197 Minimum Test error found - save the configuration
: 197 | 5008.57 4627.76 0.0042995 0.00048067 209488 0
: 198 Minimum Test error found - save the configuration
: 198 | 4962.01 4585.43 0.0043818 0.000494221 205784 0
: 199 Minimum Test error found - save the configuration
: 199 | 4917.49 4541.17 0.00430149 0.00046935 208761 0
: 200 Minimum Test error found - save the configuration
: 200 | 4870.87 4499.44 0.00458169 0.000482661 195168 0
: 201 Minimum Test error found - save the configuration
: 201 | 4826.58 4457.05 0.00430194 0.0004702 208783 0
: 202 Minimum Test error found - save the configuration
: 202 | 4781.73 4415.88 0.0043336 0.0004762 207394 0
: 203 Minimum Test error found - save the configuration
: 203 | 4738.14 4373.92 0.00431779 0.00048084 208499 0
: 204 Minimum Test error found - save the configuration
: 204 | 4693.74 4334.06 0.00429576 0.00046855 209030 0
: 205 Minimum Test error found - save the configuration
: 205 | 4650.72 4294.1 0.00433026 0.00047202 207349 0
: 206 Minimum Test error found - save the configuration
: 206 | 4607.92 4253.95 0.00432451 0.000482651 208233 0
: 207 Minimum Test error found - save the configuration
: 207 | 4566.21 4213.73 0.00434173 0.000472781 206775 0
: 208 Minimum Test error found - save the configuration
: 208 | 4523.4 4174.92 0.00431039 0.00046932 208276 0
: 209 Minimum Test error found - save the configuration
: 209 | 4481.44 4137.12 0.00431896 0.00049245 209068 0
: 210 Minimum Test error found - save the configuration
: 210 | 4441.41 4097.09 0.00430119 0.000470591 208845 0
: 211 Minimum Test error found - save the configuration
: 211 | 4400.24 4058.34 0.00433975 0.000475871 207046 0
: 212 Minimum Test error found - save the configuration
: 212 | 4358.88 4021.47 0.00431673 0.000484481 208755 0
: 213 Minimum Test error found - save the configuration
: 213 | 4319.74 3983.46 0.00429609 0.000471971 209199 0
: 214 Minimum Test error found - save the configuration
: 214 | 4279.58 3946.49 0.00435436 0.000476202 206284 0
: 215 Minimum Test error found - save the configuration
: 215 | 4239.96 3910.33 0.00431286 0.000484431 208963 0
: 216 Minimum Test error found - save the configuration
: 216 | 4202.03 3873.28 0.00432974 0.000472371 207395 0
: 217 Minimum Test error found - save the configuration
: 217 | 4162.85 3837.21 0.0043336 0.000472131 207175 0
: 218 Minimum Test error found - save the configuration
: 218 | 4124.93 3801.46 0.00431789 0.000481141 208510 0
: 219 Minimum Test error found - save the configuration
: 219 | 4086.47 3766.96 0.00433176 0.00047374 207360 0
: 220 Minimum Test error found - save the configuration
: 220 | 4049.36 3732.21 0.00430286 0.00046703 208560 0
: 221 Minimum Test error found - save the configuration
: 221 | 4012.5 3697.18 0.00431396 0.00048022 208674 0
: 222 Minimum Test error found - save the configuration
: 222 | 3976.42 3661.79 0.00570848 0.000694201 159544 0
: 223 Minimum Test error found - save the configuration
: 223 | 3939.29 3628.32 0.00567761 0.00047855 153874 0
: 224 Minimum Test error found - save the configuration
: 224 | 3903.57 3594.51 0.00448408 0.000498861 200742 0
: 225 Minimum Test error found - save the configuration
: 225 | 3867.69 3560.49 0.00577378 0.000675351 156911 0
: 226 Minimum Test error found - save the configuration
: 226 | 3831.65 3528.86 0.0056673 0.00047047 153940 0
: 227 Minimum Test error found - save the configuration
: 227 | 3798.37 3494.24 0.00441399 0.000477971 203251 0
: 228 Minimum Test error found - save the configuration
: 228 | 3762.11 3463.13 0.0044148 0.000484831 203564 0
: 229 Minimum Test error found - save the configuration
: 229 | 3729.19 3429.63 0.00441519 0.00047347 202957 0
: 230 Minimum Test error found - save the configuration
: 230 | 3694.3 3398.04 0.00441162 0.000499361 204486 0
: 231 Minimum Test error found - save the configuration
: 231 | 3661.49 3365.74 0.00437027 0.000470762 205154 0
: 232 Minimum Test error found - save the configuration
: 232 | 3626.98 3335.04 0.00437219 0.00047257 205148 0
: 233 Minimum Test error found - save the configuration
: 233 | 3594.91 3303.79 0.00439002 0.00048436 204831 0
: 234 Minimum Test error found - save the configuration
: 234 | 3561.23 3273.88 0.00438932 0.000471291 204184 0
: 235 Minimum Test error found - save the configuration
: 235 | 3530.19 3242.35 0.00439089 0.00048497 204818 0
: 236 Minimum Test error found - save the configuration
: 236 | 3497.03 3212.98 0.00437071 0.000467292 204949 0
: 237 Minimum Test error found - save the configuration
: 237 | 3465.7 3182.99 0.0043724 0.000468841 204941 0
: 238 Minimum Test error found - save the configuration
: 238 | 3434.19 3152.79 0.00444661 0.000489 202142 0
: 239 Minimum Test error found - save the configuration
: 239 | 3402.47 3124.5 0.00436744 0.000469971 205262 0
: 240 Minimum Test error found - save the configuration
: 240 | 3371.44 3095.73 0.00439148 0.000484461 204760 0
: 241 Minimum Test error found - save the configuration
: 241 | 3341.3 3066.74 0.00439261 0.000471731 204036 0
: 242 Minimum Test error found - save the configuration
: 242 | 3311.07 3038.17 0.00437771 0.00046997 204722 0
: 243 Minimum Test error found - save the configuration
: 243 | 3281.44 3009.4 0.00438666 0.00048626 205107 0
: 244 Minimum Test error found - save the configuration
: 244 | 3250.69 2981.96 0.00437141 0.000471061 205110 0
: 245 Minimum Test error found - save the configuration
: 245 | 3222.36 2952.57 0.00437632 0.000481541 205403 0
: 246 Minimum Test error found - save the configuration
: 246 | 3191 2926.98 0.00436693 0.000480531 205846 0
: 247 Minimum Test error found - save the configuration
: 247 | 3163.85 2898.82 0.00439597 0.00047365 203961 0
: 248 Minimum Test error found - save the configuration
: 248 | 3134.41 2872.18 0.00438519 0.00048309 205018 0
: 249 Minimum Test error found - save the configuration
: 249 | 3105.82 2846.01 0.00436967 0.000467171 204997 0
: 250 Minimum Test error found - save the configuration
: 250 | 3077.41 2819.99 0.00441852 0.000490151 203647 0
: 251 Minimum Test error found - save the configuration
: 251 | 3049.68 2793.87 0.00437509 0.000486701 205741 0
: 252 Minimum Test error found - save the configuration
: 252 | 3022.75 2767.43 0.00439747 0.00047547 203978 0
: 253 Minimum Test error found - save the configuration
: 253 | 2994.22 2742.14 0.00442092 0.00048913 203470 0
: 254 Minimum Test error found - save the configuration
: 254 | 2967.68 2716.34 0.00439787 0.00047934 204158 0
: 255 Minimum Test error found - save the configuration
: 255 | 2940.89 2690.91 0.00441643 0.000492881 203897 0
: 256 Minimum Test error found - save the configuration
: 256 | 2913.4 2666.57 0.00434536 0.000486401 207310 0
: 257 Minimum Test error found - save the configuration
: 257 | 2887.54 2641.87 0.00433267 0.000472811 207262 0
: 258 Minimum Test error found - save the configuration
: 258 | 2861.15 2617.67 0.00435591 0.000489802 206927 0
: 259 Minimum Test error found - save the configuration
: 259 | 2835.25 2593.48 0.00430993 0.00048085 208928 0
: 260 Minimum Test error found - save the configuration
: 260 | 2810.59 2568.73 0.00431451 0.00046778 207969 0
: 261 Minimum Test error found - save the configuration
: 261 | 2783.73 2545.6 0.0043718 0.00048832 206001 0
: 262 Minimum Test error found - save the configuration
: 262 | 2759.06 2522.16 0.00434583 0.000473561 206597 0
: 263 Minimum Test error found - save the configuration
: 263 | 2734.3 2498.48 0.00439937 0.000475931 203903 0
: 264 Minimum Test error found - save the configuration
: 264 | 2709.38 2475.71 0.0043395 0.000483552 207472 0
: 265 Minimum Test error found - save the configuration
: 265 | 2684.83 2452.89 0.0043209 0.000468691 207673 0
: 266 Minimum Test error found - save the configuration
: 266 | 2660.82 2429.11 0.00439257 0.0004782 204375 0
: 267 Minimum Test error found - save the configuration
: 267 | 2635.65 2408.35 0.00441121 0.0004911 204076 0
: 268 Minimum Test error found - save the configuration
: 268 | 2613.03 2384.89 0.00432463 0.00047272 207689 0
: 269 Minimum Test error found - save the configuration
: 269 | 2588.83 2362.79 0.00437817 0.000491401 205827 0
: 270 Minimum Test error found - save the configuration
: 270 | 2564.59 2342.26 0.00435585 0.000508131 207916 0
: 271 Minimum Test error found - save the configuration
: 271 | 2542.53 2319.98 0.00432363 0.000470252 207610 0
: 272 Minimum Test error found - save the configuration
: 272 | 2519.22 2298.32 0.00436264 0.00048805 206474 0
: 273 Minimum Test error found - save the configuration
: 273 | 2496.02 2277.15 0.0043489 0.00047715 206625 0
: 274 Minimum Test error found - save the configuration
: 274 | 2473.21 2256.69 0.00434327 0.00047244 206674 0
: 275 Minimum Test error found - save the configuration
: 275 | 2451.53 2235.5 0.00436934 0.00048569 205992 0
: 276 Minimum Test error found - save the configuration
: 276 | 2429.09 2214.79 0.0043586 0.000469849 205722 0
: 277 Minimum Test error found - save the configuration
: 277 | 2406.86 2194.67 0.00432163 0.0004674 207564 0
: 278 Minimum Test error found - save the configuration
: 278 | 2383.97 2175.43 0.00432916 0.000482241 207959 0
: 279 Minimum Test error found - save the configuration
: 279 | 2363.25 2155.19 0.00434717 0.00046935 206302 0
: 280 Minimum Test error found - save the configuration
: 280 | 2341.49 2134.83 0.00431889 0.000467521 207719 0
: 281 Minimum Test error found - save the configuration
: 281 | 2320.21 2115.51 0.00439751 0.00048853 204657 0
: 282 Minimum Test error found - save the configuration
: 282 | 2299.03 2095.5 0.00434288 0.00047194 206668 0
: 283 Minimum Test error found - save the configuration
: 283 | 2277.96 2076.12 0.00439023 0.000495531 205408 0
: 284 Minimum Test error found - save the configuration
: 284 | 2256.65 2057.56 0.0043327 0.000482781 207797 0
: 285 Minimum Test error found - save the configuration
: 285 | 2236.87 2038.01 0.0043061 0.000468611 208470 0
: 286 Minimum Test error found - save the configuration
: 286 | 2215.53 2019.8 0.00436557 0.00048483 206146 0
: 287 Minimum Test error found - save the configuration
: 287 | 2195.34 2001.41 0.00431235 0.000481561 208834 0
: 288 Minimum Test error found - save the configuration
: 288 | 2175.23 1983.7 0.00432748 0.000472001 207497 0
: 289 Minimum Test error found - save the configuration
: 289 | 2155.34 1965.44 0.00434535 0.000484571 207212 0
: 290 Minimum Test error found - save the configuration
: 290 | 2135.55 1946.85 0.0043665 0.00048793 206262 0
: 291 Minimum Test error found - save the configuration
: 291 | 2115.81 1929.1 0.00442087 0.000478591 202928 0
: 292 Minimum Test error found - save the configuration
: 292 | 2096.13 1911.46 0.00439653 0.000502032 205418 0
: 293 Minimum Test error found - save the configuration
: 293 | 2076.81 1893.71 0.00433928 0.000472431 206887 0
: 294 Minimum Test error found - save the configuration
: 294 | 2057.45 1876.49 0.00434801 0.00048379 207028 0
: 295 Minimum Test error found - save the configuration
: 295 | 2038.75 1859.43 0.0043491 0.000485941 207085 0
: 296 Minimum Test error found - save the configuration
: 296 | 2019.57 1842.33 0.00438641 0.00047372 204463 0
: 297 Minimum Test error found - save the configuration
: 297 | 2001.26 1825.4 0.00436602 0.000487652 206272 0
: 298 Minimum Test error found - save the configuration
: 298 | 1982.29 1809.07 0.00436395 0.00047213 205560 0
: 299 Minimum Test error found - save the configuration
: 299 | 1964.52 1791.81 0.00434807 0.00047186 206387 0
: 300 Minimum Test error found - save the configuration
: 300 | 1945.27 1775.91 0.0043876 0.00048931 205218 0
: 301 Minimum Test error found - save the configuration
: 301 | 1927.67 1759.83 0.00433984 0.000467871 206613 0
: 302 Minimum Test error found - save the configuration
: 302 | 1909.66 1743.5 0.00435165 0.000473941 206308 0
: 303 Minimum Test error found - save the configuration
: 303 | 1891.68 1727.77 0.00433072 0.000480421 207776 0
: 304 Minimum Test error found - save the configuration
: 304 | 1874.23 1711.72 0.00437722 0.000472731 204893 0
: 305 Minimum Test error found - save the configuration
: 305 | 1856.33 1696.72 0.00433534 0.00048011 207510 0
: 306 Minimum Test error found - save the configuration
: 306 | 1839.38 1680.53 0.00435172 0.00049364 207357 0
: 307 Minimum Test error found - save the configuration
: 307 | 1822.04 1665.17 0.00435602 0.00047502 206133 0
: 308 Minimum Test error found - save the configuration
: 308 | 1804.61 1650.25 0.0043563 0.00048669 206739 0
: 309 Minimum Test error found - save the configuration
: 309 | 1787.6 1635.3 0.00437984 0.000477682 205015 0
: 310 Minimum Test error found - save the configuration
: 310 | 1771.13 1620.27 0.00434908 0.000471351 206307 0
: 311 Minimum Test error found - save the configuration
: 311 | 1754.3 1605.66 0.00440893 0.00049679 204492 0
: 312 Minimum Test error found - save the configuration
: 312 | 1738.32 1590.31 0.0043335 0.00047268 207210 0
: 313 Minimum Test error found - save the configuration
: 313 | 1721.52 1575.33 0.00438765 0.00049091 205300 0
: 314 Minimum Test error found - save the configuration
: 314 | 1705.23 1560.73 0.00436067 0.00048635 206488 0
: 315 Minimum Test error found - save the configuration
: 315 | 1689.21 1546.84 0.00438873 0.000478251 204579 0
: 316 Minimum Test error found - save the configuration
: 316 | 1673.15 1532.57 0.00437904 0.00048696 205546 0
: 317 Minimum Test error found - save the configuration
: 317 | 1657.05 1518.14 0.00433718 0.0004716 206955 0
: 318 Minimum Test error found - save the configuration
: 318 | 1640.69 1505.21 0.0043598 0.000472351 205791 0
: 319 Minimum Test error found - save the configuration
: 319 | 1625.62 1491.08 0.00436164 0.00048809 206529 0
: 320 Minimum Test error found - save the configuration
: 320 | 1610.14 1477.31 0.0043602 0.000474341 205875 0
: 321 Minimum Test error found - save the configuration
: 321 | 1595.11 1463.66 0.00437483 0.000486271 205732 0
: 322 Minimum Test error found - save the configuration
: 322 | 1580.04 1450.29 0.00435063 0.000496631 207577 0
: 323 Minimum Test error found - save the configuration
: 323 | 1564.79 1436.66 0.00438288 0.00048314 205142 0
: 324 Minimum Test error found - save the configuration
: 324 | 1549.33 1423.63 0.0043954 0.00048905 204795 0
: 325 Minimum Test error found - save the configuration
: 325 | 1534.92 1410.19 0.0043596 0.000476062 205998 0
: 326 Minimum Test error found - save the configuration
: 326 | 1520.06 1396.91 0.00434095 0.000473802 206871 0
: 327 Minimum Test error found - save the configuration
: 327 | 1504.98 1384.76 0.00443409 0.0005096 203848 0
: 328 Minimum Test error found - save the configuration
: 328 | 1490.61 1372.4 0.00438698 0.000476101 204558 0
: 329 Minimum Test error found - save the configuration
: 329 | 1477.11 1359.12 0.00442997 0.000497372 203428 0
: 330 Minimum Test error found - save the configuration
: 330 | 1462.99 1345.98 0.00436006 0.0004764 205991 0
: 331 Minimum Test error found - save the configuration
: 331 | 1448.4 1333.51 0.00434743 0.000472881 206476 0
: 332 Minimum Test error found - save the configuration
: 332 | 1434.43 1321.62 0.0044178 0.000489421 203646 0
: 333 Minimum Test error found - save the configuration
: 333 | 1420.4 1310.17 0.00435108 0.00047011 206134 0
: 334 Minimum Test error found - save the configuration
: 334 | 1407.5 1297.51 0.00437711 0.000494002 206021 0
: 335 Minimum Test error found - save the configuration
: 335 | 1393.37 1285.59 0.00437043 0.00048658 205981 0
: 336 Minimum Test error found - save the configuration
: 336 | 1380.43 1273.77 0.00433933 0.00046962 206734 0
: 337 Minimum Test error found - save the configuration
: 337 | 1366.65 1261.76 0.00432135 0.00047969 208244 0
: 338 Minimum Test error found - save the configuration
: 338 | 1353.88 1250.11 0.0043361 0.00048484 207724 0
: 339 Minimum Test error found - save the configuration
: 339 | 1340.6 1238.2 0.00432955 0.000471121 207338 0
: 340 Minimum Test error found - save the configuration
: 340 | 1327.86 1226.52 0.00433335 0.000479491 207584 0
: 341 Minimum Test error found - save the configuration
: 341 | 1315.07 1215.25 0.00435217 0.00050026 207689 0
: 342 Minimum Test error found - save the configuration
: 342 | 1302.06 1204.87 0.00433865 0.000471671 206880 0
: 343 Minimum Test error found - save the configuration
: 343 | 1289.63 1193.49 0.0043726 0.000497121 206426 0
: 344 Minimum Test error found - save the configuration
: 344 | 1277.7 1181.3 0.00435382 0.000473731 206181 0
: 345 Minimum Test error found - save the configuration
: 345 | 1264.4 1170.94 0.00434568 0.000487371 207345 0
: 346 Minimum Test error found - save the configuration
: 346 | 1252.66 1160.28 0.00434464 0.0004869 207376 0
: 347 Minimum Test error found - save the configuration
: 347 | 1240.75 1149.26 0.00434342 0.000472471 206668 0
: 348 Minimum Test error found - save the configuration
: 348 | 1228.65 1138.08 0.00436117 0.000476021 205913 0
: 349 Minimum Test error found - save the configuration
: 349 | 1216.58 1127.26 0.00437372 0.000501311 206590 0
: 350 Minimum Test error found - save the configuration
: 350 | 1204.6 1116.87 0.00436133 0.00047433 205814 0
: 351 Minimum Test error found - save the configuration
: 351 | 1193.24 1106.2 0.00435407 0.0004906 207068 0
: 352 Minimum Test error found - save the configuration
: 352 | 1181.52 1096.3 0.00433423 0.000490681 208141 0
: 353 Minimum Test error found - save the configuration
: 353 | 1170.26 1085.74 0.00434693 0.000471121 206409 0
: 354 Minimum Test error found - save the configuration
: 354 | 1158.64 1075.23 0.00431395 0.0004778 208543 0
: 355 Minimum Test error found - save the configuration
: 355 | 1147.64 1064.74 0.00434662 0.000483091 207065 0
: 356 Minimum Test error found - save the configuration
: 356 | 1136.47 1054.76 0.0043096 0.000467561 208223 0
: 357 Minimum Test error found - save the configuration
: 357 | 1125.16 1044.88 0.0043405 0.000485141 207504 0
: 358 Minimum Test error found - save the configuration
: 358 | 1114.24 1034.74 0.00431369 0.000479432 208645 0
: 359 Minimum Test error found - save the configuration
: 359 | 1103.23 1025.18 0.00434777 0.00047009 206309 0
: 360 Minimum Test error found - save the configuration
: 360 | 1092.88 1015.49 0.00434603 0.000483041 207094 0
: 361 Minimum Test error found - save the configuration
: 361 | 1081.78 1005.92 0.00434206 0.00047405 206825 0
: 362 Minimum Test error found - save the configuration
: 362 | 1071.55 996.64 0.00435464 0.00046964 205920 0
: 363 Minimum Test error found - save the configuration
: 363 | 1061.01 986.938 0.00433681 0.000482261 207547 0
: 364 Minimum Test error found - save the configuration
: 364 | 1051.03 977.407 0.00436856 0.000488251 206169 0
: 365 Minimum Test error found - save the configuration
: 365 | 1040.4 968.555 0.00434822 0.000473792 206482 0
: 366 Minimum Test error found - save the configuration
: 366 | 1030.26 959.058 0.00437121 0.00049976 206641 0
: 367 Minimum Test error found - save the configuration
: 367 | 1020.34 949.96 0.00435776 0.00047618 206102 0
: 368 Minimum Test error found - save the configuration
: 368 | 1010.08 941.055 0.00436029 0.000481241 206236 0
: 369 Minimum Test error found - save the configuration
: 369 | 1000.67 931.617 0.00434647 0.000487711 207321 0
: 370 Minimum Test error found - save the configuration
: 370 | 990.419 922.55 0.00434274 0.00046917 206528 0
: 371 Minimum Test error found - save the configuration
: 371 | 980.805 913.905 0.00436528 0.000492012 206544 0
: 372 Minimum Test error found - save the configuration
: 372 | 971.298 905.197 0.00436115 0.000493462 206842 0
: 373 Minimum Test error found - save the configuration
: 373 | 961.74 897.022 0.00436722 0.000471671 205363 0
: 374 Minimum Test error found - save the configuration
: 374 | 952.57 887.857 0.00434263 0.000479361 207079 0
: 375 Minimum Test error found - save the configuration
: 375 | 942.939 879.754 0.00456891 0.000498261 196529 0
: 376 Minimum Test error found - save the configuration
: 376 | 933.719 870.633 0.00476212 0.000482521 186934 0
: 377 Minimum Test error found - save the configuration
: 377 | 924.439 862.114 0.00472293 0.000520691 190375 0
: 378 Minimum Test error found - save the configuration
: 378 | 915.213 854.226 0.00446495 0.00047775 200642 0
: 379 Minimum Test error found - save the configuration
: 379 | 906.558 845.825 0.00434798 0.000483842 207032 0
: 380 Minimum Test error found - save the configuration
: 380 | 897.47 837.694 0.004366 0.000473151 205505 0
: 381 Minimum Test error found - save the configuration
: 381 | 888.352 829.432 0.00437374 0.000478821 205396 0
: 382 Minimum Test error found - save the configuration
: 382 | 880.108 820.749 0.0043817 0.000488911 205508 0
: 383 Minimum Test error found - save the configuration
: 383 | 870.797 813.578 0.00433598 0.0004722 207051 0
: 384 Minimum Test error found - save the configuration
: 384 | 862.332 805.433 0.00436355 0.000473392 205647 0
: 385 Minimum Test error found - save the configuration
: 385 | 853.804 798.001 0.00438412 0.000489751 205425 0
: 386 Minimum Test error found - save the configuration
: 386 | 845.43 789.751 0.00435983 0.00047388 205870 0
: 387 Minimum Test error found - save the configuration
: 387 | 836.867 782.137 0.00439876 0.00048782 204555 0
: 388 Minimum Test error found - save the configuration
: 388 | 828.855 774.712 0.00434912 0.00047388 206439 0
: 389 Minimum Test error found - save the configuration
: 389 | 820.886 766.346 0.00438257 0.000475111 204737 0
: 390 Minimum Test error found - save the configuration
: 390 | 811.971 759.021 0.00435319 0.000482442 206679 0
: 391 Minimum Test error found - save the configuration
: 391 | 804.243 751.765 0.00434218 0.000486692 207497 0
: 392 Minimum Test error found - save the configuration
: 392 | 796.091 744.518 0.00439427 0.0004866 204726 0
: 393 Minimum Test error found - save the configuration
: 393 | 788.313 736.582 0.0043619 0.00048743 206480 0
: 394 Minimum Test error found - save the configuration
: 394 | 780.135 729.844 0.00438666 0.000476372 204589 0
: 395 Minimum Test error found - save the configuration
: 395 | 772.358 722.362 0.00437333 0.000485832 205788 0
: 396 Minimum Test error found - save the configuration
: 396 | 765.167 715.147 0.00434652 0.000472141 206485 0
: 397 Minimum Test error found - save the configuration
: 397 | 757.554 707.782 0.00435735 0.00047181 205892 0
: 398 Minimum Test error found - save the configuration
: 398 | 749.679 700.608 0.00438451 0.00048866 205347 0
: 399 Minimum Test error found - save the configuration
: 399 | 742.006 693.155 0.00436891 0.00047231 205307 0
: 400 Minimum Test error found - save the configuration
: 400 | 734.36 686.563 0.00433233 0.000472112 207242 0
: 401 Minimum Test error found - save the configuration
: 401 | 727.14 679.86 0.00438627 0.000485501 205088 0
: 402 Minimum Test error found - save the configuration
: 402 | 720.084 672.728 0.00434228 0.000471911 206699 0
: 403 Minimum Test error found - save the configuration
: 403 | 712.541 666.099 0.00436072 0.000483411 206329 0
: 404 Minimum Test error found - save the configuration
: 404 | 705.528 659.369 0.00434958 0.000487311 207132 0
: 405 Minimum Test error found - save the configuration
: 405 | 698.561 652.341 0.00434438 0.000475641 206786 0
: 406 Minimum Test error found - save the configuration
: 406 | 690.976 646.343 0.00434374 0.000482761 207201 0
: 407 Minimum Test error found - save the configuration
: 407 | 684.574 639.313 0.00436582 0.000476361 205684 0
: 408 Minimum Test error found - save the configuration
: 408 | 677.485 633.079 0.00436873 0.000474051 205409 0
: 409 Minimum Test error found - save the configuration
: 409 | 670.468 626.033 0.00434706 0.00048126 206943 0
: 410 Minimum Test error found - save the configuration
: 410 | 663.806 619.98 0.00437278 0.00047566 205280 0
: 411 Minimum Test error found - save the configuration
: 411 | 656.999 613.993 0.00434703 0.000471011 206397 0
: 412 Minimum Test error found - save the configuration
: 412 | 650.324 607.215 0.00456489 0.000498211 196721 0
: 413 Minimum Test error found - save the configuration
: 413 | 644.136 600.846 0.00433836 0.000472361 206932 0
: 414 Minimum Test error found - save the configuration
: 414 | 637.048 594.949 0.00436125 0.000483791 206321 0
: 415 Minimum Test error found - save the configuration
: 415 | 630.741 588.974 0.00443868 0.000483832 202283 0
: 416 Minimum Test error found - save the configuration
: 416 | 624.144 582.454 0.0043891 0.00048722 205029 0
: 417 Minimum Test error found - save the configuration
: 417 | 617.594 576.478 0.00437679 0.00047275 204916 0
: 418 Minimum Test error found - save the configuration
: 418 | 611.825 571.975 0.00439022 0.000481221 204656 0
: 419 Minimum Test error found - save the configuration
: 419 | 605.512 564.745 0.00440557 0.000490291 204328 0
: 420 Minimum Test error found - save the configuration
: 420 | 599.43 559.208 0.00438381 0.00047799 204823 0
: 421 Minimum Test error found - save the configuration
: 421 | 592.872 553.004 0.00443743 0.000500231 203190 0
: 422 Minimum Test error found - save the configuration
: 422 | 587.061 547.505 0.00437801 0.0004754 204991 0
: 423 Minimum Test error found - save the configuration
: 423 | 580.892 541.265 0.00441797 0.000495382 203947 0
: 424 Minimum Test error found - save the configuration
: 424 | 574.767 535.35 0.00438492 0.00048886 205336 0
: 425 Minimum Test error found - save the configuration
: 425 | 568.748 529.923 0.00439296 0.00048098 204500 0
: 426 Minimum Test error found - save the configuration
: 426 | 562.896 524.855 0.00440192 0.00048899 204451 0
: 427 Minimum Test error found - save the configuration
: 427 | 557.077 519.294 0.00454766 0.000635942 204514 0
: 428 Minimum Test error found - save the configuration
: 428 | 551.649 513.552 0.00438881 0.00048696 205031 0
: 429 Minimum Test error found - save the configuration
: 429 | 545.869 508.272 0.00436697 0.000488482 206266 0
: 430 Minimum Test error found - save the configuration
: 430 | 540.134 502.588 0.00434634 0.000468251 206287 0
: 431 Minimum Test error found - save the configuration
: 431 | 534.305 497.789 0.00441658 0.00050498 204520 0
: 432 Minimum Test error found - save the configuration
: 432 | 528.913 492.391 0.00435221 0.000480451 206625 0
: 433 Minimum Test error found - save the configuration
: 433 | 523.664 486.734 0.0043689 0.000477951 205606 0
: 434 Minimum Test error found - save the configuration
: 434 | 518.05 481.655 0.00436252 0.000486441 206394 0
: 435 Minimum Test error found - save the configuration
: 435 | 512.784 476.369 0.00437892 0.000476081 204979 0
: 436 Minimum Test error found - save the configuration
: 436 | 507.131 471.653 0.00435303 0.000483271 206731 0
: 437 Minimum Test error found - save the configuration
: 437 | 502.274 466.232 0.00433641 0.00048175 207541 0
: 438 Minimum Test error found - save the configuration
: 438 | 496.726 461.555 0.00439705 0.000478641 204165 0
: 439 Minimum Test error found - save the configuration
: 439 | 492.002 456.424 0.00434246 0.000485 207391 0
: 440 Minimum Test error found - save the configuration
: 440 | 486.504 451.724 0.00434506 0.000472162 206564 0
: 441 Minimum Test error found - save the configuration
: 441 | 481.683 447.415 0.00438598 0.0004784 204731 0
: 442 Minimum Test error found - save the configuration
: 442 | 476.803 441.723 0.00435931 0.00048665 206577 0
: 443 Minimum Test error found - save the configuration
: 443 | 471.332 437.441 0.00435858 0.00048869 206724 0
: 444 Minimum Test error found - save the configuration
: 444 | 466.634 432.413 0.00437407 0.00048751 205838 0
: 445 Minimum Test error found - save the configuration
: 445 | 461.717 427.825 0.00435272 0.000494291 207338 0
: 446 Minimum Test error found - save the configuration
: 446 | 457.268 423.545 0.00438226 0.000471651 204572 0
: 447 Minimum Test error found - save the configuration
: 447 | 452.281 418.448 0.00434501 0.00048395 207197 0
: 448 Minimum Test error found - save the configuration
: 448 | 447.584 413.829 0.00434205 0.000470611 206642 0
: 449 Minimum Test error found - save the configuration
: 449 | 442.683 409.644 0.00438728 0.0004795 204720 0
: 450 Minimum Test error found - save the configuration
: 450 | 438.364 404.839 0.00435158 0.000483021 206796 0
: 451 Minimum Test error found - save the configuration
: 451 | 433.556 401.107 0.00434358 0.0004704 206549 0
: 452 Minimum Test error found - save the configuration
: 452 | 429.299 396.227 0.0043891 0.000475561 204419 0
: 453 Minimum Test error found - save the configuration
: 453 | 424.455 392.26 0.00431342 0.000481961 208798 0
: 454 Minimum Test error found - save the configuration
: 454 | 420.085 387.823 0.00431574 0.00046935 207987 0
: 455 Minimum Test error found - save the configuration
: 455 | 415.571 383.356 0.0043287 0.0004695 207297 0
: 456 Minimum Test error found - save the configuration
: 456 | 411.568 378.898 0.0043443 0.00048233 207148 0
: 457 Minimum Test error found - save the configuration
: 457 | 406.732 374.726 0.00432033 0.000469211 207732 0
: 458 Minimum Test error found - save the configuration
: 458 | 402.619 370.772 0.00437095 0.000483821 205808 0
: 459 Minimum Test error found - save the configuration
: 459 | 398.343 366.916 0.00435933 0.00048616 206549 0
: 460 Minimum Test error found - save the configuration
: 460 | 394.176 362.714 0.00434531 0.000473281 206610 0
: 461 Minimum Test error found - save the configuration
: 461 | 390.115 359.011 0.00435366 0.00048686 206889 0
: 462 Minimum Test error found - save the configuration
: 462 | 385.985 355 0.00433937 0.000486631 207645 0
: 463 Minimum Test error found - save the configuration
: 463 | 382.152 350.66 0.00434485 0.00047307 206624 0
: 464 Minimum Test error found - save the configuration
: 464 | 377.995 346.929 0.00436603 0.00048806 206294 0
: 465 Minimum Test error found - save the configuration
: 465 | 373.727 342.769 0.00435793 0.000476071 206087 0
: 466 Minimum Test error found - save the configuration
: 466 | 369.793 339.23 0.00435076 0.000489362 207179 0
: 467 Minimum Test error found - save the configuration
: 467 | 366.154 335.315 0.00437981 0.000489641 205647 0
: 468 Minimum Test error found - save the configuration
: 468 | 362.005 331.937 0.00434476 0.00047234 206589 0
: 469 Minimum Test error found - save the configuration
: 469 | 358.438 327.776 0.00439803 0.000486851 204542 0
: 470 Minimum Test error found - save the configuration
: 470 | 354.133 324.369 0.00434681 0.000482921 207045 0
: 471 Minimum Test error found - save the configuration
: 471 | 350.565 320.749 0.00434274 0.00047078 206614 0
: 472 Minimum Test error found - save the configuration
: 472 | 346.872 316.775 0.00434666 0.000483112 207064 0
: 473 Minimum Test error found - save the configuration
: 473 | 343.684 313.53 0.0043371 0.000486312 207750 0
: 474 Minimum Test error found - save the configuration
: 474 | 339.856 310.188 0.00434429 0.000470021 206491 0
: 475 Minimum Test error found - save the configuration
: 475 | 336.058 305.727 0.00435915 0.00048552 206525 0
: 476 Minimum Test error found - save the configuration
: 476 | 332.172 302.655 0.00433987 0.000472291 206848 0
: 477 Minimum Test error found - save the configuration
: 477 | 328.752 298.971 0.00433767 0.00046777 206724 0
: 478 Minimum Test error found - save the configuration
: 478 | 325.024 296.245 0.00437128 0.00048498 205852 0
: 479 Minimum Test error found - save the configuration
: 479 | 321.598 292.308 0.00435427 0.00047753 206359 0
: 480 Minimum Test error found - save the configuration
: 480 | 317.887 289.332 0.00434874 0.000469931 206249 0
: 481 Minimum Test error found - save the configuration
: 481 | 314.917 285.898 0.00439132 0.00048718 204911 0
: 482 Minimum Test error found - save the configuration
: 482 | 311.227 283.041 0.00435648 0.00047664 206194 0
: 483 Minimum Test error found - save the configuration
: 483 | 308.077 279.819 0.00442544 0.000525491 205131 0
: 484 Minimum Test error found - save the configuration
: 484 | 304.607 276.18 0.00439157 0.000482402 204647 0
: 485 Minimum Test error found - save the configuration
: 485 | 301.319 273.911 0.00436204 0.000470961 205599 0
: 486 Minimum Test error found - save the configuration
: 486 | 298.421 269.792 0.00452197 0.000657751 207028 0
: 487 Minimum Test error found - save the configuration
: 487 | 295.12 267.483 0.00478759 0.000495041 186370 0
: 488 Minimum Test error found - save the configuration
: 488 | 291.91 263.655 0.00432855 0.000471881 207433 0
: 489 Minimum Test error found - save the configuration
: 489 | 288.604 261.606 0.00560554 0.00054556 158103 0
: 490 Minimum Test error found - save the configuration
: 490 | 285.292 257.843 0.00439658 0.00047157 203821 0
: 491 Minimum Test error found - save the configuration
: 491 | 282.221 254.847 0.00506562 0.000484181 174618 0
: 492 Minimum Test error found - save the configuration
: 492 | 279.129 251.375 0.00437544 0.00048581 205675 0
: 493 Minimum Test error found - save the configuration
: 493 | 276.099 249.172 0.00433515 0.000492751 208203 0
: 494 Minimum Test error found - save the configuration
: 494 | 273.155 246.572 0.00434321 0.000471001 206601 0
: 495 Minimum Test error found - save the configuration
: 495 | 270.306 243.467 0.00441575 0.000489161 203739 0
: 496 Minimum Test error found - save the configuration
: 496 | 267.538 241.434 0.00431955 0.00047043 207840 0
: 497 Minimum Test error found - save the configuration
: 497 | 264.332 237.441 0.00558873 0.00064985 161980 0
: 498 Minimum Test error found - save the configuration
: 498 | 261.286 234.848 0.00540718 0.000705931 170168 0
: 499 Minimum Test error found - save the configuration
: 499 | 258.481 232.325 0.00550665 0.000571 162086 0
: 500 Minimum Test error found - save the configuration
: 500 | 255.803 229.881 0.00567401 0.000611311 158019 0
: 501 Minimum Test error found - save the configuration
: 501 | 253.104 226.886 0.00498302 0.000578181 181619 0
: 502 Minimum Test error found - save the configuration
: 502 | 250.145 224.036 0.0049664 0.000527791 180237 0
: 503 Minimum Test error found - save the configuration
: 503 | 247.44 221.84 0.00486549 0.000482071 182506 0
: 504 Minimum Test error found - save the configuration
: 504 | 244.577 218.829 0.0043883 0.000473461 204351 0
: 505 Minimum Test error found - save the configuration
: 505 | 241.989 215.974 0.00435308 0.000483371 206734 0
: 506 Minimum Test error found - save the configuration
: 506 | 239.492 214.339 0.00433462 0.000467131 206853 0
: 507 Minimum Test error found - save the configuration
: 507 | 236.867 210.981 0.0043694 0.000483122 205853 0
: 508 Minimum Test error found - save the configuration
: 508 | 234.146 209.023 0.00433736 0.000479361 207362 0
: 509 Minimum Test error found - save the configuration
: 509 | 231.465 206.457 0.00434435 0.00047174 206579 0
: 510 Minimum Test error found - save the configuration
: 510 | 228.981 203.665 0.00438751 0.00048457 204974 0
: 511 Minimum Test error found - save the configuration
: 511 | 226.424 201.751 0.0043589 0.00047442 205948 0
: 512 Minimum Test error found - save the configuration
: 512 | 223.999 199.104 0.00434091 0.000469811 206660 0
: 513 Minimum Test error found - save the configuration
: 513 | 221.734 197.373 0.00440826 0.000516001 205536 0
: 514 Minimum Test error found - save the configuration
: 514 | 219.461 194.707 0.00435297 0.00048206 206670 0
: 515 Minimum Test error found - save the configuration
: 515 | 216.413 191.914 0.00436496 0.000489521 206428 0
: 516 Minimum Test error found - save the configuration
: 516 | 214.146 189.9 0.00436008 0.000482891 206335 0
: 517 Minimum Test error found - save the configuration
: 517 | 211.823 187.56 0.00435002 0.000474311 206414 0
: 518 Minimum Test error found - save the configuration
: 518 | 209.44 185.305 0.00432617 0.00047821 207903 0
: 519 Minimum Test error found - save the configuration
: 519 | 207.049 183.012 0.00433096 0.000481931 207845 0
: 520 Minimum Test error found - save the configuration
: 520 | 204.672 180.961 0.00430961 0.000468671 208283 0
: 521 Minimum Test error found - save the configuration
: 521 | 202.529 179.137 0.00434184 0.000480642 207190 0
: 522 Minimum Test error found - save the configuration
: 522 | 200.321 176.998 0.00434099 0.00048606 207527 0
: 523 Minimum Test error found - save the configuration
: 523 | 198.096 174.491 0.00435727 0.000472341 205924 0
: 524 Minimum Test error found - save the configuration
: 524 | 195.761 172.458 0.00434827 0.000479651 206792 0
: 525 Minimum Test error found - save the configuration
: 525 | 193.858 170.983 0.00435412 0.000483131 206666 0
: 526 Minimum Test error found - save the configuration
: 526 | 191.729 168.581 0.00433625 0.000465461 206676 0
: 527 Minimum Test error found - save the configuration
: 527 | 189.462 166.622 0.00437357 0.000487941 205887 0
: 528 Minimum Test error found - save the configuration
: 528 | 187.472 164.334 0.00433713 0.000469501 206845 0
: 529 Minimum Test error found - save the configuration
: 529 | 185.318 162.607 0.00434598 0.000469601 206378 0
: 530 Minimum Test error found - save the configuration
: 530 | 183.084 161.192 0.00435986 0.00048581 206502 0
: 531 Minimum Test error found - save the configuration
: 531 | 181.282 158.867 0.00434498 0.000468191 206357 0
: 532 Minimum Test error found - save the configuration
: 532 | 179.007 156.811 0.00433652 0.000470071 206908 0
: 533 Minimum Test error found - save the configuration
: 533 | 176.964 155.047 0.00439045 0.00048734 204965 0
: 534 Minimum Test error found - save the configuration
: 534 | 174.78 153.082 0.00436992 0.000473071 205294 0
: 535 Minimum Test error found - save the configuration
: 535 | 172.803 151.453 0.00436069 0.00048324 206321 0
: 536 Minimum Test error found - save the configuration
: 536 | 170.822 149.515 0.00435644 0.000488581 206833 0
: 537 Minimum Test error found - save the configuration
: 537 | 168.988 148.081 0.00432861 0.000468291 207237 0
: 538 Minimum Test error found - save the configuration
: 538 | 166.948 145.889 0.00434204 0.00048796 207572 0
: 539 Minimum Test error found - save the configuration
: 539 | 165.104 144.865 0.00431551 0.00048683 208950 0
: 540 Minimum Test error found - save the configuration
: 540 | 163.201 142.827 0.00433228 0.000466051 206920 0
: 541 Minimum Test error found - save the configuration
: 541 | 161.171 140.833 0.00436429 0.000484631 206204 0
: 542 Minimum Test error found - save the configuration
: 542 | 159.296 139.139 0.00459642 0.00056835 198606 0
: 543 Minimum Test error found - save the configuration
: 543 | 157.385 137.676 0.00447658 0.000495321 200942 0
: 544 Minimum Test error found - save the configuration
: 544 | 155.84 136.225 0.00456208 0.000497161 196806 0
: 545 Minimum Test error found - save the configuration
: 545 | 154.121 134.312 0.00455015 0.00055407 200196 0
: 546 Minimum Test error found - save the configuration
: 546 | 152.089 132.959 0.00445084 0.00047998 201468 0
: 547 Minimum Test error found - save the configuration
: 547 | 150.287 131.491 0.00458308 0.00049142 195520 0
: 548 Minimum Test error found - save the configuration
: 548 | 148.665 129.935 0.00450345 0.000474131 198545 0
: 549 Minimum Test error found - save the configuration
: 549 | 146.932 128.446 0.00456707 0.00047637 195566 0
: 550 Minimum Test error found - save the configuration
: 550 | 145.091 126.501 0.00454606 0.000503741 197906 0
: 551 Minimum Test error found - save the configuration
: 551 | 143.398 125.057 0.00453465 0.000549501 200745 0
: 552 Minimum Test error found - save the configuration
: 552 | 141.782 123.448 0.00454218 0.000557891 200789 0
: 553 Minimum Test error found - save the configuration
: 553 | 140.215 122.67 0.004482 0.00048066 199933 0
: 554 Minimum Test error found - save the configuration
: 554 | 138.739 120.616 0.00452219 0.00049035 198420 0
: 555 Minimum Test error found - save the configuration
: 555 | 136.94 119.039 0.00453131 0.00047433 197191 0
: 556 Minimum Test error found - save the configuration
: 556 | 135.251 117.703 0.00457869 0.000497351 196014 0
: 557 Minimum Test error found - save the configuration
: 557 | 133.78 116.109 0.00451865 0.000473591 197772 0
: 558 Minimum Test error found - save the configuration
: 558 | 132.161 114.93 0.00456114 0.000492651 196633 0
: 559 Minimum Test error found - save the configuration
: 559 | 130.545 113.862 0.00450466 0.000473012 198430 0
: 560 Minimum Test error found - save the configuration
: 560 | 128.996 112.312 0.00453278 0.000542121 200468 0
: 561 Minimum Test error found - save the configuration
: 561 | 127.5 110.705 0.00455703 0.000557692 200033 0
: 562 Minimum Test error found - save the configuration
: 562 | 125.912 109.551 0.00446375 0.000500251 201842 0
: 563 Minimum Test error found - save the configuration
: 563 | 124.331 107.904 0.00448168 0.000469961 199416 0
: 564 Minimum Test error found - save the configuration
: 564 | 123.177 106.762 0.00458765 0.000492731 195364 0
: 565 Minimum Test error found - save the configuration
: 565 | 121.806 105.496 0.00452562 0.00055338 201398 0
: 566 Minimum Test error found - save the configuration
: 566 | 120.106 104.219 0.0044514 0.0004876 201827 0
: 567 Minimum Test error found - save the configuration
: 567 | 118.668 102.693 0.00456621 0.00050427 196950 0
: 568 Minimum Test error found - save the configuration
: 568 | 117.204 102.091 0.00455155 0.000475541 196271 0
: 569 Minimum Test error found - save the configuration
: 569 | 115.734 100.507 0.00449005 0.00049988 200492 0
: 570 Minimum Test error found - save the configuration
: 570 | 114.364 99.0254 0.00450208 0.000469821 198400 0
: 571 Minimum Test error found - save the configuration
: 571 | 113.076 97.9241 0.00455882 0.000488762 196558 0
: 572 Minimum Test error found - save the configuration
: 572 | 111.757 96.5984 0.00452281 0.000546511 201192 0
: 573 Minimum Test error found - save the configuration
: 573 | 110.743 96.1806 0.00452112 0.000546111 201258 0
: 574 Minimum Test error found - save the configuration
: 574 | 109.014 94.2492 0.00446109 0.000482371 201070 0
: 575 Minimum Test error found - save the configuration
: 575 | 107.816 92.6338 0.00454793 0.000492741 197278 0
: 576 Minimum Test error found - save the configuration
: 576 | 106.401 91.5495 0.00456432 0.00048637 196177 0
: 577 Minimum Test error found - save the configuration
: 577 | 105.262 90.8491 0.00452653 0.000488001 198092 0
: 578 Minimum Test error found - save the configuration
: 578 | 103.907 89.8642 0.00454121 0.000496322 197781 0
: 579 Minimum Test error found - save the configuration
: 579 | 102.836 88.5321 0.0045094 0.00055949 202536 0
: 580 Minimum Test error found - save the configuration
: 580 | 101.673 87.3755 0.00457366 0.000571871 199911 0
: 581 Minimum Test error found - save the configuration
: 581 | 100.275 86.2406 0.00443736 0.000470201 201656 0
: 582 Minimum Test error found - save the configuration
: 582 | 98.977 85.0571 0.00452351 0.000483821 198035 0
: 583 Minimum Test error found - save the configuration
: 583 | 97.8384 84.4724 0.00453432 0.000472651 196964 0
: 584 Minimum Test error found - save the configuration
: 584 | 96.6429 82.9165 0.00456081 0.0004986 196937 0
: 585 Minimum Test error found - save the configuration
: 585 | 95.5258 81.6341 0.00452495 0.000472651 197419 0
: 586 Minimum Test error found - save the configuration
: 586 | 94.5368 80.7857 0.00459419 0.000582771 199431 0
: 587 Minimum Test error found - save the configuration
: 587 | 93.3946 80.3454 0.00447921 0.0004722 199650 0
: 588 Minimum Test error found - save the configuration
: 588 | 92.1287 79.1154 0.00454817 0.000489191 197094 0
: 589 Minimum Test error found - save the configuration
: 589 | 91.0003 78.0933 0.00454793 0.000474471 196393 0
: 590 Minimum Test error found - save the configuration
: 590 | 90.1361 76.5477 0.00454195 0.00048943 197408 0
: 591 Minimum Test error found - save the configuration
: 591 | 89.1005 75.9956 0.00456986 0.000574171 200216 0
: 592 Minimum Test error found - save the configuration
: 592 | 88.0733 74.7481 0.00452179 0.000535761 200701 0
: 593 Minimum Test error found - save the configuration
: 593 | 86.9318 73.6631 0.00448748 0.000490641 200158 0
: 594 Minimum Test error found - save the configuration
: 594 | 85.8329 72.811 0.00453832 0.00047399 196835 0
: 595 | 84.9403 72.8244 0.00450499 0.000457971 197676 1
: 596 Minimum Test error found - save the configuration
: 596 | 84.0686 71.0136 0.00452426 0.000475582 197595 0
: 597 Minimum Test error found - save the configuration
: 597 | 82.9086 70.2436 0.0045497 0.000491091 197112 0
: 598 Minimum Test error found - save the configuration
: 598 | 81.7955 69.4094 0.00453698 0.00048412 197392 0
: 599 Minimum Test error found - save the configuration
: 599 | 81.052 68.5222 0.00455344 0.000558352 200246 0
: 600 Minimum Test error found - save the configuration
: 600 | 80.0519 67.5022 0.00470046 0.000554502 192959 0
: 601 Minimum Test error found - save the configuration
: 601 | 79.0523 66.3579 0.00497274 0.00056487 181494 0
: 602 Minimum Test error found - save the configuration
: 602 | 78.051 65.6695 0.004869 0.000553071 185360 0
: 603 Minimum Test error found - save the configuration
: 603 | 77.0192 64.7376 0.0046167 0.000499971 194329 0
: 604 Minimum Test error found - save the configuration
: 604 | 76.1182 64.1598 0.00455187 0.000488881 196900 0
: 605 Minimum Test error found - save the configuration
: 605 | 75.2746 63.4804 0.00451537 0.00047366 197936 0
: 606 Minimum Test error found - save the configuration
: 606 | 74.4507 62.3984 0.00454034 0.000498351 197923 0
: 607 Minimum Test error found - save the configuration
: 607 | 73.6658 61.544 0.00452656 0.00047411 197412 0
: 608 Minimum Test error found - save the configuration
: 608 | 72.54 60.9569 0.00455526 0.000491211 196848 0
: 609 Minimum Test error found - save the configuration
: 609 | 71.7396 60.336 0.00453068 0.0005488 200910 0
: 610 Minimum Test error found - save the configuration
: 610 | 70.8927 58.9907 0.0044877 0.00049604 200418 0
: 611 Minimum Test error found - save the configuration
: 611 | 69.9384 58.2295 0.00454602 0.000485771 197032 0
: 612 Minimum Test error found - save the configuration
: 612 | 69.2394 57.7116 0.00452725 0.000487781 198046 0
: 613 Minimum Test error found - save the configuration
: 613 | 68.4103 56.6865 0.00453597 0.00048456 197462 0
: 614 Minimum Test error found - save the configuration
: 614 | 67.5203 55.7952 0.00451849 0.00049065 198617 0
: 615 Minimum Test error found - save the configuration
: 615 | 66.7583 55.3096 0.00454658 0.000565261 200939 0
: 616 Minimum Test error found - save the configuration
: 616 | 65.9668 54.4587 0.00448731 0.00052042 201670 0
: 617 Minimum Test error found - save the configuration
: 617 | 65.1629 53.8814 0.00449049 0.000484721 199712 0
: 618 Minimum Test error found - save the configuration
: 618 | 64.3865 53.1399 0.00452568 0.000473522 197426 0
: 619 Minimum Test error found - save the configuration
: 619 | 63.6029 52.7542 0.00454535 0.000486781 197114 0
: 620 Minimum Test error found - save the configuration
: 620 | 63.0679 51.6048 0.0045008 0.000473941 198666 0
: 621 Minimum Test error found - save the configuration
: 621 | 62.4086 50.8334 0.00450957 0.000558581 202481 0
: 622 Minimum Test error found - save the configuration
: 622 | 61.4421 50.5869 0.00444934 0.000488631 201984 0
: 623 Minimum Test error found - save the configuration
: 623 | 60.6921 49.8814 0.00452855 0.00048409 197802 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.8713 49.0239 0.00451171 0.0004708 197975 0
: 625 Minimum Test error found - save the configuration
: 625 | 59.1607 48.2556 0.00450561 0.00049214 199329 0
: 626 Minimum Test error found - save the configuration
: 626 | 58.6014 47.4355 0.00452276 0.00055467 201608 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.7531 46.7165 0.00445511 0.000485471 201530 0
: 628 Minimum Test error found - save the configuration
: 628 | 57.0882 46.1438 0.00452304 0.00047685 197717 0
: 629 Minimum Test error found - save the configuration
: 629 | 56.33 45.687 0.00453953 0.000490962 197601 0
: 630 Minimum Test error found - save the configuration
: 630 | 55.7554 44.896 0.00454202 0.00047652 196778 0
: 631 | 54.9743 45.1609 0.00451663 0.000520371 200187 1
: 632 Minimum Test error found - save the configuration
: 632 | 54.3903 43.8084 0.0045077 0.00054424 201844 0
: 633 Minimum Test error found - save the configuration
: 633 | 53.8135 43.3494 0.00447418 0.00048967 200778 0
: 634 Minimum Test error found - save the configuration
: 634 | 53.1737 42.4208 0.00454072 0.00047498 196766 0
: 635 Minimum Test error found - save the configuration
: 635 | 52.5627 41.8051 0.00459088 0.000530049 197004 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.9137 41.5956 0.00455406 0.00048778 196740 0
: 637 Minimum Test error found - save the configuration
: 637 | 51.1105 40.6484 0.00448941 0.00046951 199010 0
: 638 Minimum Test error found - save the configuration
: 638 | 50.6347 40.088 0.00457054 0.000490651 196084 0
: 639 Minimum Test error found - save the configuration
: 639 | 50.0302 39.5222 0.00443217 0.000474661 202148 0
: 640 Minimum Test error found - save the configuration
: 640 | 49.5243 39.1955 0.00453699 0.00049748 198044 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.9552 38.7505 0.00452139 0.000520122 199937 0
: 642 Minimum Test error found - save the configuration
: 642 | 48.295 38.072 0.0044942 0.00048464 199523 0
: 643 Minimum Test error found - save the configuration
: 643 | 47.5244 37.5214 0.00451019 0.00047475 198244 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.0116 36.7432 0.00456235 0.0004895 196423 0
: 645 Minimum Test error found - save the configuration
: 645 | 46.5116 36.6224 0.00451964 0.00052473 200255 0
: 646 Minimum Test error found - save the configuration
: 646 | 45.9308 36.0061 0.00445897 0.00050455 202305 0
: 647 Minimum Test error found - save the configuration
: 647 | 45.5371 35.3502 0.0045177 0.000476691 197971 0
: 648 Minimum Test error found - save the configuration
: 648 | 44.7357 34.7654 0.00453439 0.000489282 197770 0
: 649 Minimum Test error found - save the configuration
: 649 | 44.1788 34.3457 0.00445249 0.000471041 200932 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.6588 33.5707 0.00462331 0.000580271 197871 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.227 33.101 0.00490383 0.000562911 184293 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.7002 32.8627 0.00463132 0.00047463 192461 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.4047 32.2584 0.0047884 0.000566621 189494 0
: 654 Minimum Test error found - save the configuration
: 654 | 41.8871 31.8202 0.00474883 0.000561372 191047 0
: 655 Minimum Test error found - save the configuration
: 655 | 41.1359 31.6465 0.00483579 0.000492351 184186 0
: 656 Minimum Test error found - save the configuration
: 656 | 40.7015 31.4394 0.00482976 0.00056304 187498 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.2536 30.6823 0.00472939 0.000601661 193811 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.9076 30.3557 0.00470705 0.000474741 189022 0
: 659 Minimum Test error found - save the configuration
: 659 | 39.4679 29.6655 0.00487868 0.00049122 182338 0
: 660 Minimum Test error found - save the configuration
: 660 | 38.7875 29.0608 0.0048704 0.000558962 185553 0
: 661 Minimum Test error found - save the configuration
: 661 | 38.3819 28.7106 0.00470294 0.000559911 193096 0
: 662 | 37.9211 29.1085 0.00470699 0.000437201 187363 1
: 663 Minimum Test error found - save the configuration
: 663 | 37.6363 27.817 0.00486077 0.000487581 182933 0
: 664 Minimum Test error found - save the configuration
: 664 | 36.9815 27.5864 0.00485231 0.000607382 188460 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.6583 27.4501 0.00496343 0.000479881 178430 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.0654 26.7551 0.00503221 0.00056915 179249 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.6876 26.2006 0.00494408 0.000556811 182346 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.1939 25.8173 0.0049369 0.00057265 183308 0
: 669 Minimum Test error found - save the configuration
: 669 | 34.7585 25.6548 0.00484452 0.000495111 183933 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.3508 24.7156 0.0050213 0.000565631 179547 0
: 671 Minimum Test error found - save the configuration
: 671 | 34.1579 24.2803 0.00503658 0.000562301 178800 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.5266 23.9069 0.00493007 0.00056211 183152 0
: 673 | 33.1538 24.0373 0.00477641 0.000510302 187525 1
: 674 Minimum Test error found - save the configuration
: 674 | 32.6698 23.7723 0.00492897 0.00049329 180356 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.685 23.2586 0.00500234 0.00053965 179264 0
: 676 | 32.0842 23.4425 0.00482795 0.000529651 186120 1
: 677 Minimum Test error found - save the configuration
: 677 | 31.6997 22.197 0.00488798 0.00053691 183863 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.4654 21.8984 0.00494926 0.000476411 178857 0
: 679 | 31.0076 22.1701 0.0050042 0.000515551 178227 1
: 680 Minimum Test error found - save the configuration
: 680 | 30.4379 21.2536 0.00493781 0.00054594 182155 0
: 681 Minimum Test error found - save the configuration
: 681 | 29.9794 20.7012 0.00491849 0.000610081 185683 0
: 682 Minimum Test error found - save the configuration
: 682 | 29.5486 20.5465 0.00488143 0.000487741 182079 0
: 683 | 29.2221 20.5574 0.0049264 0.0005086 181086 1
: 684 Minimum Test error found - save the configuration
: 684 | 28.9442 20.2675 0.00488768 0.000558071 184774 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.402 19.825 0.00493525 0.00056029 182859 0
: 686 Minimum Test error found - save the configuration
: 686 | 28.0123 19.8156 0.00489354 0.000490152 181678 0
: 687 Minimum Test error found - save the configuration
: 687 | 27.8752 19.361 0.00489623 0.000583751 185508 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.5534 19.0283 0.00480938 0.000473731 184517 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.0224 18.372 0.00491625 0.000490241 180750 0
: 690 Minimum Test error found - save the configuration
: 690 | 26.5931 17.9172 0.00503438 0.0005427 178107 0
: 691 | 26.4199 18.2 0.0048714 0.000511761 183502 1
: 692 | 26.2939 18.8614 0.00492196 0.00051387 181485 2
: 693 | 26.1779 18.4341 0.00491872 0.000512891 181578 3
: 694 Minimum Test error found - save the configuration
: 694 | 25.6614 17.6264 0.00482162 0.0005056 185356 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.2349 16.7373 0.0049712 0.000489541 178505 0
: 696 Minimum Test error found - save the configuration
: 696 | 24.7168 16.4803 0.00493971 0.000603191 184480 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.3222 16.029 0.00486805 0.000493121 182860 0
: 698 | 24.2873 16.311 0.00500903 0.00048847 176969 1
: 699 Minimum Test error found - save the configuration
: 699 | 24.4164 15.9737 0.00489199 0.00060464 186596 0
: 700 Minimum Test error found - save the configuration
: 700 | 24.0467 15.4843 0.00487956 0.00051313 183216 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.0697 15.0939 0.00500506 0.000560371 179990 0
: 702 | 22.8242 15.1379 0.00487163 0.000519501 183818 1
: 703 Minimum Test error found - save the configuration
: 703 | 22.4626 14.7708 0.00489024 0.000597322 186354 0
: 704 | 22.2219 14.8378 0.00489438 0.000460601 180433 1
: 705 Minimum Test error found - save the configuration
: 705 | 21.7734 14.1841 0.00502049 0.000525341 177970 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.5608 14.0595 0.00493951 0.00049897 180158 0
: 707 Minimum Test error found - save the configuration
: 707 | 21.3109 13.9344 0.00488976 0.000525241 183296 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.0026 13.6956 0.00486343 0.000498571 183282 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.8636 13.0771 0.00493794 0.000524851 181279 0
: 710 | 20.4621 13.1973 0.00490397 0.00054564 183557 1
: 711 Minimum Test error found - save the configuration
: 711 | 20.1101 12.9265 0.00503399 0.00050273 176551 0
: 712 Minimum Test error found - save the configuration
: 712 | 19.9471 12.8528 0.00505167 0.000548161 177639 0
: 713 | 19.8635 13.2115 0.00485379 0.00053215 185115 1
: 714 Minimum Test error found - save the configuration
: 714 | 19.5222 12.4909 0.00490381 0.0005596 184153 0
: 715 | 19.2334 12.6034 0.00497239 0.000456611 177157 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.2548 11.5455 0.00502781 0.000579091 179827 0
: 717 | 18.9401 11.733 0.0051618 0.000607382 175654 1
: 718 | 18.3688 11.5925 0.004932 0.000586782 184111 2
: 719 Minimum Test error found - save the configuration
: 719 | 18.1387 10.9948 0.00515293 0.000532431 173142 0
: 720 | 17.835 11.0159 0.00536101 0.000528072 165531 1
: 721 Minimum Test error found - save the configuration
: 721 | 17.6783 10.8228 0.00496962 0.00064379 184936 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.4331 10.7742 0.00479872 0.000477851 185148 0
: 723 | 17.3865 11.0397 0.00496014 0.00057651 182497 1
: 724 Minimum Test error found - save the configuration
: 724 | 17.2314 10.5417 0.00479863 0.000479782 185235 0
: 725 Minimum Test error found - save the configuration
: 725 | 16.6486 10.1911 0.00510583 0.000616061 178183 0
: 726 Minimum Test error found - save the configuration
: 726 | 16.4105 9.8779 0.00480395 0.00047675 184877 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.1157 9.54929 0.00508279 0.000541811 176174 0
: 728 | 16.0303 9.70299 0.004724 0.000451621 187249 1
: 729 | 15.8862 10.1344 0.00505162 0.000519781 176529 2
: 730 Minimum Test error found - save the configuration
: 730 | 15.7402 9.17028 0.00482705 0.00060976 189695 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.5093 9.08558 0.00493212 0.00049155 180157 0
: 732 | 15.1549 9.19264 0.00501901 0.000547182 178898 1
: 733 Minimum Test error found - save the configuration
: 733 | 15.0608 8.57273 0.00476938 0.000487411 186830 0
: 734 | 14.832 8.7211 0.00498798 0.00052255 179154 1
: 735 Minimum Test error found - save the configuration
: 735 | 14.6263 8.17452 0.00476449 0.000559111 190233 0
: 736 | 14.4154 8.34424 0.00492368 0.000438941 178383 1
: 737 | 14.1635 8.34227 0.00491848 0.00054525 182931 2
: 738 Minimum Test error found - save the configuration
: 738 | 13.9997 7.89339 0.00475316 0.000475331 187011 0
: 739 | 13.7652 7.94312 0.00498305 0.000438531 176036 1
: 740 | 13.6327 8.17615 0.00493737 0.00053979 181918 2
: 741 Minimum Test error found - save the configuration
: 741 | 13.7802 7.29685 0.00495494 0.000637341 185288 0
: 742 | 13.386 7.41112 0.00498503 0.000486171 177823 1
: 743 | 13.0834 7.44051 0.00496012 0.000459721 177762 2
: 744 Minimum Test error found - save the configuration
: 744 | 12.8893 7.1096 0.00555269 0.000485401 157875 0
: 745 | 12.7455 7.4167 0.00500705 0.00050874 177845 1
: 746 Minimum Test error found - save the configuration
: 746 | 12.7946 6.85947 0.00490713 0.000550431 183625 0
: 747 | 12.4111 7.89643 0.00494526 0.000575441 183074 1
: 748 Minimum Test error found - save the configuration
: 748 | 12.2152 6.60306 0.00482981 0.00047584 183741 0
: 749 | 12.0091 6.83721 0.00508693 0.000439761 172148 1
: 750 | 11.8504 6.70906 0.00471766 0.000441691 187092 2
: 751 Minimum Test error found - save the configuration
: 751 | 11.7479 6.54042 0.0045631 0.000511531 197454 0
: 752 Minimum Test error found - save the configuration
: 752 | 11.4807 6.13153 0.00474118 0.000473191 187442 0
: 753 Minimum Test error found - save the configuration
: 753 | 11.3562 5.80076 0.00446758 0.000488771 201065 0
: 754 | 11.3727 6.58843 0.00449844 0.000439551 197098 1
: 755 Minimum Test error found - save the configuration
: 755 | 11.1295 5.79493 0.00452861 0.000565272 201850 0
: 756 | 10.9901 5.84626 0.00443305 0.000437901 200243 1
: 757 Minimum Test error found - save the configuration
: 757 | 10.8903 5.52813 0.00452319 0.000506672 199178 0
: 758 Minimum Test error found - save the configuration
: 758 | 10.6306 5.36039 0.00447357 0.00047488 200066 0
: 759 | 10.547 5.3679 0.00450242 0.000454711 197643 1
: 760 | 10.516 5.74397 0.00442579 0.00043841 200633 2
: 761 Minimum Test error found - save the configuration
: 761 | 10.2007 4.58682 0.00456928 0.000498221 196509 0
: 762 | 10.2141 4.90178 0.00447198 0.00051087 201964 1
: 763 | 10.2278 5.73773 0.00444242 0.000460722 200919 2
: 764 | 10.2587 5.37295 0.00451627 0.00043796 196160 3
: 765 | 9.9863 4.74575 0.00468646 0.000558081 193781 4
: 766 | 9.90845 5.08515 0.00450383 0.00045012 197350 5
: 767 | 9.53996 4.71864 0.00461708 0.000501371 194377 6
: 768 | 9.39777 4.82283 0.00444678 0.000456931 200509 7
: 769 Minimum Test error found - save the configuration
: 769 | 9.34792 4.22119 0.00453418 0.000478691 197264 0
: 770 Minimum Test error found - save the configuration
: 770 | 9.35038 3.8526 0.00452456 0.000559791 201777 0
: 771 | 9.17817 4.21283 0.00441947 0.000448071 201441 1
: 772 | 8.97476 4.26229 0.00447512 0.000453851 198942 2
: 773 | 8.8388 3.8754 0.0045134 0.000515102 200085 3
: 774 | 8.67937 4.02525 0.00449067 0.00045631 198297 4
: 775 Minimum Test error found - save the configuration
: 775 | 8.6778 3.7036 0.00451951 0.000471481 197627 0
: 776 Minimum Test error found - save the configuration
: 776 | 8.48423 3.61045 0.00453828 0.000564541 201322 0
: 777 Minimum Test error found - save the configuration
: 777 | 8.4181 3.60423 0.00444878 0.000471401 201138 0
: 778 | 8.28069 3.6237 0.00449643 0.00045421 197911 1
: 779 | 8.3195 4.04515 0.00448603 0.00043847 197650 2
: 780 | 8.21217 4.26705 0.00443055 0.00045491 201226 3
: 781 Minimum Test error found - save the configuration
: 781 | 8.18866 3.49645 0.00452097 0.000473961 197677 0
: 782 Minimum Test error found - save the configuration
: 782 | 7.86817 3.40746 0.00455232 0.000492061 197032 0
: 783 | 7.89337 3.4844 0.00452593 0.00047864 197663 1
: 784 | 7.95911 3.97805 0.00441962 0.000450971 201580 2
: 785 | 7.8853 3.43143 0.00447717 0.000438051 198063 3
: 786 Minimum Test error found - save the configuration
: 786 | 7.50134 3.16307 0.00444696 0.00049384 202372 0
: 787 Minimum Test error found - save the configuration
: 787 | 7.27955 3.14567 0.0045378 0.000476811 196996 0
: 788 Minimum Test error found - save the configuration
: 788 | 7.52533 2.99842 0.00456247 0.000560011 199877 0
: 789 | 7.24943 3.14111 0.00441688 0.00043933 201129 1
: 790 Minimum Test error found - save the configuration
: 790 | 7.00945 2.75825 0.00453177 0.000491421 198003 0
: 791 | 6.9962 3.14345 0.00448321 0.000467211 199203 1
: 792 Minimum Test error found - save the configuration
: 792 | 6.91683 2.69385 0.00448077 0.000489721 200449 0
: 793 | 6.8865 3.06661 0.00448889 0.0004385 197512 1
: 794 | 6.7998 3.01578 0.00448779 0.000454961 198372 2
: 795 Minimum Test error found - save the configuration
: 795 | 6.64599 2.60485 0.00449861 0.00054931 202568 0
: 796 | 6.57699 2.61677 0.00443187 0.000452121 201018 1
: 797 | 6.53079 2.69761 0.00446583 0.00051063 202266 2
: 798 Minimum Test error found - save the configuration
: 798 | 6.43437 2.6034 0.0044481 0.00048866 202049 0
: 799 | 6.32788 2.61002 0.00450742 0.000443731 196866 1
: 800 Minimum Test error found - save the configuration
: 800 | 6.45899 2.49299 0.00453734 0.00056237 201259 0
: 801 Minimum Test error found - save the configuration
: 801 | 6.38516 2.20575 0.00444688 0.00047442 201387 0
: 802 | 6.44958 2.58757 0.00448558 0.00045461 198464 1
: 803 Minimum Test error found - save the configuration
: 803 | 6.17725 1.98939 0.00453397 0.000475341 197111 0
: 804 | 6.01516 2.54644 0.00448138 0.000523612 202134 1
: 805 | 5.92432 3.24718 0.00444099 0.000438751 199888 2
: 806 | 6.07034 2.76331 0.00450127 0.00045577 197751 3
: 807 | 6.15496 2.54258 0.00450602 0.0004393 196719 4
: 808 | 5.79495 2.37988 0.00444977 0.00047477 201258 5
: 809 | 5.80569 2.47582 0.00452824 0.00052098 199638 6
: 810 | 5.67852 2.52977 0.00473623 0.000449281 186613 7
: 811 | 5.43095 2.13975 0.00444307 0.000491651 202459 8
: 812 | 5.43682 2.1102 0.00440544 0.00045791 202659 9
: 813 | 5.51636 2.12626 0.00437146 0.000436611 203312 10
: 814 | 5.37289 2.33007 0.00446913 0.00045383 199238 11
: 815 | 5.32301 2.29712 0.00452193 0.00043791 195886 12
: 816 | 5.21023 2.34942 0.00450767 0.000455561 197428 13
: 817 | 5.2125 2.15391 0.00454957 0.000484811 196814 14
: 818 Minimum Test error found - save the configuration
: 818 | 5.19173 1.91969 0.00456196 0.00049683 196796 0
: 819 | 5.14253 2.47609 0.00445014 0.000437262 199358 1
: 820 | 5.1729 2.20066 0.00446139 0.00052237 203096 2
: 821 | 4.89545 2.13017 0.00441821 0.00043696 200942 3
: 822 | 4.94323 1.98497 0.00447487 0.00045209 198868 4
: 823 | 4.87569 2.08598 0.00440637 0.0004366 201523 5
: 824 Minimum Test error found - save the configuration
: 824 | 4.63013 1.79292 0.00452478 0.00049303 198425 0
: 825 | 4.62238 2.11366 0.00447021 0.00044782 198887 1
: 826 | 4.82762 3.01436 0.00448675 0.000454981 198424 2
: 827 | 4.67861 1.97124 0.00447912 0.00047895 199992 3
: 828 | 4.68427 2.45527 0.00440168 0.000450492 202471 4
: 829 Minimum Test error found - save the configuration
: 829 | 4.70159 1.7705 0.00449739 0.00047125 198702 0
: 830 | 4.474 2.10057 0.00452662 0.00044974 196229 1
: 831 | 4.28034 1.87533 0.00445142 0.000435211 199193 2
: 832 Minimum Test error found - save the configuration
: 832 | 4.21892 1.60673 0.00445851 0.000489011 201537 0
: 833 | 4.24743 1.96797 0.00446652 0.000435301 198451 1
: 834 | 4.22107 2.40804 0.00450706 0.000452391 197304 2
: 835 Minimum Test error found - save the configuration
: 835 | 4.28864 1.52438 0.00451809 0.000522611 200227 0
: 836 | 4.12249 1.92442 0.00444846 0.000451442 200149 1
: 837 | 4.14727 1.67259 0.00448288 0.000437731 197768 2
: 838 | 4.00918 2.05797 0.00441317 0.00045258 201990 3
: 839 | 4.12284 1.82593 0.0044759 0.000438181 198132 4
: 840 | 4.02811 1.78925 0.00447113 0.00052409 202684 5
: 841 | 3.96183 1.76506 0.00442012 0.00044239 201120 6
: 842 | 3.89128 2.27296 0.0044899 0.00045443 198242 7
: 843 | 3.94488 1.6179 0.0044815 0.00043971 197932 8
: 844 | 3.8426 2.00607 0.00448822 0.000532241 202226 9
: 845 | 3.75874 2.28089 0.00440984 0.000436081 201321 10
: 846 | 3.88003 1.8783 0.00447048 0.00043722 198351 11
: 847 | 3.88584 1.67765 0.0045106 0.00043844 196456 12
: 848 | 3.68544 1.89647 0.0044788 0.000513521 201751 13
: 849 | 3.64921 1.61495 0.00446939 0.000463412 199702 14
: 850 | 3.58267 1.68122 0.00449702 0.00051876 201093 15
: 851 | 3.58263 2.04696 0.00439157 0.000453741 203158 16
: 852 | 3.73843 1.93811 0.00448785 0.000438431 197559 17
: 853 | 3.75153 2.07848 0.00441317 0.000452651 201994 18
: 854 | 3.46653 2.09712 0.00512649 0.000650111 178716 19
: 855 | 3.45666 1.80283 0.00455727 0.000448971 194728 20
: 856 | 3.38616 2.15506 0.00448995 0.00043913 197491 21
:
: Elapsed time for training with 1000 events: 3.86 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00611 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.845 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.169 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.28893e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.06428e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0351 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0417 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00141 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0481 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.89 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0202 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00249 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0386 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00486 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00215 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000391 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0486 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00559 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.91 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.102 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.561 0.159 5.35 1.59 | 3.243 3.229
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.101 0.243 1.91 1.18 | 3.332 3.324
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
using namespace TMVA;
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(":");
nnOptions.Append(":");
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
for (int i=1; i<argc; i++) {
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
}
return 0;
}
int main()
Definition Prototype.cxx:12
unsigned int UInt_t
Definition RtypesCore.h:46
double Double_t
Definition RtypesCore.h:59
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
#define gROOT
Definition TROOT.h:414
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
A specialized string object used for TTree selections.
Definition TCut.h:25
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
This is the main MVA steering class.
Definition Factory.h:80
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
static Tools & Instance()
Definition Tools.cxx:71
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
@ kPDEFoam
Definition Types.h:94
Basic string class.
Definition TString.h:139
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
A TTree represents a columnar dataset.
Definition TTree.h:79
create variable transformations
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.