Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.263 sec
: Elapsed time for training with 1000 events: 0.267 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.0026 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000782 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00416 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000304 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000335 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31507.4
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33059.5 31150 0.00432285 0.000584301 213987 0
: 2 Minimum Test error found - save the configuration
: 2 | 32579 30587.3 0.00425306 0.00046889 211407 0
: 3 Minimum Test error found - save the configuration
: 3 | 31858.4 29879.9 0.0045264 0.00053237 200299 0
: 4 Minimum Test error found - save the configuration
: 4 | 31084.5 29207.4 0.00466693 0.00048905 191485 0
: 5 Minimum Test error found - save the configuration
: 5 | 30307.4 28465.6 0.0045714 0.000506382 196801 0
: 6 Minimum Test error found - save the configuration
: 6 | 29492.4 27551.8 0.00450823 0.00055354 202292 0
: 7 Minimum Test error found - save the configuration
: 7 | 28770 26957.7 0.00434134 0.000477581 207052 0
: 8 Minimum Test error found - save the configuration
: 8 | 28312.4 26578.4 0.00433707 0.000452612 205949 0
: 9 Minimum Test error found - save the configuration
: 9 | 27956.5 26251.8 0.00429218 0.000445461 207970 0
: 10 Minimum Test error found - save the configuration
: 10 | 27633.2 25951.3 0.00431936 0.000460611 207321 0
: 11 Minimum Test error found - save the configuration
: 11 | 27327.3 25670.8 0.00420997 0.00047176 214006 0
: 12 Minimum Test error found - save the configuration
: 12 | 27041 25398.2 0.00428628 0.000443851 208202 0
: 13 Minimum Test error found - save the configuration
: 13 | 26760.8 25137.7 0.00428091 0.00049172 211127 0
: 14 Minimum Test error found - save the configuration
: 14 | 26490.5 24885.5 0.00415352 0.000452311 216146 0
: 15 Minimum Test error found - save the configuration
: 15 | 26231.3 24635.4 0.00425066 0.000455691 210806 0
: 16 Minimum Test error found - save the configuration
: 16 | 25973.2 24394.1 0.00423085 0.000521182 215653 0
: 17 Minimum Test error found - save the configuration
: 17 | 25724.3 24155.7 0.00417416 0.000441061 214299 0
: 18 Minimum Test error found - save the configuration
: 18 | 25476.4 23925.1 0.0042526 0.000456681 210753 0
: 19 Minimum Test error found - save the configuration
: 19 | 25238.6 23694.5 0.00422726 0.000530021 216378 0
: 20 Minimum Test error found - save the configuration
: 20 | 24998.3 23472.7 0.00418576 0.000441571 213665 0
: 21 Minimum Test error found - save the configuration
: 21 | 24767.6 23250.8 0.00424244 0.000439461 210362 0
: 22 Minimum Test error found - save the configuration
: 22 | 24537.7 23033.3 0.00427513 0.000456131 209479 0
: 23 Minimum Test error found - save the configuration
: 23 | 24312.1 22818.6 0.00415752 0.000462071 216483 0
: 24 Minimum Test error found - save the configuration
: 24 | 24087.7 22609 0.00424578 0.000458089 211211 0
: 25 Minimum Test error found - save the configuration
: 25 | 23867.9 22402.2 0.00426989 0.000441551 208968 0
: 26 Minimum Test error found - save the configuration
: 26 | 23653.6 22194.2 0.00426322 0.00054306 215045 0
: 27 Minimum Test error found - save the configuration
: 27 | 23436.3 21993.7 0.00419289 0.000455941 214079 0
: 28 Minimum Test error found - save the configuration
: 28 | 23227.8 21791.1 0.00426389 0.00044409 209435 0
: 29 Minimum Test error found - save the configuration
: 29 | 23017.1 21593.9 0.00428584 0.00044188 208119 0
: 30 Minimum Test error found - save the configuration
: 30 | 22810.8 21398.9 0.00430056 0.000474691 209103 0
: 31 Minimum Test error found - save the configuration
: 31 | 22606.5 21206.5 0.00426967 0.00045891 209932 0
: 32 Minimum Test error found - save the configuration
: 32 | 22405 21016 0.004295 0.000442371 207651 0
: 33 Minimum Test error found - save the configuration
: 33 | 22206.1 20827.1 0.00426391 0.000516982 213508 0
: 34 Minimum Test error found - save the configuration
: 34 | 22009.2 20640 0.00431958 0.000466171 207609 0
: 35 Minimum Test error found - save the configuration
: 35 | 21813.9 20455.4 0.00428799 0.000444461 208142 0
: 36 Minimum Test error found - save the configuration
: 36 | 21622.4 20271 0.00432864 0.000478951 207809 0
: 37 Minimum Test error found - save the configuration
: 37 | 21428.5 20093.4 0.00422689 0.000456342 212171 0
: 38 Minimum Test error found - save the configuration
: 38 | 21241.2 19915.6 0.00428356 0.000457562 209096 0
: 39 Minimum Test error found - save the configuration
: 39 | 21055.3 19738.5 0.00430788 0.000443532 207021 0
: 40 Minimum Test error found - save the configuration
: 40 | 20868.8 19565.9 0.00421017 0.000448771 212687 0
: 41 Minimum Test error found - save the configuration
: 41 | 20687.5 19392.8 0.00430499 0.000458241 207968 0
: 42 Minimum Test error found - save the configuration
: 42 | 20506.2 19222.3 0.00429176 0.000447241 208089 0
: 43 Minimum Test error found - save the configuration
: 43 | 20327.4 19053.3 0.0043231 0.00053495 211185 0
: 44 Minimum Test error found - save the configuration
: 44 | 20150.7 18885.4 0.00423163 0.00046154 212197 0
: 45 Minimum Test error found - save the configuration
: 45 | 19974.5 18720.6 0.00431718 0.00044764 206743 0
: 46 Minimum Test error found - save the configuration
: 46 | 19801.2 18557.1 0.00431184 0.000446661 206976 0
: 47 Minimum Test error found - save the configuration
: 47 | 19628.3 18397 0.00424358 0.00047459 212259 0
: 48 Minimum Test error found - save the configuration
: 48 | 19460.7 18235.3 0.00424036 0.00044981 211051 0
: 49 Minimum Test error found - save the configuration
: 49 | 19289 18080 0.00422829 0.000435371 210920 0
: 50 Minimum Test error found - save the configuration
: 50 | 19127.5 17919.1 0.00422735 0.00049834 214534 0
: 51 Minimum Test error found - save the configuration
: 51 | 18955.7 17769.9 0.00416792 0.000433831 214243 0
: 52 Minimum Test error found - save the configuration
: 52 | 18796.9 17615.1 0.00426678 0.000475692 211021 0
: 53 Minimum Test error found - save the configuration
: 53 | 18635 17461.7 0.00417237 0.000448841 214850 0
: 54 Minimum Test error found - save the configuration
: 54 | 18473.1 17311.5 0.00424269 0.00043563 210136 0
: 55 Minimum Test error found - save the configuration
: 55 | 18314.5 17158.4 0.00428024 0.00051614 212534 0
: 56 Minimum Test error found - save the configuration
: 56 | 18149.1 17003.5 0.00420402 0.000458871 213610 0
: 57 Minimum Test error found - save the configuration
: 57 | 18001.1 16857.8 0.00434502 0.000463241 206091 0
: 58 Minimum Test error found - save the configuration
: 58 | 17836.7 16715.4 0.00428913 0.00046154 209009 0
: 59 Minimum Test error found - save the configuration
: 59 | 17681.3 16563.5 0.00424539 0.000457961 211225 0
: 60 Minimum Test error found - save the configuration
: 60 | 17521.2 16408.8 0.00434252 0.000469981 206583 0
: 61 Minimum Test error found - save the configuration
: 61 | 17367.3 16265.3 0.00431383 0.00044793 206938 0
: 62 Minimum Test error found - save the configuration
: 62 | 17213.6 16123.1 0.00428275 0.000467091 209663 0
: 63 Minimum Test error found - save the configuration
: 63 | 17060.2 15965.3 0.00433088 0.000473161 207377 0
: 64 Minimum Test error found - save the configuration
: 64 | 16910.7 15823.6 0.00433905 0.00047126 206837 0
: 65 Minimum Test error found - save the configuration
: 65 | 16758.5 15678.5 0.00427477 0.00045696 209544 0
: 66 Minimum Test error found - save the configuration
: 66 | 16606.3 15529.2 0.00436514 0.00047897 205858 0
: 67 Minimum Test error found - save the configuration
: 67 | 16454.6 15388.4 0.00442165 0.000490942 203526 0
: 68 Minimum Test error found - save the configuration
: 68 | 16306.5 15247.5 0.00431247 0.000468672 208128 0
: 69 Minimum Test error found - save the configuration
: 69 | 16161.6 15105.2 0.00439786 0.00046196 203257 0
: 70 Minimum Test error found - save the configuration
: 70 | 16014.4 14968.2 0.00438666 0.00051135 206435 0
: 71 Minimum Test error found - save the configuration
: 71 | 15869.6 14831.9 0.00434262 0.000485581 207413 0
: 72 Minimum Test error found - save the configuration
: 72 | 15727.8 14696.1 0.00438878 0.000459942 203623 0
: 73 Minimum Test error found - save the configuration
: 73 | 15586.8 14561.3 0.00439768 0.000473121 203845 0
: 74 Minimum Test error found - save the configuration
: 74 | 15443.6 14427.7 0.00437318 0.00050436 206782 0
: 75 Minimum Test error found - save the configuration
: 75 | 15308 14292.1 0.00438553 0.000461341 203864 0
: 76 Minimum Test error found - save the configuration
: 76 | 15164.5 14164.6 0.00444433 0.000477132 201654 0
: 77 Minimum Test error found - save the configuration
: 77 | 15030 14033.5 0.00439734 0.00049394 204950 0
: 78 Minimum Test error found - save the configuration
: 78 | 14892.1 13905.9 0.00438378 0.000483571 205117 0
: 79 Minimum Test error found - save the configuration
: 79 | 14758.7 13778.3 0.00442043 0.00046413 202209 0
: 80 Minimum Test error found - save the configuration
: 80 | 14624.5 13652.7 0.00442314 0.000465261 202129 0
: 81 Minimum Test error found - save the configuration
: 81 | 14493.2 13527.5 0.004447 0.000483931 201864 0
: 82 Minimum Test error found - save the configuration
: 82 | 14362.3 13403.5 0.00442095 0.000531291 205674 0
: 83 Minimum Test error found - save the configuration
: 83 | 14231.8 13282.6 0.00439305 0.000479661 204427 0
: 84 Minimum Test error found - save the configuration
: 84 | 14103.2 13163.1 0.00441073 0.000462571 202626 0
: 85 Minimum Test error found - save the configuration
: 85 | 13977 13042.6 0.00446422 0.00048092 200839 0
: 86 Minimum Test error found - save the configuration
: 86 | 13852.9 12921.5 0.00445794 0.00054638 204522 0
: 87 Minimum Test error found - save the configuration
: 87 | 13727.1 12802.8 0.00436477 0.0004636 205067 0
: 88 Minimum Test error found - save the configuration
: 88 | 13600.6 12688.9 0.00444585 0.00047911 201677 0
: 89 Minimum Test error found - save the configuration
: 89 | 13479.7 12574.3 0.00452049 0.00046775 197398 0
: 90 Minimum Test error found - save the configuration
: 90 | 13358.9 12459.7 0.00452323 0.000472661 197503 0
: 91 Minimum Test error found - save the configuration
: 91 | 13238.7 12345.9 0.00425593 0.000456891 210580 0
: 92 Minimum Test error found - save the configuration
: 92 | 13118.7 12234.2 0.00426072 0.00046702 210876 0
: 93 Minimum Test error found - save the configuration
: 93 | 13000.9 12123.1 0.00425342 0.00047616 211793 0
: 94 Minimum Test error found - save the configuration
: 94 | 12883.1 12013.7 0.00425374 0.00046136 210950 0
: 95 Minimum Test error found - save the configuration
: 95 | 12768.3 11903.8 0.00426427 0.00046322 210468 0
: 96 Minimum Test error found - save the configuration
: 96 | 12653.4 11794.5 0.00439801 0.00048664 204532 0
: 97 Minimum Test error found - save the configuration
: 97 | 12537.9 11688.4 0.00447116 0.0004992 201412 0
: 98 Minimum Test error found - save the configuration
: 98 | 12426.1 11581.8 0.00437768 0.000477951 205143 0
: 99 Minimum Test error found - save the configuration
: 99 | 12313.7 11475.7 0.00444457 0.000464081 200980 0
: 100 Minimum Test error found - save the configuration
: 100 | 12202.2 11371.3 0.00443974 0.00046342 201191 0
: 101 Minimum Test error found - save the configuration
: 101 | 12091.8 11268.5 0.00447731 0.00055993 204218 0
: 102 Minimum Test error found - save the configuration
: 102 | 11982.3 11167.4 0.00436132 0.000466092 205380 0
: 103 Minimum Test error found - save the configuration
: 103 | 11876.3 11063.6 0.00448895 0.000497591 200433 0
: 104 Minimum Test error found - save the configuration
: 104 | 11766.7 10964.5 0.00444532 0.00054606 205167 0
: 105 Minimum Test error found - save the configuration
: 105 | 11661.5 10864.3 0.00441943 0.00048988 203586 0
: 106 Minimum Test error found - save the configuration
: 106 | 11555.5 10766.2 0.00447617 0.00046368 199378 0
: 107 Minimum Test error found - save the configuration
: 107 | 11453.6 10665.5 0.00446252 0.000537002 203795 0
: 108 Minimum Test error found - save the configuration
: 108 | 11346.8 10570.4 0.00437944 0.000468661 204563 0
: 109 Minimum Test error found - save the configuration
: 109 | 11246.7 10472.5 0.00445321 0.00047374 201032 0
: 110 Minimum Test error found - save the configuration
: 110 | 11142.1 10380 0.00444447 0.00053829 204804 0
: 111 Minimum Test error found - save the configuration
: 111 | 11043.9 10284 0.0043686 0.000461921 204778 0
: 112 Minimum Test error found - save the configuration
: 112 | 10943.8 10189.3 0.00448296 0.00049194 200450 0
: 113 Minimum Test error found - save the configuration
: 113 | 10844.1 10096.7 0.00443641 0.00046643 201513 0
: 114 Minimum Test error found - save the configuration
: 114 | 10746.1 10004.5 0.00449499 0.000564811 203553 0
: 115 Minimum Test error found - save the configuration
: 115 | 10649.5 9912.2 0.00438914 0.0004658 203908 0
: 116 Minimum Test error found - save the configuration
: 116 | 10551.3 9823.24 0.00449514 0.0004922 199853 0
: 117 Minimum Test error found - save the configuration
: 117 | 10456 9734.79 0.00448643 0.000469991 199182 0
: 118 Minimum Test error found - save the configuration
: 118 | 10362.5 9645.15 0.00446504 0.000561091 204921 0
: 119 Minimum Test error found - save the configuration
: 119 | 10268.3 9556.73 0.0044184 0.00046964 202595 0
: 120 Minimum Test error found - save the configuration
: 120 | 10175.6 9468.47 0.0044633 0.000486131 201148 0
: 121 Minimum Test error found - save the configuration
: 121 | 10081.9 9383.09 0.00447939 0.00048146 200104 0
: 122 Minimum Test error found - save the configuration
: 122 | 9990.67 9298.5 0.00446155 0.000546151 204322 0
: 123 Minimum Test error found - save the configuration
: 123 | 9902.65 9210.44 0.00441386 0.000482741 203505 0
: 124 Minimum Test error found - save the configuration
: 124 | 9809.68 9127.88 0.00453094 0.000468322 196917 0
: 125 Minimum Test error found - save the configuration
: 125 | 9722.01 9043.95 0.0045373 0.00047204 196790 0
: 126 Minimum Test error found - save the configuration
: 126 | 9633.73 8960.8 0.00452474 0.000563962 201981 0
: 127 Minimum Test error found - save the configuration
: 127 | 9544.75 8880.59 0.00455611 0.000472781 195919 0
: 128 Minimum Test error found - save the configuration
: 128 | 9460.17 8797.76 0.00459321 0.000509521 195901 0
: 129 Minimum Test error found - save the configuration
: 129 | 9372.5 8718.26 0.00451819 0.00046983 197611 0
: 130 Minimum Test error found - save the configuration
: 130 | 9289.26 8636.32 0.00453378 0.000501061 198378 0
: 131 Minimum Test error found - save the configuration
: 131 | 9202.86 8558.12 0.00451954 0.000552291 201651 0
: 132 Minimum Test error found - save the configuration
: 132 | 9118.9 8480.9 0.00444314 0.00048285 202006 0
: 133 Minimum Test error found - save the configuration
: 133 | 9037.07 8402.4 0.00452465 0.0004665 197134 0
: 134 Minimum Test error found - save the configuration
: 134 | 8954.8 8324.68 0.00455239 0.000487412 196803 0
: 135 Minimum Test error found - save the configuration
: 135 | 8872.94 8248.09 0.00452909 0.00046928 197054 0
: 136 Minimum Test error found - save the configuration
: 136 | 8792.4 8171.72 0.0045498 0.000550042 200012 0
: 137 Minimum Test error found - save the configuration
: 137 | 8711.87 8096.75 0.00448692 0.00049269 200289 0
: 138 Minimum Test error found - save the configuration
: 138 | 8631.75 8023.45 0.00445227 0.00048732 201768 0
: 139 Minimum Test error found - save the configuration
: 139 | 8554.59 7948.55 0.00449605 0.00047539 198973 0
: 140 Minimum Test error found - save the configuration
: 140 | 8475.57 7875.69 0.00448367 0.000486571 200145 0
: 141 Minimum Test error found - save the configuration
: 141 | 8399.35 7802.15 0.00448243 0.000542561 203053 0
: 142 Minimum Test error found - save the configuration
: 142 | 8320.68 7732.12 0.00442159 0.000500061 204002 0
: 143 Minimum Test error found - save the configuration
: 143 | 8246.3 7660.42 0.00443519 0.00046652 201579 0
: 144 Minimum Test error found - save the configuration
: 144 | 8170.45 7589.85 0.00445565 0.000484841 201470 0
: 145 Minimum Test error found - save the configuration
: 145 | 8095.66 7520.35 0.00442919 0.000467031 201910 0
: 146 Minimum Test error found - save the configuration
: 146 | 8022.42 7450.24 0.00448841 0.00055685 203482 0
: 147 Minimum Test error found - save the configuration
: 147 | 7949.51 7380.24 0.00436199 0.00046949 205524 0
: 148 Minimum Test error found - save the configuration
: 148 | 7875.86 7312.32 0.00445789 0.00047852 201037 0
: 149 Minimum Test error found - save the configuration
: 149 | 7803.9 7244.95 0.00472966 0.000478571 188187 0
: 150 Minimum Test error found - save the configuration
: 150 | 7732.35 7178.45 0.00486877 0.00058952 186949 0
: 151 Minimum Test error found - save the configuration
: 151 | 7661.9 7112.19 0.00478547 0.000520312 187566 0
: 152 Minimum Test error found - save the configuration
: 152 | 7591.54 7046.81 0.00465839 0.000491822 192005 0
: 153 Minimum Test error found - save the configuration
: 153 | 7522.44 6981.53 0.0044743 0.000479201 200246 0
: 154 Minimum Test error found - save the configuration
: 154 | 7453.75 6916.66 0.0044408 0.000528531 204485 0
: 155 Minimum Test error found - save the configuration
: 155 | 7385.29 6852.62 0.00443335 0.00049517 203140 0
: 156 Minimum Test error found - save the configuration
: 156 | 7317.29 6789.85 0.00447607 0.000477191 200056 0
: 157 Minimum Test error found - save the configuration
: 157 | 7249.92 6727.89 0.004484 0.00048884 200242 0
: 158 Minimum Test error found - save the configuration
: 158 | 7185.52 6663.65 0.0044676 0.000471141 200177 0
: 159 Minimum Test error found - save the configuration
: 159 | 7118.57 6601.54 0.00448148 0.000507321 201301 0
: 160 Minimum Test error found - save the configuration
: 160 | 7052.6 6541.24 0.00444741 0.00054341 204918 0
: 161 Minimum Test error found - save the configuration
: 161 | 6989.02 6479.77 0.00480263 0.00068633 194349 0
: 162 Minimum Test error found - save the configuration
: 162 | 6924.16 6420.22 0.00444761 0.00048519 201897 0
: 163 Minimum Test error found - save the configuration
: 163 | 6859.83 6362.21 0.00448641 0.000473821 199373 0
: 164 Minimum Test error found - save the configuration
: 164 | 6799.2 6301.19 0.00447059 0.00048309 200627 0
: 165 Minimum Test error found - save the configuration
: 165 | 6735.72 6242.56 0.00445121 0.000528461 203939 0
: 166 Minimum Test error found - save the configuration
: 166 | 6674 6183.96 0.0055633 0.00066434 163300 0
: 167 Minimum Test error found - save the configuration
: 167 | 6611.9 6127.32 0.00600218 0.000662871 149832 0
: 168 Minimum Test error found - save the configuration
: 168 | 6552.27 6069.8 0.00616152 0.000697862 146422 0
: 169 Minimum Test error found - save the configuration
: 169 | 6490.83 6014.3 0.00619488 0.00069729 145518 0
: 170 Minimum Test error found - save the configuration
: 170 | 6431.44 5958.9 0.00534376 0.000481341 164527 0
: 171 Minimum Test error found - save the configuration
: 171 | 6372.7 5903.45 0.0043335 0.00048116 207666 0
: 172 Minimum Test error found - save the configuration
: 172 | 6314.24 5848.22 0.00427819 0.000465661 209835 0
: 173 Minimum Test error found - save the configuration
: 173 | 6255.3 5794.75 0.00431244 0.00047186 208302 0
: 174 Minimum Test error found - save the configuration
: 174 | 6198.21 5741.03 0.00431997 0.000482201 208455 0
: 175 Minimum Test error found - save the configuration
: 175 | 6141.53 5687.02 0.00429707 0.00048242 209718 0
: 176 Minimum Test error found - save the configuration
: 176 | 6083.54 5636.03 0.0043023 0.000466931 208585 0
: 177 Minimum Test error found - save the configuration
: 177 | 6030.14 5581.28 0.00429512 0.00047582 209463 0
: 178 Minimum Test error found - save the configuration
: 178 | 5973.1 5529.6 0.00426996 0.000482711 211235 0
: 179 Minimum Test error found - save the configuration
: 179 | 5918.9 5476.51 0.00430849 0.00046923 208374 0
: 180 Minimum Test error found - save the configuration
: 180 | 5862.5 5426.88 0.00427859 0.000463811 209711 0
: 181 Minimum Test error found - save the configuration
: 181 | 5809.29 5376.65 0.00428396 0.000475661 210068 0
: 182 Minimum Test error found - save the configuration
: 182 | 5755.57 5326.84 0.00431379 0.000467221 207978 0
: 183 Minimum Test error found - save the configuration
: 183 | 5702.84 5277.1 0.00431002 0.00046864 208259 0
: 184 Minimum Test error found - save the configuration
: 184 | 5650.04 5228.8 0.00434377 0.00048632 207391 0
: 185 Minimum Test error found - save the configuration
: 185 | 5599.63 5177.25 0.00430599 0.00046444 208249 0
: 186 Minimum Test error found - save the configuration
: 186 | 5545.32 5130.92 0.00436979 0.000472052 205247 0
: 187 Minimum Test error found - save the configuration
: 187 | 5496.66 5080.72 0.00440003 0.00050362 205317 0
: 188 Minimum Test error found - save the configuration
: 188 | 5444.62 5033.27 0.00452561 0.000496462 198553 0
: 189 Minimum Test error found - save the configuration
: 189 | 5394.45 4986.36 0.00450449 0.000484731 199017 0
: 190 Minimum Test error found - save the configuration
: 190 | 5343.84 4941.12 0.00431133 0.0004702 208272 0
: 191 Minimum Test error found - save the configuration
: 191 | 5295.22 4894.71 0.00439455 0.000485351 204646 0
: 192 Minimum Test error found - save the configuration
: 192 | 5245.98 4849.95 0.00431911 0.00048627 208723 0
: 193 Minimum Test error found - save the configuration
: 193 | 5197.58 4805.33 0.00434672 0.000472811 206510 0
: 194 Minimum Test error found - save the configuration
: 194 | 5150.52 4759.4 0.00435819 0.000488172 206718 0
: 195 Minimum Test error found - save the configuration
: 195 | 5101.58 4716.33 0.00427965 0.000479771 210533 0
: 196 Minimum Test error found - save the configuration
: 196 | 5056.08 4671.26 0.00430577 0.00047044 208587 0
: 197 Minimum Test error found - save the configuration
: 197 | 5008.57 4627.76 0.0042995 0.00048067 209488 0
: 198 Minimum Test error found - save the configuration
: 198 | 4962.01 4585.43 0.0043818 0.000494221 205784 0
: 199 Minimum Test error found - save the configuration
: 199 | 4917.49 4541.17 0.00430149 0.00046935 208761 0
: 200 Minimum Test error found - save the configuration
: 200 | 4870.87 4499.44 0.00458169 0.000482661 195168 0
: 201 Minimum Test error found - save the configuration
: 201 | 4826.58 4457.05 0.00430194 0.0004702 208783 0
: 202 Minimum Test error found - save the configuration
: 202 | 4781.73 4415.88 0.0043336 0.0004762 207394 0
: 203 Minimum Test error found - save the configuration
: 203 | 4738.14 4373.92 0.00431779 0.00048084 208499 0
: 204 Minimum Test error found - save the configuration
: 204 | 4693.74 4334.06 0.00429576 0.00046855 209030 0
: 205 Minimum Test error found - save the configuration
: 205 | 4650.72 4294.1 0.00433026 0.00047202 207349 0
: 206 Minimum Test error found - save the configuration
: 206 | 4607.92 4253.95 0.00432451 0.000482651 208233 0
: 207 Minimum Test error found - save the configuration
: 207 | 4566.21 4213.73 0.00434173 0.000472781 206775 0
: 208 Minimum Test error found - save the configuration
: 208 | 4523.4 4174.92 0.00431039 0.00046932 208276 0
: 209 Minimum Test error found - save the configuration
: 209 | 4481.44 4137.12 0.00431896 0.00049245 209068 0
: 210 Minimum Test error found - save the configuration
: 210 | 4441.41 4097.09 0.00430119 0.000470591 208845 0
: 211 Minimum Test error found - save the configuration
: 211 | 4400.24 4058.34 0.00433975 0.000475871 207046 0
: 212 Minimum Test error found - save the configuration
: 212 | 4358.88 4021.47 0.00431673 0.000484481 208755 0
: 213 Minimum Test error found - save the configuration
: 213 | 4319.74 3983.46 0.00429609 0.000471971 209199 0
: 214 Minimum Test error found - save the configuration
: 214 | 4279.58 3946.49 0.00435436 0.000476202 206284 0
: 215 Minimum Test error found - save the configuration
: 215 | 4239.96 3910.33 0.00431286 0.000484431 208963 0
: 216 Minimum Test error found - save the configuration
: 216 | 4202.03 3873.28 0.00432974 0.000472371 207395 0
: 217 Minimum Test error found - save the configuration
: 217 | 4162.85 3837.21 0.0043336 0.000472131 207175 0
: 218 Minimum Test error found - save the configuration
: 218 | 4124.93 3801.46 0.00431789 0.000481141 208510 0
: 219 Minimum Test error found - save the configuration
: 219 | 4086.47 3766.96 0.00433176 0.00047374 207360 0
: 220 Minimum Test error found - save the configuration
: 220 | 4049.36 3732.21 0.00430286 0.00046703 208560 0
: 221 Minimum Test error found - save the configuration
: 221 | 4012.5 3697.18 0.00431396 0.00048022 208674 0
: 222 Minimum Test error found - save the configuration
: 222 | 3976.42 3661.79 0.00570848 0.000694201 159544 0
: 223 Minimum Test error found - save the configuration
: 223 | 3939.29 3628.32 0.00567761 0.00047855 153874 0
: 224 Minimum Test error found - save the configuration
: 224 | 3903.57 3594.51 0.00448408 0.000498861 200742 0
: 225 Minimum Test error found - save the configuration
: 225 | 3867.69 3560.49 0.00577378 0.000675351 156911 0
: 226 Minimum Test error found - save the configuration
: 226 | 3831.65 3528.86 0.0056673 0.00047047 153940 0
: 227 Minimum Test error found - save the configuration
: 227 | 3798.37 3494.24 0.00441399 0.000477971 203251 0
: 228 Minimum Test error found - save the configuration
: 228 | 3762.11 3463.13 0.0044148 0.000484831 203564 0
: 229 Minimum Test error found - save the configuration
: 229 | 3729.19 3429.63 0.00441519 0.00047347 202957 0
: 230 Minimum Test error found - save the configuration
: 230 | 3694.3 3398.04 0.00441162 0.000499361 204486 0
: 231 Minimum Test error found - save the configuration
: 231 | 3661.49 3365.74 0.00437027 0.000470762 205154 0
: 232 Minimum Test error found - save the configuration
: 232 | 3626.98 3335.04 0.00437219 0.00047257 205148 0
: 233 Minimum Test error found - save the configuration
: 233 | 3594.91 3303.79 0.00439002 0.00048436 204831 0
: 234 Minimum Test error found - save the configuration
: 234 | 3561.23 3273.88 0.00438932 0.000471291 204184 0
: 235 Minimum Test error found - save the configuration
: 235 | 3530.19 3242.35 0.00439089 0.00048497 204818 0
: 236 Minimum Test error found - save the configuration
: 236 | 3497.03 3212.98 0.00437071 0.000467292 204949 0
: 237 Minimum Test error found - save the configuration
: 237 | 3465.7 3182.99 0.0043724 0.000468841 204941 0
: 238 Minimum Test error found - save the configuration
: 238 | 3434.19 3152.79 0.00444661 0.000489 202142 0
: 239 Minimum Test error found - save the configuration
: 239 | 3402.47 3124.5 0.00436744 0.000469971 205262 0
: 240 Minimum Test error found - save the configuration
: 240 | 3371.44 3095.73 0.00439148 0.000484461 204760 0
: 241 Minimum Test error found - save the configuration
: 241 | 3341.3 3066.74 0.00439261 0.000471731 204036 0
: 242 Minimum Test error found - save the configuration
: 242 | 3311.07 3038.17 0.00437771 0.00046997 204722 0
: 243 Minimum Test error found - save the configuration
: 243 | 3281.44 3009.4 0.00438666 0.00048626 205107 0
: 244 Minimum Test error found - save the configuration
: 244 | 3250.69 2981.96 0.00437141 0.000471061 205110 0
: 245 Minimum Test error found - save the configuration
: 245 | 3222.36 2952.57 0.00437632 0.000481541 205403 0
: 246 Minimum Test error found - save the configuration
: 246 | 3191 2926.98 0.00436693 0.000480531 205846 0
: 247 Minimum Test error found - save the configuration
: 247 | 3163.85 2898.82 0.00439597 0.00047365 203961 0
: 248 Minimum Test error found - save the configuration
: 248 | 3134.41 2872.18 0.00438519 0.00048309 205018 0
: 249 Minimum Test error found - save the configuration
: 249 | 3105.82 2846.01 0.00436967 0.000467171 204997 0
: 250 Minimum Test error found - save the configuration
: 250 | 3077.41 2819.99 0.00441852 0.000490151 203647 0
: 251 Minimum Test error found - save the configuration
: 251 | 3049.68 2793.87 0.00437509 0.000486701 205741 0
: 252 Minimum Test error found - save the configuration
: 252 | 3022.75 2767.43 0.00439747 0.00047547 203978 0
: 253 Minimum Test error found - save the configuration
: 253 | 2994.22 2742.14 0.00442092 0.00048913 203470 0
: 254 Minimum Test error found - save the configuration
: 254 | 2967.68 2716.34 0.00439787 0.00047934 204158 0
: 255 Minimum Test error found - save the configuration
: 255 | 2940.89 2690.91 0.00441643 0.000492881 203897 0
: 256 Minimum Test error found - save the configuration
: 256 | 2913.4 2666.57 0.00434536 0.000486401 207310 0
: 257 Minimum Test error found - save the configuration
: 257 | 2887.54 2641.87 0.00433267 0.000472811 207262 0
: 258 Minimum Test error found - save the configuration
: 258 | 2861.15 2617.67 0.00435591 0.000489802 206927 0
: 259 Minimum Test error found - save the configuration
: 259 | 2835.25 2593.48 0.00430993 0.00048085 208928 0
: 260 Minimum Test error found - save the configuration
: 260 | 2810.59 2568.73 0.00431451 0.00046778 207969 0
: 261 Minimum Test error found - save the configuration
: 261 | 2783.73 2545.6 0.0043718 0.00048832 206001 0
: 262 Minimum Test error found - save the configuration
: 262 | 2759.06 2522.16 0.00434583 0.000473561 206597 0
: 263 Minimum Test error found - save the configuration
: 263 | 2734.3 2498.48 0.00439937 0.000475931 203903 0
: 264 Minimum Test error found - save the configuration
: 264 | 2709.38 2475.71 0.0043395 0.000483552 207472 0
: 265 Minimum Test error found - save the configuration
: 265 | 2684.83 2452.89 0.0043209 0.000468691 207673 0
: 266 Minimum Test error found - save the configuration
: 266 | 2660.82 2429.11 0.00439257 0.0004782 204375 0
: 267 Minimum Test error found - save the configuration
: 267 | 2635.65 2408.35 0.00441121 0.0004911 204076 0
: 268 Minimum Test error found - save the configuration
: 268 | 2613.03 2384.89 0.00432463 0.00047272 207689 0
: 269 Minimum Test error found - save the configuration
: 269 | 2588.83 2362.79 0.00437817 0.000491401 205827 0
: 270 Minimum Test error found - save the configuration
: 270 | 2564.59 2342.26 0.00435585 0.000508131 207916 0
: 271 Minimum Test error found - save the configuration
: 271 | 2542.53 2319.98 0.00432363 0.000470252 207610 0
: 272 Minimum Test error found - save the configuration
: 272 | 2519.22 2298.32 0.00436264 0.00048805 206474 0
: 273 Minimum Test error found - save the configuration
: 273 | 2496.02 2277.15 0.0043489 0.00047715 206625 0
: 274 Minimum Test error found - save the configuration
: 274 | 2473.21 2256.69 0.00434327 0.00047244 206674 0
: 275 Minimum Test error found - save the configuration
: 275 | 2451.53 2235.5 0.00436934 0.00048569 205992 0
: 276 Minimum Test error found - save the configuration
: 276 | 2429.09 2214.79 0.0043586 0.000469849 205722 0
: 277 Minimum Test error found - save the configuration
: 277 | 2406.86 2194.67 0.00432163 0.0004674 207564 0
: 278 Minimum Test error found - save the configuration
: 278 | 2383.97 2175.43 0.00432916 0.000482241 207959 0
: 279 Minimum Test error found - save the configuration
: 279 | 2363.25 2155.19 0.00434717 0.00046935 206302 0
: 280 Minimum Test error found - save the configuration
: 280 | 2341.49 2134.83 0.00431889 0.000467521 207719 0
: 281 Minimum Test error found - save the configuration
: 281 | 2320.21 2115.51 0.00439751 0.00048853 204657 0
: 282 Minimum Test error found - save the configuration
: 282 | 2299.03 2095.5 0.00434288 0.00047194 206668 0
: 283 Minimum Test error found - save the configuration
: 283 | 2277.96 2076.12 0.00439023 0.000495531 205408 0
: 284 Minimum Test error found - save the configuration
: 284 | 2256.65 2057.56 0.0043327 0.000482781 207797 0
: 285 Minimum Test error found - save the configuration
: 285 | 2236.87 2038.01 0.0043061 0.000468611 208470 0
: 286 Minimum Test error found - save the configuration
: 286 | 2215.53 2019.8 0.00436557 0.00048483 206146 0
: 287 Minimum Test error found - save the configuration
: 287 | 2195.34 2001.41 0.00431235 0.000481561 208834 0
: 288 Minimum Test error found - save the configuration
: 288 | 2175.23 1983.7 0.00432748 0.000472001 207497 0
: 289 Minimum Test error found - save the configuration
: 289 | 2155.34 1965.44 0.00434535 0.000484571 207212 0
: 290 Minimum Test error found - save the configuration
: 290 | 2135.55 1946.85 0.0043665 0.00048793 206262 0
: 291 Minimum Test error found - save the configuration
: 291 | 2115.81 1929.1 0.00442087 0.000478591 202928 0
: 292 Minimum Test error found - save the configuration
: 292 | 2096.13 1911.46 0.00439653 0.000502032 205418 0
: 293 Minimum Test error found - save the configuration
: 293 | 2076.81 1893.71 0.00433928 0.000472431 206887 0
: 294 Minimum Test error found - save the configuration
: 294 | 2057.45 1876.49 0.00434801 0.00048379 207028 0
: 295 Minimum Test error found - save the configuration
: 295 | 2038.75 1859.43 0.0043491 0.000485941 207085 0
: 296 Minimum Test error found - save the configuration
: 296 | 2019.57 1842.33 0.00438641 0.00047372 204463 0
: 297 Minimum Test error found - save the configuration
: 297 | 2001.26 1825.4 0.00436602 0.000487652 206272 0
: 298 Minimum Test error found - save the configuration
: 298 | 1982.29 1809.07 0.00436395 0.00047213 205560 0
: 299 Minimum Test error found - save the configuration
: 299 | 1964.52 1791.81 0.00434807 0.00047186 206387 0
: 300 Minimum Test error found - save the configuration
: 300 | 1945.27 1775.91 0.0043876 0.00048931 205218 0
: 301 Minimum Test error found - save the configuration
: 301 | 1927.67 1759.83 0.00433984 0.000467871 206613 0
: 302 Minimum Test error found - save the configuration
: 302 | 1909.66 1743.5 0.00435165 0.000473941 206308 0
: 303 Minimum Test error found - save the configuration
: 303 | 1891.68 1727.77 0.00433072 0.000480421 207776 0
: 304 Minimum Test error found - save the configuration
: 304 | 1874.23 1711.72 0.00437722 0.000472731 204893 0
: 305 Minimum Test error found - save the configuration
: 305 | 1856.33 1696.72 0.00433534 0.00048011 207510 0
: 306 Minimum Test error found - save the configuration
: 306 | 1839.38 1680.53 0.00435172 0.00049364 207357 0
: 307 Minimum Test error found - save the configuration
: 307 | 1822.04 1665.17 0.00435602 0.00047502 206133 0
: 308 Minimum Test error found - save the configuration
: 308 | 1804.61 1650.25 0.0043563 0.00048669 206739 0
: 309 Minimum Test error found - save the configuration
: 309 | 1787.6 1635.3 0.00437984 0.000477682 205015 0
: 310 Minimum Test error found - save the configuration
: 310 | 1771.13 1620.27 0.00434908 0.000471351 206307 0
: 311 Minimum Test error found - save the configuration
: 311 | 1754.3 1605.66 0.00440893 0.00049679 204492 0
: 312 Minimum Test error found - save the configuration
: 312 | 1738.32 1590.31 0.0043335 0.00047268 207210 0
: 313 Minimum Test error found - save the configuration
: 313 | 1721.52 1575.33 0.00438765 0.00049091 205300 0
: 314 Minimum Test error found - save the configuration
: 314 | 1705.23 1560.73 0.00436067 0.00048635 206488 0
: 315 Minimum Test error found - save the configuration
: 315 | 1689.21 1546.84 0.00438873 0.000478251 204579 0
: 316 Minimum Test error found - save the configuration
: 316 | 1673.15 1532.57 0.00437904 0.00048696 205546 0
: 317 Minimum Test error found - save the configuration
: 317 | 1657.05 1518.14 0.00433718 0.0004716 206955 0
: 318 Minimum Test error found - save the configuration
: 318 | 1640.69 1505.21 0.0043598 0.000472351 205791 0
: 319 Minimum Test error found - save the configuration
: 319 | 1625.62 1491.08 0.00436164 0.00048809 206529 0
: 320 Minimum Test error found - save the configuration
: 320 | 1610.14 1477.31 0.0043602 0.000474341 205875 0
: 321 Minimum Test error found - save the configuration
: 321 | 1595.11 1463.66 0.00437483 0.000486271 205732 0
: 322 Minimum Test error found - save the configuration
: 322 | 1580.04 1450.29 0.00435063 0.000496631 207577 0
: 323 Minimum Test error found - save the configuration
: 323 | 1564.79 1436.66 0.00438288 0.00048314 205142 0
: 324 Minimum Test error found - save the configuration
: 324 | 1549.33 1423.63 0.0043954 0.00048905 204795 0
: 325 Minimum Test error found - save the configuration
: 325 | 1534.92 1410.19 0.0043596 0.000476062 205998 0
: 326 Minimum Test error found - save the configuration
: 326 | 1520.06 1396.91 0.00434095 0.000473802 206871 0
: 327 Minimum Test error found - save the configuration
: 327 | 1504.98 1384.76 0.00443409 0.0005096 203848 0
: 328 Minimum Test error found - save the configuration
: 328 | 1490.61 1372.4 0.00438698 0.000476101 204558 0
: 329 Minimum Test error found - save the configuration
: 329 | 1477.11 1359.12 0.00442997 0.000497372 203428 0
: 330 Minimum Test error found - save the configuration
: 330 | 1462.99 1345.98 0.00436006 0.0004764 205991 0
: 331 Minimum Test error found - save the configuration
: 331 | 1448.4 1333.51 0.00434743 0.000472881 206476 0
: 332 Minimum Test error found - save the configuration
: 332 | 1434.43 1321.62 0.0044178 0.000489421 203646 0
: 333 Minimum Test error found - save the configuration
: 333 | 1420.4 1310.17 0.00435108 0.00047011 206134 0
: 334 Minimum Test error found - save the configuration
: 334 | 1407.5 1297.51 0.00437711 0.000494002 206021 0
: 335 Minimum Test error found - save the configuration
: 335 | 1393.37 1285.59 0.00437043 0.00048658 205981 0
: 336 Minimum Test error found - save the configuration
: 336 | 1380.43 1273.77 0.00433933 0.00046962 206734 0
: 337 Minimum Test error found - save the configuration
: 337 | 1366.65 1261.76 0.00432135 0.00047969 208244 0
: 338 Minimum Test error found - save the configuration
: 338 | 1353.88 1250.11 0.0043361 0.00048484 207724 0
: 339 Minimum Test error found - save the configuration
: 339 | 1340.6 1238.2 0.00432955 0.000471121 207338 0
: 340 Minimum Test error found - save the configuration
: 340 | 1327.86 1226.52 0.00433335 0.000479491 207584 0
: 341 Minimum Test error found - save the configuration
: 341 | 1315.07 1215.25 0.00435217 0.00050026 207689 0
: 342 Minimum Test error found - save the configuration
: 342 | 1302.06 1204.87 0.00433865 0.000471671 206880 0
: 343 Minimum Test error found - save the configuration
: 343 | 1289.63 1193.49 0.0043726 0.000497121 206426 0
: 344 Minimum Test error found - save the configuration
: 344 | 1277.7 1181.3 0.00435382 0.000473731 206181 0
: 345 Minimum Test error found - save the configuration
: 345 | 1264.4 1170.94 0.00434568 0.000487371 207345 0
: 346 Minimum Test error found - save the configuration
: 346 | 1252.66 1160.28 0.00434464 0.0004869 207376 0
: 347 Minimum Test error found - save the configuration
: 347 | 1240.75 1149.26 0.00434342 0.000472471 206668 0
: 348 Minimum Test error found - save the configuration
: 348 | 1228.65 1138.08 0.00436117 0.000476021 205913 0
: 349 Minimum Test error found - save the configuration
: 349 | 1216.58 1127.26 0.00437372 0.000501311 206590 0
: 350 Minimum Test error found - save the configuration
: 350 | 1204.6 1116.87 0.00436133 0.00047433 205814 0
: 351 Minimum Test error found - save the configuration
: 351 | 1193.24 1106.2 0.00435407 0.0004906 207068 0
: 352 Minimum Test error found - save the configuration
: 352 | 1181.52 1096.3 0.00433423 0.000490681 208141 0
: 353 Minimum Test error found - save the configuration
: 353 | 1170.26 1085.74 0.00434693 0.000471121 206409 0
: 354 Minimum Test error found - save the configuration
: 354 | 1158.64 1075.23 0.00431395 0.0004778 208543 0
: 355 Minimum Test error found - save the configuration
: 355 | 1147.64 1064.74 0.00434662 0.000483091 207065 0
: 356 Minimum Test error found - save the configuration
: 356 | 1136.47 1054.76 0.0043096 0.000467561 208223 0
: 357 Minimum Test error found - save the configuration
: 357 | 1125.16 1044.88 0.0043405 0.000485141 207504 0
: 358 Minimum Test error found - save the configuration
: 358 | 1114.24 1034.74 0.00431369 0.000479432 208645 0
: 359 Minimum Test error found - save the configuration
: 359 | 1103.23 1025.18 0.00434777 0.00047009 206309 0
: 360 Minimum Test error found - save the configuration
: 360 | 1092.88 1015.49 0.00434603 0.000483041 207094 0
: 361 Minimum Test error found - save the configuration
: 361 | 1081.78 1005.92 0.00434206 0.00047405 206825 0
: 362 Minimum Test error found - save the configuration
: 362 | 1071.55 996.64 0.00435464 0.00046964 205920 0
: 363 Minimum Test error found - save the configuration
: 363 | 1061.01 986.938 0.00433681 0.000482261 207547 0
: 364 Minimum Test error found - save the configuration
: 364 | 1051.03 977.407 0.00436856 0.000488251 206169 0
: 365 Minimum Test error found - save the configuration
: 365 | 1040.4 968.555 0.00434822 0.000473792 206482 0
: 366 Minimum Test error found - save the configuration
: 366 | 1030.26 959.058 0.00437121 0.00049976 206641 0
: 367 Minimum Test error found - save the configuration
: 367 | 1020.34 949.96 0.00435776 0.00047618 206102 0
: 368 Minimum Test error found - save the configuration
: 368 | 1010.08 941.055 0.00436029 0.000481241 206236 0
: 369 Minimum Test error found - save the configuration
: 369 | 1000.67 931.617 0.00434647 0.000487711 207321 0
: 370 Minimum Test error found - save the configuration
: 370 | 990.419 922.55 0.00434274 0.00046917 206528 0
: 371 Minimum Test error found - save the configuration
: 371 | 980.805 913.905 0.00436528 0.000492012 206544 0
: 372 Minimum Test error found - save the configuration
: 372 | 971.298 905.197 0.00436115 0.000493462 206842 0
: 373 Minimum Test error found - save the configuration
: 373 | 961.74 897.022 0.00436722 0.000471671 205363 0
: 374 Minimum Test error found - save the configuration
: 374 | 952.57 887.857 0.00434263 0.000479361 207079 0
: 375 Minimum Test error found - save the configuration
: 375 | 942.939 879.754 0.00456891 0.000498261 196529 0
: 376 Minimum Test error found - save the configuration
: 376 | 933.719 870.633 0.00476212 0.000482521 186934 0
: 377 Minimum Test error found - save the configuration
: 377 | 924.439 862.114 0.00472293 0.000520691 190375 0
: 378 Minimum Test error found - save the configuration
: 378 | 915.213 854.226 0.00446495 0.00047775 200642 0
: 379 Minimum Test error found - save the configuration
: 379 | 906.558 845.825 0.00434798 0.000483842 207032 0
: 380 Minimum Test error found - save the configuration
: 380 | 897.47 837.694 0.004366 0.000473151 205505 0
: 381 Minimum Test error found - save the configuration
: 381 | 888.352 829.432 0.00437374 0.000478821 205396 0
: 382 Minimum Test error found - save the configuration
: 382 | 880.108 820.749 0.0043817 0.000488911 205508 0
: 383 Minimum Test error found - save the configuration
: 383 | 870.797 813.578 0.00433598 0.0004722 207051 0
: 384 Minimum Test error found - save the configuration
: 384 | 862.332 805.433 0.00436355 0.000473392 205647 0
: 385 Minimum Test error found - save the configuration
: 385 | 853.804 798.001 0.00438412 0.000489751 205425 0
: 386 Minimum Test error found - save the configuration
: 386 | 845.43 789.751 0.00435983 0.00047388 205870 0
: 387 Minimum Test error found - save the configuration
: 387 | 836.867 782.137 0.00439876 0.00048782 204555 0
: 388 Minimum Test error found - save the configuration
: 388 | 828.855 774.712 0.00434912 0.00047388 206439 0
: 389 Minimum Test error found - save the configuration
: 389 | 820.886 766.346 0.00438257 0.000475111 204737 0
: 390 Minimum Test error found - save the configuration
: 390 | 811.971 759.021 0.00435319 0.000482442 206679 0
: 391 Minimum Test error found - save the configuration
: 391 | 804.243 751.765 0.00434218 0.000486692 207497 0
: 392 Minimum Test error found - save the configuration
: 392 | 796.091 744.518 0.00439427 0.0004866 204726 0
: 393 Minimum Test error found - save the configuration
: 393 | 788.313 736.582 0.0043619 0.00048743 206480 0
: 394 Minimum Test error found - save the configuration
: 394 | 780.135 729.844 0.00438666 0.000476372 204589 0
: 395 Minimum Test error found - save the configuration
: 395 | 772.358 722.362 0.00437333 0.000485832 205788 0
: 396 Minimum Test error found - save the configuration
: 396 | 765.167 715.147 0.00434652 0.000472141 206485 0
: 397 Minimum Test error found - save the configuration
: 397 | 757.554 707.782 0.00435735 0.00047181 205892 0
: 398 Minimum Test error found - save the configuration
: 398 | 749.679 700.608 0.00438451 0.00048866 205347 0
: 399 Minimum Test error found - save the configuration
: 399 | 742.006 693.155 0.00436891 0.00047231 205307 0
: 400 Minimum Test error found - save the configuration
: 400 | 734.36 686.563 0.00433233 0.000472112 207242 0
: 401 Minimum Test error found - save the configuration
: 401 | 727.14 679.86 0.00438627 0.000485501 205088 0
: 402 Minimum Test error found - save the configuration
: 402 | 720.084 672.728 0.00434228 0.000471911 206699 0
: 403 Minimum Test error found - save the configuration
: 403 | 712.541 666.099 0.00436072 0.000483411 206329 0
: 404 Minimum Test error found - save the configuration
: 404 | 705.528 659.369 0.00434958 0.000487311 207132 0
: 405 Minimum Test error found - save the configuration
: 405 | 698.561 652.341 0.00434438 0.000475641 206786 0
: 406 Minimum Test error found - save the configuration
: 406 | 690.976 646.343 0.00434374 0.000482761 207201 0
: 407 Minimum Test error found - save the configuration
: 407 | 684.574 639.313 0.00436582 0.000476361 205684 0
: 408 Minimum Test error found - save the configuration
: 408 | 677.485 633.079 0.00436873 0.000474051 205409 0
: 409 Minimum Test error found - save the configuration
: 409 | 670.468 626.033 0.00434706 0.00048126 206943 0
: 410 Minimum Test error found - save the configuration
: 410 | 663.806 619.98 0.00437278 0.00047566 205280 0
: 411 Minimum Test error found - save the configuration
: 411 | 656.999 613.993 0.00434703 0.000471011 206397 0
: 412 Minimum Test error found - save the configuration
: 412 | 650.324 607.215 0.00456489 0.000498211 196721 0
: 413 Minimum Test error found - save the configuration
: 413 | 644.136 600.846 0.00433836 0.000472361 206932 0
: 414 Minimum Test error found - save the configuration
: 414 | 637.048 594.949 0.00436125 0.000483791 206321 0
: 415 Minimum Test error found - save the configuration
: 415 | 630.741 588.974 0.00443868 0.000483832 202283 0
: 416 Minimum Test error found - save the configuration
: 416 | 624.144 582.454 0.0043891 0.00048722 205029 0
: 417 Minimum Test error found - save the configuration
: 417 | 617.594 576.478 0.00437679 0.00047275 204916 0
: 418 Minimum Test error found - save the configuration
: 418 | 611.825 571.975 0.00439022 0.000481221 204656 0
: 419 Minimum Test error found - save the configuration
: 419 | 605.512 564.745 0.00440557 0.000490291 204328 0
: 420 Minimum Test error found - save the configuration
: 420 | 599.43 559.208 0.00438381 0.00047799 204823 0
: 421 Minimum Test error found - save the configuration
: 421 | 592.872 553.004 0.00443743 0.000500231 203190 0
: 422 Minimum Test error found - save the configuration
: 422 | 587.061 547.505 0.00437801 0.0004754 204991 0
: 423 Minimum Test error found - save the configuration
: 423 | 580.892 541.265 0.00441797 0.000495382 203947 0
: 424 Minimum Test error found - save the configuration
: 424 | 574.767 535.35 0.00438492 0.00048886 205336 0
: 425 Minimum Test error found - save the configuration
: 425 | 568.748 529.923 0.00439296 0.00048098 204500 0
: 426 Minimum Test error found - save the configuration
: 426 | 562.896 524.855 0.00440192 0.00048899 204451 0
: 427 Minimum Test error found - save the configuration
: 427 | 557.077 519.294 0.00454766 0.000635942 204514 0
: 428 Minimum Test error found - save the configuration
: 428 | 551.649 513.552 0.00438881 0.00048696 205031 0
: 429 Minimum Test error found - save the configuration
: 429 | 545.869 508.272 0.00436697 0.000488482 206266 0
: 430 Minimum Test error found - save the configuration
: 430 | 540.134 502.588 0.00434634 0.000468251 206287 0
: 431 Minimum Test error found - save the configuration
: 431 | 534.305 497.789 0.00441658 0.00050498 204520 0
: 432 Minimum Test error found - save the configuration
: 432 | 528.913 492.391 0.00435221 0.000480451 206625 0
: 433 Minimum Test error found - save the configuration
: 433 | 523.664 486.734 0.0043689 0.000477951 205606 0
: 434 Minimum Test error found - save the configuration
: 434 | 518.05 481.655 0.00436252 0.000486441 206394 0
: 435 Minimum Test error found - save the configuration
: 435 | 512.784 476.369 0.00437892 0.000476081 204979 0
: 436 Minimum Test error found - save the configuration
: 436 | 507.131 471.653 0.00435303 0.000483271 206731 0
: 437 Minimum Test error found - save the configuration
: 437 | 502.274 466.232 0.00433641 0.00048175 207541 0
: 438 Minimum Test error found - save the configuration
: 438 | 496.726 461.555 0.00439705 0.000478641 204165 0
: 439 Minimum Test error found - save the configuration
: 439 | 492.002 456.424 0.00434246 0.000485 207391 0
: 440 Minimum Test error found - save the configuration
: 440 | 486.504 451.724 0.00434506 0.000472162 206564 0
: 441 Minimum Test error found - save the configuration
: 441 | 481.683 447.415 0.00438598 0.0004784 204731 0
: 442 Minimum Test error found - save the configuration
: 442 | 476.803 441.723 0.00435931 0.00048665 206577 0
: 443 Minimum Test error found - save the configuration
: 443 | 471.332 437.441 0.00435858 0.00048869 206724 0
: 444 Minimum Test error found - save the configuration
: 444 | 466.634 432.413 0.00437407 0.00048751 205838 0
: 445 Minimum Test error found - save the configuration
: 445 | 461.717 427.825 0.00435272 0.000494291 207338 0
: 446 Minimum Test error found - save the configuration
: 446 | 457.268 423.545 0.00438226 0.000471651 204572 0
: 447 Minimum Test error found - save the configuration
: 447 | 452.281 418.448 0.00434501 0.00048395 207197 0
: 448 Minimum Test error found - save the configuration
: 448 | 447.584 413.829 0.00434205 0.000470611 206642 0
: 449 Minimum Test error found - save the configuration
: 449 | 442.683 409.644 0.00438728 0.0004795 204720 0
: 450 Minimum Test error found - save the configuration
: 450 | 438.364 404.839 0.00435158 0.000483021 206796 0
: 451 Minimum Test error found - save the configuration
: 451 | 433.556 401.107 0.00434358 0.0004704 206549 0
: 452 Minimum Test error found - save the configuration
: 452 | 429.299 396.227 0.0043891 0.000475561 204419 0
: 453 Minimum Test error found - save the configuration
: 453 | 424.455 392.26 0.00431342 0.000481961 208798 0
: 454 Minimum Test error found - save the configuration
: 454 | 420.085 387.823 0.00431574 0.00046935 207987 0
: 455 Minimum Test error found - save the configuration
: 455 | 415.571 383.356 0.0043287 0.0004695 207297 0
: 456 Minimum Test error found - save the configuration
: 456 | 411.568 378.898 0.0043443 0.00048233 207148 0
: 457 Minimum Test error found - save the configuration
: 457 | 406.732 374.726 0.00432033 0.000469211 207732 0
: 458 Minimum Test error found - save the configuration
: 458 | 402.619 370.772 0.00437095 0.000483821 205808 0
: 459 Minimum Test error found - save the configuration
: 459 | 398.343 366.916 0.00435933 0.00048616 206549 0
: 460 Minimum Test error found - save the configuration
: 460 | 394.176 362.714 0.00434531 0.000473281 206610 0
: 461 Minimum Test error found - save the configuration
: 461 | 390.115 359.011 0.00435366 0.00048686 206889 0
: 462 Minimum Test error found - save the configuration
: 462 | 385.985 355 0.00433937 0.000486631 207645 0
: 463 Minimum Test error found - save the configuration
: 463 | 382.152 350.66 0.00434485 0.00047307 206624 0
: 464 Minimum Test error found - save the configuration
: 464 | 377.995 346.929 0.00436603 0.00048806 206294 0
: 465 Minimum Test error found - save the configuration
: 465 | 373.727 342.769 0.00435793 0.000476071 206087 0
: 466 Minimum Test error found - save the configuration
: 466 | 369.793 339.23 0.00435076 0.000489362 207179 0
: 467 Minimum Test error found - save the configuration
: 467 | 366.154 335.315 0.00437981 0.000489641 205647 0
: 468 Minimum Test error found - save the configuration
: 468 | 362.005 331.937 0.00434476 0.00047234 206589 0
: 469 Minimum Test error found - save the configuration
: 469 | 358.438 327.776 0.00439803 0.000486851 204542 0
: 470 Minimum Test error found - save the configuration
: 470 | 354.133 324.369 0.00434681 0.000482921 207045 0
: 471 Minimum Test error found - save the configuration
: 471 | 350.565 320.749 0.00434274 0.00047078 206614 0
: 472 Minimum Test error found - save the configuration
: 472 | 346.872 316.775 0.00434666 0.000483112 207064 0
: 473 Minimum Test error found - save the configuration
: 473 | 343.684 313.53 0.0043371 0.000486312 207750 0
: 474 Minimum Test error found - save the configuration
: 474 | 339.856 310.188 0.00434429 0.000470021 206491 0
: 475 Minimum Test error found - save the configuration
: 475 | 336.058 305.727 0.00435915 0.00048552 206525 0
: 476 Minimum Test error found - save the configuration
: 476 | 332.172 302.655 0.00433987 0.000472291 206848 0
: 477 Minimum Test error found - save the configuration
: 477 | 328.752 298.971 0.00433767 0.00046777 206724 0
: 478 Minimum Test error found - save the configuration
: 478 | 325.024 296.245 0.00437128 0.00048498 205852 0
: 479 Minimum Test error found - save the configuration
: 479 | 321.598 292.308 0.00435427 0.00047753 206359 0
: 480 Minimum Test error found - save the configuration
: 480 | 317.887 289.332 0.00434874 0.000469931 206249 0
: 481 Minimum Test error found - save the configuration
: 481 | 314.917 285.898 0.00439132 0.00048718 204911 0
: 482 Minimum Test error found - save the configuration
: 482 | 311.227 283.041 0.00435648 0.00047664 206194 0
: 483 Minimum Test error found - save the configuration
: 483 | 308.077 279.819 0.00442544 0.000525491 205131 0
: 484 Minimum Test error found - save the configuration
: 484 | 304.607 276.18 0.00439157 0.000482402 204647 0
: 485 Minimum Test error found - save the configuration
: 485 | 301.319 273.911 0.00436204 0.000470961 205599 0
: 486 Minimum Test error found - save the configuration
: 486 | 298.421 269.792 0.00452197 0.000657751 207028 0
: 487 Minimum Test error found - save the configuration
: 487 | 295.12 267.483 0.00478759 0.000495041 186370 0
: 488 Minimum Test error found - save the configuration
: 488 | 291.91 263.655 0.00432855 0.000471881 207433 0
: 489 Minimum Test error found - save the configuration
: 489 | 288.604 261.606 0.00560554 0.00054556 158103 0
: 490 Minimum Test error found - save the configuration
: 490 | 285.292 257.843 0.00439658 0.00047157 203821 0
: 491 Minimum Test error found - save the configuration
: 491 | 282.221 254.847 0.00506562 0.000484181 174618 0
: 492 Minimum Test error found - save the configuration
: 492 | 279.129 251.375 0.00437544 0.00048581 205675 0
: 493 Minimum Test error found - save the configuration
: 493 | 276.099 249.172 0.00433515 0.000492751 208203 0
: 494 Minimum Test error found - save the configuration
: 494 | 273.155 246.572 0.00434321 0.000471001 206601 0
: 495 Minimum Test error found - save the configuration
: 495 | 270.306 243.467 0.00441575 0.000489161 203739 0
: 496 Minimum Test error found - save the configuration
: 496 | 267.538 241.434 0.00431955 0.00047043 207840 0
: 497 Minimum Test error found - save the configuration
: 497 | 264.332 237.441 0.00558873 0.00064985 161980 0
: 498 Minimum Test error found - save the configuration
: 498 | 261.286 234.848 0.00540718 0.000705931 170168 0
: 499 Minimum Test error found - save the configuration
: 499 | 258.481 232.325 0.00550665 0.000571 162086 0
: 500 Minimum Test error found - save the configuration
: 500 | 255.803 229.881 0.00567401 0.000611311 158019 0
: 501 Minimum Test error found - save the configuration
: 501 | 253.104 226.886 0.00498302 0.000578181 181619 0
: 502 Minimum Test error found - save the configuration
: 502 | 250.145 224.036 0.0049664 0.000527791 180237 0
: 503 Minimum Test error found - save the configuration
: 503 | 247.44 221.84 0.00486549 0.000482071 182506 0
: 504 Minimum Test error found - save the configuration
: 504 | 244.577 218.829 0.0043883 0.000473461 204351 0
: 505 Minimum Test error found - save the configuration
: 505 | 241.989 215.974 0.00435308 0.000483371 206734 0
: 506 Minimum Test error found - save the configuration
: 506 | 239.492 214.339 0.00433462 0.000467131 206853 0
: 507 Minimum Test error found - save the configuration
: 507 | 236.867 210.981 0.0043694 0.000483122 205853 0
: 508 Minimum Test error found - save the configuration
: 508 | 234.146 209.023 0.00433736 0.000479361 207362 0
: 509 Minimum Test error found - save the configuration
: 509 | 231.465 206.457 0.00434435 0.00047174 206579 0
: 510 Minimum Test error found - save the configuration
: 510 | 228.981 203.665 0.00438751 0.00048457 204974 0
: 511 Minimum Test error found - save the configuration
: 511 | 226.424 201.751 0.0043589 0.00047442 205948 0
: 512 Minimum Test error found - save the configuration
: 512 | 223.999 199.104 0.00434091 0.000469811 206660 0
: 513 Minimum Test error found - save the configuration
: 513 | 221.734 197.373 0.00440826 0.000516001 205536 0
: 514 Minimum Test error found - save the configuration
: 514 | 219.461 194.707 0.00435297 0.00048206 206670 0
: 515 Minimum Test error found - save the configuration
: 515 | 216.413 191.914 0.00436496 0.000489521 206428 0
: 516 Minimum Test error found - save the configuration
: 516 | 214.146 189.9 0.00436008 0.000482891 206335 0
: 517 Minimum Test error found - save the configuration
: 517 | 211.823 187.56 0.00435002 0.000474311 206414 0
: 518 Minimum Test error found - save the configuration
: 518 | 209.44 185.305 0.00432617 0.00047821 207903 0
: 519 Minimum Test error found - save the configuration
: 519 | 207.049 183.012 0.00433096 0.000481931 207845 0
: 520 Minimum Test error found - save the configuration
: 520 | 204.672 180.961 0.00430961 0.000468671 208283 0
: 521 Minimum Test error found - save the configuration
: 521 | 202.529 179.137 0.00434184 0.000480642 207190 0
: 522 Minimum Test error found - save the configuration
: 522 | 200.321 176.998 0.00434099 0.00048606 207527 0
: 523 Minimum Test error found - save the configuration
: 523 | 198.096 174.491 0.00435727 0.000472341 205924 0
: 524 Minimum Test error found - save the configuration
: 524 | 195.761 172.458 0.00434827 0.000479651 206792 0
: 525 Minimum Test error found - save the configuration
: 525 | 193.858 170.983 0.00435412 0.000483131 206666 0
: 526 Minimum Test error found - save the configuration
: 526 | 191.729 168.581 0.00433625 0.000465461 206676 0
: 527 Minimum Test error found - save the configuration
: 527 | 189.462 166.622 0.00437357 0.000487941 205887 0
: 528 Minimum Test error found - save the configuration
: 528 | 187.472 164.334 0.00433713 0.000469501 206845 0
: 529 Minimum Test error found - save the configuration
: 529 | 185.318 162.607 0.00434598 0.000469601 206378 0
: 530 Minimum Test error found - save the configuration
: 530 | 183.084 161.192 0.00435986 0.00048581 206502 0
: 531 Minimum Test error found - save the configuration
: 531 | 181.282 158.867 0.00434498 0.000468191 206357 0
: 532 Minimum Test error found - save the configuration
: 532 | 179.007 156.811 0.00433652 0.000470071 206908 0
: 533 Minimum Test error found - save the configuration
: 533 | 176.964 155.047 0.00439045 0.00048734 204965 0
: 534 Minimum Test error found - save the configuration
: 534 | 174.78 153.082 0.00436992 0.000473071 205294 0
: 535 Minimum Test error found - save the configuration
: 535 | 172.803 151.453 0.00436069 0.00048324 206321 0
: 536 Minimum Test error found - save the configuration
: 536 | 170.822 149.515 0.00435644 0.000488581 206833 0
: 537 Minimum Test error found - save the configuration
: 537 | 168.988 148.081 0.00432861 0.000468291 207237 0
: 538 Minimum Test error found - save the configuration
: 538 | 166.948 145.889 0.00434204 0.00048796 207572 0
: 539 Minimum Test error found - save the configuration
: 539 | 165.104 144.865 0.00431551 0.00048683 208950 0
: 540 Minimum Test error found - save the configuration
: 540 | 163.201 142.827 0.00433228 0.000466051 206920 0
: 541 Minimum Test error found - save the configuration
: 541 | 161.171 140.833 0.00436429 0.000484631 206204 0
: 542 Minimum Test error found - save the configuration
: 542 | 159.296 139.139 0.00459642 0.00056835 198606 0
: 543 Minimum Test error found - save the configuration
: 543 | 157.385 137.676 0.00447658 0.000495321 200942 0
: 544 Minimum Test error found - save the configuration
: 544 | 155.84 136.225 0.00456208 0.000497161 196806 0
: 545 Minimum Test error found - save the configuration
: 545 | 154.121 134.312 0.00455015 0.00055407 200196 0
: 546 Minimum Test error found - save the configuration
: 546 | 152.089 132.959 0.00445084 0.00047998 201468 0
: 547 Minimum Test error found - save the configuration
: 547 | 150.287 131.491 0.00458308 0.00049142 195520 0
: 548 Minimum Test error found - save the configuration
: 548 | 148.665 129.935 0.00450345 0.000474131 198545 0
: 549 Minimum Test error found - save the configuration
: 549 | 146.932 128.446 0.00456707 0.00047637 195566 0
: 550 Minimum Test error found - save the configuration
: 550 | 145.091 126.501 0.00454606 0.000503741 197906 0
: 551 Minimum Test error found - save the configuration
: 551 | 143.398 125.057 0.00453465 0.000549501 200745 0
: 552 Minimum Test error found - save the configuration
: 552 | 141.782 123.448 0.00454218 0.000557891 200789 0
: 553 Minimum Test error found - save the configuration
: 553 | 140.215 122.67 0.004482 0.00048066 199933 0
: 554 Minimum Test error found - save the configuration
: 554 | 138.739 120.616 0.00452219 0.00049035 198420 0
: 555 Minimum Test error found - save the configuration
: 555 | 136.94 119.039 0.00453131 0.00047433 197191 0
: 556 Minimum Test error found - save the configuration
: 556 | 135.251 117.703 0.00457869 0.000497351 196014 0
: 557 Minimum Test error found - save the configuration
: 557 | 133.78 116.109 0.00451865 0.000473591 197772 0
: 558 Minimum Test error found - save the configuration
: 558 | 132.161 114.93 0.00456114 0.000492651 196633 0
: 559 Minimum Test error found - save the configuration
: 559 | 130.545 113.862 0.00450466 0.000473012 198430 0
: 560 Minimum Test error found - save the configuration
: 560 | 128.996 112.312 0.00453278 0.000542121 200468 0
: 561 Minimum Test error found - save the configuration
: 561 | 127.5 110.705 0.00455703 0.000557692 200033 0
: 562 Minimum Test error found - save the configuration
: 562 | 125.912 109.551 0.00446375 0.000500251 201842 0
: 563 Minimum Test error found - save the configuration
: 563 | 124.331 107.904 0.00448168 0.000469961 199416 0
: 564 Minimum Test error found - save the configuration
: 564 | 123.177 106.762 0.00458765 0.000492731 195364 0
: 565 Minimum Test error found - save the configuration
: 565 | 121.806 105.496 0.00452562 0.00055338 201398 0
: 566 Minimum Test error found - save the configuration
: 566 | 120.106 104.219 0.0044514 0.0004876 201827 0
: 567 Minimum Test error found - save the configuration
: 567 | 118.668 102.693 0.00456621 0.00050427 196950 0
: 568 Minimum Test error found - save the configuration
: 568 | 117.204 102.091 0.00455155 0.000475541 196271 0
: 569 Minimum Test error found - save the configuration
: 569 | 115.734 100.507 0.00449005 0.00049988 200492 0
: 570 Minimum Test error found - save the configuration
: 570 | 114.364 99.0254 0.00450208 0.000469821 198400 0
: 571 Minimum Test error found - save the configuration
: 571 | 113.076 97.9241 0.00455882 0.000488762 196558 0
: 572 Minimum Test error found - save the configuration
: 572 | 111.757 96.5984 0.00452281 0.000546511 201192 0
: 573 Minimum Test error found - save the configuration
: 573 | 110.743 96.1806 0.00452112 0.000546111 201258 0
: 574 Minimum Test error found - save the configuration
: 574 | 109.014 94.2492 0.00446109 0.000482371 201070 0
: 575 Minimum Test error found - save the configuration
: 575 | 107.816 92.6338 0.00454793 0.000492741 197278 0
: 576 Minimum Test error found - save the configuration
: 576 | 106.401 91.5495 0.00456432 0.00048637 196177 0
: 577 Minimum Test error found - save the configuration
: 577 | 105.262 90.8491 0.00452653 0.000488001 198092 0
: 578 Minimum Test error found - save the configuration
: 578 | 103.907 89.8642 0.00454121 0.000496322 197781 0
: 579 Minimum Test error found - save the configuration
: 579 | 102.836 88.5321 0.0045094 0.00055949 202536 0
: 580 Minimum Test error found - save the configuration
: 580 | 101.673 87.3755 0.00457366 0.000571871 199911 0
: 581 Minimum Test error found - save the configuration
: 581 | 100.275 86.2406 0.00443736 0.000470201 201656 0
: 582 Minimum Test error found - save the configuration
: 582 | 98.977 85.0571 0.00452351 0.000483821 198035 0
: 583 Minimum Test error found - save the configuration
: 583 | 97.8384 84.4724 0.00453432 0.000472651 196964 0
: 584 Minimum Test error found - save the configuration
: 584 | 96.6429 82.9165 0.00456081 0.0004986 196937 0
: 585 Minimum Test error found - save the configuration
: 585 | 95.5258 81.6341 0.00452495 0.000472651 197419 0
: 586 Minimum Test error found - save the configuration
: 586 | 94.5368 80.7857 0.00459419 0.000582771 199431 0
: 587 Minimum Test error found - save the configuration
: 587 | 93.3946 80.3454 0.00447921 0.0004722 199650 0
: 588 Minimum Test error found - save the configuration
: 588 | 92.1287 79.1154 0.00454817 0.000489191 197094 0
: 589 Minimum Test error found - save the configuration
: 589 | 91.0003 78.0933 0.00454793 0.000474471 196393 0
: 590 Minimum Test error found - save the configuration
: 590 | 90.1361 76.5477 0.00454195 0.00048943 197408 0
: 591 Minimum Test error found - save the configuration
: 591 | 89.1005 75.9956 0.00456986 0.000574171 200216 0
: 592 Minimum Test error found - save the configuration
: 592 | 88.0733 74.7481 0.00452179 0.000535761 200701 0
: 593 Minimum Test error found - save the configuration
: 593 | 86.9318 73.6631 0.00448748 0.000490641 200158 0
: 594 Minimum Test error found - save the configuration
: 594 | 85.8329 72.811 0.00453832 0.00047399 196835 0
: 595 | 84.9403 72.8244 0.00450499 0.000457971 197676 1
: 596 Minimum Test error found - save the configuration
: 596 | 84.0686 71.0136 0.00452426 0.000475582 197595 0
: 597 Minimum Test error found - save the configuration
: 597 | 82.9086 70.2436 0.0045497 0.000491091 197112 0
: 598 Minimum Test error found - save the configuration
: 598 | 81.7955 69.4094 0.00453698 0.00048412 197392 0
: 599 Minimum Test error found - save the configuration
: 599 | 81.052 68.5222 0.00455344 0.000558352 200246 0
: 600 Minimum Test error found - save the configuration
: 600 | 80.0519 67.5022 0.00470046 0.000554502 192959 0
: 601 Minimum Test error found - save the configuration
: 601 | 79.0523 66.3579 0.00497274 0.00056487 181494 0
: 602 Minimum Test error found - save the configuration
: 602 | 78.051 65.6695 0.004869 0.000553071 185360 0
: 603 Minimum Test error found - save the configuration
: 603 | 77.0192 64.7376 0.0046167 0.000499971 194329 0
: 604 Minimum Test error found - save the configuration
: 604 | 76.1182 64.1598 0.00455187 0.000488881 196900 0
: 605 Minimum Test error found - save the configuration
: 605 | 75.2746 63.4804 0.00451537 0.00047366 197936 0
: 606 Minimum Test error found - save the configuration
: 606 | 74.4507 62.3984 0.00454034 0.000498351 197923 0
: 607 Minimum Test error found - save the configuration
: 607 | 73.6658 61.544 0.00452656 0.00047411 197412 0
: 608 Minimum Test error found - save the configuration
: 608 | 72.54 60.9569 0.00455526 0.000491211 196848 0
: 609 Minimum Test error found - save the configuration
: 609 | 71.7396 60.336 0.00453068 0.0005488 200910 0
: 610 Minimum Test error found - save the configuration
: 610 | 70.8927 58.9907 0.0044877 0.00049604 200418 0
: 611 Minimum Test error found - save the configuration
: 611 | 69.9384 58.2295 0.00454602 0.000485771 197032 0
: 612 Minimum Test error found - save the configuration
: 612 | 69.2394 57.7116 0.00452725 0.000487781 198046 0
: 613 Minimum Test error found - save the configuration
: 613 | 68.4103 56.6865 0.00453597 0.00048456 197462 0
: 614 Minimum Test error found - save the configuration
: 614 | 67.5203 55.7952 0.00451849 0.00049065 198617 0
: 615 Minimum Test error found - save the configuration
: 615 | 66.7583 55.3096 0.00454658 0.000565261 200939 0
: 616 Minimum Test error found - save the configuration
: 616 | 65.9668 54.4587 0.00448731 0.00052042 201670 0
: 617 Minimum Test error found - save the configuration
: 617 | 65.1629 53.8814 0.00449049 0.000484721 199712 0
: 618 Minimum Test error found - save the configuration
: 618 | 64.3865 53.1399 0.00452568 0.000473522 197426 0
: 619 Minimum Test error found - save the configuration
: 619 | 63.6029 52.7542 0.00454535 0.000486781 197114 0
: 620 Minimum Test error found - save the configuration
: 620 | 63.0679 51.6048 0.0045008 0.000473941 198666 0
: 621 Minimum Test error found - save the configuration
: 621 | 62.4086 50.8334 0.00450957 0.000558581 202481 0
: 622 Minimum Test error found - save the configuration
: 622 | 61.4421 50.5869 0.00444934 0.000488631 201984 0
: 623 Minimum Test error found - save the configuration
: 623 | 60.6921 49.8814 0.00452855 0.00048409 197802 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.8713 49.0239 0.00451171 0.0004708 197975 0
: 625 Minimum Test error found - save the configuration
: 625 | 59.1607 48.2556 0.00450561 0.00049214 199329 0
: 626 Minimum Test error found - save the configuration
: 626 | 58.6014 47.4355 0.00452276 0.00055467 201608 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.7531 46.7165 0.00445511 0.000485471 201530 0
: 628 Minimum Test error found - save the configuration
: 628 | 57.0882 46.1438 0.00452304 0.00047685 197717 0
: 629 Minimum Test error found - save the configuration
: 629 | 56.33 45.687 0.00453953 0.000490962 197601 0
: 630 Minimum Test error found - save the configuration
: 630 | 55.7554 44.896 0.00454202 0.00047652 196778 0
: 631 | 54.9743 45.1609 0.00451663 0.000520371 200187 1
: 632 Minimum Test error found - save the configuration
: 632 | 54.3903 43.8084 0.0045077 0.00054424 201844 0
: 633 Minimum Test error found - save the configuration
: 633 | 53.8135 43.3494 0.00447418 0.00048967 200778 0
: 634 Minimum Test error found - save the configuration
: 634 | 53.1737 42.4208 0.00454072 0.00047498 196766 0
: 635 Minimum Test error found - save the configuration
: 635 | 52.5627 41.8051 0.00459088 0.000530049 197004 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.9137 41.5956 0.00455406 0.00048778 196740 0
: 637 Minimum Test error found - save the configuration
: 637 | 51.1105 40.6484 0.00448941 0.00046951 199010 0
: 638 Minimum Test error found - save the configuration
: 638 | 50.6347 40.088 0.00457054 0.000490651 196084 0
: 639 Minimum Test error found - save the configuration
: 639 | 50.0302 39.5222 0.00443217 0.000474661 202148 0
: 640 Minimum Test error found - save the configuration
: 640 | 49.5243 39.1955 0.00453699 0.00049748 198044 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.9552 38.7505 0.00452139 0.000520122 199937 0
: 642 Minimum Test error found - save the configuration
: 642 | 48.295 38.072 0.0044942 0.00048464 199523 0
: 643 Minimum Test error found - save the configuration
: 643 | 47.5244 37.5214 0.00451019 0.00047475 198244 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.0116 36.7432 0.00456235 0.0004895 196423 0
: 645 Minimum Test error found - save the configuration
: 645 | 46.5116 36.6224 0.00451964 0.00052473 200255 0
: 646 Minimum Test error found - save the configuration
: 646 | 45.9308 36.0061 0.00445897 0.00050455 202305 0
: 647 Minimum Test error found - save the configuration
: 647 | 45.5371 35.3502 0.0045177 0.000476691 197971 0
: 648 Minimum Test error found - save the configuration
: 648 | 44.7357 34.7654 0.00453439 0.000489282 197770 0
: 649 Minimum Test error found - save the configuration
: 649 | 44.1788 34.3457 0.00445249 0.000471041 200932 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.6588 33.5707 0.00462331 0.000580271 197871 0
: 651 Minimum Test error found - save the configuration
: 651 | 43.227 33.101 0.00490383 0.000562911 184293 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.7002 32.8627 0.00463132 0.00047463 192461 0
: 653 Minimum Test error found - save the configuration
: 653 | 42.4047 32.2584 0.0047884 0.000566621 189494 0
: 654 Minimum Test error found - save the configuration
: 654 | 41.8871 31.8202 0.00474883 0.000561372 191047 0
: 655 Minimum Test error found - save the configuration
: 655 | 41.1359 31.6465 0.00483579 0.000492351 184186 0
: 656 Minimum Test error found - save the configuration
: 656 | 40.7015 31.4394 0.00482976 0.00056304 187498 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.2536 30.6823 0.00472939 0.000601661 193811 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.9076 30.3557 0.00470705 0.000474741 189022 0
: 659 Minimum Test error found - save the configuration
: 659 | 39.4679 29.6655 0.00487868 0.00049122 182338 0
: 660 Minimum Test error found - save the configuration
: 660 | 38.7875 29.0608 0.0048704 0.000558962 185553 0
: 661 Minimum Test error found - save the configuration
: 661 | 38.3819 28.7106 0.00470294 0.000559911 193096 0
: 662 | 37.9211 29.1085 0.00470699 0.000437201 187363 1
: 663 Minimum Test error found - save the configuration
: 663 | 37.6363 27.817 0.00486077 0.000487581 182933 0
: 664 Minimum Test error found - save the configuration
: 664 | 36.9815 27.5864 0.00485231 0.000607382 188460 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.6583 27.4501 0.00496343 0.000479881 178430 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.0654 26.7551 0.00503221 0.00056915 179249 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.6876 26.2006 0.00494408 0.000556811 182346 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.1939 25.8173 0.0049369 0.00057265 183308 0
: 669 Minimum Test error found - save the configuration
: 669 | 34.7585 25.6548 0.00484452 0.000495111 183933 0
: 670 Minimum Test error found - save the configuration
: 670 | 34.3508 24.7156 0.0050213 0.000565631 179547 0
: 671 Minimum Test error found - save the configuration
: 671 | 34.1579 24.2803 0.00503658 0.000562301 178800 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.5266 23.9069 0.00493007 0.00056211 183152 0
: 673 | 33.1538 24.0373 0.00477641 0.000510302 187525 1
: 674 Minimum Test error found - save the configuration
: 674 | 32.6698 23.7723 0.00492897 0.00049329 180356 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.685 23.2586 0.00500234 0.00053965 179264 0
: 676 | 32.0842 23.4425 0.00482795 0.000529651 186120 1
: 677 Minimum Test error found - save the configuration
: 677 | 31.6997 22.197 0.00488798 0.00053691 183863 0
: 678 Minimum Test error found - save the configuration
: 678 | 31.4654 21.8984 0.00494926 0.000476411 178857 0
: 679 | 31.0076 22.1701 0.0050042 0.000515551 178227 1
: 680 Minimum Test error found - save the configuration
: 680 | 30.4379 21.2536 0.00493781 0.00054594 182155 0
: 681 Minimum Test error found - save the configuration
: 681 | 29.9794 20.7012 0.00491849 0.000610081 185683 0
: 682 Minimum Test error found - save the configuration
: 682 | 29.5486 20.5465 0.00488143 0.000487741 182079 0
: 683 | 29.2221 20.5574 0.0049264 0.0005086 181086 1
: 684 Minimum Test error found - save the configuration
: 684 | 28.9442 20.2675 0.00488768 0.000558071 184774 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.402 19.825 0.00493525 0.00056029 182859 0
: 686 Minimum Test error found - save the configuration
: 686 | 28.0123 19.8156 0.00489354 0.000490152 181678 0
: 687 Minimum Test error found - save the configuration
: 687 | 27.8752 19.361 0.00489623 0.000583751 185508 0
: 688 Minimum Test error found - save the configuration
: 688 | 27.5534 19.0283 0.00480938 0.000473731 184517 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.0224 18.372 0.00491625 0.000490241 180750 0
: 690 Minimum Test error found - save the configuration
: 690 | 26.5931 17.9172 0.00503438 0.0005427 178107 0
: 691 | 26.4199 18.2 0.0048714 0.000511761 183502 1
: 692 | 26.2939 18.8614 0.00492196 0.00051387 181485 2
: 693 | 26.1779 18.4341 0.00491872 0.000512891 181578 3
: 694 Minimum Test error found - save the configuration
: 694 | 25.6614 17.6264 0.00482162 0.0005056 185356 0
: 695 Minimum Test error found - save the configuration
: 695 | 25.2349 16.7373 0.0049712 0.000489541 178505 0
: 696 Minimum Test error found - save the configuration
: 696 | 24.7168 16.4803 0.00493971 0.000603191 184480 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.3222 16.029 0.00486805 0.000493121 182860 0
: 698 | 24.2873 16.311 0.00500903 0.00048847 176969 1
: 699 Minimum Test error found - save the configuration
: 699 | 24.4164 15.9737 0.00489199 0.00060464 186596 0
: 700 Minimum Test error found - save the configuration
: 700 | 24.0467 15.4843 0.00487956 0.00051313 183216 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.0697 15.0939 0.00500506 0.000560371 179990 0
: 702 | 22.8242 15.1379 0.00487163 0.000519501 183818 1
: 703 Minimum Test error found - save the configuration
: 703 | 22.4626 14.7708 0.00489024 0.000597322 186354 0
: 704 | 22.2219 14.8378 0.00489438 0.000460601 180433 1
: 705 Minimum Test error found - save the configuration
: 705 | 21.7734 14.1841 0.00502049 0.000525341 177970 0
: 706 Minimum Test error found - save the configuration
: 706 | 21.5608 14.0595 0.00493951 0.00049897 180158 0
: 707 Minimum Test error found - save the configuration
: 707 | 21.3109 13.9344 0.00488976 0.000525241 183296 0
: 708 Minimum Test error found - save the configuration
: 708 | 21.0026 13.6956 0.00486343 0.000498571 183282 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.8636 13.0771 0.00493794 0.000524851 181279 0
: 710 | 20.4621 13.1973 0.00490397 0.00054564 183557 1
: 711 Minimum Test error found - save the configuration
: 711 | 20.1101 12.9265 0.00503399 0.00050273 176551 0
: 712 Minimum Test error found - save the configuration
: 712 | 19.9471 12.8528 0.00505167 0.000548161 177639 0
: 713 | 19.8635 13.2115 0.00485379 0.00053215 185115 1
: 714 Minimum Test error found - save the configuration
: 714 | 19.5222 12.4909 0.00490381 0.0005596 184153 0
: 715 | 19.2334 12.6034 0.00497239 0.000456611 177157 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.2548 11.5455 0.00502781 0.000579091 179827 0
: 717 | 18.9401 11.733 0.0051618 0.000607382 175654 1
: 718 | 18.3688 11.5925 0.004932 0.000586782 184111 2
: 719 Minimum Test error found - save the configuration
: 719 | 18.1387 10.9948 0.00515293 0.000532431 173142 0
: 720 | 17.835 11.0159 0.00536101 0.000528072 165531 1
: 721 Minimum Test error found - save the configuration
: 721 | 17.6783 10.8228 0.00496962 0.00064379 184936 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.4331 10.7742 0.00479872 0.000477851 185148 0
: 723 | 17.3865 11.0397 0.00496014 0.00057651 182497 1
: 724 Minimum Test error found - save the configuration
: 724 | 17.2314 10.5417 0.00479863 0.000479782 185235 0
: 725 Minimum Test error found - save the configuration
: 725 | 16.6486 10.1911 0.00510583 0.000616061 178183 0
: 726 Minimum Test error found - save the configuration
: 726 | 16.4105 9.8779 0.00480395 0.00047675 184877 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.1157 9.54929 0.00508279 0.000541811 176174 0
: 728 | 16.0303 9.70299 0.004724 0.000451621 187249 1
: 729 | 15.8862 10.1344 0.00505162 0.000519781 176529 2
: 730 Minimum Test error found - save the configuration
: 730 | 15.7402 9.17028 0.00482705 0.00060976 189695 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.5093 9.08558 0.00493212 0.00049155 180157 0
: 732 | 15.1549 9.19264 0.00501901 0.000547182 178898 1
: 733 Minimum Test error found - save the configuration
: 733 | 15.0608 8.57273 0.00476938 0.000487411 186830 0
: 734 | 14.832 8.7211 0.00498798 0.00052255 179154 1
: 735 Minimum Test error found - save the configuration
: 735 | 14.6263 8.17452 0.00476449 0.000559111 190233 0
: 736 | 14.4154 8.34424 0.00492368 0.000438941 178383 1
: 737 | 14.1635 8.34227 0.00491848 0.00054525 182931 2
: 738 Minimum Test error found - save the configuration
: 738 | 13.9997 7.89339 0.00475316 0.000475331 187011 0
: 739 | 13.7652 7.94312 0.00498305 0.000438531 176036 1
: 740 | 13.6327 8.17615 0.00493737 0.00053979 181918 2
: 741 Minimum Test error found - save the configuration
: 741 | 13.7802 7.29685 0.00495494 0.000637341 185288 0
: 742 | 13.386 7.41112 0.00498503 0.000486171 177823 1
: 743 | 13.0834 7.44051 0.00496012 0.000459721 177762 2
: 744 Minimum Test error found - save the configuration
: 744 | 12.8893 7.1096 0.00555269 0.000485401 157875 0
: 745 | 12.7455 7.4167 0.00500705 0.00050874 177845 1
: 746 Minimum Test error found - save the configuration
: 746 | 12.7946 6.85947 0.00490713 0.000550431 183625 0
: 747 | 12.4111 7.89643 0.00494526 0.000575441 183074 1
: 748 Minimum Test error found - save the configuration
: 748 | 12.2152 6.60306 0.00482981 0.00047584 183741 0
: 749 | 12.0091 6.83721 0.00508693 0.000439761 172148 1
: 750 | 11.8504 6.70906 0.00471766 0.000441691 187092 2
: 751 Minimum Test error found - save the configuration
: 751 | 11.7479 6.54042 0.0045631 0.000511531 197454 0
: 752 Minimum Test error found - save the configuration
: 752 | 11.4807 6.13153 0.00474118 0.000473191 187442 0
: 753 Minimum Test error found - save the configuration
: 753 | 11.3562 5.80076 0.00446758 0.000488771 201065 0
: 754 | 11.3727 6.58843 0.00449844 0.000439551 197098 1
: 755 Minimum Test error found - save the configuration
: 755 | 11.1295 5.79493 0.00452861 0.000565272 201850 0
: 756 | 10.9901 5.84626 0.00443305 0.000437901 200243 1
: 757 Minimum Test error found - save the configuration
: 757 | 10.8903 5.52813 0.00452319 0.000506672 199178 0
: 758 Minimum Test error found - save the configuration
: 758 | 10.6306 5.36039 0.00447357 0.00047488 200066 0
: 759 | 10.547 5.3679 0.00450242 0.000454711 197643 1
: 760 | 10.516 5.74397 0.00442579 0.00043841 200633 2
: 761 Minimum Test error found - save the configuration
: 761 | 10.2007 4.58682 0.00456928 0.000498221 196509 0
: 762 | 10.2141 4.90178 0.00447198 0.00051087 201964 1
: 763 | 10.2278 5.73773 0.00444242 0.000460722 200919 2
: 764 | 10.2587 5.37295 0.00451627 0.00043796 196160 3
: 765 | 9.9863 4.74575 0.00468646 0.000558081 193781 4
: 766 | 9.90845 5.08515 0.00450383 0.00045012 197350 5
: 767 | 9.53996 4.71864 0.00461708 0.000501371 194377 6
: 768 | 9.39777 4.82283 0.00444678 0.000456931 200509 7
: 769 Minimum Test error found - save the configuration
: 769 | 9.34792 4.22119 0.00453418 0.000478691 197264 0
: 770 Minimum Test error found - save the configuration
: 770 | 9.35038 3.8526 0.00452456 0.000559791 201777 0
: 771 | 9.17817 4.21283 0.00441947 0.000448071 201441 1
: 772 | 8.97476 4.26229 0.00447512 0.000453851 198942 2
: 773 | 8.8388 3.8754 0.0045134 0.000515102 200085 3
: 774 | 8.67937 4.02525 0.00449067 0.00045631 198297 4
: 775 Minimum Test error found - save the configuration
: 775 | 8.6778 3.7036 0.00451951 0.000471481 197627 0
: 776 Minimum Test error found - save the configuration
: 776 | 8.48423 3.61045 0.00453828 0.000564541 201322 0
: 777 Minimum Test error found - save the configuration
: 777 | 8.4181 3.60423 0.00444878 0.000471401 201138 0
: 778 | 8.28069 3.6237 0.00449643 0.00045421 197911 1
: 779 | 8.3195 4.04515 0.00448603 0.00043847 197650 2
: 780 | 8.21217 4.26705 0.00443055 0.00045491 201226 3
: 781 Minimum Test error found - save the configuration
: 781 | 8.18866 3.49645 0.00452097 0.000473961 197677 0
: 782 Minimum Test error found - save the configuration
: 782 | 7.86817 3.40746 0.00455232 0.000492061 197032 0
: 783 | 7.89337 3.4844 0.00452593 0.00047864 197663 1
: 784 | 7.95911 3.97805 0.00441962 0.000450971 201580 2
: 785 | 7.8853 3.43143 0.00447717 0.000438051 198063 3
: 786 Minimum Test error found - save the configuration
: 786 | 7.50134 3.16307 0.00444696 0.00049384 202372 0
: 787 Minimum Test error found - save the configuration
: 787 | 7.27955 3.14567 0.0045378 0.000476811 196996 0
: 788 Minimum Test error found - save the configuration
: 788 | 7.52533 2.99842 0.00456247 0.000560011 199877 0
: 789 | 7.24943 3.14111 0.00441688 0.00043933 201129 1
: 790 Minimum Test error found - save the configuration
: 790 | 7.00945 2.75825 0.00453177 0.000491421 198003 0
: 791 | 6.9962 3.14345 0.00448321 0.000467211 199203 1
: 792 Minimum Test error found - save the configuration
: 792 | 6.91683 2.69385 0.00448077 0.000489721 200449 0
: 793 | 6.8865 3.06661 0.00448889 0.0004385 197512 1
: 794 | 6.7998 3.01578 0.00448779 0.000454961 198372 2
: 795 Minimum Test error found - save the configuration
: 795 | 6.64599 2.60485 0.00449861 0.00054931 202568 0
: 796 | 6.57699 2.61677 0.00443187 0.000452121 201018 1
: 797 | 6.53079 2.69761 0.00446583 0.00051063 202266 2
: 798 Minimum Test error found - save the configuration
: 798 | 6.43437 2.6034 0.0044481 0.00048866 202049 0
: 799 | 6.32788 2.61002 0.00450742 0.000443731 196866 1
: 800 Minimum Test error found - save the configuration
: 800 | 6.45899 2.49299 0.00453734 0.00056237 201259 0
: 801 Minimum Test error found - save the configuration
: 801 | 6.38516 2.20575 0.00444688 0.00047442 201387 0
: 802 | 6.44958 2.58757 0.00448558 0.00045461 198464 1
: 803 Minimum Test error found - save the configuration
: 803 | 6.17725 1.98939 0.00453397 0.000475341 197111 0
: 804 | 6.01516 2.54644 0.00448138 0.000523612 202134 1
: 805 | 5.92432 3.24718 0.00444099 0.000438751 199888 2
: 806 | 6.07034 2.76331 0.00450127 0.00045577 197751 3
: 807 | 6.15496 2.54258 0.00450602 0.0004393 196719 4
: 808 | 5.79495 2.37988 0.00444977 0.00047477 201258 5
: 809 | 5.80569 2.47582 0.00452824 0.00052098 199638 6
: 810 | 5.67852 2.52977 0.00473623 0.000449281 186613 7
: 811 | 5.43095 2.13975 0.00444307 0.000491651 202459 8
: 812 | 5.43682 2.1102 0.00440544 0.00045791 202659 9
: 813 | 5.51636 2.12626 0.00437146 0.000436611 203312 10
: 814 | 5.37289 2.33007 0.00446913 0.00045383 199238 11
: 815 | 5.32301 2.29712 0.00452193 0.00043791 195886 12
: 816 | 5.21023 2.34942 0.00450767 0.000455561 197428 13
: 817 | 5.2125 2.15391 0.00454957 0.000484811 196814 14
: 818 Minimum Test error found - save the configuration
: 818 | 5.19173 1.91969 0.00456196 0.00049683 196796 0
: 819 | 5.14253 2.47609 0.00445014 0.000437262 199358 1
: 820 | 5.1729 2.20066 0.00446139 0.00052237 203096 2
: 821 | 4.89545 2.13017 0.00441821 0.00043696 200942 3
: 822 | 4.94323 1.98497 0.00447487 0.00045209 198868 4
: 823 | 4.87569 2.08598 0.00440637 0.0004366 201523 5
: 824 Minimum Test error found - save the configuration
: 824 | 4.63013 1.79292 0.00452478 0.00049303 198425 0
: 825 | 4.62238 2.11366 0.00447021 0.00044782 198887 1
: 826 | 4.82762 3.01436 0.00448675 0.000454981 198424 2
: 827 | 4.67861 1.97124 0.00447912 0.00047895 199992 3
: 828 | 4.68427 2.45527 0.00440168 0.000450492 202471 4
: 829 Minimum Test error found - save the configuration
: 829 | 4.70159 1.7705 0.00449739 0.00047125 198702 0
: 830 | 4.474 2.10057 0.00452662 0.00044974 196229 1
: 831 | 4.28034 1.87533 0.00445142 0.000435211 199193 2
: 832 Minimum Test error found - save the configuration
: 832 | 4.21892 1.60673 0.00445851 0.000489011 201537 0
: 833 | 4.24743 1.96797 0.00446652 0.000435301 198451 1
: 834 | 4.22107 2.40804 0.00450706 0.000452391 197304 2
: 835 Minimum Test error found - save the configuration
: 835 | 4.28864 1.52438 0.00451809 0.000522611 200227 0
: 836 | 4.12249 1.92442 0.00444846 0.000451442 200149 1
: 837 | 4.14727 1.67259 0.00448288 0.000437731 197768 2
: 838 | 4.00918 2.05797 0.00441317 0.00045258 201990 3
: 839 | 4.12284 1.82593 0.0044759 0.000438181 198132 4
: 840 | 4.02811 1.78925 0.00447113 0.00052409 202684 5
: 841 | 3.96183 1.76506 0.00442012 0.00044239 201120 6
: 842 | 3.89128 2.27296 0.0044899 0.00045443 198242 7
: 843 | 3.94488 1.6179 0.0044815 0.00043971 197932 8
: 844 | 3.8426 2.00607 0.00448822 0.000532241 202226 9
: 845 | 3.75874 2.28089 0.00440984 0.000436081 201321 10
: 846 | 3.88003 1.8783 0.00447048 0.00043722 198351 11
: 847 | 3.88584 1.67765 0.0045106 0.00043844 196456 12
: 848 | 3.68544 1.89647 0.0044788 0.000513521 201751 13
: 849 | 3.64921 1.61495 0.00446939 0.000463412 199702 14
: 850 | 3.58267 1.68122 0.00449702 0.00051876 201093 15
: 851 | 3.58263 2.04696 0.00439157 0.000453741 203158 16
: 852 | 3.73843 1.93811 0.00448785 0.000438431 197559 17
: 853 | 3.75153 2.07848 0.00441317 0.000452651 201994 18
: 854 | 3.46653 2.09712 0.00512649 0.000650111 178716 19
: 855 | 3.45666 1.80283 0.00455727 0.000448971 194728 20
: 856 | 3.38616 2.15506 0.00448995 0.00043913 197491 21
:
: Elapsed time for training with 1000 events: 3.86 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00611 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.845 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.169 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.28893e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.06428e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0351 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0417 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00141 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0481 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.89 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0202 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00249 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0386 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00486 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00215 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000391 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0486 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00559 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.91 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.102 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.561 0.159 5.35 1.59 | 3.243 3.229
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : 0.101 0.243 1.91 1.18 | 3.332 3.324
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.