Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.287 sec
: Elapsed time for training with 1000 events: 0.291 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00279 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000743 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00431 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000212 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000357 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31538.5
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33081.3 31101.6 0.00492725 0.000571479 183664 0
: 2 Minimum Test error found - save the configuration
: 2 | 32506.8 30515.5 0.00498971 0.000538268 179717 0
: 3 Minimum Test error found - save the configuration
: 3 | 31788 29821.5 0.0051874 0.00056294 172993 0
: 4 Minimum Test error found - save the configuration
: 4 | 31009.7 29146.9 0.00529432 0.000567199 169236 0
: 5 Minimum Test error found - save the configuration
: 5 | 30229.9 28364.4 0.0052621 0.000560479 170154 0
: 6 Minimum Test error found - save the configuration
: 6 | 29338.1 27412.8 0.00520287 0.000550499 171956 0
: 7 Minimum Test error found - save the configuration
: 7 | 28601.8 26773 0.00516573 0.000550079 173323 0
: 8 Minimum Test error found - save the configuration
: 8 | 28132.2 26401.7 0.00510529 0.000554369 175788 0
: 9 Minimum Test error found - save the configuration
: 9 | 27774.7 26080 0.00513506 0.00055807 174788 0
: 10 Minimum Test error found - save the configuration
: 10 | 27451.6 25784.5 0.00513278 0.000557799 174864 0
: 11 Minimum Test error found - save the configuration
: 11 | 27152 25502.1 0.00518608 0.000553709 172698 0
: 12 Minimum Test error found - save the configuration
: 12 | 26865.8 25230.3 0.00514746 0.0005428 173737 0
: 13 Minimum Test error found - save the configuration
: 13 | 26587 24970.5 0.00513855 0.000541638 174030 0
: 14 Minimum Test error found - save the configuration
: 14 | 26318.8 24718.8 0.00517234 0.000553949 173220 0
: 15 Minimum Test error found - save the configuration
: 15 | 26058.4 24472.2 0.00515676 0.00055806 173962 0
: 16 Minimum Test error found - save the configuration
: 16 | 25803.2 24231.6 0.00516678 0.000560909 173691 0
: 17 Minimum Test error found - save the configuration
: 17 | 25553.7 23996 0.00516269 0.000551619 173495 0
: 18 Minimum Test error found - save the configuration
: 18 | 25309.5 23764.5 0.00516871 0.00054322 172954 0
: 19 Minimum Test error found - save the configuration
: 19 | 25068.5 23538.5 0.00515417 0.000536369 173242 0
: 20 Minimum Test error found - save the configuration
: 20 | 24836.2 23311.6 0.00540742 0.000580789 165747 0
: 21 Minimum Test error found - save the configuration
: 21 | 24601.5 23092.4 0.00519608 0.000567119 172825 0
: 22 Minimum Test error found - save the configuration
: 22 | 24373.5 22875.8 0.00522197 0.00055087 171266 0
: 23 Minimum Test error found - save the configuration
: 23 | 24147.5 22663.7 0.00518034 0.000543528 172532 0
: 24 Minimum Test error found - save the configuration
: 24 | 23926.4 22453.1 0.0052221 0.000565789 171810 0
: 25 Minimum Test error found - save the configuration
: 25 | 23705.3 22248.5 0.00517451 0.000563389 173494 0
: 26 Minimum Test error found - save the configuration
: 26 | 23490.8 22044 0.00515832 0.000559959 173975 0
: 27 Minimum Test error found - save the configuration
: 27 | 23278.7 21840.4 0.00518582 0.00054527 172393 0
: 28 Minimum Test error found - save the configuration
: 28 | 23065.8 21642.9 0.00519269 0.000543979 172091 0
: 29 Minimum Test error found - save the configuration
: 29 | 22860.2 21444.2 0.00532507 0.000572621 168334 0
: 30 Minimum Test error found - save the configuration
: 30 | 22655.4 21247.3 0.00522385 0.0005697 171890 0
: 31 Minimum Test error found - save the configuration
: 31 | 22449.4 21057.1 0.00517284 0.000545948 172902 0
: 32 Minimum Test error found - save the configuration
: 32 | 22249.4 20868.2 0.00523343 0.000551368 170865 0
: 33 Minimum Test error found - save the configuration
: 33 | 22052.5 20679.2 0.00521429 0.000566869 172138 0
: 34 Minimum Test error found - save the configuration
: 34 | 21854.2 20495.3 0.00520652 0.000565309 172369 0
: 35 Minimum Test error found - save the configuration
: 35 | 21661.8 20311.2 0.00520039 0.000561359 172450 0
: 36 Minimum Test error found - save the configuration
: 36 | 21470.3 20128.8 0.00519367 0.00054408 172058 0
: 37 Minimum Test error found - save the configuration
: 37 | 21280.4 19948.7 0.0051987 0.000544259 171879 0
: 38 Minimum Test error found - save the configuration
: 38 | 21089 19775.9 0.00523189 0.000565479 171438 0
: 39 Minimum Test error found - save the configuration
: 39 | 20906.8 19599.7 0.00524621 0.00057835 171385 0
: 40 Minimum Test error found - save the configuration
: 40 | 20724.3 19423.9 0.00528176 0.00055705 169323 0
: 41 Minimum Test error found - save the configuration
: 41 | 20537.6 19257.2 0.00533117 0.000570929 168059 0
: 42 Minimum Test error found - save the configuration
: 42 | 20361.9 19085.5 0.00524585 0.00056734 170995 0
: 43 Minimum Test error found - save the configuration
: 43 | 20181.2 18919 0.00523894 0.000565219 171170 0
: 44 Minimum Test error found - save the configuration
: 44 | 20005.3 18751.3 0.00519668 0.000545609 172004 0
: 45 Minimum Test error found - save the configuration
: 45 | 19830.1 18578.1 0.00525945 0.000559429 170212 0
: 46 Minimum Test error found - save the configuration
: 46 | 19647.9 18411.9 0.00522898 0.0005655 171546 0
: 47 Minimum Test error found - save the configuration
: 47 | 19476.2 18252.5 0.00523376 0.000568939 171496 0
: 48 Minimum Test error found - save the configuration
: 48 | 19304.2 18088.6 0.00525528 0.000552249 170103 0
: 49 Minimum Test error found - save the configuration
: 49 | 19140.4 17924.4 0.0052876 0.000567589 169491 0
: 50 Minimum Test error found - save the configuration
: 50 | 18970.1 17779.7 0.00526948 0.000570029 170233 0
: 51 Minimum Test error found - save the configuration
: 51 | 18806.1 17614.5 0.00523694 0.000562959 171160 0
: 52 Minimum Test error found - save the configuration
: 52 | 18634.6 17451.7 0.00527231 0.000556698 169649 0
: 53 Minimum Test error found - save the configuration
: 53 | 18471.1 17297.8 0.00529495 0.000571949 169384 0
: 54 Minimum Test error found - save the configuration
: 54 | 18303.6 17144.1 0.00526266 0.00057107 170518 0
: 55 Minimum Test error found - save the configuration
: 55 | 18146.6 16987.5 0.00527114 0.000556219 169674 0
: 56 Minimum Test error found - save the configuration
: 56 | 17984.8 16837.3 0.00527636 0.000568349 169923 0
: 57 Minimum Test error found - save the configuration
: 57 | 17823.9 16679.1 0.00529704 0.000573079 169350 0
: 58 Minimum Test error found - save the configuration
: 58 | 17664.6 16528 0.00529643 0.000567099 169157 0
: 59 Minimum Test error found - save the configuration
: 59 | 17504.6 16381.9 0.00542556 0.00061692 166367 0
: 60 Minimum Test error found - save the configuration
: 60 | 17351.4 16232.4 0.0053405 0.000576339 167921 0
: 61 Minimum Test error found - save the configuration
: 61 | 17196 16084.9 0.00541454 0.00057757 165393 0
: 62 Minimum Test error found - save the configuration
: 62 | 17040.5 15938.5 0.00533384 0.000580499 168303 0
: 63 Minimum Test error found - save the configuration
: 63 | 16891.8 15791 0.00535861 0.00059171 167824 0
: 64 Minimum Test error found - save the configuration
: 64 | 16737.7 15649 0.00552483 0.00058423 161924 0
: 65 Minimum Test error found - save the configuration
: 65 | 16587.1 15507.3 0.00536406 0.00058557 167417 0
: 66 Minimum Test error found - save the configuration
: 66 | 16438.8 15367.1 0.00533233 0.00056344 167754 0
: 67 Minimum Test error found - save the configuration
: 67 | 16291.5 15226.9 0.00542296 0.00059693 165768 0
: 68 Minimum Test error found - save the configuration
: 68 | 16144.2 15090.6 0.00548565 0.00061599 164283 0
: 69 Minimum Test error found - save the configuration
: 69 | 16000.9 14951.2 0.00541894 0.00059442 165820 0
: 70 Minimum Test error found - save the configuration
: 70 | 15856.7 14815 0.00542938 0.000612219 166073 0
: 71 Minimum Test error found - save the configuration
: 71 | 15714.9 14679.7 0.00544606 0.000584939 164571 0
: 72 Minimum Test error found - save the configuration
: 72 | 15571 14549 0.00542173 0.00059039 165586 0
: 73 Minimum Test error found - save the configuration
: 73 | 15434.4 14415.4 0.00535723 0.00056828 167051 0
: 74 Minimum Test error found - save the configuration
: 74 | 15294 14285.8 0.00536518 0.000582459 167269 0
: 75 Minimum Test error found - save the configuration
: 75 | 15158.4 14154.5 0.00536262 0.000584899 167444 0
: 76 Minimum Test error found - save the configuration
: 76 | 15021.7 14026.2 0.00536045 0.000569439 166979 0
: 77 Minimum Test error found - save the configuration
: 77 | 14887.2 13898 0.00541979 0.000584219 165441 0
: 78 Minimum Test error found - save the configuration
: 78 | 14750.9 13775.5 0.00540353 0.000575681 165705 0
: 79 Minimum Test error found - save the configuration
: 79 | 14621.7 13649.3 0.00543242 0.00062706 166481 0
: 80 Minimum Test error found - save the configuration
: 80 | 14489.5 13525.6 0.00545314 0.000589869 164498 0
: 81 Minimum Test error found - save the configuration
: 81 | 14360 13402.8 0.00545019 0.000603999 165078 0
: 82 Minimum Test error found - save the configuration
: 82 | 14231.3 13280.7 0.00538199 0.000582679 166691 0
: 83 Minimum Test error found - save the configuration
: 83 | 14103 13161.1 0.0053952 0.00056724 165702 0
: 84 Minimum Test error found - save the configuration
: 84 | 13977.2 13041.2 0.00536708 0.00058397 167255 0
: 85 Minimum Test error found - save the configuration
: 85 | 13850.2 12925.2 0.00542273 0.000571259 164899 0
: 86 Minimum Test error found - save the configuration
: 86 | 13727.8 12807 0.00552282 0.000601321 162552 0
: 87 Minimum Test error found - save the configuration
: 87 | 13602.9 12692.5 0.00539354 0.000588489 166492 0
: 88 Minimum Test error found - save the configuration
: 88 | 13482.6 12576.3 0.00541229 0.000580399 165567 0
: 89 Minimum Test error found - save the configuration
: 89 | 13362.1 12460.8 0.00550524 0.00058932 162737 0
: 90 Minimum Test error found - save the configuration
: 90 | 13240.6 12348.1 0.00543874 0.00057946 164633 0
: 91 Minimum Test error found - save the configuration
: 91 | 13121.4 12237.1 0.00556426 0.000586729 160722 0
: 92 Minimum Test error found - save the configuration
: 92 | 13005.2 12124.7 0.00544332 0.000575079 164330 0
: 93 Minimum Test error found - save the configuration
: 93 | 12887.1 12015.2 0.00539091 0.000587199 166538 0
: 94 Minimum Test error found - save the configuration
: 94 | 12773.1 11904.1 0.00539011 0.000568219 165910 0
: 95 Minimum Test error found - save the configuration
: 95 | 12657.4 11795.8 0.00540047 0.000588071 166237 0
: 96 Minimum Test error found - save the configuration
: 96 | 12540.8 11692 0.00546218 0.000570699 163550 0
: 97 Minimum Test error found - save the configuration
: 97 | 12431.3 11584.6 0.00548407 0.000590159 163468 0
: 98 Minimum Test error found - save the configuration
: 98 | 12320.4 11477.2 0.00546617 0.000606049 164605 0
: 99 Minimum Test error found - save the configuration
: 99 | 12205.4 11376.7 0.00543406 0.000601669 165550 0
: 100 Minimum Test error found - save the configuration
: 100 | 12096.6 11275.7 0.00547959 0.00058678 163505 0
: 101 Minimum Test error found - save the configuration
: 101 | 11990.1 11171.7 0.00540158 0.000579949 165919 0
: 102 Minimum Test error found - save the configuration
: 102 | 11882.1 11069 0.0054714 0.00060956 164547 0
: 103 Minimum Test error found - save the configuration
: 103 | 11773.7 10969.2 0.00544077 0.000570309 164256 0
: 104 Minimum Test error found - save the configuration
: 104 | 11666.9 10871.5 0.00539115 0.000584359 166431 0
: 105 Minimum Test error found - save the configuration
: 105 | 11564.4 10770.8 0.0055347 0.000586439 161673 0
: 106 Minimum Test error found - save the configuration
: 106 | 11458.1 10673.9 0.00541409 0.0005867 165721 0
: 107 Minimum Test error found - save the configuration
: 107 | 11354.7 10578.3 0.00561949 0.000586319 158945 0
: 108 Minimum Test error found - save the configuration
: 108 | 11253.2 10481.9 0.00544711 0.000591819 164769 0
: 109 Minimum Test error found - save the configuration
: 109 | 11152.3 10385.3 0.00545836 0.0005979 164594 0
: 110 Minimum Test error found - save the configuration
: 110 | 11050.4 10291.6 0.00543074 0.00058907 165232 0
: 111 Minimum Test error found - save the configuration
: 111 | 10951.3 10197.7 0.00544606 0.00057302 164169 0
: 112 Minimum Test error found - save the configuration
: 112 | 10852.6 10104.2 0.00542325 0.00059045 165536 0
: 113 Minimum Test error found - save the configuration
: 113 | 10754.2 10012.4 0.00541468 0.000579399 165451 0
: 114 Minimum Test error found - save the configuration
: 114 | 10656.7 9921.59 0.00544071 0.000586679 164812 0
: 115 Minimum Test error found - save the configuration
: 115 | 10560.9 9831.15 0.00566116 0.000592479 157832 0
: 116 Minimum Test error found - save the configuration
: 116 | 10466.6 9739.8 0.00548963 0.00060153 163663 0
: 117 Minimum Test error found - save the configuration
: 117 | 10370 9651.9 0.00546708 0.000577579 163616 0
: 118 Minimum Test error found - save the configuration
: 118 | 10277.4 9563.25 0.00552355 0.000588199 162096 0
: 119 Minimum Test error found - save the configuration
: 119 | 10182.7 9478.01 0.00545486 0.000576939 164004 0
: 120 Minimum Test error found - save the configuration
: 120 | 10091.3 9392.02 0.00542092 0.00059117 165640 0
: 121 Minimum Test error found - save the configuration
: 121 | 9999.84 9306.76 0.00548436 0.000587999 163387 0
: 122 Minimum Test error found - save the configuration
: 122 | 9910.24 9220.94 0.00549656 0.00059563 163234 0
: 123 Minimum Test error found - save the configuration
: 123 | 9819.1 9138.14 0.00546854 0.000588459 163932 0
: 124 Minimum Test error found - save the configuration
: 124 | 9731.6 9053.53 0.00548463 0.000588369 163390 0
: 125 Minimum Test error found - save the configuration
: 125 | 9642.23 8971.06 0.00551847 0.000595069 162489 0
: 126 Minimum Test error found - save the configuration
: 126 | 9554.02 8890.81 0.00554812 0.00060495 161839 0
: 127 Minimum Test error found - save the configuration
: 127 | 9469.77 8807.51 0.00547927 0.000589049 163592 0
: 128 Minimum Test error found - save the configuration
: 128 | 9382.77 8726.41 0.00552507 0.00060793 162696 0
: 129 Minimum Test error found - save the configuration
: 129 | 9296.91 8646.92 0.00550317 0.000584239 162637 0
: 130 Minimum Test error found - save the configuration
: 130 | 9212.23 8568.93 0.00549617 0.000600891 163423 0
: 131 Minimum Test error found - save the configuration
: 131 | 9128.93 8490.38 0.00548782 0.000582519 163089 0
: 132 Minimum Test error found - save the configuration
: 132 | 9046.38 8412.21 0.00549155 0.000599591 163534 0
: 133 Minimum Test error found - save the configuration
: 133 | 8963.96 8334.94 0.00550442 0.000603951 163250 0
: 134 Minimum Test error found - save the configuration
: 134 | 8881.27 8260.24 0.00553256 0.0006033 162296 0
: 135 Minimum Test error found - save the configuration
: 135 | 8801.69 8183.94 0.00552353 0.00058413 161963 0
: 136 Minimum Test error found - save the configuration
: 136 | 8722.82 8106.78 0.0055115 0.00059984 162878 0
: 137 Minimum Test error found - save the configuration
: 137 | 8640.51 8034.62 0.00549075 0.000581729 162965 0
: 138 Minimum Test error found - save the configuration
: 138 | 8563.62 7960.3 0.00550718 0.000595099 162864 0
: 139 Minimum Test error found - save the configuration
: 139 | 8485.96 7886.23 0.00550633 0.000580279 162402 0
: 140 Minimum Test error found - save the configuration
: 140 | 8407.32 7815.22 0.00549421 0.000599559 163444 0
: 141 Minimum Test error found - save the configuration
: 141 | 8331.11 7743.22 0.00547559 0.00058085 163441 0
: 142 Minimum Test error found - save the configuration
: 142 | 8255.72 7671.56 0.00550653 0.00058505 162553 0
: 143 Minimum Test error found - save the configuration
: 143 | 8180.64 7600.17 0.0056231 0.000723331 163273 0
: 144 Minimum Test error found - save the configuration
: 144 | 8105.26 7530.59 0.00559303 0.00060432 160362 0
: 145 Minimum Test error found - save the configuration
: 145 | 8031.4 7461.28 0.00556407 0.000615141 161651 0
: 146 Minimum Test error found - save the configuration
: 146 | 7957.91 7392.82 0.00550833 0.00058435 162470 0
: 147 Minimum Test error found - save the configuration
: 147 | 7884.86 7325.54 0.00551035 0.00059823 162863 0
: 148 Minimum Test error found - save the configuration
: 148 | 7813.67 7257.37 0.00550094 0.00059371 163025 0
: 149 Minimum Test error found - save the configuration
: 149 | 7743.29 7188.87 0.0055411 0.00059984 161902 0
: 150 Minimum Test error found - save the configuration
: 150 | 7670.17 7123.69 0.00549373 0.000581809 162869 0
: 151 Minimum Test error found - save the configuration
: 151 | 7600.85 7058.64 0.00550916 0.00059796 162893 0
: 152 Minimum Test error found - save the configuration
: 152 | 7531.14 6994.07 0.00548048 0.00060438 164066 0
: 153 Minimum Test error found - save the configuration
: 153 | 7463.12 6928.62 0.00547648 0.000591381 163763 0
: 154 Minimum Test error found - save the configuration
: 154 | 7394.39 6864.93 0.00547489 0.0005802 163442 0
: 155 Minimum Test error found - save the configuration
: 155 | 7326.85 6801.21 0.00544107 0.000588351 164856 0
: 156 Minimum Test error found - save the configuration
: 156 | 7258.8 6739.3 0.0054275 0.000579169 165005 0
: 157 Minimum Test error found - save the configuration
: 157 | 7193.65 6676.34 0.00544625 0.000589719 164727 0
: 158 Minimum Test error found - save the configuration
: 158 | 7126.72 6615.12 0.00540466 0.00059138 166207 0
: 159 Minimum Test error found - save the configuration
: 159 | 7063.03 6552.27 0.00545273 0.0005878 164442 0
: 160 Minimum Test error found - save the configuration
: 160 | 6996.56 6492.88 0.00548675 0.000595279 163550 0
: 161 Minimum Test error found - save the configuration
: 161 | 6934.07 6431.14 0.00542933 0.000575399 164815 0
: 162 Minimum Test error found - save the configuration
: 162 | 6868.68 6372.71 0.0055501 0.000601139 161650 0
: 163 Minimum Test error found - save the configuration
: 163 | 6806.83 6313.22 0.00541617 0.00059347 165882 0
: 164 Minimum Test error found - save the configuration
: 164 | 6744.12 6254.68 0.00546043 0.000589019 164223 0
: 165 Minimum Test error found - save the configuration
: 165 | 6681.39 6197.44 0.00549584 0.00058171 162796 0
: 166 Minimum Test error found - save the configuration
: 166 | 6620.93 6139.93 0.00545761 0.00059158 164405 0
: 167 Minimum Test error found - save the configuration
: 167 | 6559.92 6082.58 0.00545066 0.000578911 164212 0
: 168 Minimum Test error found - save the configuration
: 168 | 6500.26 6025.61 0.00545405 0.000593491 164590 0
: 169 Minimum Test error found - save the configuration
: 169 | 6439.29 5969.97 0.00543772 0.00057697 164584 0
: 170 Minimum Test error found - save the configuration
: 170 | 6380.62 5914.87 0.00548531 0.000595629 163610 0
: 171 Minimum Test error found - save the configuration
: 171 | 6322.53 5858.49 0.00551067 0.00060595 163108 0
: 172 Minimum Test error found - save the configuration
: 172 | 6263.39 5805.16 0.00547164 0.000598099 164152 0
: 173 Minimum Test error found - save the configuration
: 173 | 6205.3 5752.02 0.00546967 0.00058036 163622 0
: 174 Minimum Test error found - save the configuration
: 174 | 6149.59 5697.89 0.0054793 0.00060335 164071 0
: 175 Minimum Test error found - save the configuration
: 175 | 6093.24 5643.23 0.00542703 0.00058549 165237 0
: 176 Minimum Test error found - save the configuration
: 176 | 6035.65 5591.74 0.00543331 0.000583229 164946 0
: 177 Minimum Test error found - save the configuration
: 177 | 5980.21 5540.6 0.00541993 0.0005943 165782 0
: 178 Minimum Test error found - save the configuration
: 178 | 5925.34 5489.2 0.00545029 0.000578379 164207 0
: 179 Minimum Test error found - save the configuration
: 179 | 5872.27 5436.05 0.00546318 0.000587039 164064 0
: 180 Minimum Test error found - save the configuration
: 180 | 5816.62 5385.68 0.00550523 0.000583389 162541 0
: 181 Minimum Test error found - save the configuration
: 181 | 5762.63 5335.78 0.00546653 0.000594089 164189 0
: 182 Minimum Test error found - save the configuration
: 182 | 5709.8 5286.74 0.00542347 0.000575851 165030 0
: 183 Minimum Test error found - save the configuration
: 183 | 5658.01 5236.53 0.00550164 0.000629471 164198 0
: 184 Minimum Test error found - save the configuration
: 184 | 5605.44 5186.9 0.00553977 0.00058556 161479 0
: 185 Minimum Test error found - save the configuration
: 185 | 5553.53 5138.68 0.00556868 0.000607239 161243 0
: 186 Minimum Test error found - save the configuration
: 186 | 5501.08 5092.45 0.00541598 0.000579469 165409 0
: 187 Minimum Test error found - save the configuration
: 187 | 5451.91 5044.83 0.00543051 0.000592771 165367 0
: 188 Minimum Test error found - save the configuration
: 188 | 5401.46 4997 0.00541546 0.000577279 165352 0
: 189 Minimum Test error found - save the configuration
: 189 | 5351.27 4950.35 0.00547789 0.000600759 164031 0
: 190 Minimum Test error found - save the configuration
: 190 | 5302.32 4903.79 0.00542274 0.000586239 165409 0
: 191 Minimum Test error found - save the configuration
: 191 | 5253.34 4857.63 0.00542489 0.000582909 165222 0
: 192 Minimum Test error found - save the configuration
: 192 | 5203.99 4812.61 0.00547116 0.000597729 164155 0
: 193 Minimum Test error found - save the configuration
: 193 | 5156.16 4767.96 0.00549683 0.00059311 163141 0
: 194 Minimum Test error found - save the configuration
: 194 | 5108.57 4724.05 0.00541933 0.000590449 165670 0
: 195 Minimum Test error found - save the configuration
: 195 | 5061.87 4680.15 0.00541897 0.000574469 165136 0
: 196 Minimum Test error found - save the configuration
: 196 | 5015.38 4635.56 0.00550738 0.0005955 162870 0
: 197 Minimum Test error found - save the configuration
: 197 | 4968.88 4591.71 0.00541735 0.000577069 165280 0
: 198 Minimum Test error found - save the configuration
: 198 | 4922.69 4549.2 0.00541808 0.000588191 165635 0
: 199 Minimum Test error found - save the configuration
: 199 | 4877.2 4507.14 0.0054989 0.000589591 162956 0
: 200 Minimum Test error found - save the configuration
: 200 | 4831.83 4465.91 0.00548149 0.000603241 163993 0
: 201 Minimum Test error found - save the configuration
: 201 | 4787.54 4424.57 0.00543387 0.000574579 164633 0
: 202 Minimum Test error found - save the configuration
: 202 | 4744.76 4382.05 0.00548153 0.000602029 163951 0
: 203 Minimum Test error found - save the configuration
: 203 | 4699.4 4341.77 0.0054231 0.00058524 165362 0
: 204 Minimum Test error found - save the configuration
: 204 | 4656.02 4302.16 0.00542276 0.000581339 165241 0
: 205 Minimum Test error found - save the configuration
: 205 | 4615.02 4260.25 0.00543503 0.000593679 165243 0
: 206 Minimum Test error found - save the configuration
: 206 | 4570.45 4221.65 0.00580198 0.00060521 153942 0
: 207 Minimum Test error found - save the configuration
: 207 | 4528.96 4182.48 0.00543997 0.00057907 164579 0
: 208 Minimum Test error found - save the configuration
: 208 | 4487.06 4145.36 0.00546249 0.000597039 164425 0
: 209 Minimum Test error found - save the configuration
: 209 | 4447.09 4104.85 0.00541351 0.00058597 165716 0
: 210 Minimum Test error found - save the configuration
: 210 | 4405.23 4066.09 0.0054204 0.000584109 165416 0
: 211 Minimum Test error found - save the configuration
: 211 | 4364.65 4028.59 0.00546792 0.00060042 164355 0
: 212 Minimum Test error found - save the configuration
: 212 | 4324.46 3990.82 0.00542341 0.000583479 165292 0
: 213 Minimum Test error found - save the configuration
: 213 | 4284.51 3953.91 0.00545968 0.000593059 164385 0
: 214 Minimum Test error found - save the configuration
: 214 | 4246.23 3916.15 0.00543099 0.000576699 164803 0
: 215 Minimum Test error found - save the configuration
: 215 | 4206.6 3879.45 0.00546198 0.000595159 164378 0
: 216 Minimum Test error found - save the configuration
: 216 | 4168.13 3842.79 0.00547187 0.00058179 163597 0
: 217 Minimum Test error found - save the configuration
: 217 | 4128.74 3808.89 0.00546921 0.000617021 164874 0
: 218 Minimum Test error found - save the configuration
: 218 | 4093.43 3771.22 0.00549243 0.00058407 162987 0
: 219 Minimum Test error found - save the configuration
: 219 | 4053.1 3738.36 0.00548997 0.000590151 163271 0
: 220 Minimum Test error found - save the configuration
: 220 | 4017.91 3702.3 0.00545403 0.00058135 164181 0
: 221 Minimum Test error found - save the configuration
: 221 | 3980.46 3668.5 0.00548874 0.00060033 163652 0
: 222 Minimum Test error found - save the configuration
: 222 | 3944.32 3633.94 0.00544488 0.000578679 164399 0
: 223 Minimum Test error found - save the configuration
: 223 | 3908.57 3599.69 0.0055516 0.000607161 161798 0
: 224 Minimum Test error found - save the configuration
: 224 | 3872.04 3566.33 0.00543647 0.00057833 164672 0
: 225 Minimum Test error found - save the configuration
: 225 | 3836.49 3534.01 0.00550624 0.000600809 163085 0
: 226 Minimum Test error found - save the configuration
: 226 | 3801.64 3501.95 0.00549141 0.000582269 162961 0
: 227 Minimum Test error found - save the configuration
: 227 | 3768.4 3467.91 0.00554683 0.00060412 161854 0
: 228 Minimum Test error found - save the configuration
: 228 | 3733.23 3435.56 0.00548948 0.00058227 163025 0
: 229 Minimum Test error found - save the configuration
: 229 | 3699.1 3403.04 0.0055535 0.00060279 161593 0
: 230 Minimum Test error found - save the configuration
: 230 | 3665.18 3371.86 0.00550997 0.000585039 162439 0
: 231 Minimum Test error found - save the configuration
: 231 | 3631.61 3340.79 0.00546059 0.000597371 164500 0
: 232 Minimum Test error found - save the configuration
: 232 | 3599.32 3309.11 0.00549288 0.000611721 163896 0
: 233 Minimum Test error found - save the configuration
: 233 | 3566.13 3279.02 0.00568749 0.000632411 158257 0
: 234 Minimum Test error found - save the configuration
: 234 | 3534.14 3248.26 0.00538876 0.00057083 166046 0
: 235 Minimum Test error found - save the configuration
: 235 | 3501.86 3218.34 0.00542197 0.000589179 165536 0
: 236 Minimum Test error found - save the configuration
: 236 | 3470.3 3187.78 0.00551571 0.000582019 162150 0
: 237 Minimum Test error found - save the configuration
: 237 | 3438.25 3158.24 0.00544156 0.00059173 164954 0
: 238 Minimum Test error found - save the configuration
: 238 | 3407.14 3129.17 0.0054513 0.00058192 164292 0
: 239 Minimum Test error found - save the configuration
: 239 | 3376.12 3100.35 0.0054283 0.0005901 165351 0
: 240 Minimum Test error found - save the configuration
: 240 | 3345.4 3071.89 0.00547479 0.000580669 163461 0
: 241 Minimum Test error found - save the configuration
: 241 | 3314.98 3043.48 0.00556 0.000609041 161585 0
: 242 Minimum Test error found - save the configuration
: 242 | 3285.74 3014.21 0.00543105 0.000577219 164818 0
: 243 Minimum Test error found - save the configuration
: 243 | 3254.63 2986.97 0.00545852 0.000589699 164311 0
: 244 Minimum Test error found - save the configuration
: 244 | 3225.79 2959.35 0.00540838 0.000583079 165793 0
: 245 Minimum Test error found - save the configuration
: 245 | 3196.51 2931.87 0.00546999 0.000585559 163786 0
: 246 Minimum Test error found - save the configuration
: 246 | 3167.98 2903.93 0.00547867 0.00058947 163626 0
: 247 Minimum Test error found - save the configuration
: 247 | 3138.24 2877.26 0.00551641 0.00063244 163801 0
: 248 Minimum Test error found - save the configuration
: 248 | 3109.52 2851.41 0.00547431 0.00059106 163825 0
: 249 Minimum Test error found - save the configuration
: 249 | 3082.01 2826.06 0.00547443 0.000589929 163783 0
: 250 Minimum Test error found - save the configuration
: 250 | 3054.44 2798.81 0.00543642 0.000594059 165209 0
: 251 Minimum Test error found - save the configuration
: 251 | 3026.87 2771.97 0.00543644 0.000577379 164641 0
: 252 Minimum Test error found - save the configuration
: 252 | 2998.17 2746.7 0.00547761 0.000595139 163851 0
: 253 Minimum Test error found - save the configuration
: 253 | 2971.18 2721.79 0.0054101 0.000572579 165374 0
: 254 Minimum Test error found - save the configuration
: 254 | 2945.08 2695.8 0.00550222 0.00060422 163332 0
: 255 Minimum Test error found - save the configuration
: 255 | 2917.6 2671.85 0.00545934 0.000586871 164188 0
: 256 Minimum Test error found - save the configuration
: 256 | 2891.74 2646.11 0.00541613 0.000578169 165359 0
: 257 Minimum Test error found - save the configuration
: 257 | 2865.02 2622.55 0.00541971 0.00058464 165458 0
: 258 Minimum Test error found - save the configuration
: 258 | 2839.67 2597.4 0.0055576 0.00062565 162208 0
: 259 Minimum Test error found - save the configuration
: 259 | 2813.71 2573.28 0.00541069 0.000564449 165076 0
: 260 Minimum Test error found - save the configuration
: 260 | 2788.4 2549.79 0.0054776 0.00059598 163880 0
: 261 Minimum Test error found - save the configuration
: 261 | 2763.77 2525.98 0.00559216 0.000587349 159846 0
: 262 Minimum Test error found - save the configuration
: 262 | 2737.58 2503.55 0.00546625 0.000591619 164115 0
: 263 Minimum Test error found - save the configuration
: 263 | 2713.1 2480.93 0.00543862 0.000594909 165163 0
: 264 Minimum Test error found - save the configuration
: 264 | 2689.47 2456.4 0.00547987 0.00059805 163873 0
: 265 Minimum Test error found - save the configuration
: 265 | 2664.12 2433.97 0.0054222 0.000583539 165335 0
: 266 Minimum Test error found - save the configuration
: 266 | 2640.23 2411.84 0.00547181 0.000589669 163863 0
: 267 Minimum Test error found - save the configuration
: 267 | 2616 2389.88 0.00549233 0.00062697 164428 0
: 268 Minimum Test error found - save the configuration
: 268 | 2592.75 2367.83 0.00547095 0.000584429 163716 0
: 269 Minimum Test error found - save the configuration
: 269 | 2568.7 2346.28 0.00544537 0.000598459 165054 0
: 270 Minimum Test error found - save the configuration
: 270 | 2545.61 2324.68 0.00542517 0.000577229 165019 0
: 271 Minimum Test error found - save the configuration
: 271 | 2523.63 2301.85 0.00542418 0.000590261 165497 0
: 272 Minimum Test error found - save the configuration
: 272 | 2499.44 2281.03 0.00541465 0.000570799 165158 0
: 273 Minimum Test error found - save the configuration
: 273 | 2476.6 2260.74 0.00544069 0.00059272 165018 0
: 274 Minimum Test error found - save the configuration
: 274 | 2454.55 2239.89 0.00536032 0.0005822 167430 0
: 275 Minimum Test error found - save the configuration
: 275 | 2431.74 2220.35 0.00549819 0.000597929 163257 0
: 276 Minimum Test error found - save the configuration
: 276 | 2410.73 2198.96 0.00537059 0.000594249 167492 0
: 277 Minimum Test error found - save the configuration
: 277 | 2387.95 2179.01 0.00541748 0.00058188 165440 0
: 278 Minimum Test error found - save the configuration
: 278 | 2366.6 2158.74 0.00543297 0.00059059 165208 0
: 279 Minimum Test error found - save the configuration
: 279 | 2345.09 2138.64 0.00546434 0.000583201 163896 0
: 280 Minimum Test error found - save the configuration
: 280 | 2323.09 2119.53 0.00544163 0.000591319 164938 0
: 281 Minimum Test error found - save the configuration
: 281 | 2302.29 2100.4 0.00547277 0.00058231 163584 0
: 282 Minimum Test error found - save the configuration
: 282 | 2281.3 2080.76 0.00544192 0.00059323 164993 0
: 283 Minimum Test error found - save the configuration
: 283 | 2260.5 2061.2 0.00541145 0.000584919 165751 0
: 284 Minimum Test error found - save the configuration
: 284 | 2239.43 2042.75 0.00565753 0.000589989 157867 0
: 285 Minimum Test error found - save the configuration
: 285 | 2219.02 2024.06 0.0054843 0.000583829 163250 0
: 286 Minimum Test error found - save the configuration
: 286 | 2198.71 2005.35 0.0054724 0.00060456 164344 0
: 287 Minimum Test error found - save the configuration
: 287 | 2178.58 1987.28 0.00546887 0.000575649 163492 0
: 288 Minimum Test error found - save the configuration
: 288 | 2158.37 1968.64 0.00544537 0.00059344 164883 0
: 289 Minimum Test error found - save the configuration
: 289 | 2138.73 1950.91 0.00549021 0.000604419 163740 0
: 290 Minimum Test error found - save the configuration
: 290 | 2119.34 1932.61 0.00555108 0.00060953 161893 0
: 291 Minimum Test error found - save the configuration
: 291 | 2099.08 1915.06 0.00549413 0.00058165 162851 0
: 292 Minimum Test error found - save the configuration
: 292 | 2080.26 1897.24 0.00551601 0.0005955 162585 0
: 293 Minimum Test error found - save the configuration
: 293 | 2060.64 1880.06 0.00554327 0.000603371 161947 0
: 294 Minimum Test error found - save the configuration
: 294 | 2041.5 1863.44 0.00560383 0.00060803 160134 0
: 295 Minimum Test error found - save the configuration
: 295 | 2023.26 1845.85 0.00550433 0.00060677 163347 0
: 296 Minimum Test error found - save the configuration
: 296 | 2003.98 1828.82 0.00550509 0.00061721 163670 0
: 297 Minimum Test error found - save the configuration
: 297 | 1985.45 1811.94 0.00595203 0.000631731 150368 0
: 298 Minimum Test error found - save the configuration
: 298 | 1967.13 1795.63 0.00552028 0.000581619 161987 0
: 299 Minimum Test error found - save the configuration
: 299 | 1948.76 1778.88 0.00560403 0.00061708 160419 0
: 300 Minimum Test error found - save the configuration
: 300 | 1930.42 1762.98 0.00557996 0.00060317 160746 0
: 301 Minimum Test error found - save the configuration
: 301 | 1912.59 1746.97 0.00543169 0.00058958 165217 0
: 302 Minimum Test error found - save the configuration
: 302 | 1894.75 1731.33 0.00551186 0.00061575 163395 0
: 303 Minimum Test error found - save the configuration
: 303 | 1877.09 1715.97 0.00551098 0.0006243 163710 0
: 304 Minimum Test error found - save the configuration
: 304 | 1859.77 1699.98 0.00556961 0.00060521 161147 0
: 305 Minimum Test error found - save the configuration
: 305 | 1842.66 1683.61 0.00559703 0.000582889 159549 0
: 306 Minimum Test error found - save the configuration
: 306 | 1824.74 1668.35 0.00565298 0.00062017 158957 0
: 307 Minimum Test error found - save the configuration
: 307 | 1808.03 1652.94 0.00560468 0.000610979 160202 0
: 308 Minimum Test error found - save the configuration
: 308 | 1790.68 1637.67 0.00557051 0.000596709 160843 0
: 309 Minimum Test error found - save the configuration
: 309 | 1774.11 1622.31 0.00557617 0.00060727 161001 0
: 310 Minimum Test error found - save the configuration
: 310 | 1756.92 1608.75 0.00552054 0.000584649 162078 0
: 311 Minimum Test error found - save the configuration
: 311 | 1740.76 1594.02 0.00558882 0.000618521 160956 0
: 312 Minimum Test error found - save the configuration
: 312 | 1724.39 1578.68 0.00546933 0.00058964 163945 0
: 313 Minimum Test error found - save the configuration
: 313 | 1707.77 1564.76 0.00554684 0.000610681 162069 0
: 314 Minimum Test error found - save the configuration
: 314 | 1691.72 1549.98 0.00561098 0.00059635 159533 0
: 315 Minimum Test error found - save the configuration
: 315 | 1675.35 1535.9 0.00556606 0.00059121 160809 0
: 316 Minimum Test error found - save the configuration
: 316 | 1659.7 1522.02 0.00550424 0.000608039 163392 0
: 317 Minimum Test error found - save the configuration
: 317 | 1643.83 1508.18 0.00543887 0.000593209 165096 0
: 318 Minimum Test error found - save the configuration
: 318 | 1628.19 1494.65 0.00546441 0.000583399 163901 0
: 319 Minimum Test error found - save the configuration
: 319 | 1612.97 1480.44 0.00546004 0.00059343 164386 0
: 320 Minimum Test error found - save the configuration
: 320 | 1597.2 1466.76 0.00546468 0.00057847 163726 0
: 321 Minimum Test error found - save the configuration
: 321 | 1582.33 1452.98 0.00545412 0.00059124 164512 0
: 322 Minimum Test error found - save the configuration
: 322 | 1566.73 1439.93 0.00543231 0.000576 164734 0
: 323 Minimum Test error found - save the configuration
: 323 | 1552.19 1426.46 0.00550404 0.000620461 163814 0
: 324 Minimum Test error found - save the configuration
: 324 | 1537.04 1413.44 0.00544617 0.00059804 165012 0
: 325 Minimum Test error found - save the configuration
: 325 | 1522.62 1399.92 0.00545297 0.000591549 164561 0
: 326 Minimum Test error found - save the configuration
: 326 | 1507.54 1387.42 0.00543339 0.000579689 164823 0
: 327 Minimum Test error found - save the configuration
: 327 | 1493.31 1375.27 0.00550644 0.00060184 163112 0
: 328 Minimum Test error found - save the configuration
: 328 | 1479.08 1362.32 0.00544536 0.00057554 164277 0
: 329 Minimum Test error found - save the configuration
: 329 | 1465.33 1348.97 0.00552224 0.0006042 162666 0
: 330 Minimum Test error found - save the configuration
: 330 | 1450.69 1336.53 0.00541515 0.000583689 165581 0
: 331 Minimum Test error found - save the configuration
: 331 | 1436.52 1324.83 0.00545086 0.000586549 164463 0
: 332 Minimum Test error found - save the configuration
: 332 | 1423.34 1312.3 0.00554341 0.000668411 164103 0
: 333 Minimum Test error found - save the configuration
: 333 | 1408.93 1300.42 0.00552469 0.00060726 162687 0
: 334 Minimum Test error found - save the configuration
: 334 | 1395.91 1287.92 0.00546093 0.0005893 164216 0
: 335 Minimum Test error found - save the configuration
: 335 | 1382.03 1276.37 0.00546011 0.00059783 164532 0
: 336 Minimum Test error found - save the configuration
: 336 | 1368.83 1264.49 0.00547807 0.000602919 164098 0
: 337 Minimum Test error found - save the configuration
: 337 | 1355.89 1252.44 0.00556336 0.00060369 161301 0
: 338 Minimum Test error found - save the configuration
: 338 | 1342.39 1241.05 0.00545612 0.00059149 164452 0
: 339 Minimum Test error found - save the configuration
: 339 | 1330 1228.98 0.00544414 0.00059288 164906 0
: 340 Minimum Test error found - save the configuration
: 340 | 1316.82 1217.73 0.00542101 0.000574959 165083 0
: 341 Minimum Test error found - save the configuration
: 341 | 1304.12 1206.93 0.00544504 0.000590269 164786 0
: 342 Minimum Test error found - save the configuration
: 342 | 1291.7 1195.53 0.00550268 0.00061112 163547 0
: 343 Minimum Test error found - save the configuration
: 343 | 1279.29 1184.6 0.00545704 0.00059711 164611 0
: 344 Minimum Test error found - save the configuration
: 344 | 1266.57 1173.98 0.00552261 0.00059491 162348 0
: 345 Minimum Test error found - save the configuration
: 345 | 1255.02 1162.14 0.00547318 0.000598449 164112 0
: 346 Minimum Test error found - save the configuration
: 346 | 1242.69 1152.27 0.00542023 0.00058369 165408 0
: 347 Minimum Test error found - save the configuration
: 347 | 1230.5 1140.4 0.00542444 0.000584529 165292 0
: 348 Minimum Test error found - save the configuration
: 348 | 1218.4 1130.26 0.00557312 0.00062821 161782 0
: 349 Minimum Test error found - save the configuration
: 349 | 1206.97 1119.37 0.00557399 0.00059865 160793 0
: 350 Minimum Test error found - save the configuration
: 350 | 1195.06 1108.77 0.00561329 0.000581739 158997 0
: 351 Minimum Test error found - save the configuration
: 351 | 1183.51 1098.33 0.00561594 0.000630461 160466 0
: 352 Minimum Test error found - save the configuration
: 352 | 1172.25 1087.87 0.0056355 0.000613839 159310 0
: 353 Minimum Test error found - save the configuration
: 353 | 1160.55 1077.62 0.00551791 0.000600399 162684 0
: 354 Minimum Test error found - save the configuration
: 354 | 1149.51 1067.27 0.00557545 0.000601569 160840 0
: 355 Minimum Test error found - save the configuration
: 355 | 1138.45 1057.04 0.00550888 0.000579319 162286 0
: 356 Minimum Test error found - save the configuration
: 356 | 1127.09 1047.08 0.00561069 0.000610509 159994 0
: 357 Minimum Test error found - save the configuration
: 357 | 1116.39 1036.86 0.00559004 0.00060335 160427 0
: 358 Minimum Test error found - save the configuration
: 358 | 1105.25 1026.98 0.00554104 0.00060967 162227 0
: 359 Minimum Test error found - save the configuration
: 359 | 1094.08 1017.81 0.00559912 0.000588 159645 0
: 360 Minimum Test error found - save the configuration
: 360 | 1083.76 1008.46 0.00557949 0.00058954 160322 0
: 361 Minimum Test error found - save the configuration
: 361 | 1073.31 998.778 0.00551745 0.00059592 162551 0
: 362 Minimum Test error found - save the configuration
: 362 | 1062.6 989.174 0.00562472 0.00059825 159157 0
: 363 Minimum Test error found - save the configuration
: 363 | 1052.47 979.595 0.0055792 0.000614641 161142 0
: 364 Minimum Test error found - save the configuration
: 364 | 1042.26 969.894 0.00550971 0.00058481 162440 0
: 365 Minimum Test error found - save the configuration
: 365 | 1031.69 960.947 0.00558419 0.00059991 160505 0
: 366 Minimum Test error found - save the configuration
: 366 | 1022 951.707 0.00552249 0.00058502 162026 0
: 367 Minimum Test error found - save the configuration
: 367 | 1011.64 942.708 0.00558688 0.00060752 160663 0
: 368 Minimum Test error found - save the configuration
: 368 | 1002.01 934.043 0.00554135 0.00061064 162248 0
: 369 Minimum Test error found - save the configuration
: 369 | 992.273 924.747 0.00549469 0.0006027 163533 0
: 370 Minimum Test error found - save the configuration
: 370 | 982.548 916.072 0.0055258 0.00060846 162690 0
: 371 Minimum Test error found - save the configuration
: 371 | 973.016 906.736 0.00552256 0.00058385 161986 0
: 372 Minimum Test error found - save the configuration
: 372 | 963.092 898.37 0.00554048 0.00059608 161799 0
: 373 Minimum Test error found - save the configuration
: 373 | 953.905 889.496 0.00552277 0.000586279 162058 0
: 374 Minimum Test error found - save the configuration
: 374 | 944.235 880.932 0.00561369 0.000620321 160212 0
: 375 Minimum Test error found - save the configuration
: 375 | 935.265 872.469 0.00552032 0.000591539 162312 0
: 376 Minimum Test error found - save the configuration
: 376 | 925.723 864.712 0.00550832 0.000610309 163332 0
: 377 Minimum Test error found - save the configuration
: 377 | 917.058 855.52 0.00551639 0.000590319 162401 0
: 378 Minimum Test error found - save the configuration
: 378 | 907.533 847.441 0.00550604 0.000596469 162947 0
: 379 Minimum Test error found - save the configuration
: 379 | 898.713 839.262 0.00571496 0.00060639 156600 0
: 380 Minimum Test error found - save the configuration
: 380 | 890.204 830.981 0.00548377 0.000588439 163421 0
: 381 Minimum Test error found - save the configuration
: 381 | 880.935 822.915 0.00555494 0.00060315 161558 0
: 382 Minimum Test error found - save the configuration
: 382 | 872.601 814.526 0.0055279 0.00057469 161511 0
: 383 Minimum Test error found - save the configuration
: 383 | 863.696 806.364 0.00544061 0.00058683 164820 0
: 384 Minimum Test error found - save the configuration
: 384 | 854.926 798.756 0.00543759 0.0005968 165262 0
: 385 Minimum Test error found - save the configuration
: 385 | 846.664 791.007 0.00544157 0.000596509 165117 0
: 386 Minimum Test error found - save the configuration
: 386 | 838.582 783.382 0.00545569 0.00058619 164288 0
: 387 Minimum Test error found - save the configuration
: 387 | 829.782 775.277 0.00576208 0.000630701 155903 0
: 388 Minimum Test error found - save the configuration
: 388 | 821.511 767.896 0.00561555 0.00062865 160420 0
: 389 Minimum Test error found - save the configuration
: 389 | 813.341 760.126 0.00554695 0.00058877 161349 0
: 390 Minimum Test error found - save the configuration
: 390 | 805.241 752.645 0.00559038 0.00059661 160200 0
: 391 Minimum Test error found - save the configuration
: 391 | 797.161 745.453 0.00558742 0.00059374 160202 0
: 392 Minimum Test error found - save the configuration
: 392 | 789.218 737.766 0.00552927 0.000609971 162625 0
: 393 Minimum Test error found - save the configuration
: 393 | 781.577 730.828 0.00551394 0.000594031 162605 0
: 394 Minimum Test error found - save the configuration
: 394 | 773.452 723.499 0.00553279 0.000609421 162490 0
: 395 Minimum Test error found - save the configuration
: 395 | 765.827 716.021 0.00550332 0.00057775 162418 0
: 396 Minimum Test error found - save the configuration
: 396 | 757.946 709.043 0.00552489 0.00059709 162344 0
: 397 Minimum Test error found - save the configuration
: 397 | 750.624 702.265 0.00559403 0.00062013 160840 0
: 398 Minimum Test error found - save the configuration
: 398 | 743.02 694.677 0.00552179 0.000586169 162087 0
: 399 Minimum Test error found - save the configuration
: 399 | 735.561 687.384 0.0056039 0.00061019 160202 0
: 400 Minimum Test error found - save the configuration
: 400 | 727.835 681.004 0.0055124 0.000591029 162556 0
: 401 Minimum Test error found - save the configuration
: 401 | 720.808 674.278 0.00553257 0.0006118 162576 0
: 402 Minimum Test error found - save the configuration
: 402 | 713.791 667.625 0.00554162 0.000579999 161238 0
: 403 Minimum Test error found - save the configuration
: 403 | 706.312 660.396 0.00552874 0.00059632 162192 0
: 404 Minimum Test error found - save the configuration
: 404 | 699.515 653.539 0.00552818 0.000580161 161681 0
: 405 Minimum Test error found - save the configuration
: 405 | 692.149 646.931 0.00555856 0.000613911 161791 0
: 406 Minimum Test error found - save the configuration
: 406 | 685.107 640.542 0.00552579 0.000592179 162153 0
: 407 Minimum Test error found - save the configuration
: 407 | 678.214 633.709 0.00550836 0.000602449 163069 0
: 408 Minimum Test error found - save the configuration
: 408 | 671.449 627.164 0.00562105 0.00062319 160068 0
: 409 Minimum Test error found - save the configuration
: 409 | 664.421 620.807 0.00557436 0.000576479 160068 0
: 410 Minimum Test error found - save the configuration
: 410 | 657.797 614.388 0.00551369 0.000595849 162673 0
: 411 Minimum Test error found - save the configuration
: 411 | 651.087 608.296 0.00549918 0.000592239 163034 0
: 412 Minimum Test error found - save the configuration
: 412 | 644.334 601.598 0.00550352 0.00060917 163454 0
: 413 Minimum Test error found - save the configuration
: 413 | 637.534 595.573 0.0054992 0.000592729 163050 0
: 414 Minimum Test error found - save the configuration
: 414 | 631.108 589.619 0.00557857 0.000604929 160848 0
: 415 Minimum Test error found - save the configuration
: 415 | 625.147 583.541 0.0055087 0.000581309 162358 0
: 416 Minimum Test error found - save the configuration
: 416 | 618.341 577.324 0.0055387 0.00059398 161789 0
: 417 Minimum Test error found - save the configuration
: 417 | 612.042 571.212 0.00552251 0.0005806 161881 0
: 418 Minimum Test error found - save the configuration
: 418 | 605.831 565.343 0.00556535 0.0006104 161455 0
: 419 Minimum Test error found - save the configuration
: 419 | 599.343 559.489 0.00553422 0.000600499 162149 0
: 420 Minimum Test error found - save the configuration
: 420 | 593.386 553.473 0.00547924 0.00060154 164012 0
: 421 Minimum Test error found - save the configuration
: 421 | 587.257 547.983 0.00549888 0.000594109 163107 0
: 422 Minimum Test error found - save the configuration
: 422 | 581.238 542.253 0.00545478 0.000593569 164568 0
: 423 Minimum Test error found - save the configuration
: 423 | 575.523 536.522 0.00541057 0.000574881 165437 0
: 424 Minimum Test error found - save the configuration
: 424 | 569.292 531.555 0.00546033 0.000590581 164280 0
: 425 Minimum Test error found - save the configuration
: 425 | 563.677 525.312 0.00542644 0.00057072 164754 0
: 426 Minimum Test error found - save the configuration
: 426 | 557.513 519.653 0.00542863 0.000587069 165236 0
: 427 Minimum Test error found - save the configuration
: 427 | 551.903 514.17 0.00545138 0.000573579 164008 0
: 428 Minimum Test error found - save the configuration
: 428 | 546.135 508.952 0.0054333 0.0005955 165364 0
: 429 Minimum Test error found - save the configuration
: 429 | 540.554 503.432 0.00542024 0.000592209 165699 0
: 430 Minimum Test error found - save the configuration
: 430 | 534.893 498.403 0.00540651 0.000563149 165175 0
: 431 Minimum Test error found - save the configuration
: 431 | 529.505 493.471 0.00544654 0.000580819 164416 0
: 432 Minimum Test error found - save the configuration
: 432 | 524.109 487.236 0.00535013 0.000569069 167327 0
: 433 Minimum Test error found - save the configuration
: 433 | 518.333 482.505 0.00537049 0.000583659 167125 0
: 434 Minimum Test error found - save the configuration
: 434 | 513.329 477.299 0.00537058 0.000582559 167084 0
: 435 Minimum Test error found - save the configuration
: 435 | 507.815 471.895 0.00541523 0.00057421 165254 0
: 436 Minimum Test error found - save the configuration
: 436 | 502.28 467.29 0.00535946 0.000578839 167342 0
: 437 Minimum Test error found - save the configuration
: 437 | 497.423 461.766 0.00539585 0.00058639 166339 0
: 438 Minimum Test error found - save the configuration
: 438 | 492.242 456.641 0.00536437 0.000589699 167551 0
: 439 Minimum Test error found - save the configuration
: 439 | 486.841 451.824 0.0053978 0.00057881 166010 0
: 440 Minimum Test error found - save the configuration
: 440 | 481.622 447.313 0.00545787 0.00058435 164152 0
: 441 Minimum Test error found - save the configuration
: 441 | 476.733 442.461 0.00544893 0.000589401 164625 0
: 442 Minimum Test error found - save the configuration
: 442 | 472.182 437.277 0.00545104 0.000575161 164073 0
: 443 Minimum Test error found - save the configuration
: 443 | 466.773 432.533 0.0054522 0.000592421 164617 0
: 444 Minimum Test error found - save the configuration
: 444 | 461.861 428.276 0.00550811 0.00057963 162322 0
: 445 Minimum Test error found - save the configuration
: 445 | 457.299 423.283 0.0054439 0.000589799 164809 0
: 446 Minimum Test error found - save the configuration
: 446 | 452.339 418.706 0.00546206 0.000575 163698 0
: 447 Minimum Test error found - save the configuration
: 447 | 447.611 414.388 0.00546026 0.00059214 164335 0
: 448 Minimum Test error found - save the configuration
: 448 | 443.076 409.586 0.00541096 0.000574209 165400 0
: 449 Minimum Test error found - save the configuration
: 449 | 438.38 404.951 0.0054708 0.000600449 164259 0
: 450 Minimum Test error found - save the configuration
: 450 | 433.492 401.042 0.0054418 0.000587139 164790 0
: 451 Minimum Test error found - save the configuration
: 451 | 429.28 396.406 0.00546805 0.000586899 163896 0
: 452 Minimum Test error found - save the configuration
: 452 | 424.519 392.427 0.00545816 0.00061554 165200 0
: 453 Minimum Test error found - save the configuration
: 453 | 420.417 387.894 0.00545194 0.00058373 164331 0
: 454 Minimum Test error found - save the configuration
: 454 | 415.734 383.394 0.00544967 0.0005953 164800 0
: 455 Minimum Test error found - save the configuration
: 455 | 411.305 379.433 0.00546651 0.000577839 163644 0
: 456 Minimum Test error found - save the configuration
: 456 | 407.163 375.144 0.0054365 0.000588001 165000 0
: 457 Minimum Test error found - save the configuration
: 457 | 402.883 371.044 0.00545104 0.00057716 164140 0
: 458 Minimum Test error found - save the configuration
: 458 | 398.676 366.767 0.00544619 0.00059026 164747 0
: 459 Minimum Test error found - save the configuration
: 459 | 394.311 362.54 0.00545718 0.00057473 163852 0
: 460 Minimum Test error found - save the configuration
: 460 | 390.115 359.046 0.00544372 0.00059302 164925 0
: 461 Minimum Test error found - save the configuration
: 461 | 386.376 354.471 0.00542572 0.000583329 165208 0
: 462 Minimum Test error found - save the configuration
: 462 | 381.897 350.831 0.00547989 0.00059336 163715 0
: 463 Minimum Test error found - save the configuration
: 463 | 378.146 346.676 0.00543688 0.000581669 164771 0
: 464 Minimum Test error found - save the configuration
: 464 | 373.801 343.028 0.00543129 0.000583279 165016 0
: 465 Minimum Test error found - save the configuration
: 465 | 370.081 338.92 0.00544067 0.00059248 165010 0
: 466 Minimum Test error found - save the configuration
: 466 | 366.062 335.424 0.00566647 0.0006054 158069 0
: 467 Minimum Test error found - save the configuration
: 467 | 362.34 331.552 0.00542394 0.00058883 165456 0
: 468 Minimum Test error found - save the configuration
: 468 | 358.214 328.132 0.0054852 0.000582109 163162 0
: 469 Minimum Test error found - save the configuration
: 469 | 354.647 323.798 0.00545747 0.000594039 164493 0
: 470 Minimum Test error found - save the configuration
: 470 | 350.484 320.372 0.00544097 0.000576659 164463 0
: 471 Minimum Test error found - save the configuration
: 471 | 346.843 317.11 0.0054674 0.00059359 164143 0
: 472 Minimum Test error found - save the configuration
: 472 | 343.339 313.541 0.00546233 0.00057322 163629 0
: 473 Minimum Test error found - save the configuration
: 473 | 339.966 309.626 0.00544803 0.00058861 164629 0
: 474 Minimum Test error found - save the configuration
: 474 | 336 306.399 0.00541034 0.000569999 165278 0
: 475 Minimum Test error found - save the configuration
: 475 | 332.479 303.178 0.0054838 0.000595539 163657 0
: 476 Minimum Test error found - save the configuration
: 476 | 329.22 299.513 0.00547404 0.00058454 163616 0
: 477 Minimum Test error found - save the configuration
: 477 | 325.283 296.123 0.00544507 0.00059212 164848 0
: 478 Minimum Test error found - save the configuration
: 478 | 321.624 292.535 0.00544231 0.000608219 165491 0
: 479 Minimum Test error found - save the configuration
: 479 | 318.133 289.436 0.00566665 0.00060469 158041 0
: 480 Minimum Test error found - save the configuration
: 480 | 314.934 285.815 0.00544475 0.000596749 165017 0
: 481 Minimum Test error found - save the configuration
: 481 | 311.421 282.603 0.00549276 0.000598029 163441 0
: 482 Minimum Test error found - save the configuration
: 482 | 308.209 279.597 0.005412 0.00057546 165408 0
: 483 Minimum Test error found - save the configuration
: 483 | 304.822 275.944 0.005447 0.000596929 164946 0
: 484 Minimum Test error found - save the configuration
: 484 | 301.332 273.037 0.0054444 0.000585369 164642 0
: 485 Minimum Test error found - save the configuration
: 485 | 298.058 269.878 0.00545694 0.000583609 164159 0
: 486 Minimum Test error found - save the configuration
: 486 | 294.879 266.637 0.00544298 0.000593919 164980 0
: 487 Minimum Test error found - save the configuration
: 487 | 291.768 263.454 0.00548465 0.0006029 163876 0
: 488 Minimum Test error found - save the configuration
: 488 | 288.443 260.601 0.00545995 0.00059334 164386 0
: 489 Minimum Test error found - save the configuration
: 489 | 285.345 257.706 0.00541723 0.00057321 165152 0
: 490 Minimum Test error found - save the configuration
: 490 | 282.515 254.65 0.00545975 0.00059565 164470 0
: 491 Minimum Test error found - save the configuration
: 491 | 279.523 251.797 0.00541042 0.000573489 165394 0
: 492 Minimum Test error found - save the configuration
: 492 | 276.248 249.005 0.00542469 0.00057795 165059 0
: 493 Minimum Test error found - save the configuration
: 493 | 273.339 246.418 0.00543987 0.000586819 164845 0
: 494 Minimum Test error found - save the configuration
: 494 | 270.402 243.464 0.00534529 0.000569939 167527 0
: 495 Minimum Test error found - save the configuration
: 495 | 267.484 240.294 0.0053854 0.00058256 166568 0
: 496 Minimum Test error found - save the configuration
: 496 | 264.416 237.537 0.00535969 0.000562599 166768 0
: 497 Minimum Test error found - save the configuration
: 497 | 261.992 234.904 0.00534528 0.000579749 167872 0
: 498 Minimum Test error found - save the configuration
: 498 | 258.786 232.183 0.0053606 0.00059181 167758 0
: 499 Minimum Test error found - save the configuration
: 499 | 255.908 229.929 0.00541588 0.00056597 164952 0
: 500 Minimum Test error found - save the configuration
: 500 | 253.33 226.409 0.00543406 0.000588289 165092 0
: 501 Minimum Test error found - save the configuration
: 501 | 250.328 224.53 0.00542074 0.000572309 165002 0
: 502 Minimum Test error found - save the configuration
: 502 | 247.854 221.997 0.00544575 0.00059171 164811 0
: 503 Minimum Test error found - save the configuration
: 503 | 244.853 219.214 0.00541695 0.000580929 165425 0
: 504 Minimum Test error found - save the configuration
: 504 | 242.321 216.345 0.00536411 0.000572289 166951 0
: 505 Minimum Test error found - save the configuration
: 505 | 239.408 213.924 0.00535907 0.000582481 167484 0
: 506 Minimum Test error found - save the configuration
: 506 | 237.051 211.494 0.00534528 0.000565729 167380 0
: 507 Minimum Test error found - save the configuration
: 507 | 234.523 209.049 0.00542217 0.0006028 165997 0
: 508 Minimum Test error found - save the configuration
: 508 | 231.944 206.449 0.00540654 0.000582999 165853 0
: 509 Minimum Test error found - save the configuration
: 509 | 229.166 203.996 0.00543423 0.000574389 164614 0
: 510 Minimum Test error found - save the configuration
: 510 | 226.684 201.377 0.00535942 0.00058913 167705 0
: 511 Minimum Test error found - save the configuration
: 511 | 223.927 199.851 0.0054007 0.000573379 165723 0
: 512 Minimum Test error found - save the configuration
: 512 | 221.581 197.088 0.00536535 0.000581049 167214 0
: 513 Minimum Test error found - save the configuration
: 513 | 219.073 195.406 0.00537132 0.00062098 168409 0
: 514 Minimum Test error found - save the configuration
: 514 | 216.985 193.074 0.00540492 0.000587011 166047 0
: 515 Minimum Test error found - save the configuration
: 515 | 214.401 190.4 0.00536241 0.000590709 167655 0
: 516 Minimum Test error found - save the configuration
: 516 | 212.026 189.076 0.00535603 0.000569839 167148 0
: 517 Minimum Test error found - save the configuration
: 517 | 209.794 186.062 0.00530774 0.000569749 168848 0
: 518 Minimum Test error found - save the configuration
: 518 | 207.246 183.946 0.00536002 0.00058267 167457 0
: 519 Minimum Test error found - save the configuration
: 519 | 205.068 182.074 0.00591019 0.00061784 151162 0
: 520 Minimum Test error found - save the configuration
: 520 | 202.921 180.251 0.00544318 0.000575079 164335 0
: 521 Minimum Test error found - save the configuration
: 521 | 200.473 177.642 0.00542751 0.00059202 165443 0
: 522 Minimum Test error found - save the configuration
: 522 | 198.343 176.056 0.00543589 0.00058541 164932 0
: 523 Minimum Test error found - save the configuration
: 523 | 196.232 174.328 0.0054418 0.000603679 165354 0
: 524 Minimum Test error found - save the configuration
: 524 | 193.999 171.578 0.00550714 0.000582079 162435 0
: 525 Minimum Test error found - save the configuration
: 525 | 192.153 169.661 0.00541925 0.00057993 165313 0
: 526 Minimum Test error found - save the configuration
: 526 | 189.634 167.075 0.00542874 0.00059233 165412 0
: 527 Minimum Test error found - save the configuration
: 527 | 187.732 165.14 0.00550081 0.00060033 163249 0
: 528 Minimum Test error found - save the configuration
: 528 | 185.456 163.642 0.00543436 0.000594301 165287 0
: 529 Minimum Test error found - save the configuration
: 529 | 183.44 161.782 0.00547807 0.000617749 164598 0
: 530 Minimum Test error found - save the configuration
: 530 | 181.197 159.045 0.0055443 0.000611091 162166 0
: 531 Minimum Test error found - save the configuration
: 531 | 179.217 157.391 0.00551107 0.00057732 162149 0
: 532 Minimum Test error found - save the configuration
: 532 | 177.021 156.656 0.00545879 0.000589481 164294 0
: 533 Minimum Test error found - save the configuration
: 533 | 175.093 153.796 0.00541369 0.000573389 165279 0
: 534 Minimum Test error found - save the configuration
: 534 | 173.071 152.239 0.00553608 0.000599039 162040 0
: 535 Minimum Test error found - save the configuration
: 535 | 171.006 150.886 0.00543524 0.000576719 164659 0
: 536 Minimum Test error found - save the configuration
: 536 | 169.231 148.649 0.00544321 0.000590709 164863 0
: 537 Minimum Test error found - save the configuration
: 537 | 167.244 146.925 0.00542365 0.00057356 164945 0
: 538 Minimum Test error found - save the configuration
: 538 | 165.453 146.659 0.00555816 0.00061647 161888 0
: 539 Minimum Test error found - save the configuration
: 539 | 163.582 143.741 0.00542634 0.000575719 164927 0
: 540 Minimum Test error found - save the configuration
: 540 | 161.689 141.668 0.00552248 0.00059953 162504 0
: 541 Minimum Test error found - save the configuration
: 541 | 159.525 139.64 0.00562528 0.000758762 164389 0
: 542 Minimum Test error found - save the configuration
: 542 | 157.803 138.474 0.00631302 0.0006034 140114 0
: 543 Minimum Test error found - save the configuration
: 543 | 156.069 137.587 0.00630008 0.000943256 149342 0
: 544 Minimum Test error found - save the configuration
: 544 | 154.454 136.233 0.00675271 0.00060443 130118 0
: 545 Minimum Test error found - save the configuration
: 545 | 152.653 133.606 0.00551816 0.000601789 162722 0
: 546 Minimum Test error found - save the configuration
: 546 | 150.463 131.913 0.00548764 0.000594369 163490 0
: 547 Minimum Test error found - save the configuration
: 547 | 148.701 130.425 0.00547783 0.000576179 163210 0
: 548 Minimum Test error found - save the configuration
: 548 | 147.224 128.899 0.00544685 0.000592169 164789 0
: 549 Minimum Test error found - save the configuration
: 549 | 145.393 127.988 0.00545144 0.000587359 164471 0
: 550 Minimum Test error found - save the configuration
: 550 | 143.828 127.037 0.00541982 0.00059369 165764 0
: 551 Minimum Test error found - save the configuration
: 551 | 142.126 124.668 0.00564197 0.000642271 160010 0
: 552 Minimum Test error found - save the configuration
: 552 | 140.554 123.083 0.00716868 0.000913265 127889 0
: 553 Minimum Test error found - save the configuration
: 553 | 138.658 122.091 0.0083899 0.000915164 107027 0
: 554 Minimum Test error found - save the configuration
: 554 | 137.268 120.602 0.00835013 0.000909735 107521 0
: 555 Minimum Test error found - save the configuration
: 555 | 135.709 118.409 0.0071129 0.00058246 122503 0
: 556 Minimum Test error found - save the configuration
: 556 | 133.807 117.644 0.00546961 0.000590989 163981 0
: 557 Minimum Test error found - save the configuration
: 557 | 132.395 115.741 0.00553444 0.000580729 161495 0
: 558 Minimum Test error found - save the configuration
: 558 | 130.592 114.614 0.00560025 0.00060912 160284 0
: 559 Minimum Test error found - save the configuration
: 559 | 129.135 113.165 0.00552602 0.000577229 161656 0
: 560 Minimum Test error found - save the configuration
: 560 | 127.529 111.595 0.00540894 0.000590701 166036 0
: 561 Minimum Test error found - save the configuration
: 561 | 125.932 111.398 0.0053941 0.000573699 165961 0
: 562 Minimum Test error found - save the configuration
: 562 | 124.642 109.118 0.00545128 0.000579899 164225 0
: 563 Minimum Test error found - save the configuration
: 563 | 123.143 107.151 0.0055845 0.000778002 166441 0
: 564 Minimum Test error found - save the configuration
: 564 | 121.542 105.556 0.00838895 0.000929255 107243 0
: 565 Minimum Test error found - save the configuration
: 565 | 120.091 104.891 0.00849441 0.000915576 105557 0
: 566 Minimum Test error found - save the configuration
: 566 | 118.709 103.534 0.0072015 0.000580141 120821 0
: 567 Minimum Test error found - save the configuration
: 567 | 117.346 102.165 0.0054965 0.00059755 163300 0
: 568 Minimum Test error found - save the configuration
: 568 | 115.853 101.605 0.00547583 0.000600541 164093 0
: 569 Minimum Test error found - save the configuration
: 569 | 114.465 100.587 0.00547567 0.0005892 163717 0
: 570 Minimum Test error found - save the configuration
: 570 | 113.163 98.3641 0.00563138 0.00059954 158988 0
: 571 Minimum Test error found - save the configuration
: 571 | 111.848 97.3998 0.00552498 0.00060762 162689 0
: 572 Minimum Test error found - save the configuration
: 572 | 110.751 95.8354 0.00543348 0.00058334 164944 0
: 573 Minimum Test error found - save the configuration
: 573 | 109.373 94.8773 0.00542852 0.000591309 165385 0
: 574 Minimum Test error found - save the configuration
: 574 | 107.848 93.3995 0.00545298 0.00058094 164202 0
: 575 Minimum Test error found - save the configuration
: 575 | 106.655 92.0804 0.00543438 0.00058584 164998 0
: 576 Minimum Test error found - save the configuration
: 576 | 105.359 92.0421 0.00542483 0.000575289 164964 0
: 577 Minimum Test error found - save the configuration
: 577 | 104.022 90.9205 0.00543804 0.00059004 165017 0
: 578 Minimum Test error found - save the configuration
: 578 | 103.036 89.8326 0.00543313 0.000573989 164638 0
: 579 Minimum Test error found - save the configuration
: 579 | 102.02 88.2726 0.00542995 0.000588179 165229 0
: 580 Minimum Test error found - save the configuration
: 580 | 100.433 87.238 0.00542736 0.00058235 165118 0
: 581 Minimum Test error found - save the configuration
: 581 | 99.043 85.9933 0.00540201 0.000581969 165974 0
: 582 Minimum Test error found - save the configuration
: 582 | 97.9859 84.8174 0.00552354 0.000587799 162083 0
: 583 Minimum Test error found - save the configuration
: 583 | 96.8135 84.5524 0.00541885 0.000574631 165145 0
: 584 Minimum Test error found - save the configuration
: 584 | 95.9763 82.5883 0.00544217 0.000584751 164697 0
: 585 Minimum Test error found - save the configuration
: 585 | 94.4551 82.5248 0.00543902 0.000574349 164451 0
: 586 Minimum Test error found - save the configuration
: 586 | 93.3473 81.3018 0.00546032 0.000593479 164378 0
: 587 Minimum Test error found - save the configuration
: 587 | 92.4056 79.5536 0.00541735 0.000573669 165164 0
: 588 Minimum Test error found - save the configuration
: 588 | 91.341 78.7112 0.00544193 0.00059124 164925 0
: 589 Minimum Test error found - save the configuration
: 589 | 90.1287 77.8595 0.00544619 0.00059233 164817 0
: 590 Minimum Test error found - save the configuration
: 590 | 89.1221 77.2662 0.00566429 0.00064737 159460 0
: 591 Minimum Test error found - save the configuration
: 591 | 88.1813 75.1992 0.00576796 0.00062701 155613 0
: 592 Minimum Test error found - save the configuration
: 592 | 86.9371 74.2819 0.00585382 0.000643041 153528 0
: 593 Minimum Test error found - save the configuration
: 593 | 85.8636 74.14 0.00584758 0.000585689 152036 0
: 594 Minimum Test error found - save the configuration
: 594 | 85.0046 72.9978 0.00571372 0.0006007 156463 0
: 595 Minimum Test error found - save the configuration
: 595 | 84.0485 71.8734 0.00548974 0.00060547 163791 0
: 596 Minimum Test error found - save the configuration
: 596 | 83.0079 70.733 0.0054495 0.00059228 164703 0
: 597 Minimum Test error found - save the configuration
: 597 | 81.8461 70.272 0.0054444 0.00057862 164414 0
: 598 Minimum Test error found - save the configuration
: 598 | 80.9084 69.4983 0.00544825 0.000592321 164747 0
: 599 Minimum Test error found - save the configuration
: 599 | 79.9449 68.3656 0.00544085 0.000575279 164421 0
: 600 Minimum Test error found - save the configuration
: 600 | 79.075 67.6554 0.00544412 0.000593639 164932 0
: 601 Minimum Test error found - save the configuration
: 601 | 78.2227 67.0861 0.00547231 0.00059441 164005 0
: 602 Minimum Test error found - save the configuration
: 602 | 77.2249 66.1846 0.00566826 0.000660931 159766 0
: 603 Minimum Test error found - save the configuration
: 603 | 76.4578 65.1004 0.00601253 0.0006409 148931 0
: 604 Minimum Test error found - save the configuration
: 604 | 75.6241 64.416 0.00613897 0.00058659 144082 0
: 605 Minimum Test error found - save the configuration
: 605 | 74.6375 63.4613 0.00554977 0.00060584 161815 0
: 606 Minimum Test error found - save the configuration
: 606 | 73.6147 63.1737 0.00585292 0.000916305 162054 0
: 607 Minimum Test error found - save the configuration
: 607 | 72.7377 62.1541 0.00672908 0.00059352 130387 0
: 608 Minimum Test error found - save the configuration
: 608 | 71.8855 61.5726 0.005676 0.000602539 157683 0
: 609 Minimum Test error found - save the configuration
: 609 | 70.9461 59.8841 0.00553727 0.00060537 162209 0
: 610 Minimum Test error found - save the configuration
: 610 | 70.1269 59.0632 0.00551375 0.00058897 162444 0
: 611 Minimum Test error found - save the configuration
: 611 | 69.3986 58.9341 0.00550039 0.000593569 163038 0
: 612 Minimum Test error found - save the configuration
: 612 | 68.4463 57.8426 0.00546535 0.00058013 163759 0
: 613 Minimum Test error found - save the configuration
: 613 | 67.6341 57.5457 0.00546919 0.00059784 164226 0
: 614 Minimum Test error found - save the configuration
: 614 | 66.8446 56.4771 0.00545109 0.00058203 164303 0
: 615 Minimum Test error found - save the configuration
: 615 | 66.0899 55.8805 0.00548035 0.000593179 163694 0
: 616 Minimum Test error found - save the configuration
: 616 | 65.3301 54.7635 0.00541779 0.00058664 165592 0
: 617 Minimum Test error found - save the configuration
: 617 | 64.5144 54.4614 0.00541669 0.00057325 165172 0
: 618 Minimum Test error found - save the configuration
: 618 | 63.9624 53.418 0.00546249 0.000592191 164261 0
: 619 Minimum Test error found - save the configuration
: 619 | 62.9437 52.5261 0.00543247 0.000576139 164734 0
: 620 Minimum Test error found - save the configuration
: 620 | 62.1363 52.1295 0.00543392 0.000591439 165205 0
: 621 Minimum Test error found - save the configuration
: 621 | 61.4262 50.9876 0.00559965 0.00059904 159980 0
: 622 Minimum Test error found - save the configuration
: 622 | 60.89 50.3155 0.00543082 0.00059034 165273 0
: 623 Minimum Test error found - save the configuration
: 623 | 60.0618 50.1834 0.00565668 0.000671262 160468 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.2031 49.5104 0.00545056 0.000593571 164711 0
: 625 Minimum Test error found - save the configuration
: 625 | 58.4766 48.6303 0.00544919 0.00057711 164201 0
: 626 Minimum Test error found - save the configuration
: 626 | 57.8132 47.8596 0.0054557 0.00059726 164662 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.0332 46.9609 0.00541591 0.000573779 165217 0
: 628 Minimum Test error found - save the configuration
: 628 | 56.2798 46.4263 0.00543779 0.000593489 165143 0
: 629 | 55.7215 46.6278 0.00541557 0.000534589 163902 1
: 630 Minimum Test error found - save the configuration
: 630 | 55.2446 46.1608 0.00544353 0.00059256 164916 0
: 631 Minimum Test error found - save the configuration
: 631 | 54.7248 45.0789 0.00545938 0.00058762 164212 0
: 632 Minimum Test error found - save the configuration
: 632 | 53.9389 44.0959 0.00545078 0.00061153 165315 0
: 633 Minimum Test error found - save the configuration
: 633 | 53.1723 43.7331 0.0055041 0.000589579 162783 0
: 634 Minimum Test error found - save the configuration
: 634 | 52.5457 42.805 0.00545448 0.000585009 164289 0
: 635 Minimum Test error found - save the configuration
: 635 | 51.7566 42.1384 0.00548429 0.00059416 163595 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.1237 41.6914 0.00545194 0.00058542 164389 0
: 637 Minimum Test error found - save the configuration
: 637 | 50.648 41.0897 0.00547126 0.00058929 163868 0
: 638 Minimum Test error found - save the configuration
: 638 | 49.8985 40.6279 0.00542382 0.000574969 164988 0
: 639 Minimum Test error found - save the configuration
: 639 | 49.3071 39.8345 0.00545 0.00059271 164701 0
: 640 Minimum Test error found - save the configuration
: 640 | 48.7203 39.3848 0.00542723 0.00057476 164865 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.053 39.0179 0.00543797 0.000590069 165020 0
: 642 Minimum Test error found - save the configuration
: 642 | 47.4471 38.2088 0.00542844 0.000578499 164950 0
: 643 Minimum Test error found - save the configuration
: 643 | 47.2781 38.104 0.00552387 0.00060166 162529 0
: 644 Minimum Test error found - save the configuration
: 644 | 46.4933 37.0883 0.0054346 0.00058305 164896 0
: 645 Minimum Test error found - save the configuration
: 645 | 45.9785 36.8934 0.00561789 0.00061454 159893 0
: 646 | 45.4074 37.0613 0.00547153 0.000535719 162081 1
: 647 Minimum Test error found - save the configuration
: 647 | 44.8485 35.3249 0.00550913 0.000594089 162766 0
: 648 | 44.6593 35.3717 0.00541267 0.000535819 164040 1
: 649 Minimum Test error found - save the configuration
: 649 | 43.6801 34.7043 0.00544415 0.00059094 164839 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.0797 33.9114 0.00547054 0.000583599 163702 0
: 651 Minimum Test error found - save the configuration
: 651 | 42.5416 33.4866 0.00545242 0.000582949 164289 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.1206 33.1536 0.0054875 0.00062619 164565 0
: 653 Minimum Test error found - save the configuration
: 653 | 41.6257 32.673 0.00554114 0.000599469 161889 0
: 654 Minimum Test error found - save the configuration
: 654 | 41.1281 31.8708 0.00553221 0.000605579 162383 0
: 655 Minimum Test error found - save the configuration
: 655 | 40.6057 31.776 0.00554658 0.00060417 161864 0
: 656 Minimum Test error found - save the configuration
: 656 | 40.0234 31.6518 0.00548145 0.000577689 163140 0
: 657 Minimum Test error found - save the configuration
: 657 | 39.6688 30.9445 0.00548643 0.0005998 163712 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.1277 30.8522 0.00554394 0.000581499 161211 0
: 659 Minimum Test error found - save the configuration
: 659 | 38.584 30.2666 0.00548538 0.00059448 163569 0
: 660 Minimum Test error found - save the configuration
: 660 | 38.0811 29.6572 0.00551496 0.000578169 162049 0
: 661 | 37.677 29.8185 0.00543962 0.000573779 164412 1
: 662 Minimum Test error found - save the configuration
: 662 | 37.2435 28.4573 0.00546276 0.00057811 163778 0
: 663 Minimum Test error found - save the configuration
: 663 | 36.6669 28.0626 0.00545917 0.0005958 164495 0
: 664 Minimum Test error found - save the configuration
: 664 | 36.2418 27.7218 0.00545823 0.00058458 164148 0
: 665 Minimum Test error found - save the configuration
: 665 | 35.8655 27.0464 0.00548333 0.000597769 163748 0
: 666 Minimum Test error found - save the configuration
: 666 | 35.3362 26.7699 0.00545314 0.000583589 164286 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.0673 26.3893 0.00543412 0.000581079 164845 0
: 668 Minimum Test error found - save the configuration
: 668 | 34.5412 25.9031 0.00545886 0.00058934 164287 0
: 669 Minimum Test error found - save the configuration
: 669 | 34.073 25.4937 0.00542623 0.000574079 164875 0
: 670 | 33.7366 25.7894 0.00540072 0.000550759 164950 1
: 671 Minimum Test error found - save the configuration
: 671 | 33.44 24.8685 0.00550802 0.0005985 162949 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.0757 24.5327 0.00549591 0.000589269 163044 0
: 673 | 32.7198 24.8099 0.00540273 0.000538569 164468 1
: 674 Minimum Test error found - save the configuration
: 674 | 32.2201 23.5188 0.00543945 0.0005889 164930 0
: 675 | 31.836 23.5953 0.00538383 0.000542149 165232 1
: 676 Minimum Test error found - save the configuration
: 676 | 31.5629 22.7567 0.00542341 0.000583849 165304 0
: 677 Minimum Test error found - save the configuration
: 677 | 30.9477 22.4082 0.00554981 0.00059254 161379 0
: 678 Minimum Test error found - save the configuration
: 678 | 30.5466 22.3389 0.0054322 0.000582329 164953 0
: 679 Minimum Test error found - save the configuration
: 679 | 30.0642 22.0478 0.00545574 0.000594271 164559 0
: 680 Minimum Test error found - save the configuration
: 680 | 29.7479 21.6925 0.00545804 0.000581371 164046 0
: 681 Minimum Test error found - save the configuration
: 681 | 29.2519 21.0043 0.00556625 0.00061336 161522 0
: 682 | 29.1193 21.3165 0.00541228 0.00053533 164037 1
: 683 Minimum Test error found - save the configuration
: 683 | 28.688 20.3722 0.00545036 0.00059063 164618 0
: 684 | 28.1935 21.3905 0.00552414 0.00053496 160347 1
: 685 | 28.2125 20.8855 0.00542761 0.000551549 164067 2
: 686 Minimum Test error found - save the configuration
: 686 | 27.5762 19.5079 0.00543769 0.00057509 164521 0
: 687 Minimum Test error found - save the configuration
: 687 | 27.1403 19.4215 0.00545557 0.00059291 164519 0
: 688 Minimum Test error found - save the configuration
: 688 | 26.9057 19.036 0.00544497 0.00057836 164386 0
: 689 | 26.6096 19.4498 0.00540716 0.000549719 164696 1
: 690 Minimum Test error found - save the configuration
: 690 | 26.1381 18.8029 0.00543393 0.0005821 164886 0
: 691 Minimum Test error found - save the configuration
: 691 | 25.9072 18.5778 0.00551023 0.00060048 162941 0
: 692 Minimum Test error found - save the configuration
: 692 | 25.5943 17.6898 0.00545983 0.00058321 164048 0
: 693 | 25.062 18.0447 0.0054096 0.000546949 164519 1
: 694 Minimum Test error found - save the configuration
: 694 | 24.7712 17.5168 0.00545105 0.00059203 164642 0
: 695 Minimum Test error found - save the configuration
: 695 | 24.4072 17.5071 0.00551299 0.00058982 162497 0
: 696 Minimum Test error found - save the configuration
: 696 | 24.115 17.1059 0.00555561 0.000591269 161149 0
: 697 Minimum Test error found - save the configuration
: 697 | 23.8702 16.4973 0.00543277 0.00058268 164945 0
: 698 | 23.4994 17.4391 0.00541085 0.000551759 164640 1
: 699 Minimum Test error found - save the configuration
: 699 | 23.2053 16.2232 0.005492 0.000580399 162880 0
: 700 | 23.0271 17.0924 0.00540755 0.000550289 164702 1
: 701 Minimum Test error found - save the configuration
: 701 | 22.8471 16.1726 0.00543776 0.00057525 164524 0
: 702 | 22.2957 16.2389 0.00541817 0.000552079 164403 1
: 703 Minimum Test error found - save the configuration
: 703 | 21.9659 15.6328 0.00544333 0.000587559 164752 0
: 704 Minimum Test error found - save the configuration
: 704 | 21.7349 15.0785 0.00548692 0.00059332 163479 0
: 705 | 21.4507 16.2397 0.00541877 0.000547469 164227 1
: 706 | 21.2421 15.3907 0.00540031 0.000542468 164682 2
: 707 Minimum Test error found - save the configuration
: 707 | 20.7892 14.6289 0.00545759 0.000604701 164850 0
: 708 Minimum Test error found - save the configuration
: 708 | 20.5754 14.5886 0.00544412 0.00057471 164291 0
: 709 Minimum Test error found - save the configuration
: 709 | 20.2525 14.3357 0.00552917 0.00059534 162146 0
: 710 Minimum Test error found - save the configuration
: 710 | 19.9763 13.9187 0.00542616 0.000576379 164956 0
: 711 Minimum Test error found - save the configuration
: 711 | 19.7088 13.6629 0.00547243 0.00060336 164302 0
: 712 | 19.4638 13.9729 0.00538756 0.000535359 164874 1
: 713 Minimum Test error found - save the configuration
: 713 | 19.2971 13.3893 0.00543313 0.000588369 165127 0
: 714 | 19.052 13.9306 0.00538752 0.000541988 165101 1
: 715 Minimum Test error found - save the configuration
: 715 | 18.7992 13.2847 0.00544023 0.00058615 164810 0
: 716 Minimum Test error found - save the configuration
: 716 | 18.4541 12.8304 0.00570484 0.00060441 156849 0
: 717 | 18.2745 13.6149 0.00541961 0.000553329 164397 1
: 718 Minimum Test error found - save the configuration
: 718 | 18.002 12.8188 0.0057031 0.000819022 163797 0
: 719 Minimum Test error found - save the configuration
: 719 | 17.6924 12.6383 0.00717302 0.00061457 121980 0
: 720 | 17.3757 12.723 0.00574411 0.000593619 155325 1
: 721 Minimum Test error found - save the configuration
: 721 | 17.306 12.3511 0.00560623 0.000610651 160142 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.1539 11.947 0.00542842 0.000574089 164801 0
: 723 | 17.0171 12.5447 0.00540235 0.000555489 165055 1
: 724 Minimum Test error found - save the configuration
: 724 | 16.4922 11.8498 0.00542605 0.000570539 164761 0
: 725 | 16.3076 11.9075 0.00541673 0.000554809 164544 1
: 726 | 16.0922 12.3785 0.00549646 0.000534199 161217 2
: 727 Minimum Test error found - save the configuration
: 727 | 15.8377 11.1321 0.00548554 0.000601209 163789 0
: 728 | 15.6626 11.63 0.00545339 0.000534858 162650 1
: 729 Minimum Test error found - save the configuration
: 729 | 15.6525 11.0454 0.00555744 0.000595469 161226 0
: 730 Minimum Test error found - save the configuration
: 730 | 15.3995 11.0134 0.00547327 0.000573739 163281 0
: 731 Minimum Test error found - save the configuration
: 731 | 15.107 10.429 0.00545983 0.00058993 164274 0
: 732 | 14.815 10.6746 0.0053902 0.000543709 165068 1
: 733 | 14.5775 11.1973 0.0055064 0.000550018 161408 2
: 734 Minimum Test error found - save the configuration
: 734 | 14.5024 10.3452 0.00779832 0.00066983 112226 0
: 735 | 14.4457 11.2498 0.00572243 0.000713742 159722 1
: 736 Minimum Test error found - save the configuration
: 736 | 14.1359 10.1774 0.0056929 0.00061239 157464 0
: 737 Minimum Test error found - save the configuration
: 737 | 13.8041 9.66307 0.00550511 0.000578129 162371 0
: 738 Minimum Test error found - save the configuration
: 738 | 13.7444 9.34466 0.00549719 0.000594449 163174 0
: 739 | 13.5297 9.55944 0.00600645 0.000854713 155288 1
: 740 Minimum Test error found - save the configuration
: 740 | 13.287 9.11115 0.0056288 0.00059017 158773 0
: 741 | 13.0981 9.29671 0.00552109 0.000551409 160976 1
: 742 | 12.9716 9.49606 0.00541153 0.00054371 164345 2
: 743 | 12.8335 9.32075 0.00539757 0.000551739 165090 3
: 744 | 12.66 9.34666 0.00541043 0.000558799 164893 4
: 745 Minimum Test error found - save the configuration
: 745 | 12.5188 8.73485 0.00548172 0.00063656 165113 0
: 746 | 12.2586 9.1316 0.00549616 0.000534709 161243 1
: 747 Minimum Test error found - save the configuration
: 747 | 12.1103 8.56398 0.00547601 0.00061474 164566 0
: 748 | 11.8098 8.86617 0.00544256 0.000557979 163781 1
: 749 Minimum Test error found - save the configuration
: 749 | 11.6915 8.38495 0.00548804 0.00059626 163540 0
: 750 | 11.5647 9.04515 0.00544226 0.000535609 163044 1
: 751 | 11.4341 8.51169 0.00541315 0.000550689 164526 2
: 752 | 11.3441 8.48789 0.00545282 0.000543468 162954 3
: 753 Minimum Test error found - save the configuration
: 753 | 11.1677 8.06939 0.0054683 0.00059848 164277 0
: 754 Minimum Test error found - save the configuration
: 754 | 11.0631 7.88223 0.0054294 0.00058886 165271 0
: 755 | 11.001 7.92992 0.00551735 0.000545838 160917 1
: 756 Minimum Test error found - save the configuration
: 756 | 10.6141 7.17038 0.0054927 0.000589319 163153 0
: 757 | 10.6686 8.31111 0.00538858 0.000534079 164796 1
: 758 | 10.7252 7.55471 0.00540665 0.000554259 164867 2
: 759 | 10.5396 7.29193 0.00548229 0.000550069 162199 3
: 760 | 10.2463 7.5648 0.00542758 0.000551159 164055 4
: 761 Minimum Test error found - save the configuration
: 761 | 10.1586 7.0503 0.00542621 0.00057404 164875 0
: 762 | 9.98367 7.59729 0.00546771 0.000552639 162765 1
: 763 | 9.79177 7.06416 0.00541623 0.000534589 163879 2
: 764 Minimum Test error found - save the configuration
: 764 | 9.65076 7.04035 0.00548527 0.000596109 163627 0
: 765 Minimum Test error found - save the configuration
: 765 | 9.6018 6.66606 0.00722387 0.000967826 127876 0
: 766 Minimum Test error found - save the configuration
: 766 | 9.4976 6.52653 0.00631335 0.0006001 140025 0
: 767 Minimum Test error found - save the configuration
: 767 | 9.27749 6.21594 0.00640978 0.000931896 146042 0
: 768 | 9.0573 6.55781 0.00567442 0.000536019 155690 1
: 769 | 8.96813 6.24983 0.00556054 0.000556329 159865 2
: 770 Minimum Test error found - save the configuration
: 770 | 8.93964 5.6152 0.00550018 0.00058401 162728 0
: 771 | 8.9935 6.15767 0.00542671 0.000566439 164600 1
: 772 Minimum Test error found - save the configuration
: 772 | 8.61868 5.42041 0.00543551 0.000575369 164604 0
: 773 | 8.48099 5.96411 0.00545029 0.000556559 163474 1
: 774 | 8.39621 5.91334 0.0056473 0.000546239 156830 2
: 775 | 8.29479 5.61431 0.00547119 0.000551759 162620 3
: 776 Minimum Test error found - save the configuration
: 776 | 8.21293 5.39906 0.00543881 0.00057654 164532 0
: 777 Minimum Test error found - save the configuration
: 777 | 8.27503 5.20903 0.00553036 0.00060039 162273 0
: 778 Minimum Test error found - save the configuration
: 778 | 8.02983 4.90737 0.00542752 0.000573529 164813 0
: 779 | 7.83154 5.11764 0.0055439 0.000550149 160200 1
: 780 | 7.81158 5.02698 0.00541719 0.000536678 163917 2
: 781 Minimum Test error found - save the configuration
: 781 | 7.84244 4.65862 0.0054526 0.000590979 164554 0
: 782 | 7.55087 5.28971 0.00548162 0.000580409 163225 1
: 783 | 7.59546 4.99979 0.00588275 0.000551509 150059 2
: 784 | 7.40049 5.28223 0.00809489 0.000606519 106832 3
: 785 | 7.31658 4.9403 0.00554298 0.000567399 160785 4
: 786 | 7.18844 5.09031 0.00552238 0.000534859 160400 5
: 787 | 7.20135 4.85942 0.00545473 0.000553929 163239 6
: 788 Minimum Test error found - save the configuration
: 788 | 6.96652 4.35219 0.00551961 0.00067332 165075 0
: 789 | 6.87867 5.00396 0.006107 0.000848104 152123 1
: 790 Minimum Test error found - save the configuration
: 790 | 6.92773 3.96124 0.00587516 0.00060197 151711 0
: 791 | 6.75193 4.44398 0.00726127 0.000868065 125133 1
: 792 Minimum Test error found - save the configuration
: 792 | 6.61373 3.65332 0.00581837 0.00059417 153133 0
: 793 | 6.59517 3.90839 0.00541591 0.000557239 164654 1
: 794 | 6.56341 4.40374 0.00539575 0.000535209 164591 2
: 795 | 6.54316 4.60141 0.00554821 0.000568169 160641 3
: 796 Minimum Test error found - save the configuration
: 796 | 6.40437 3.49919 0.00547747 0.000579969 163349 0
: 797 | 6.47842 3.82366 0.00544631 0.000553989 163522 1
: 798 | 6.46348 4.03818 0.00541404 0.000537798 164061 2
: 799 | 6.1606 3.69974 0.00574228 0.000793124 161644 3
: 800 | 6.03164 3.84278 0.00762 0.000865055 118432 4
: 801 | 6.02928 3.83324 0.00836707 0.000860515 106574 5
: 802 | 6.05933 3.84515 0.00839948 0.000860264 106112 6
: 803 | 5.72632 3.96032 0.00631482 0.000561179 139042 7
: 804 | 5.85293 3.62607 0.00543354 0.000537518 163398 8
: 805 Minimum Test error found - save the configuration
: 805 | 5.74535 3.25354 0.00557664 0.000603579 160867 0
: 806 | 5.70219 4.23616 0.00543166 0.000542489 163627 1
: 807 | 5.50883 3.36315 0.00549306 0.00060377 163623 2
: 808 | 5.67538 3.81899 0.00556409 0.000559619 159857 3
: 809 | 5.42669 3.78104 0.00551164 0.000565679 161748 4
: 810 | 5.36809 3.65035 0.00550176 0.000536798 161129 5
: 811 | 5.39965 3.94333 0.00548519 0.000551819 162161 6
: 812 | 5.27103 3.39042 0.00571847 0.000765863 161531 7
: 813 | 5.24259 3.34199 0.00843148 0.000864785 105727 8
: 814 Minimum Test error found - save the configuration
: 814 | 5.20129 2.82149 0.00850219 0.000927215 105611 0
: 815 | 5.19177 3.53947 0.00717332 0.000561649 120998 1
: 816 | 5.24266 3.50421 0.00544788 0.000534468 162820 2
: 817 | 5.28478 4.46837 0.0073943 0.000914935 123469 3
: 818 | 4.91323 3.05464 0.0059619 0.00057485 148504 4
: 819 | 4.84381 3.1018 0.00548035 0.000537419 161847 5
: 820 | 4.93575 3.03366 0.0054733 0.000561639 162878 6
: 821 | 4.71033 3.4152 0.0054604 0.000541449 162636 7
: 822 | 4.57566 3.08357 0.00546439 0.000557449 163034 8
: 823 Minimum Test error found - save the configuration
: 823 | 4.64163 2.64144 0.00547199 0.000588279 163810 0
: 824 | 4.53321 2.74857 0.00545144 0.000545658 163073 1
: 825 | 4.65763 3.48509 0.00543713 0.00055653 163914 2
: 826 | 4.40555 3.20054 0.00545323 0.000547709 163082 3
: 827 | 4.30458 2.67233 0.0054309 0.000554209 164046 4
: 828 | 4.34403 3.02356 0.00549945 0.000565689 162148 5
: 829 | 4.21993 3.41575 0.00544994 0.000553939 163399 6
: 830 | 4.22686 3.23632 0.00541651 0.000537468 163967 7
: 831 | 4.0467 2.91539 0.00546334 0.000560829 163182 8
: 832 | 4.09527 2.84815 0.00546871 0.000541719 162371 9
: 833 | 4.04827 2.6891 0.00545207 0.000552569 163282 10
: 834 | 4.05995 3.86019 0.00542808 0.000538189 163603 11
: 835 | 4.03449 2.8475 0.00561807 0.000552639 157933 12
: 836 | 4.04584 2.91027 0.00543942 0.000537409 163198 13
: 837 | 4.00787 3.24667 0.0054341 0.000552599 163884 14
: 838 | 3.8255 3.19915 0.00562554 0.000593209 158972 15
: 839 | 3.82252 3.05787 0.00556866 0.000564749 159875 16
: 840 | 3.69181 3.20183 0.00548356 0.000536389 161709 17
: 841 Minimum Test error found - save the configuration
: 841 | 3.75631 2.48438 0.00552387 0.00059535 162321 0
: 842 | 3.63713 2.82598 0.00580312 0.000875965 162366 1
: 843 | 3.67963 2.81879 0.00554218 0.000540279 159939 2
: 844 | 3.59636 2.8518 0.00552461 0.000564059 161272 3
: 845 | 3.45614 2.89147 0.00546728 0.000538069 162298 4
: 846 | 3.51879 3.36728 0.00576365 0.000654682 156588 5
: 847 | 3.4847 2.95125 0.00635393 0.00054564 137734 6
: 848 | 3.55808 3.24219 0.00564246 0.000560809 157429 7
: 849 | 3.50626 3.44176 0.00544349 0.000550879 163512 8
: 850 | 3.33388 2.79798 0.00538723 0.00054202 165112 9
: 851 | 3.44603 3.0949 0.00541833 0.000533518 163773 10
: 852 | 3.3242 3.26964 0.00543326 0.000551608 163879 11
: 853 | 3.38565 3.63001 0.00544237 0.000547909 163450 12
: 854 | 3.53592 3.41567 0.00547403 0.000553069 162570 13
: 855 | 3.38421 3.06626 0.00544225 0.000538039 163125 14
: 856 | 3.26364 3.36522 0.00545436 0.000554989 163286 15
: 857 | 3.21363 3.3667 0.0054273 0.000535839 163550 16
: 858 | 3.14817 3.1263 0.00547621 0.000551779 162455 17
: 859 | 3.02713 3.6793 0.00555166 0.000708612 165185 18
: 860 | 3.0293 4.2055 0.00544738 0.000558539 163638 19
: 861 | 3.02271 2.77042 0.00542862 0.000538548 163597 20
: 862 | 3.16115 3.20499 0.00543687 0.000552099 163774 21
:
: Elapsed time for training with 1000 events: 4.78 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00941 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.927 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.172 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.26366e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.04099e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0424 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0438 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00158 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0749 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.989 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0237 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00287 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0455 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00533 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00198 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000395 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.076 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00863 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 1.01 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.11 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.740 -0.0515 5.22 1.59 | 3.230 3.222
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.117 0.0263 1.82 1.08 | 3.358 3.348
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.