Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.297 sec
: Elapsed time for training with 1000 events: 0.301 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00258 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000857 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00426 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000323 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000361 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012194 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011292 1.0330 [ -4.3453 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31535.8
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33043.1 31089.9 0.00407965 0.00052168 224848 0
: 2 Minimum Test error found - save the configuration
: 2 | 32478.2 30453.9 0.00441924 0.000472661 202707 0
: 3 Minimum Test error found - save the configuration
: 3 | 31690.1 29741.9 0.00432383 0.000510052 209766 0
: 4 Minimum Test error found - save the configuration
: 4 | 30910.6 29096.4 0.0045454 0.0004817 196865 0
: 5 Minimum Test error found - save the configuration
: 5 | 30174.1 28382.5 0.00430827 0.00048311 209142 0
: 6 Minimum Test error found - save the configuration
: 6 | 29356.4 27459.9 0.00426414 0.000470131 210859 0
: 7 Minimum Test error found - save the configuration
: 7 | 28573.1 26745.9 0.00431148 0.000499022 209838 0
: 8 Minimum Test error found - save the configuration
: 8 | 28076.2 26346.7 0.00408321 0.00044607 219953 0
: 9 Minimum Test error found - save the configuration
: 9 | 27710 26027.1 0.00425187 0.00044071 209910 0
: 10 Minimum Test error found - save the configuration
: 10 | 27397 25724 0.00407011 0.00045914 221547 0
: 11 Minimum Test error found - save the configuration
: 11 | 27089.9 25445.8 0.00450949 0.000465152 197807 0
: 12 Minimum Test error found - save the configuration
: 12 | 26806.4 25175.2 0.00415261 0.0004472 215901 0
: 13 Minimum Test error found - save the configuration
: 13 | 26528.9 24916.2 0.00415766 0.00044073 215232 0
: 14 Minimum Test error found - save the configuration
: 14 | 26264 24662.2 0.00416156 0.000449141 215493 0
: 15 Minimum Test error found - save the configuration
: 15 | 25999.2 24420.9 0.00426319 0.00045756 210215 0
: 16 Minimum Test error found - save the configuration
: 16 | 25748.7 24180 0.00406775 0.000449292 221089 0
: 17 Minimum Test error found - save the configuration
: 17 | 25501.2 23942.9 0.00414105 0.000483531 218728 0
: 18 Minimum Test error found - save the configuration
: 18 | 25253 23716.7 0.00517992 0.000470971 169889 0
: 19 Minimum Test error found - save the configuration
: 19 | 25016.6 23489.8 0.00428296 0.00044732 208570 0
: 20 Minimum Test error found - save the configuration
: 20 | 24782.3 23265.3 0.00405084 0.00045349 222386 0
: 21 Minimum Test error found - save the configuration
: 21 | 24551.4 23044.1 0.00409033 0.000444721 219442 0
: 22 Minimum Test error found - save the configuration
: 22 | 24322 22828.7 0.00500189 0.000626662 182848 0
: 23 Minimum Test error found - save the configuration
: 23 | 24097.9 22616.1 0.00411255 0.0004524 218570 0
: 24 Minimum Test error found - save the configuration
: 24 | 23878.2 22404.6 0.00426298 0.000466561 210725 0
: 25 Minimum Test error found - save the configuration
: 25 | 23658.5 22198.5 0.00467111 0.000684101 200652 0
: 26 Minimum Test error found - save the configuration
: 26 | 23442.2 21996.8 0.00484792 0.00046809 182656 0
: 27 Minimum Test error found - save the configuration
: 27 | 23230.1 21796.8 0.00408997 0.000451681 219884 0
: 28 Minimum Test error found - save the configuration
: 28 | 23022.4 21596.2 0.00415394 0.000471721 217260 0
: 29 Minimum Test error found - save the configuration
: 29 | 22812 21402.6 0.00472322 0.00055561 191957 0
: 30 Minimum Test error found - save the configuration
: 30 | 22608.8 21208.5 0.00442982 0.000479121 202496 0
: 31 Minimum Test error found - save the configuration
: 31 | 22407.3 21015.3 0.00424027 0.000460711 211665 0
: 32 Minimum Test error found - save the configuration
: 32 | 22205.8 20826.3 0.00415151 0.00045213 216253 0
: 33 Minimum Test error found - save the configuration
: 33 | 22008.4 20638.8 0.00416276 0.000455171 215774 0
: 34 Minimum Test error found - save the configuration
: 34 | 21812.6 20453.3 0.004228 0.00048143 213529 0
: 35 Minimum Test error found - save the configuration
: 35 | 21618.6 20270.5 0.00415982 0.000448102 215534 0
: 36 Minimum Test error found - save the configuration
: 36 | 21426.7 20090 0.00416838 0.000456341 215515 0
: 37 Minimum Test error found - save the configuration
: 37 | 21235.6 19913.4 0.0040628 0.000437101 220647 0
: 38 Minimum Test error found - save the configuration
: 38 | 21050.7 19733.8 0.00418285 0.00045292 214481 0
: 39 Minimum Test error found - save the configuration
: 39 | 20863.5 19556.5 0.00404367 0.000444091 222248 0
: 40 Minimum Test error found - save the configuration
: 40 | 20676.4 19380.6 0.00413889 0.00049515 219555 0
: 41 Minimum Test error found - save the configuration
: 41 | 20490.7 19207.4 0.0042744 0.00046781 210162 0
: 42 Minimum Test error found - save the configuration
: 42 | 20310.3 19035.6 0.00416731 0.000456972 215614 0
: 43 Minimum Test error found - save the configuration
: 43 | 20129.4 18865.9 0.00447705 0.000479951 200145 0
: 44 Minimum Test error found - save the configuration
: 44 | 19952.1 18700.5 0.00417662 0.000481461 216500 0
: 45 Minimum Test error found - save the configuration
: 45 | 19777.3 18532.2 0.00425099 0.000516401 214214 0
: 46 Minimum Test error found - save the configuration
: 46 | 19601.5 18369.3 0.00412232 0.000452231 217978 0
: 47 Minimum Test error found - save the configuration
: 47 | 19430.3 18203.7 0.00412181 0.000445702 217622 0
: 48 Minimum Test error found - save the configuration
: 48 | 19258.4 18043.7 0.00464051 0.000709371 203503 0
: 49 Minimum Test error found - save the configuration
: 49 | 19089.9 17879.8 0.00444989 0.000479211 201477 0
: 50 Minimum Test error found - save the configuration
: 50 | 18915.5 17730.1 0.00433452 0.00047024 207024 0
: 51 Minimum Test error found - save the configuration
: 51 | 18755.9 17569.5 0.00421165 0.00045815 213135 0
: 52 Minimum Test error found - save the configuration
: 52 | 18589.5 17409.6 0.00431399 0.000532231 211542 0
: 53 Minimum Test error found - save the configuration
: 53 | 18423 17254.2 0.0041798 0.000455342 214796 0
: 54 Minimum Test error found - save the configuration
: 54 | 18259.4 17103.4 0.00414656 0.000457981 216886 0
: 55 Minimum Test error found - save the configuration
: 55 | 18101.3 16949.1 0.00420878 0.00047406 214206 0
: 56 Minimum Test error found - save the configuration
: 56 | 17939.1 16794.2 0.0042406 0.000465821 211933 0
: 57 Minimum Test error found - save the configuration
: 57 | 17780.7 16644.7 0.00443067 0.000523081 204730 0
: 58 Minimum Test error found - save the configuration
: 58 | 17622.1 16493.2 0.00447415 0.000515681 202098 0
: 59 Minimum Test error found - save the configuration
: 59 | 17464.9 16343.2 0.00449641 0.000487981 199580 0
: 60 Minimum Test error found - save the configuration
: 60 | 17308.8 16194.8 0.00451374 0.000481791 198415 0
: 61 Minimum Test error found - save the configuration
: 61 | 17154 16049.6 0.00450018 0.00053087 201547 0
: 62 Minimum Test error found - save the configuration
: 62 | 17001.2 15902 0.00442472 0.000502851 203984 0
: 63 Minimum Test error found - save the configuration
: 63 | 16851.6 15754.1 0.00455204 0.00053559 199181 0
: 64 Minimum Test error found - save the configuration
: 64 | 16696.8 15613.5 0.00461555 0.000513152 195008 0
: 65 Minimum Test error found - save the configuration
: 65 | 16548.5 15470.8 0.00443567 0.000503371 203443 0
: 66 Minimum Test error found - save the configuration
: 66 | 16399.3 15332 0.00451905 0.00048413 198269 0
: 67 Minimum Test error found - save the configuration
: 67 | 16251.3 15195.6 0.00454718 0.000527432 199018 0
: 68 Minimum Test error found - save the configuration
: 68 | 16108.9 15054.5 0.00450288 0.000518661 200792 0
: 69 Minimum Test error found - save the configuration
: 69 | 15961.5 14918.3 0.00449709 0.000481771 199237 0
: 70 Minimum Test error found - save the configuration
: 70 | 15819 14781.6 0.00458048 0.000479001 195052 0
: 71 Minimum Test error found - save the configuration
: 71 | 15676.1 14647.1 0.00454462 0.00049085 197347 0
: 72 Minimum Test error found - save the configuration
: 72 | 15534.7 14515.5 0.00453207 0.000530501 199922 0
: 73 Minimum Test error found - save the configuration
: 73 | 15398.3 14380.8 0.00458552 0.000531111 197316 0
: 74 Minimum Test error found - save the configuration
: 74 | 15258 14248.8 0.00454155 0.000485071 197215 0
: 75 Minimum Test error found - save the configuration
: 75 | 15118.9 14121.6 0.00458692 0.000496831 195595 0
: 76 Minimum Test error found - save the configuration
: 76 | 14984.9 13992.7 0.00456104 0.000479192 195990 0
: 77 Minimum Test error found - save the configuration
: 77 | 14849.7 13865.8 0.00454645 0.000516991 198538 0
: 78 Minimum Test error found - save the configuration
: 78 | 14715.4 13741.4 0.00450542 0.000530622 201268 0
: 79 Minimum Test error found - save the configuration
: 79 | 14585.3 13615.4 0.00451265 0.00049488 199116 0
: 80 Minimum Test error found - save the configuration
: 80 | 14452.8 13492.2 0.00448984 0.000489532 199985 0
: 81 Minimum Test error found - save the configuration
: 81 | 14322.8 13370.6 0.00462149 0.000546931 196340 0
: 82 Minimum Test error found - save the configuration
: 82 | 14196.2 13247.6 0.00455427 0.000531252 198856 0
: 83 Minimum Test error found - save the configuration
: 83 | 14066.2 13128.1 0.00453682 0.000484891 197437 0
: 84 Minimum Test error found - save the configuration
: 84 | 13941.4 13007.6 0.00452005 0.00050807 199403 0
: 85 Minimum Test error found - save the configuration
: 85 | 13814.6 12890.3 0.00453855 0.000484381 197328 0
: 86 Minimum Test error found - save the configuration
: 86 | 13690.2 12774.8 0.00462037 0.00048214 193319 0
: 87 Minimum Test error found - save the configuration
: 87 | 13569.3 12656.9 0.00469086 0.000584872 194837 0
: 88 Minimum Test error found - save the configuration
: 88 | 13445.9 12541.9 0.00473807 0.000523382 189812 0
: 89 Minimum Test error found - save the configuration
: 89 | 13324.7 12428.6 0.00460303 0.000518191 195846 0
: 90 Minimum Test error found - save the configuration
: 90 | 13204.6 12316.6 0.0045505 0.000495731 197299 0
: 91 Minimum Test error found - save the configuration
: 91 | 13086.7 12204.3 0.00461542 0.00054395 196489 0
: 92 Minimum Test error found - save the configuration
: 92 | 12969 12093.3 0.0045479 0.000510431 198144 0
: 93 Minimum Test error found - save the configuration
: 93 | 12852 11983.4 0.00457876 0.000486981 195514 0
: 94 Minimum Test error found - save the configuration
: 94 | 12734.1 11877.5 0.00454152 0.000481941 197065 0
: 95 Minimum Test error found - save the configuration
: 95 | 12621.1 11770.6 0.00460884 0.000561412 197656 0
: 96 Minimum Test error found - save the configuration
: 96 | 12508.6 11662.2 0.00451632 0.000501201 199247 0
: 97 Minimum Test error found - save the configuration
: 97 | 12394.4 11557.6 0.00453245 0.000482202 197519 0
: 98 Minimum Test error found - save the configuration
: 98 | 12282.8 11453.6 0.00456965 0.000511241 197122 0
: 99 Minimum Test error found - save the configuration
: 99 | 12172.9 11348.9 0.0044528 0.000487802 201766 0
: 100 Minimum Test error found - save the configuration
: 100 | 12062 11246.3 0.0043614 0.00047338 205760 0
: 101 Minimum Test error found - save the configuration
: 101 | 11953 11146.4 0.00432729 0.00047884 207876 0
: 102 Minimum Test error found - save the configuration
: 102 | 11846.7 11043.4 0.00431464 0.00047586 208400 0
: 103 Minimum Test error found - save the configuration
: 103 | 11738.7 10943.1 0.00434902 0.000481851 206870 0
: 104 Minimum Test error found - save the configuration
: 104 | 11633.5 10844.1 0.00437201 0.00048524 205827 0
: 105 Minimum Test error found - save the configuration
: 105 | 11526.7 10747.3 0.00433964 0.000476081 207063 0
: 106 Minimum Test error found - save the configuration
: 106 | 11424.5 10648.6 0.00447543 0.000481471 200303 0
: 107 Minimum Test error found - save the configuration
: 107 | 11320.8 10551.2 0.00434181 0.000487471 207558 0
: 108 Minimum Test error found - save the configuration
: 108 | 11218.9 10455.4 0.00432367 0.00047405 207813 0
: 109 Minimum Test error found - save the configuration
: 109 | 11115.4 10361.9 0.0043385 0.000477761 207214 0
: 110 Minimum Test error found - save the configuration
: 110 | 11017.8 10265.5 0.00440731 0.00049185 204318 0
: 111 Minimum Test error found - save the configuration
: 111 | 10915 10176.4 0.00454056 0.000489981 197503 0
: 112 Minimum Test error found - save the configuration
: 112 | 10817.5 10084 0.00457037 0.000496851 196390 0
: 113 Minimum Test error found - save the configuration
: 113 | 10719.8 9991.82 0.00461607 0.000527181 195652 0
: 114 Minimum Test error found - save the configuration
: 114 | 10623.4 9899.6 0.0045789 0.00054586 198362 0
: 115 Minimum Test error found - save the configuration
: 115 | 10527.5 9808.94 0.00456364 0.00047999 195903 0
: 116 Minimum Test error found - save the configuration
: 116 | 10430.3 9721.41 0.004569 0.000484802 195877 0
: 117 Minimum Test error found - save the configuration
: 117 | 10336.7 9633 0.00455199 0.0005111 197976 0
: 118 Minimum Test error found - save the configuration
: 118 | 10242.7 9544.95 0.00459131 0.000527661 196867 0
: 119 Minimum Test error found - save the configuration
: 119 | 10150.5 9456.4 0.00458914 0.00052154 196676 0
: 120 Minimum Test error found - save the configuration
: 120 | 10057 9372.18 0.00451348 0.000485362 198604 0
: 121 Minimum Test error found - save the configuration
: 121 | 9967.01 9286.66 0.00457901 0.0005126 196734 0
: 122 Minimum Test error found - save the configuration
: 122 | 9876.62 9200.21 0.0046213 0.000527682 195426 0
: 123 Minimum Test error found - save the configuration
: 123 | 9785.25 9117.74 0.00456789 0.000535871 198412 0
: 124 Minimum Test error found - save the configuration
: 124 | 9698.06 9034.18 0.00453352 0.000481301 197423 0
: 125 Minimum Test error found - save the configuration
: 125 | 9609.81 8949.89 0.0045666 0.00051767 197583 0
: 126 Minimum Test error found - save the configuration
: 126 | 9522.46 8868.92 0.00453627 0.000479791 197215 0
: 127 Minimum Test error found - save the configuration
: 127 | 9434.38 8789.52 0.00459016 0.000555071 198261 0
: 128 Minimum Test error found - save the configuration
: 128 | 9349.89 8708.51 0.00453675 0.000486471 197517 0
: 129 Minimum Test error found - save the configuration
: 129 | 9265.21 8627.78 0.00455171 0.000482201 196584 0
: 130 Minimum Test error found - save the configuration
: 130 | 9180.62 8548.44 0.00458659 0.000511291 196305 0
: 131 Minimum Test error found - save the configuration
: 131 | 9097.15 8468.87 0.00540241 0.00052551 164039 0
: 132 Minimum Test error found - save the configuration
: 132 | 9014.02 8392.14 0.00457265 0.000525911 197690 0
: 133 Minimum Test error found - save the configuration
: 133 | 8930.97 8315.82 0.00456968 0.000494791 196324 0
: 134 Minimum Test error found - save the configuration
: 134 | 8850.92 8239.34 0.00462654 0.000537651 195652 0
: 135 Minimum Test error found - save the configuration
: 135 | 8770.25 8162.37 0.00455041 0.000490601 197054 0
: 136 Minimum Test error found - save the configuration
: 136 | 8690.08 8087.34 0.00456942 0.000530882 198091 0
: 137 Minimum Test error found - save the configuration
: 137 | 8610.45 8013.18 0.00455002 0.00048321 196715 0
: 138 Minimum Test error found - save the configuration
: 138 | 8533.15 7937.67 0.00464944 0.000526511 194037 0
: 139 Minimum Test error found - save the configuration
: 139 | 8454.34 7865.05 0.00458118 0.000546321 198272 0
: 140 Minimum Test error found - save the configuration
: 140 | 8377.08 7792.92 0.00456827 0.000486312 195984 0
: 141 Minimum Test error found - save the configuration
: 141 | 8300.3 7721.34 0.00464025 0.000507841 193592 0
: 142 Minimum Test error found - save the configuration
: 142 | 8225.46 7650.21 0.00463442 0.000500972 193543 0
: 143 Minimum Test error found - save the configuration
: 143 | 8149.98 7579.01 0.00468177 0.000485151 190630 0
: 144 Minimum Test error found - save the configuration
: 144 | 8076.11 7507.6 0.00464437 0.00051798 193874 0
: 145 Minimum Test error found - save the configuration
: 145 | 8001.34 7439.04 0.00461637 0.000486471 193709 0
: 146 Minimum Test error found - save the configuration
: 146 | 7927.73 7371.08 0.00468782 0.00055191 193428 0
: 147 Minimum Test error found - save the configuration
: 147 | 7856.56 7302.6 0.00462701 0.000528841 195209 0
: 148 Minimum Test error found - save the configuration
: 148 | 7783.87 7235.09 0.00461618 0.00050002 194356 0
: 149 Minimum Test error found - save the configuration
: 149 | 7712.97 7168.31 0.00456236 0.00048144 196034 0
: 150 Minimum Test error found - save the configuration
: 150 | 7641.97 7102.14 0.00471069 0.00055598 192553 0
: 151 Minimum Test error found - save the configuration
: 151 | 7573.38 7036.01 0.00463363 0.000479072 192560 0
: 152 Minimum Test error found - save the configuration
: 152 | 7503.02 6970.65 0.00466341 0.000512181 192714 0
: 153 Minimum Test error found - save the configuration
: 153 | 7434.16 6906.12 0.00458251 0.000494952 195716 0
: 154 Minimum Test error found - save the configuration
: 154 | 7366.14 6842.61 0.00474367 0.000520111 189414 0
: 155 Minimum Test error found - save the configuration
: 155 | 7298.9 6779.03 0.00466162 0.000522712 193288 0
: 156 Minimum Test error found - save the configuration
: 156 | 7231.6 6717.39 0.00462437 0.00048554 193291 0
: 157 Minimum Test error found - save the configuration
: 157 | 7166.95 6652.95 0.00459949 0.000475821 194002 0
: 158 Minimum Test error found - save the configuration
: 158 | 7099.6 6591.88 0.00467884 0.00054602 193573 0
: 159 Minimum Test error found - save the configuration
: 159 | 7035.1 6530.78 0.00464419 0.000514921 193739 0
: 160 Minimum Test error found - save the configuration
: 160 | 6970.09 6470.3 0.00463797 0.000478581 192336 0
: 161 Minimum Test error found - save the configuration
: 161 | 6907.43 6409.58 0.00466183 0.00048552 191557 0
: 162 Minimum Test error found - save the configuration
: 162 | 6842.92 6349.74 0.00469358 0.000519771 191671 0
: 163 Minimum Test error found - save the configuration
: 163 | 6780.37 6291.23 0.00466448 0.000489841 191633 0
: 164 Minimum Test error found - save the configuration
: 164 | 6717.81 6232.84 0.00462811 0.00051141 194331 0
: 165 Minimum Test error found - save the configuration
: 165 | 6656.86 6174.14 0.00458969 0.000507481 195972 0
: 166 Minimum Test error found - save the configuration
: 166 | 6594.83 6117.49 0.00446607 0.000525361 203009 0
: 167 Minimum Test error found - save the configuration
: 167 | 6534.27 6061.34 0.00446056 0.000484782 201218 0
: 168 Minimum Test error found - save the configuration
: 168 | 6474.2 6005.43 0.0044573 0.000485371 201414 0
: 169 Minimum Test error found - save the configuration
: 169 | 6415.92 5947.83 0.00449928 0.000519511 201017 0
: 170 Minimum Test error found - save the configuration
: 170 | 6356.28 5892.51 0.00616345 0.00055259 142581 0
: 171 Minimum Test error found - save the configuration
: 171 | 6298.3 5836.28 0.00449092 0.000497262 200318 0
: 172 Minimum Test error found - save the configuration
: 172 | 6239.11 5783.21 0.00561746 0.000691682 162411 0
: 173 Minimum Test error found - save the configuration
: 173 | 6182.39 5728.53 0.00495 0.000533812 181152 0
: 174 Minimum Test error found - save the configuration
: 174 | 6124.61 5675.98 0.0046556 0.000493211 192197 0
: 175 Minimum Test error found - save the configuration
: 175 | 6069.45 5621.96 0.00457952 0.000618121 201949 0
: 176 Minimum Test error found - save the configuration
: 176 | 6012.79 5570.53 0.00647728 0.000496422 133760 0
: 177 Minimum Test error found - save the configuration
: 177 | 5957.49 5517.9 0.00451005 0.000498871 199443 0
: 178 Minimum Test error found - save the configuration
: 178 | 5901.74 5467.29 0.00449486 0.00052859 201701 0
: 179 Minimum Test error found - save the configuration
: 179 | 5849.27 5414.8 0.00444735 0.000483742 201836 0
: 180 Minimum Test error found - save the configuration
: 180 | 5794.08 5364.2 0.00539815 0.00049436 163139 0
: 181 Minimum Test error found - save the configuration
: 181 | 5739.86 5315.8 0.00491696 0.000735531 191322 0
: 182 Minimum Test error found - save the configuration
: 182 | 5687.83 5265.65 0.00557082 0.000680652 163594 0
: 183 Minimum Test error found - save the configuration
: 183 | 5635.6 5215.85 0.00667747 0.000769362 135407 0
: 184 Minimum Test error found - save the configuration
: 184 | 5583.75 5166.97 0.00606281 0.000756351 150760 0
: 185 Minimum Test error found - save the configuration
: 185 | 5531.19 5119.88 0.00620627 0.00050285 140267 0
: 186 Minimum Test error found - save the configuration
: 186 | 5480.18 5071.9 0.00448471 0.000481092 199819 0
: 187 Minimum Test error found - save the configuration
: 187 | 5430.12 5024.39 0.00447685 0.00049691 201008 0
: 188 Minimum Test error found - save the configuration
: 188 | 5380.34 4977.03 0.00447721 0.000480121 200146 0
: 189 Minimum Test error found - save the configuration
: 189 | 5330.32 4929.93 0.00454603 0.00054066 199732 0
: 190 Minimum Test error found - save the configuration
: 190 | 5280.41 4884.81 0.00452323 0.0004965 198672 0
: 191 Minimum Test error found - save the configuration
: 191 | 5231.73 4840.19 0.00452069 0.000486082 198284 0
: 192 Minimum Test error found - save the configuration
: 192 | 5184.58 4793.32 0.00580824 0.0005476 152073 0
: 193 Minimum Test error found - save the configuration
: 193 | 5135.29 4749.74 0.00626129 0.000598771 141280 0
: 194 Minimum Test error found - save the configuration
: 194 | 5088.65 4705.32 0.00578903 0.000547941 152640 0
: 195 Minimum Test error found - save the configuration
: 195 | 5041.59 4660.89 0.00515241 0.000792841 183504 0
: 196 Minimum Test error found - save the configuration
: 196 | 4995.68 4616.06 0.00676558 0.000754891 133096 0
: 197 Minimum Test error found - save the configuration
: 197 | 4948.99 4573.19 0.00672085 0.000692682 132710 0
: 198 Minimum Test error found - save the configuration
: 198 | 4902.33 4531.94 0.00452005 0.000490451 198531 0
: 199 Minimum Test error found - save the configuration
: 199 | 4857.65 4489.89 0.00524746 0.000729753 177081 0
: 200 Minimum Test error found - save the configuration
: 200 | 4812.49 4448.32 0.00548989 0.0004975 160244 0
: 201 Minimum Test error found - save the configuration
: 201 | 4768.91 4406.39 0.00448175 0.000479881 199907 0
: 202 Minimum Test error found - save the configuration
: 202 | 4724.53 4365.68 0.00493195 0.00074905 191255 0
: 203 Minimum Test error found - save the configuration
: 203 | 4681.53 4324.09 0.00448962 0.000489282 199983 0
: 204 Minimum Test error found - save the configuration
: 204 | 4637.34 4284.17 0.00574251 0.000543281 153869 0
: 205 Minimum Test error found - save the configuration
: 205 | 4595.82 4243.42 0.00583411 0.000752651 157435 0
: 206 Minimum Test error found - save the configuration
: 206 | 4551.73 4205.48 0.00569182 0.000738172 161497 0
: 207 Minimum Test error found - save the configuration
: 207 | 4511.12 4165.56 0.00566037 0.00049445 154861 0
: 208 Minimum Test error found - save the configuration
: 208 | 4469.41 4126.31 0.00626415 0.000752072 145136 0
: 209 Minimum Test error found - save the configuration
: 209 | 4428.05 4087.84 0.00519937 0.000502081 170311 0
: 210 Minimum Test error found - save the configuration
: 210 | 4386.82 4050.34 0.00454871 0.00051665 198410 0
: 211 Minimum Test error found - save the configuration
: 211 | 4347.88 4011.25 0.00459428 0.000478851 194390 0
: 212 Minimum Test error found - save the configuration
: 212 | 4306.77 3973.75 0.00451908 0.0004974 198922 0
: 213 Minimum Test error found - save the configuration
: 213 | 4267.2 3937.13 0.00457453 0.000533321 197961 0
: 214 Minimum Test error found - save the configuration
: 214 | 4227.59 3901.19 0.00449865 0.00048916 199527 0
: 215 Minimum Test error found - save the configuration
: 215 | 4189.13 3864.83 0.00451583 0.00048719 198578 0
: 216 Minimum Test error found - save the configuration
: 216 | 4151.82 3827.56 0.00453232 0.00051269 199023 0
: 217 Minimum Test error found - save the configuration
: 217 | 4113.54 3791.2 0.00455096 0.000487031 196854 0
: 218 Minimum Test error found - save the configuration
: 218 | 4074.49 3756.77 0.00456023 0.000523852 198198 0
: 219 Minimum Test error found - save the configuration
: 219 | 4037.58 3721.6 0.00445789 0.000484961 201363 0
: 220 Minimum Test error found - save the configuration
: 220 | 4000.57 3687.12 0.00448607 0.000486942 200044 0
: 221 Minimum Test error found - save the configuration
: 221 | 3964.21 3652.73 0.00453816 0.000491511 197695 0
: 222 Minimum Test error found - save the configuration
: 222 | 3927.5 3619.12 0.00454096 0.000486011 197290 0
: 223 Minimum Test error found - save the configuration
: 223 | 3892.24 3584.76 0.00454289 0.00053134 199424 0
: 224 Minimum Test error found - save the configuration
: 224 | 3856.14 3551.53 0.00457494 0.00048457 195581 0
: 225 Minimum Test error found - save the configuration
: 225 | 3821.76 3517.72 0.00455828 0.000524621 198331 0
: 226 Minimum Test error found - save the configuration
: 226 | 3786.75 3484.04 0.0045253 0.00048754 198130 0
: 227 Minimum Test error found - save the configuration
: 227 | 3751.29 3452.77 0.00454743 0.000515461 198414 0
: 228 Minimum Test error found - save the configuration
: 228 | 3716.97 3421.07 0.0045643 0.000557531 199662 0
: 229 Minimum Test error found - save the configuration
: 229 | 3683.48 3389.16 0.00497281 0.000706331 187508 0
: 230 Minimum Test error found - save the configuration
: 230 | 3650.15 3357.32 0.0059602 0.000492861 146323 0
: 231 Minimum Test error found - save the configuration
: 231 | 3617 3325.58 0.00452118 0.00048532 198223 0
: 232 Minimum Test error found - save the configuration
: 232 | 3584.18 3294.24 0.00500953 0.000683132 184911 0
: 233 Minimum Test error found - save the configuration
: 233 | 3550.16 3264.71 0.00452159 0.000489261 198397 0
: 234 Minimum Test error found - save the configuration
: 234 | 3518.62 3234.58 0.00450204 0.000487412 199271 0
: 235 Minimum Test error found - save the configuration
: 235 | 3486.79 3204.38 0.00454708 0.000484731 196930 0
: 236 Minimum Test error found - save the configuration
: 236 | 3455.62 3173.6 0.00448294 0.000484402 200073 0
: 237 Minimum Test error found - save the configuration
: 237 | 3423.53 3144.03 0.00453353 0.00052736 199692 0
: 238 Minimum Test error found - save the configuration
: 238 | 3392.19 3115.3 0.00451458 0.00049197 198876 0
: 239 Minimum Test error found - save the configuration
: 239 | 3361.59 3086.2 0.00449834 0.000489081 199538 0
: 240 Minimum Test error found - save the configuration
: 240 | 3331.07 3057.6 0.00454706 0.00051714 198515 0
: 241 Minimum Test error found - save the configuration
: 241 | 3300.44 3029.24 0.00450253 0.000488192 199286 0
: 242 Minimum Test error found - save the configuration
: 242 | 3270.76 3001.15 0.00455588 0.00052042 198243 0
: 243 Minimum Test error found - save the configuration
: 243 | 3241.36 2972.25 0.00454299 0.000497362 197744 0
: 244 Minimum Test error found - save the configuration
: 244 | 3210.92 2945.08 0.0045347 0.00048867 197725 0
: 245 Minimum Test error found - save the configuration
: 245 | 3182.38 2917.49 0.00451053 0.00048682 198822 0
: 246 Minimum Test error found - save the configuration
: 246 | 3152.64 2891.33 0.00470562 0.00054726 192384 0
: 247 Minimum Test error found - save the configuration
: 247 | 3124.58 2864.49 0.00459777 0.000480262 194292 0
: 248 Minimum Test error found - save the configuration
: 248 | 3096.22 2837.73 0.00457913 0.00050368 196297 0
: 249 Minimum Test error found - save the configuration
: 249 | 3068.53 2810.82 0.00453175 0.00048145 197516 0
: 250 Minimum Test error found - save the configuration
: 250 | 3039.72 2784.84 0.00450789 0.000484671 198846 0
: 251 Minimum Test error found - save the configuration
: 251 | 3012.94 2758.17 0.00464669 0.000553481 195446 0
: 252 Minimum Test error found - save the configuration
: 252 | 2984.62 2733.44 0.00458117 0.00048919 195504 0
: 253 Minimum Test error found - save the configuration
: 253 | 2958.19 2707.51 0.00457415 0.00048813 195790 0
: 254 Minimum Test error found - save the configuration
: 254 | 2930.76 2682.9 0.00468238 0.00057934 194977 0
: 255 Minimum Test error found - save the configuration
: 255 | 2904.88 2657.76 0.00461384 0.00053173 195977 0
: 256 Minimum Test error found - save the configuration
: 256 | 2878.28 2632.91 0.00455525 0.000490411 196810 0
: 257 Minimum Test error found - save the configuration
: 257 | 2851.95 2608.76 0.0045933 0.00048781 194861 0
: 258 Minimum Test error found - save the configuration
: 258 | 2825.78 2585.28 0.00457223 0.000497101 196313 0
: 259 Minimum Test error found - save the configuration
: 259 | 2801.38 2560.34 0.00466056 0.000572261 195680 0
: 260 Minimum Test error found - save the configuration
: 260 | 2774.88 2537.18 0.00456899 0.00048912 196085 0
: 261 Minimum Test error found - save the configuration
: 261 | 2750.09 2513.65 0.00488772 0.000568122 185202 0
: 262 Minimum Test error found - save the configuration
: 262 | 2725.38 2490.12 0.0048479 0.00056988 187002 0
: 263 Minimum Test error found - save the configuration
: 263 | 2700.58 2467.02 0.00460959 0.000516052 195430 0
: 264 Minimum Test error found - save the configuration
: 264 | 2675.88 2444.44 0.00459832 0.000521691 196241 0
: 265 Minimum Test error found - save the configuration
: 265 | 2651.83 2422.44 0.00441444 0.000487202 203706 0
: 266 Minimum Test error found - save the configuration
: 266 | 2627.92 2399.61 0.00474161 0.000501301 188666 0
: 267 Minimum Test error found - save the configuration
: 267 | 2603.75 2377.45 0.00442279 0.000487321 203280 0
: 268 Minimum Test error found - save the configuration
: 268 | 2580.32 2355.64 0.00444413 0.00048668 202150 0
: 269 Minimum Test error found - save the configuration
: 269 | 2556.94 2334.53 0.00459461 0.000586461 199593 0
: 270 Minimum Test error found - save the configuration
: 270 | 2533.93 2312.89 0.00465273 0.000617292 198244 0
: 271 Minimum Test error found - save the configuration
: 271 | 2510.57 2291.92 0.00437368 0.000484301 205688 0
: 272 Minimum Test error found - save the configuration
: 272 | 2488.63 2269.92 0.00435973 0.000479572 206177 0
: 273 Minimum Test error found - save the configuration
: 273 | 2465.42 2249.37 0.0043862 0.00048367 204995 0
: 274 Minimum Test error found - save the configuration
: 274 | 2442.85 2228.92 0.00435 0.000488031 207148 0
: 275 Minimum Test error found - save the configuration
: 275 | 2420.86 2208.43 0.00436366 0.000484191 206214 0
: 276 Minimum Test error found - save the configuration
: 276 | 2399.41 2187.21 0.00436898 0.00048313 205875 0
: 277 Minimum Test error found - save the configuration
: 277 | 2376.67 2167.44 0.00437193 0.000481891 205654 0
: 278 Minimum Test error found - save the configuration
: 278 | 2355.57 2146.93 0.00439323 0.0004782 204341 0
: 279 Minimum Test error found - save the configuration
: 279 | 2333.29 2127.9 0.0043896 0.000486841 204983 0
: 280 Minimum Test error found - save the configuration
: 280 | 2312.22 2108.86 0.00438889 0.000495931 205499 0
: 281 Minimum Test error found - save the configuration
: 281 | 2291.08 2090.22 0.00439318 0.000485631 204732 0
: 282 Minimum Test error found - save the configuration
: 282 | 2270.85 2070.81 0.0043648 0.000482132 206044 0
: 283 Minimum Test error found - save the configuration
: 283 | 2249.92 2051.08 0.0043526 0.000475531 206342 0
: 284 Minimum Test error found - save the configuration
: 284 | 2228.81 2032.19 0.00436973 0.000482891 205823 0
: 285 Minimum Test error found - save the configuration
: 285 | 2207.93 2014.38 0.0044947 0.000491532 199842 0
: 286 Minimum Test error found - save the configuration
: 286 | 2188.9 1994.75 0.00448197 0.00048802 200303 0
: 287 Minimum Test error found - save the configuration
: 287 | 2167.91 1976.45 0.00447213 0.000484762 200634 0
: 288 Minimum Test error found - save the configuration
: 288 | 2148.71 1957.79 0.00450216 0.000503551 200070 0
: 289 Minimum Test error found - save the configuration
: 289 | 2127.75 1940.58 0.00446884 0.00052195 202691 0
: 290 Minimum Test error found - save the configuration
: 290 | 2108.77 1922.46 0.00448291 0.000499131 200814 0
: 291 Minimum Test error found - save the configuration
: 291 | 2089.19 1904.83 0.00445893 0.000481111 201115 0
: 292 Minimum Test error found - save the configuration
: 292 | 2069.97 1887.48 0.0044733 0.000489832 200830 0
: 293 Minimum Test error found - save the configuration
: 293 | 2050.86 1869.98 0.00448233 0.00048647 200207 0
: 294 Minimum Test error found - save the configuration
: 294 | 2031.84 1852.97 0.00453021 0.000533661 200173 0
: 295 Minimum Test error found - save the configuration
: 295 | 2012.86 1836.14 0.00448498 0.000502511 200881 0
: 296 Minimum Test error found - save the configuration
: 296 | 1994.41 1819.59 0.00449577 0.00049032 199728 0
: 297 Minimum Test error found - save the configuration
: 297 | 1975.35 1803.44 0.00447123 0.000489131 200899 0
: 298 Minimum Test error found - save the configuration
: 298 | 1957.69 1786.87 0.00448425 0.00048937 200256 0
: 299 Minimum Test error found - save the configuration
: 299 | 1939.51 1770.19 0.00449913 0.000492411 199665 0
: 300 Minimum Test error found - save the configuration
: 300 | 1921.55 1753.67 0.00453212 0.00052902 199845 0
: 301 Minimum Test error found - save the configuration
: 301 | 1903.24 1737.64 0.00448161 0.00048685 200262 0
: 302 Minimum Test error found - save the configuration
: 302 | 1885.52 1721.69 0.00448765 0.000490032 200119 0
: 303 Minimum Test error found - save the configuration
: 303 | 1868.11 1705.45 0.00453578 0.000491521 197811 0
: 304 Minimum Test error found - save the configuration
: 304 | 1849.76 1690.89 0.00447961 0.000483972 200218 0
: 305 Minimum Test error found - save the configuration
: 305 | 1833.13 1675.24 0.00453525 0.000536761 200076 0
: 306 Minimum Test error found - save the configuration
: 306 | 1815.74 1660.04 0.00448326 0.000487611 200218 0
: 307 Minimum Test error found - save the configuration
: 307 | 1799.06 1644.62 0.0044973 0.000483922 199333 0
: 308 Minimum Test error found - save the configuration
: 308 | 1782.07 1629.26 0.00451088 0.000488541 198889 0
: 309 Minimum Test error found - save the configuration
: 309 | 1765.11 1614.41 0.00451033 0.000488782 198928 0
: 310 Minimum Test error found - save the configuration
: 310 | 1748.6 1599.23 0.00454874 0.00053137 199135 0
: 311 Minimum Test error found - save the configuration
: 311 | 1731.45 1585.21 0.00448059 0.000526572 202326 0
: 312 Minimum Test error found - save the configuration
: 312 | 1715.4 1570.68 0.00454399 0.0004958 197619 0
: 313 Minimum Test error found - save the configuration
: 313 | 1699.33 1556.1 0.00447618 0.000481091 200246 0
: 314 Minimum Test error found - save the configuration
: 314 | 1683.18 1541.85 0.00448705 0.000489552 200125 0
: 315 Minimum Test error found - save the configuration
: 315 | 1667.05 1527.86 0.00449089 0.000482321 199573 0
: 316 Minimum Test error found - save the configuration
: 316 | 1651.82 1513.23 0.00452548 0.000533162 200385 0
: 317 Minimum Test error found - save the configuration
: 317 | 1635.41 1499.61 0.00447748 0.000481891 200221 0
: 318 Minimum Test error found - save the configuration
: 318 | 1620.1 1485.79 0.00449903 0.00049104 199601 0
: 319 Minimum Test error found - save the configuration
: 319 | 1604.43 1472.58 0.00446123 0.000483821 201136 0
: 320 Minimum Test error found - save the configuration
: 320 | 1589.15 1459.19 0.00450282 0.00048829 199276 0
: 321 Minimum Test error found - save the configuration
: 321 | 1574.33 1445.61 0.00452649 0.000532981 200325 0
: 322 Minimum Test error found - save the configuration
: 322 | 1559.05 1432.42 0.00450523 0.000499611 199719 0
: 323 Minimum Test error found - save the configuration
: 323 | 1544.45 1418.7 0.00449117 0.000479661 199426 0
: 324 Minimum Test error found - save the configuration
: 324 | 1529.13 1406.05 0.00451213 0.000495801 199187 0
: 325 Minimum Test error found - save the configuration
: 325 | 1514.68 1393.61 0.00449057 0.00048002 199474 0
: 326 Minimum Test error found - save the configuration
: 326 | 1500.29 1380.2 0.00448861 0.000498251 200483 0
: 327 Minimum Test error found - save the configuration
: 327 | 1485.81 1367.41 0.00452266 0.000523511 200043 0
: 328 Minimum Test error found - save the configuration
: 328 | 1471.58 1354.62 0.00449794 0.000495162 199861 0
: 329 Minimum Test error found - save the configuration
: 329 | 1457.39 1342.44 0.00450552 0.00048187 198825 0
: 330 Minimum Test error found - save the configuration
: 330 | 1443.55 1329.7 0.00451215 0.000490272 198912 0
: 331 Minimum Test error found - save the configuration
: 331 | 1429.81 1317.9 0.00449734 0.000493571 199812 0
: 332 Minimum Test error found - save the configuration
: 332 | 1415.72 1305.67 0.00456842 0.00054516 198844 0
: 333 Minimum Test error found - save the configuration
: 333 | 1402.43 1293.35 0.00451567 0.000501742 199306 0
: 334 Minimum Test error found - save the configuration
: 334 | 1388.65 1281 0.00453515 0.000502171 198365 0
: 335 Minimum Test error found - save the configuration
: 335 | 1375.11 1269.47 0.00449458 0.000491602 199851 0
: 336 Minimum Test error found - save the configuration
: 336 | 1362.51 1257.2 0.00451187 0.000495511 199185 0
: 337 Minimum Test error found - save the configuration
: 337 | 1348.71 1245.35 0.0045721 0.000538361 198327 0
: 338 Minimum Test error found - save the configuration
: 338 | 1335.44 1234.51 0.00451331 0.00050266 199469 0
: 339 Minimum Test error found - save the configuration
: 339 | 1322.85 1223.27 0.00453543 0.000494561 197977 0
: 340 Minimum Test error found - save the configuration
: 340 | 1310.25 1211.72 0.0045213 0.00048919 198407 0
: 341 Minimum Test error found - save the configuration
: 341 | 1297.61 1200.41 0.00450675 0.00049686 199507 0
: 342 Minimum Test error found - save the configuration
: 342 | 1285.11 1188.93 0.00455495 0.000522522 198392 0
: 343 Minimum Test error found - save the configuration
: 343 | 1272.65 1177.61 0.00450667 0.00049547 199442 0
: 344 Minimum Test error found - save the configuration
: 344 | 1260.49 1166.25 0.00445188 0.000476481 201238 0
: 345 Minimum Test error found - save the configuration
: 345 | 1247.85 1156.12 0.0045259 0.000492811 198359 0
: 346 Minimum Test error found - save the configuration
: 346 | 1236.02 1145 0.00445872 0.000478401 200989 0
: 347 Minimum Test error found - save the configuration
: 347 | 1224.12 1134.14 0.00457936 0.000544542 198274 0
: 348 Minimum Test error found - save the configuration
: 348 | 1212.31 1123.7 0.00447319 0.000479071 200295 0
: 349 Minimum Test error found - save the configuration
: 349 | 1200.81 1112.5 0.00447606 0.000495652 200984 0
: 350 Minimum Test error found - save the configuration
: 350 | 1188.54 1102.01 0.00447396 0.00048066 200336 0
: 351 Minimum Test error found - save the configuration
: 351 | 1176.77 1091.96 0.00451472 0.000504221 199476 0
: 352 Minimum Test error found - save the configuration
: 352 | 1165.56 1081.74 0.00452722 0.00051615 199448 0
: 353 Minimum Test error found - save the configuration
: 353 | 1154.75 1071.17 0.00451088 0.000538161 201373 0
: 354 Minimum Test error found - save the configuration
: 354 | 1142.55 1062.06 0.00447734 0.000481421 200204 0
: 355 Minimum Test error found - save the configuration
: 355 | 1132.3 1051.21 0.00450107 0.00048452 199176 0
: 356 Minimum Test error found - save the configuration
: 356 | 1120.81 1041.73 0.00446028 0.000475591 200769 0
: 357 Minimum Test error found - save the configuration
: 357 | 1109.95 1031.96 0.00449194 0.00049127 199967 0
: 358 Minimum Test error found - save the configuration
: 358 | 1099.48 1021.86 0.00476176 0.000567512 190737 0
: 359 Minimum Test error found - save the configuration
: 359 | 1088.45 1012.42 0.00448052 0.00049365 200659 0
: 360 Minimum Test error found - save the configuration
: 360 | 1077.94 1002.6 0.00441838 0.000486151 203447 0
: 361 Minimum Test error found - save the configuration
: 361 | 1067.35 993.342 0.00443182 0.000485212 202706 0
: 362 Minimum Test error found - save the configuration
: 362 | 1057 983.947 0.00438037 0.00047474 204833 0
: 363 Minimum Test error found - save the configuration
: 363 | 1046.79 974.103 0.00436273 0.00048149 206120 0
: 364 Minimum Test error found - save the configuration
: 364 | 1036.42 964.796 0.00442811 0.000485582 202916 0
: 365 Minimum Test error found - save the configuration
: 365 | 1026.2 955.618 0.00446252 0.000488541 201310 0
: 366 Minimum Test error found - save the configuration
: 366 | 1016.23 946.46 0.00438773 0.00048197 204826 0
: 367 Minimum Test error found - save the configuration
: 367 | 1006.37 937.423 0.00439027 0.000492662 205254 0
: 368 Minimum Test error found - save the configuration
: 368 | 996.529 928.038 0.00440667 0.000488421 204173 0
: 369 Minimum Test error found - save the configuration
: 369 | 986.494 919.815 0.00440876 0.00047674 203458 0
: 370 Minimum Test error found - save the configuration
: 370 | 977.092 911.071 0.00439478 0.000485432 204638 0
: 371 Minimum Test error found - save the configuration
: 371 | 967.481 901.852 0.00440407 0.0004959 204700 0
: 372 Minimum Test error found - save the configuration
: 372 | 957.707 893.35 0.00442649 0.000496102 203542 0
: 373 Minimum Test error found - save the configuration
: 373 | 948.765 885.035 0.00440077 0.000484972 204301 0
: 374 Minimum Test error found - save the configuration
: 374 | 938.883 876.531 0.00504418 0.000684792 183512 0
: 375 Minimum Test error found - save the configuration
: 375 | 930.058 867.539 0.00465101 0.00050371 192897 0
: 376 Minimum Test error found - save the configuration
: 376 | 920.66 859.375 0.00439385 0.000481522 204482 0
: 377 Minimum Test error found - save the configuration
: 377 | 911.904 850.814 0.00440539 0.000487471 204190 0
: 378 Minimum Test error found - save the configuration
: 378 | 902.842 842.612 0.00439812 0.00048845 204621 0
: 379 Minimum Test error found - save the configuration
: 379 | 893.624 834.314 0.00444127 0.000483571 202138 0
: 380 Minimum Test error found - save the configuration
: 380 | 884.85 826.123 0.00442679 0.00048509 202958 0
: 381 Minimum Test error found - save the configuration
: 381 | 876.012 817.736 0.00441677 0.000484761 203458 0
: 382 Minimum Test error found - save the configuration
: 382 | 866.957 810.138 0.00440602 0.000486122 204087 0
: 383 Minimum Test error found - save the configuration
: 383 | 859.001 801.6 0.00441973 0.000483311 203231 0
: 384 Minimum Test error found - save the configuration
: 384 | 849.831 794.035 0.00437972 0.00047286 204768 0
: 385 Minimum Test error found - save the configuration
: 385 | 841.856 786.053 0.0044019 0.000483481 204164 0
: 386 Minimum Test error found - save the configuration
: 386 | 833.045 778.456 0.00442581 0.000481761 202837 0
: 387 Minimum Test error found - save the configuration
: 387 | 825.172 770.884 0.00441641 0.00049818 204174 0
: 388 Minimum Test error found - save the configuration
: 388 | 816.697 763.621 0.00443672 0.000486002 202495 0
: 389 Minimum Test error found - save the configuration
: 389 | 809.19 755.837 0.00441785 0.00048944 203645 0
: 390 Minimum Test error found - save the configuration
: 390 | 800.364 748.253 0.00445549 0.000486561 201566 0
: 391 Minimum Test error found - save the configuration
: 391 | 792.696 740.785 0.00441158 0.000473721 203156 0
: 392 Minimum Test error found - save the configuration
: 392 | 785.012 733.112 0.00440056 0.000490131 204581 0
: 393 Minimum Test error found - save the configuration
: 393 | 776.343 726.452 0.00437405 0.000483481 205626 0
: 394 Minimum Test error found - save the configuration
: 394 | 769.306 718.743 0.00439868 0.000481021 204204 0
: 395 Minimum Test error found - save the configuration
: 395 | 761.038 711.538 0.0043847 0.00047976 204869 0
: 396 Minimum Test error found - save the configuration
: 396 | 753.659 704.232 0.00440591 0.000485021 204035 0
: 397 Minimum Test error found - save the configuration
: 397 | 745.917 697.24 0.00437794 0.000486131 205560 0
: 398 Minimum Test error found - save the configuration
: 398 | 738.392 690.385 0.00441504 0.00048138 203373 0
: 399 Minimum Test error found - save the configuration
: 399 | 731.229 683.435 0.00438056 0.000480052 205102 0
: 400 Minimum Test error found - save the configuration
: 400 | 723.76 676.631 0.0043934 0.0004812 204489 0
: 401 Minimum Test error found - save the configuration
: 401 | 716.409 669.529 0.00439394 0.000470931 203925 0
: 402 Minimum Test error found - save the configuration
: 402 | 709.196 662.581 0.0044054 0.000489051 204272 0
: 403 Minimum Test error found - save the configuration
: 403 | 701.792 656.25 0.00436879 0.000474781 205444 0
: 404 Minimum Test error found - save the configuration
: 404 | 695.254 649.427 0.00437133 0.000482651 205725 0
: 405 Minimum Test error found - save the configuration
: 405 | 687.954 643.53 0.00439076 0.00047889 204506 0
: 406 Minimum Test error found - save the configuration
: 406 | 681.033 636.449 0.00441422 0.000477751 203228 0
: 407 Minimum Test error found - save the configuration
: 407 | 674.1 629.756 0.00537751 0.000506721 164244 0
: 408 Minimum Test error found - save the configuration
: 408 | 667.298 623.18 0.00444945 0.000487311 201911 0
: 409 Minimum Test error found - save the configuration
: 409 | 660.489 617.276 0.00440451 0.000487752 204251 0
: 410 Minimum Test error found - save the configuration
: 410 | 653.652 610.94 0.00441736 0.0004807 203218 0
: 411 Minimum Test error found - save the configuration
: 411 | 647.209 604.293 0.00528539 0.000712932 174961 0
: 412 Minimum Test error found - save the configuration
: 412 | 640.466 597.743 0.00632875 0.000702281 142185 0
: 413 Minimum Test error found - save the configuration
: 413 | 633.66 591.897 0.00633718 0.000706991 142091 0
: 414 Minimum Test error found - save the configuration
: 414 | 627.446 585.69 0.00631618 0.0006944 142304 0
: 415 Minimum Test error found - save the configuration
: 415 | 620.897 579.468 0.0063366 0.000699171 141909 0
: 416 Minimum Test error found - save the configuration
: 416 | 614.313 573.681 0.00630909 0.000707021 142804 0
: 417 Minimum Test error found - save the configuration
: 417 | 608.435 567.367 0.00630134 0.000700382 142833 0
: 418 Minimum Test error found - save the configuration
: 418 | 601.86 561.849 0.00630347 0.000702282 142827 0
: 419 Minimum Test error found - save the configuration
: 419 | 595.92 555.709 0.00630397 0.00070938 142995 0
: 420 Minimum Test error found - save the configuration
: 420 | 589.635 549.974 0.00471897 0.000497731 189518 0
: 421 Minimum Test error found - save the configuration
: 421 | 583.751 544.323 0.0044629 0.000486561 201190 0
: 422 Minimum Test error found - save the configuration
: 422 | 577.632 538.736 0.00447982 0.000489972 200509 0
: 423 Minimum Test error found - save the configuration
: 423 | 571.733 532.951 0.00447553 0.00048763 200607 0
: 424 Minimum Test error found - save the configuration
: 424 | 565.662 527.212 0.0045265 0.000529351 200143 0
: 425 Minimum Test error found - save the configuration
: 425 | 559.938 521.525 0.00448948 0.00050766 200913 0
: 426 Minimum Test error found - save the configuration
: 426 | 554.007 516.637 0.00449387 0.00048941 199777 0
: 427 Minimum Test error found - save the configuration
: 427 | 548.758 510.501 0.00446457 0.000480862 200818 0
: 428 Minimum Test error found - save the configuration
: 428 | 542.416 505.486 0.00447797 0.0004878 200493 0
: 429 Minimum Test error found - save the configuration
: 429 | 537.282 499.624 0.00449748 0.000493552 199804 0
: 430 Minimum Test error found - save the configuration
: 430 | 531.282 494.494 0.00455895 0.000534541 198787 0
: 431 Minimum Test error found - save the configuration
: 431 | 526.105 489.505 0.00448247 0.000483732 200063 0
: 432 Minimum Test error found - save the configuration
: 432 | 520.725 483.779 0.00450567 0.000494891 199463 0
: 433 Minimum Test error found - save the configuration
: 433 | 514.948 478.992 0.00453619 0.00048147 197301 0
: 434 Minimum Test error found - save the configuration
: 434 | 509.855 473.581 0.00454124 0.000509602 198431 0
: 435 Minimum Test error found - save the configuration
: 435 | 504.454 468.324 0.00455757 0.000522231 198249 0
: 436 Minimum Test error found - save the configuration
: 436 | 499.079 463.779 0.00457137 0.000492262 196121 0
: 437 Minimum Test error found - save the configuration
: 437 | 493.848 459.102 0.00452501 0.00048904 198218 0
: 438 Minimum Test error found - save the configuration
: 438 | 488.93 454.236 0.00453144 0.000491841 198040 0
: 439 Minimum Test error found - save the configuration
: 439 | 483.744 449.649 0.00457985 0.00052896 197488 0
: 440 Minimum Test error found - save the configuration
: 440 | 478.81 444.622 0.00453665 0.000507961 198576 0
: 441 Minimum Test error found - save the configuration
: 441 | 474.119 439.442 0.00455216 0.000491281 197002 0
: 442 Minimum Test error found - save the configuration
: 442 | 468.809 434.919 0.00454879 0.000487601 196987 0
: 443 Minimum Test error found - save the configuration
: 443 | 463.971 429.863 0.0045451 0.000493161 197436 0
: 444 Minimum Test error found - save the configuration
: 444 | 458.787 425.224 0.00457874 0.000543001 198229 0
: 445 Minimum Test error found - save the configuration
: 445 | 454.292 420.712 0.00450017 0.000481871 199089 0
: 446 Minimum Test error found - save the configuration
: 446 | 449.254 416.286 0.00449378 0.000484231 199524 0
: 447 Minimum Test error found - save the configuration
: 447 | 445.19 411.427 0.00447882 0.000482661 200192 0
: 448 Minimum Test error found - save the configuration
: 448 | 439.92 407.075 0.00448813 0.000489621 200075 0
: 449 Minimum Test error found - save the configuration
: 449 | 435.327 402.593 0.00452108 0.000525362 200214 0
: 450 Minimum Test error found - save the configuration
: 450 | 430.952 398.526 0.00449004 0.000499301 200464 0
: 451 Minimum Test error found - save the configuration
: 451 | 426.557 393.451 0.00449194 0.000481851 199497 0
: 452 Minimum Test error found - save the configuration
: 452 | 421.98 390.005 0.00448285 0.000486982 200207 0
: 453 Minimum Test error found - save the configuration
: 453 | 417.612 385.399 0.00448199 0.00047973 199887 0
: 454 Minimum Test error found - save the configuration
: 454 | 413.146 381.224 0.00450212 0.000496961 199742 0
: 455 Minimum Test error found - save the configuration
: 455 | 408.845 376.618 0.00451553 0.00052279 200364 0
: 456 Minimum Test error found - save the configuration
: 456 | 404.578 372.711 0.00455131 0.00048791 196880 0
: 457 Minimum Test error found - save the configuration
: 457 | 400.372 368.291 0.00452809 0.000493971 198309 0
: 458 Minimum Test error found - save the configuration
: 458 | 395.762 364.334 0.00452558 0.000496181 198541 0
: 459 Minimum Test error found - save the configuration
: 459 | 391.733 360.511 0.00455901 0.000524582 198293 0
: 460 Minimum Test error found - save the configuration
: 460 | 387.68 356.43 0.00450589 0.00053367 201399 0
: 461 Minimum Test error found - save the configuration
: 461 | 383.741 352.429 0.00449259 0.000485091 199626 0
: 462 Minimum Test error found - save the configuration
: 462 | 379.322 348.419 0.00454678 0.000496161 197501 0
: 463 Minimum Test error found - save the configuration
: 463 | 375.51 344.381 0.00452866 0.00048779 197977 0
: 464 Minimum Test error found - save the configuration
: 464 | 371.497 340.508 0.00460322 0.0005448 197121 0
: 465 Minimum Test error found - save the configuration
: 465 | 367.339 337.004 0.00450678 0.000510281 200175 0
: 466 Minimum Test error found - save the configuration
: 466 | 363.724 332.806 0.00455462 0.000494591 197043 0
: 467 Minimum Test error found - save the configuration
: 467 | 359.755 329.432 0.00451781 0.000484611 198354 0
: 468 Minimum Test error found - save the configuration
: 468 | 355.796 325.428 0.00450982 0.000496791 199351 0
: 469 Minimum Test error found - save the configuration
: 469 | 352.462 322.171 0.00457601 0.000531351 197792 0
: 470 Minimum Test error found - save the configuration
: 470 | 348.181 318.55 0.00453373 0.000498852 198271 0
: 471 Minimum Test error found - save the configuration
: 471 | 345.055 314.732 0.00452284 0.000489701 198357 0
: 472 Minimum Test error found - save the configuration
: 472 | 340.981 310.934 0.00452599 0.000490762 198254 0
: 473 Minimum Test error found - save the configuration
: 473 | 337.077 307.811 0.00452715 0.00048892 198107 0
: 474 Minimum Test error found - save the configuration
: 474 | 333.599 304.202 0.00454089 0.00052658 199287 0
: 475 Minimum Test error found - save the configuration
: 475 | 330.026 300.501 0.00448308 0.000486631 200178 0
: 476 Minimum Test error found - save the configuration
: 476 | 326.487 297.653 0.00446101 0.00048373 201143 0
: 477 Minimum Test error found - save the configuration
: 477 | 323.088 293.776 0.00447743 0.000488761 200568 0
: 478 Minimum Test error found - save the configuration
: 478 | 319.45 290.369 0.00448598 0.00048595 199999 0
: 479 Minimum Test error found - save the configuration
: 479 | 316.096 287.019 0.00449264 0.000494211 200079 0
: 480 Minimum Test error found - save the configuration
: 480 | 312.857 283.961 0.0045097 0.000529921 201016 0
: 481 Minimum Test error found - save the configuration
: 481 | 309.216 280.345 0.00448042 0.000485581 200258 0
: 482 Minimum Test error found - save the configuration
: 482 | 305.64 277.555 0.00448262 0.000479502 199844 0
: 483 Minimum Test error found - save the configuration
: 483 | 302.573 274.466 0.00447721 0.000483741 200327 0
: 484 Minimum Test error found - save the configuration
: 484 | 299.195 271.866 0.00447085 0.00048228 200573 0
: 485 Minimum Test error found - save the configuration
: 485 | 296.511 268.67 0.00453001 0.000529902 199995 0
: 486 Minimum Test error found - save the configuration
: 486 | 293.117 265.703 0.0044916 0.000492371 200039 0
: 487 Minimum Test error found - save the configuration
: 487 | 289.981 262.413 0.00451003 0.000483751 198695 0
: 488 Minimum Test error found - save the configuration
: 488 | 286.759 258.513 0.0045294 0.000491521 198124 0
: 489 Minimum Test error found - save the configuration
: 489 | 283.486 256.492 0.004489 0.000483881 199744 0
: 490 Minimum Test error found - save the configuration
: 490 | 280.715 253.218 0.00451847 0.000521311 200142 0
: 491 Minimum Test error found - save the configuration
: 491 | 277.488 250.85 0.00447827 0.000513981 201802 0
: 492 Minimum Test error found - save the configuration
: 492 | 274.377 248.215 0.00449462 0.000482161 199379 0
: 493 Minimum Test error found - save the configuration
: 493 | 271.547 244.402 0.00447815 0.00049717 200956 0
: 494 Minimum Test error found - save the configuration
: 494 | 268.409 241.729 0.00449613 0.000485252 199458 0
: 495 Minimum Test error found - save the configuration
: 495 | 265.646 239.085 0.00447835 0.0004852 200343 0
: 496 Minimum Test error found - save the configuration
: 496 | 262.717 236.452 0.00453482 0.00052516 199518 0
: 497 Minimum Test error found - save the configuration
: 497 | 259.848 233.047 0.00449561 0.000485981 199520 0
: 498 Minimum Test error found - save the configuration
: 498 | 257 230.463 0.00448672 0.00047732 199531 0
: 499 Minimum Test error found - save the configuration
: 499 | 254.222 227.852 0.00447494 0.000484582 200483 0
: 500 Minimum Test error found - save the configuration
: 500 | 251.374 225.106 0.00448437 0.00048331 199947 0
: 501 Minimum Test error found - save the configuration
: 501 | 248.74 222.837 0.00452691 0.000531112 200210 0
: 502 Minimum Test error found - save the configuration
: 502 | 245.989 220.359 0.0044733 0.000482451 200459 0
: 503 Minimum Test error found - save the configuration
: 503 | 243.282 217.344 0.00448123 0.00048251 200064 0
: 504 Minimum Test error found - save the configuration
: 504 | 240.539 215.059 0.00447156 0.000481592 200503 0
: 505 Minimum Test error found - save the configuration
: 505 | 238.218 212.44 0.00446095 0.00048349 201134 0
: 506 Minimum Test error found - save the configuration
: 506 | 235.639 209.927 0.00451923 0.000528201 200450 0
: 507 Minimum Test error found - save the configuration
: 507 | 232.932 207.917 0.00450073 0.00048465 199199 0
: 508 Minimum Test error found - save the configuration
: 508 | 230.228 205.23 0.00447746 0.00048553 200404 0
: 509 Minimum Test error found - save the configuration
: 509 | 227.915 202.826 0.00448456 0.000484341 199989 0
: 510 Minimum Test error found - save the configuration
: 510 | 225.22 200.145 0.00448543 0.00047993 199725 0
: 511 Minimum Test error found - save the configuration
: 511 | 222.795 197.909 0.00450827 0.000527662 200974 0
: 512 Minimum Test error found - save the configuration
: 512 | 220.545 196.582 0.00453203 0.00048323 197590 0
: 513 Minimum Test error found - save the configuration
: 513 | 217.964 193.281 0.00484481 0.000601912 188550 0
: 514 Minimum Test error found - save the configuration
: 514 | 215.29 191.012 0.00451454 0.000500681 199310 0
: 515 Minimum Test error found - save the configuration
: 515 | 213.095 190.394 0.00456361 0.000530671 198367 0
: 516 Minimum Test error found - save the configuration
: 516 | 210.999 187.297 0.00465621 0.000498581 192417 0
: 517 Minimum Test error found - save the configuration
: 517 | 208.531 184.39 0.00457319 0.000488171 195838 0
: 518 Minimum Test error found - save the configuration
: 518 | 206.003 182.728 0.00491071 0.000552441 183559 0
: 519 Minimum Test error found - save the configuration
: 519 | 203.656 179.979 0.00453838 0.000515472 198861 0
: 520 Minimum Test error found - save the configuration
: 520 | 201.367 178.372 0.00453043 0.000520301 199495 0
: 521 Minimum Test error found - save the configuration
: 521 | 199.307 176.829 0.00460959 0.000506822 194990 0
: 522 Minimum Test error found - save the configuration
: 522 | 197.303 173.821 0.00440451 0.00049093 204417 0
: 523 Minimum Test error found - save the configuration
: 523 | 194.73 172.114 0.00449405 0.00048208 199403 0
: 524 Minimum Test error found - save the configuration
: 524 | 192.618 170.303 0.00444097 0.000491142 202541 0
: 525 Minimum Test error found - save the configuration
: 525 | 190.293 167.855 0.00452718 0.000488141 198067 0
: 526 Minimum Test error found - save the configuration
: 526 | 188.431 165.82 0.00450026 0.000487522 199365 0
: 527 Minimum Test error found - save the configuration
: 527 | 186.032 163.634 0.00453239 0.000486781 197745 0
: 528 Minimum Test error found - save the configuration
: 528 | 184.016 161.987 0.00447196 0.000483452 200576 0
: 529 Minimum Test error found - save the configuration
: 529 | 182.551 159.646 0.00486263 0.000482901 182660 0
: 530 Minimum Test error found - save the configuration
: 530 | 180.017 157.655 0.00497303 0.000714191 187845 0
: 531 Minimum Test error found - save the configuration
: 531 | 177.903 156.356 0.00502225 0.000530522 178105 0
: 532 Minimum Test error found - save the configuration
: 532 | 175.859 154.489 0.00446376 0.000492941 201470 0
: 533 Minimum Test error found - save the configuration
: 533 | 173.855 153.002 0.00448599 0.000478971 199650 0
: 534 Minimum Test error found - save the configuration
: 534 | 172.185 150.634 0.00453938 0.000504531 198273 0
: 535 Minimum Test error found - save the configuration
: 535 | 169.753 149.406 0.00451759 0.000486752 198470 0
: 536 Minimum Test error found - save the configuration
: 536 | 168.268 147.585 0.00457781 0.00053505 197885 0
: 537 Minimum Test error found - save the configuration
: 537 | 166.048 146.788 0.00455428 0.00048704 196694 0
: 538 Minimum Test error found - save the configuration
: 538 | 164.241 143.968 0.00448188 0.000482772 200045 0
: 539 Minimum Test error found - save the configuration
: 539 | 162.26 142.292 0.00448468 0.00048589 200061 0
: 540 Minimum Test error found - save the configuration
: 540 | 160.402 140.499 0.00447147 0.000482961 200576 0
: 541 Minimum Test error found - save the configuration
: 541 | 158.781 138.664 0.00457761 0.00052851 197575 0
: 542 Minimum Test error found - save the configuration
: 542 | 157.071 136.818 0.00447822 0.000482351 200207 0
: 543 Minimum Test error found - save the configuration
: 543 | 154.939 135.158 0.00448545 0.000483391 199897 0
: 544 Minimum Test error found - save the configuration
: 544 | 152.929 134.053 0.00445963 0.00048043 201046 0
: 545 Minimum Test error found - save the configuration
: 545 | 151.181 132.043 0.00448058 0.000483681 200155 0
: 546 Minimum Test error found - save the configuration
: 546 | 149.736 130.808 0.00453179 0.000525601 199691 0
: 547 Minimum Test error found - save the configuration
: 547 | 148.079 128.817 0.00447972 0.000484591 200244 0
: 548 Minimum Test error found - save the configuration
: 548 | 146.141 127.961 0.00505923 0.000729792 184782 0
: 549 Minimum Test error found - save the configuration
: 549 | 144.421 125.943 0.00496354 0.000492771 178940 0
: 550 Minimum Test error found - save the configuration
: 550 | 142.72 124.702 0.00457037 0.000485092 195825 0
: 551 Minimum Test error found - save the configuration
: 551 | 140.947 123.022 0.00452405 0.000489701 198297 0
: 552 Minimum Test error found - save the configuration
: 552 | 139.747 121.697 0.00463376 0.000492372 193172 0
: 553 Minimum Test error found - save the configuration
: 553 | 138.184 120.481 0.0045127 0.000533771 201059 0
: 554 Minimum Test error found - save the configuration
: 554 | 136.134 118.699 0.00468573 0.000525072 192277 0
: 555 Minimum Test error found - save the configuration
: 555 | 134.551 117.152 0.00463597 0.000556011 196080 0
: 556 Minimum Test error found - save the configuration
: 556 | 132.958 115.621 0.00458899 0.000495051 195411 0
: 557 Minimum Test error found - save the configuration
: 557 | 131.56 114.418 0.00470353 0.000676651 198665 0
: 558 Minimum Test error found - save the configuration
: 558 | 129.934 113.046 0.00483467 0.000486692 183994 0
: 559 Minimum Test error found - save the configuration
: 559 | 128.421 111.795 0.00452794 0.00048177 197718 0
: 560 Minimum Test error found - save the configuration
: 560 | 127.012 110.484 0.00469738 0.000536521 192268 0
: 561 Minimum Test error found - save the configuration
: 561 | 125.2 109.594 0.0050158 0.000542352 178833 0
: 562 Minimum Test error found - save the configuration
: 562 | 123.929 107.92 0.00456284 0.000487411 196298 0
: 563 Minimum Test error found - save the configuration
: 563 | 122.535 107.602 0.00477164 0.000520521 188186 0
: 564 Minimum Test error found - save the configuration
: 564 | 120.87 105.479 0.00500838 0.000677001 184699 0
: 565 Minimum Test error found - save the configuration
: 565 | 119.39 103.737 0.00469392 0.000539841 192582 0
: 566 Minimum Test error found - save the configuration
: 566 | 118.332 102.077 0.00464206 0.000543231 195178 0
: 567 Minimum Test error found - save the configuration
: 567 | 116.809 100.813 0.00460251 0.000492791 194661 0
: 568 Minimum Test error found - save the configuration
: 568 | 115.189 99.9774 0.00473796 0.000503361 188920 0
: 569 Minimum Test error found - save the configuration
: 569 | 113.822 98.9002 0.00459046 0.00052783 196917 0
: 570 Minimum Test error found - save the configuration
: 570 | 112.464 97.629 0.00466205 0.000511482 192745 0
: 571 Minimum Test error found - save the configuration
: 571 | 111.02 96.0422 0.00508988 0.000598552 178121 0
: 572 Minimum Test error found - save the configuration
: 572 | 109.823 94.635 0.00464031 0.000531191 194689 0
: 573 Minimum Test error found - save the configuration
: 573 | 108.741 94.0756 0.00520994 0.000495001 169673 0
: 574 Minimum Test error found - save the configuration
: 574 | 107.475 92.5778 0.0045509 0.000485831 196799 0
: 575 Minimum Test error found - save the configuration
: 575 | 106.014 91.438 0.00472016 0.00053362 191089 0
: 576 Minimum Test error found - save the configuration
: 576 | 104.975 90.8447 0.00463212 0.000482941 192809 0
: 577 Minimum Test error found - save the configuration
: 577 | 103.664 89.9776 0.00459455 0.000485551 194695 0
: 578 Minimum Test error found - save the configuration
: 578 | 102.706 88.2665 0.0046666 0.000485622 191343 0
: 579 Minimum Test error found - save the configuration
: 579 | 101.167 87.4833 0.0046939 0.000591011 194985 0
: 580 Minimum Test error found - save the configuration
: 580 | 99.8822 85.6993 0.00497708 0.0004945 178469 0
: 581 Minimum Test error found - save the configuration
: 581 | 99.1579 84.3812 0.00460321 0.000486331 194322 0
: 582 Minimum Test error found - save the configuration
: 582 | 97.4488 83.8925 0.0047352 0.00053611 190518 0
: 583 Minimum Test error found - save the configuration
: 583 | 96.36 83.0569 0.0047278 0.000490232 188788 0
: 584 Minimum Test error found - save the configuration
: 584 | 95.265 81.5619 0.00453404 0.000480961 197381 0
: 585 Minimum Test error found - save the configuration
: 585 | 94.0084 80.214 0.00468982 0.000555222 193489 0
: 586 Minimum Test error found - save the configuration
: 586 | 93.0001 79.4848 0.00468422 0.000541461 193108 0
: 587 Minimum Test error found - save the configuration
: 587 | 91.8018 78.9595 0.0047119 0.000603121 194705 0
: 588 Minimum Test error found - save the configuration
: 588 | 90.8724 77.3671 0.00497434 0.000495812 178630 0
: 589 Minimum Test error found - save the configuration
: 589 | 89.873 76.8898 0.0046097 0.0005641 197746 0
: 590 Minimum Test error found - save the configuration
: 590 | 88.8605 75.8351 0.00466841 0.000494332 191659 0
: 591 Minimum Test error found - save the configuration
: 591 | 87.544 75.0479 0.00459247 0.00048132 194593 0
: 592 Minimum Test error found - save the configuration
: 592 | 86.9859 73.7885 0.00450218 0.000480232 198909 0
: 593 Minimum Test error found - save the configuration
: 593 | 85.7131 73.6509 0.0045322 0.000519801 199382 0
: 594 Minimum Test error found - save the configuration
: 594 | 84.6628 72.6577 0.00474035 0.000721222 199048 0
: 595 Minimum Test error found - save the configuration
: 595 | 83.8695 71.9958 0.00454552 0.000494001 197457 0
: 596 Minimum Test error found - save the configuration
: 596 | 82.8751 70.9702 0.00453256 0.000487131 197754 0
: 597 Minimum Test error found - save the configuration
: 597 | 81.8823 70.3205 0.00467582 0.000633091 197886 0
: 598 Minimum Test error found - save the configuration
: 598 | 80.7119 68.764 0.00464998 0.000490411 192328 0
: 599 Minimum Test error found - save the configuration
: 599 | 79.8451 67.3024 0.00450583 0.00047253 198349 0
: 600 Minimum Test error found - save the configuration
: 600 | 78.9275 66.8625 0.00477449 0.000487392 186606 0
: 601 Minimum Test error found - save the configuration
: 601 | 77.9558 65.9358 0.00467631 0.00053135 193006 0
: 602 Minimum Test error found - save the configuration
: 602 | 77.1583 65.0302 0.00468441 0.000546121 193317 0
: 603 Minimum Test error found - save the configuration
: 603 | 76.3719 64.1709 0.00439642 0.000486881 204628 0
: 604 Minimum Test error found - save the configuration
: 604 | 75.4825 63.6763 0.0043727 0.00047776 205395 0
: 605 Minimum Test error found - save the configuration
: 605 | 74.6754 62.7188 0.00439215 0.000482941 204645 0
: 606 Minimum Test error found - save the configuration
: 606 | 73.6679 61.3214 0.00439496 0.00047999 204344 0
: 607 | 72.9484 61.3509 0.00435856 0.00044944 204650 1
: 608 Minimum Test error found - save the configuration
: 608 | 71.9922 60.0367 0.00436329 0.000482371 206137 0
: 609 Minimum Test error found - save the configuration
: 609 | 71.0845 59.86 0.00441391 0.000480411 203381 0
: 610 Minimum Test error found - save the configuration
: 610 | 70.2707 58.4169 0.00438471 0.00047939 204849 0
: 611 | 69.5965 59.1114 0.00437241 0.000448553 203881 1
: 612 Minimum Test error found - save the configuration
: 612 | 68.7783 57.7813 0.00439727 0.00047494 203961 0
: 613 Minimum Test error found - save the configuration
: 613 | 67.9702 56.3857 0.00442786 0.00048819 203063 0
: 614 Minimum Test error found - save the configuration
: 614 | 66.9554 55.962 0.00437121 0.000476092 205385 0
: 615 Minimum Test error found - save the configuration
: 615 | 66.0896 54.8738 0.00437837 0.000479711 205199 0
: 616 Minimum Test error found - save the configuration
: 616 | 65.305 54.5456 0.00437602 0.00047628 205142 0
: 617 Minimum Test error found - save the configuration
: 617 | 64.7336 53.0631 0.00436131 0.000472212 205703 0
: 618 Minimum Test error found - save the configuration
: 618 | 64.0463 52.1754 0.00440085 0.000489171 204516 0
: 619 Minimum Test error found - save the configuration
: 619 | 62.9796 51.77 0.00438944 0.0004799 204628 0
: 620 Minimum Test error found - save the configuration
: 620 | 62.4298 51.3811 0.00436179 0.000481911 206192 0
: 621 Minimum Test error found - save the configuration
: 621 | 61.5182 50.2678 0.00440037 0.00047642 203876 0
: 622 Minimum Test error found - save the configuration
: 622 | 60.6763 49.6494 0.00437599 0.00047396 205022 0
: 623 Minimum Test error found - save the configuration
: 623 | 59.945 48.9427 0.00438144 0.000481641 205139 0
: 624 Minimum Test error found - save the configuration
: 624 | 59.4204 48.6126 0.00438796 0.00047932 204675 0
: 625 | 58.7049 48.8708 0.00433639 0.000447081 205692 1
: 626 Minimum Test error found - save the configuration
: 626 | 58.1127 47.9302 0.00437311 0.000483311 205666 0
: 627 Minimum Test error found - save the configuration
: 627 | 57.2361 46.1759 0.00436131 0.00047379 205787 0
: 628 | 56.8427 46.5598 0.00434241 0.00044661 205350 1
: 629 | 56.3322 46.2925 0.00434837 0.000446822 205047 2
: 630 Minimum Test error found - save the configuration
: 630 | 55.5646 44.4389 0.00435888 0.00047683 206077 0
: 631 Minimum Test error found - save the configuration
: 631 | 54.4921 43.7229 0.00435437 0.00047868 206415 0
: 632 Minimum Test error found - save the configuration
: 632 | 53.912 43.5222 0.00438789 0.000481011 204767 0
: 633 Minimum Test error found - save the configuration
: 633 | 53.1613 42.6127 0.00437293 0.00046805 204872 0
: 634 Minimum Test error found - save the configuration
: 634 | 52.6334 42.267 0.00445764 0.00054546 204490 0
: 635 Minimum Test error found - save the configuration
: 635 | 51.9519 41.447 0.00447706 0.000473241 199809 0
: 636 Minimum Test error found - save the configuration
: 636 | 51.2922 40.7545 0.00446406 0.00049416 201517 0
: 637 | 50.7448 41.0224 0.0043379 0.000444451 205473 1
: 638 Minimum Test error found - save the configuration
: 638 | 50.3821 39.6385 0.00436949 0.000480642 205717 0
: 639 Minimum Test error found - save the configuration
: 639 | 49.5194 38.8287 0.00437351 0.00047472 205192 0
: 640 | 48.8673 39.0559 0.00446578 0.00051085 202279 1
: 641 Minimum Test error found - save the configuration
: 641 | 48.2708 37.8871 0.00493609 0.000509291 180717 0
: 642 | 47.6016 38.217 0.00452123 0.000445432 196281 1
: 643 Minimum Test error found - save the configuration
: 643 | 47.3277 36.8561 0.00436706 0.00047718 205662 0
: 644 Minimum Test error found - save the configuration
: 644 | 46.6916 36.5165 0.00442028 0.00048049 203057 0
: 645 Minimum Test error found - save the configuration
: 645 | 46.2916 35.7662 0.00437237 0.000479242 205490 0
: 646 Minimum Test error found - save the configuration
: 646 | 45.4897 35.4145 0.00444635 0.000487731 202091 0
: 647 Minimum Test error found - save the configuration
: 647 | 44.7844 34.9426 0.00452164 0.000486231 198245 0
: 648 Minimum Test error found - save the configuration
: 648 | 44.4185 34.8831 0.00442488 0.000482472 202922 0
: 649 Minimum Test error found - save the configuration
: 649 | 43.9598 34.5778 0.00438152 0.00048619 205374 0
: 650 Minimum Test error found - save the configuration
: 650 | 43.4521 33.8464 0.00436712 0.000475641 205577 0
: 651 Minimum Test error found - save the configuration
: 651 | 42.8572 32.9959 0.00440402 0.000484951 204130 0
: 652 Minimum Test error found - save the configuration
: 652 | 42.2216 32.7132 0.00437422 0.000477931 205324 0
: 653 Minimum Test error found - save the configuration
: 653 | 41.8441 32.0637 0.00442571 0.00048372 202943 0
: 654 Minimum Test error found - save the configuration
: 654 | 41.1905 31.4758 0.00437291 0.000482961 205658 0
: 655 Minimum Test error found - save the configuration
: 655 | 40.7088 30.9595 0.00442505 0.00047044 202296 0
: 656 Minimum Test error found - save the configuration
: 656 | 40.1488 30.7337 0.00436385 0.000477091 205827 0
: 657 Minimum Test error found - save the configuration
: 657 | 39.8487 30.0903 0.00441423 0.000477192 203198 0
: 658 Minimum Test error found - save the configuration
: 658 | 39.1887 29.6899 0.00444677 0.000489581 202164 0
: 659 Minimum Test error found - save the configuration
: 659 | 38.8429 29.169 0.00441381 0.000478071 203266 0
: 660 Minimum Test error found - save the configuration
: 660 | 38.4088 28.806 0.00461126 0.000486901 193970 0
: 661 Minimum Test error found - save the configuration
: 661 | 38.0702 28.3667 0.00436607 0.000479451 205834 0
: 662 Minimum Test error found - save the configuration
: 662 | 37.4234 28.0317 0.00437964 0.000470221 204634 0
: 663 Minimum Test error found - save the configuration
: 663 | 37.1041 27.4699 0.00437492 0.000481281 205463 0
: 664 Minimum Test error found - save the configuration
: 664 | 36.6709 27.1823 0.004403 0.000478521 203849 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.625 26.7342 0.00437731 0.000478632 205198 0
: 666 Minimum Test error found - save the configuration
: 666 | 35.7454 26.2323 0.00437626 0.000473352 204976 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.1241 25.8382 0.00471967 0.00054633 191693 0
: 668 Minimum Test error found - save the configuration
: 668 | 34.9328 25.7181 0.00458055 0.00052938 197474 0
: 669 Minimum Test error found - save the configuration
: 669 | 34.6953 25.2112 0.00445925 0.0004862 201357 0
: 670 | 34.3216 25.8794 0.0044334 0.000448181 200742 1
: 671 Minimum Test error found - save the configuration
: 671 | 34.0388 24.2333 0.00450794 0.000483541 198788 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.1868 23.7242 0.00446113 0.00047892 200894 0
: 673 | 32.9282 24.4344 0.00442838 0.000447261 200949 1
: 674 | 32.6793 23.9339 0.0044772 0.00048927 200605 2
: 675 Minimum Test error found - save the configuration
: 675 | 31.872 23.0061 0.00449459 0.000487862 199664 0
: 676 Minimum Test error found - save the configuration
: 676 | 31.7938 22.5444 0.00446446 0.000479101 200735 0
: 677 | 31.4938 22.794 0.00445567 0.00044982 199708 1
: 678 Minimum Test error found - save the configuration
: 678 | 31.1596 22.5432 0.00448348 0.000482701 199961 0
: 679 Minimum Test error found - save the configuration
: 679 | 30.5854 21.641 0.00449604 0.00049715 200056 0
: 680 Minimum Test error found - save the configuration
: 680 | 30.1136 21.1479 0.00483554 0.00049201 184182 0
: 681 Minimum Test error found - save the configuration
: 681 | 29.6706 21.0714 0.00448266 0.00049128 200432 0
: 682 Minimum Test error found - save the configuration
: 682 | 29.2494 20.6653 0.00448118 0.000478481 199865 0
: 683 Minimum Test error found - save the configuration
: 683 | 28.8896 20.3188 0.0045027 0.00049838 199784 0
: 684 Minimum Test error found - save the configuration
: 684 | 28.5024 19.9583 0.00453008 0.000522722 199633 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.0891 19.5927 0.00447385 0.000494631 201045 0
: 686 Minimum Test error found - save the configuration
: 686 | 27.8096 19.341 0.00448252 0.000475771 199663 0
: 687 | 27.7113 19.6153 0.00443326 0.000447661 200723 1
: 688 Minimum Test error found - save the configuration
: 688 | 27.2204 18.9183 0.00450925 0.00053692 201393 0
: 689 Minimum Test error found - save the configuration
: 689 | 26.914 18.478 0.00459728 0.000527262 196559 0
: 690 | 26.5965 18.6955 0.00441375 0.000483671 203558 1
: 691 | 26.4845 18.5993 0.00442532 0.00044803 201142 2
: 692 Minimum Test error found - save the configuration
: 692 | 25.6997 17.8023 0.0044827 0.000491811 200457 0
: 693 Minimum Test error found - save the configuration
: 693 | 25.5617 17.6614 0.00446801 0.000483341 200770 0
: 694 Minimum Test error found - save the configuration
: 694 | 25.0968 17.0693 0.00449368 0.000484682 199551 0
: 695 | 24.835 17.2694 0.00449836 0.000494 199782 1
: 696 Minimum Test error found - save the configuration
: 696 | 24.5945 16.8355 0.00447128 0.000518621 202396 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.1255 16.6415 0.00445077 0.000483811 201666 0
: 698 Minimum Test error found - save the configuration
: 698 | 23.7298 16.4482 0.00444214 0.00048101 201963 0
: 699 Minimum Test error found - save the configuration
: 699 | 23.4816 16.0946 0.00449512 0.000499451 200217 0
: 700 Minimum Test error found - save the configuration
: 700 | 23.2886 16.054 0.00448756 0.000486101 199927 0
: 701 Minimum Test error found - save the configuration
: 701 | 23.0308 15.6983 0.00451625 0.00052095 200235 0
: 702 | 22.6557 15.8125 0.0044257 0.000447161 201079 1
: 703 Minimum Test error found - save the configuration
: 703 | 22.3418 15.3213 0.00452094 0.000503331 199124 0
: 704 | 22.1435 15.8877 0.00446519 0.000446282 199059 1
: 705 Minimum Test error found - save the configuration
: 705 | 21.7791 14.4565 0.00447612 0.000484511 200421 0
: 706 | 21.5321 14.9139 0.00446556 0.000445651 199010 1
: 707 Minimum Test error found - save the configuration
: 707 | 21.2191 14.2506 0.00453136 0.000531181 199991 0
: 708 | 20.8662 14.8649 0.00441744 0.000446721 201475 1
: 709 | 20.6155 14.302 0.00444911 0.000449142 200002 2
: 710 Minimum Test error found - save the configuration
: 710 | 20.2879 13.865 0.00447791 0.000483952 200303 0
: 711 Minimum Test error found - save the configuration
: 711 | 19.9769 13.7848 0.00448075 0.00048384 200155 0
: 712 Minimum Test error found - save the configuration
: 712 | 19.7024 13.5507 0.00451592 0.00053514 200966 0
: 713 Minimum Test error found - save the configuration
: 713 | 19.5882 13.1535 0.0044949 0.00053231 201888 0
: 714 Minimum Test error found - save the configuration
: 714 | 19.1594 12.9859 0.0045433 0.000489962 197368 0
: 715 | 19.612 13.1355 0.00443255 0.000451761 200965 1
: 716 Minimum Test error found - save the configuration
: 716 | 19.1331 12.7438 0.0044655 0.000485441 201002 0
: 717 Minimum Test error found - save the configuration
: 717 | 18.6417 12.3172 0.00448208 0.000486601 200226 0
: 718 | 18.3331 12.3231 0.00498567 0.000450422 176396 1
: 719 Minimum Test error found - save the configuration
: 719 | 18.0218 12.2935 0.00447355 0.000487181 200684 0
: 720 Minimum Test error found - save the configuration
: 720 | 17.7877 11.8278 0.00447001 0.000484912 200748 0
: 721 | 17.4221 12.0228 0.00450639 0.00048326 198850 1
: 722 | 17.7703 12.2852 0.00457619 0.000492541 195903 2
: 723 | 17.7442 11.906 0.00444148 0.000449362 200395 3
: 724 Minimum Test error found - save the configuration
: 724 | 17.1157 11.715 0.00445943 0.00048638 201357 0
: 725 Minimum Test error found - save the configuration
: 725 | 16.839 10.9308 0.00447242 0.000482181 200489 0
: 726 | 16.5014 10.9872 0.00441347 0.00044197 201435 1
: 727 | 16.2355 11.2547 0.00445811 0.00045563 199876 2
: 728 Minimum Test error found - save the configuration
: 728 | 15.9533 10.345 0.00458779 0.000536082 197448 0
: 729 | 15.809 10.4677 0.0046358 0.00047582 192309 1
: 730 | 15.6509 10.6605 0.00449603 0.000450731 197760 2
: 731 | 15.519 10.3648 0.00443719 0.00044613 200448 3
: 732 | 15.3922 10.3728 0.00447259 0.00047455 200098 4
: 733 Minimum Test error found - save the configuration
: 733 | 15.0744 9.97643 0.00450234 0.000528201 201302 0
: 734 | 14.7468 10.0219 0.0044495 0.00045045 200048 1
: 735 Minimum Test error found - save the configuration
: 735 | 14.6095 9.89012 0.00447783 0.000483642 200291 0
: 736 Minimum Test error found - save the configuration
: 736 | 14.4017 9.58604 0.0044707 0.000485631 200749 0
: 737 | 14.176 9.80102 0.00446586 0.000445002 198963 1
: 738 | 14.0789 9.6615 0.00449494 0.000495821 200044 2
: 739 Minimum Test error found - save the configuration
: 739 | 13.8451 8.95307 0.00450531 0.00048055 198770 0
: 740 Minimum Test error found - save the configuration
: 740 | 13.5954 8.45233 0.00449088 0.000485892 199751 0
: 741 Minimum Test error found - save the configuration
: 741 | 13.5094 8.31713 0.00448668 0.00047916 199625 0
: 742 Minimum Test error found - save the configuration
: 742 | 13.2669 7.93928 0.00457827 0.000498921 196110 0
: 743 | 13.0931 8.26722 0.00447897 0.000495661 200838 1
: 744 | 13.2735 8.16368 0.00443491 0.000492931 202944 2
: 745 Minimum Test error found - save the configuration
: 745 | 12.8773 7.14418 0.00447413 0.000483461 200468 0
: 746 | 12.5866 7.46077 0.00466969 0.000453381 189740 1
: 747 Minimum Test error found - save the configuration
: 747 | 12.4457 6.80603 0.00447249 0.000480912 200422 0
: 748 | 12.4173 6.90937 0.00447939 0.00048517 200290 1
: 749 | 12.122 6.88613 0.0044454 0.000488161 202161 2
: 750 | 12.0813 7.42334 0.00442229 0.00044758 201273 3
: 751 Minimum Test error found - save the configuration
: 751 | 11.8538 6.30681 0.004471 0.000480621 200482 0
: 752 | 12.0425 7.19725 0.00443202 0.000449841 200895 1
: 753 | 11.8977 6.95604 0.004421 0.00044432 201173 2
: 754 | 11.6593 7.08657 0.00440494 0.000438261 201680 3
: 755 | 11.4087 7.56061 0.00447539 0.000496251 201049 4
: 756 Minimum Test error found - save the configuration
: 756 | 11.0605 6.04346 0.00447436 0.000492111 200892 0
: 757 Minimum Test error found - save the configuration
: 757 | 10.8744 5.87714 0.00518383 0.000698671 178366 0
: 758 | 11.0058 6.05593 0.00657802 0.000704331 136201 1
: 759 Minimum Test error found - save the configuration
: 759 | 10.898 5.52655 0.00676395 0.000753711 133106 0
: 760 Minimum Test error found - save the configuration
: 760 | 10.5174 5.21433 0.00676428 0.000738561 132764 0
: 761 | 10.5664 5.56506 0.00507696 0.000495981 174635 1
: 762 | 10.3725 5.57748 0.00449713 0.000443291 197344 2
: 763 | 10.1821 5.31622 0.00490775 0.00044946 179441 3
: 764 Minimum Test error found - save the configuration
: 764 | 10.0433 4.88912 0.00438914 0.000483271 204820 0
: 765 Minimum Test error found - save the configuration
: 765 | 10.0903 4.87479 0.00438012 0.00047515 204867 0
: 766 | 10.0374 4.88718 0.00432738 0.00043982 205785 1
: 767 Minimum Test error found - save the configuration
: 767 | 9.76918 4.2924 0.00438173 0.000480792 205079 0
: 768 Minimum Test error found - save the configuration
: 768 | 9.66312 4.18639 0.00436368 0.000474551 205702 0
: 769 | 9.49591 4.6502 0.00438621 0.000450901 203288 1
: 770 Minimum Test error found - save the configuration
: 770 | 9.22512 4.04131 0.00436304 0.000488941 206500 0
: 771 Minimum Test error found - save the configuration
: 771 | 9.15308 3.79753 0.00455004 0.00049771 197417 0
: 772 | 9.13084 3.85444 0.00434447 0.00044951 205394 1
: 773 Minimum Test error found - save the configuration
: 773 | 8.81592 3.32432 0.00437451 0.000481022 205471 0
: 774 | 8.6646 3.66002 0.00438932 0.000447091 202931 1
: 775 | 8.62631 3.63331 0.00432589 0.000445041 206141 2
: 776 Minimum Test error found - save the configuration
: 776 | 8.49472 3.32257 0.00436919 0.000473011 205329 0
: 777 | 8.30739 3.4463 0.00435558 0.000448741 204769 1
: 778 | 8.25616 3.66623 0.00434288 0.00044662 205325 2
: 779 Minimum Test error found - save the configuration
: 779 | 8.29259 3.27184 0.00438446 0.000472751 204514 0
: 780 Minimum Test error found - save the configuration
: 780 | 8.17934 3.14063 0.00437101 0.000478361 205516 0
: 781 Minimum Test error found - save the configuration
: 781 | 7.98039 2.97049 0.00437594 0.000486651 205693 0
: 782 | 7.8829 2.97114 0.0043524 0.000446721 204830 1
: 783 Minimum Test error found - save the configuration
: 783 | 7.68326 2.62343 0.00438562 0.000499701 205872 0
: 784 | 7.54948 3.03918 0.00435342 0.000441181 204487 1
: 785 | 7.54863 3.05166 0.0043184 0.000446472 206615 2
: 786 | 7.48775 2.84499 0.00434118 0.000448892 205535 3
: 787 | 7.34936 2.89195 0.00434389 0.00044043 204947 4
: 788 Minimum Test error found - save the configuration
: 788 | 7.21723 2.48247 0.00438051 0.00048155 205183 0
: 789 | 7.10324 2.69836 0.00434351 0.000445311 205223 1
: 790 | 7.07235 2.87597 0.00431941 0.000438491 206137 2
: 791 Minimum Test error found - save the configuration
: 791 | 7.06805 2.36028 0.00453048 0.000483231 197665 0
: 792 | 6.96689 2.64858 0.0043764 0.000474561 205032 1
: 793 | 6.87977 2.62492 0.00448128 0.000450351 198465 2
: 794 | 6.75668 2.74079 0.00451026 0.000454461 197249 3
: 795 | 6.75251 2.5672 0.0045485 0.00048599 196923 4
: 796 Minimum Test error found - save the configuration
: 796 | 6.56603 2.23709 0.00440291 0.00047583 203714 0
: 797 | 6.65861 2.43884 0.00435265 0.000451921 205090 1
: 798 | 6.99346 2.87967 0.00433383 0.000446851 205815 2
: 799 Minimum Test error found - save the configuration
: 799 | 6.68855 2.13134 0.0045135 0.00048435 198553 0
: 800 | 6.50539 2.45464 0.00452222 0.000484951 198154 1
: 801 | 6.27195 2.56757 0.00449389 0.000452091 197932 2
: 802 | 6.17499 2.50369 0.00451385 0.000479611 198303 3
: 803 | 6.19908 2.47285 0.00446889 0.00044792 198957 4
: 804 | 5.97989 2.25689 0.00436039 0.00045041 204605 5
: 805 Minimum Test error found - save the configuration
: 805 | 5.8697 1.9762 0.00441836 0.000478992 203078 0
: 806 Minimum Test error found - save the configuration
: 806 | 5.75469 1.88745 0.00442071 0.00048399 203215 0
: 807 Minimum Test error found - save the configuration
: 807 | 5.68251 1.77536 0.00456513 0.000486751 196156 0
: 808 | 5.56581 2.31241 0.00455027 0.000480621 196577 1
: 809 | 5.71971 1.8706 0.00451359 0.000453151 197023 2
: 810 | 5.91514 2.68641 0.00451962 0.0004787 197975 3
: 811 | 5.61847 2.02267 0.00447438 0.00044868 198723 4
: 812 | 5.59746 3.35495 0.00451657 0.000483252 198348 5
: 813 | 5.5656 1.95003 0.00445683 0.0004511 199714 6
: 814 | 5.31757 2.25069 0.00452867 0.000485341 197857 7
: 815 Minimum Test error found - save the configuration
: 815 | 5.32502 1.66577 0.0044529 0.000486411 201690 0
: 816 | 5.26395 2.01274 0.00448534 0.000485921 200029 1
: 817 | 5.15733 2.44204 0.00457201 0.000451581 194155 2
: 818 | 5.14214 1.94113 0.00453851 0.000448791 195613 3
: 819 | 5.08429 2.72134 0.00442047 0.000448341 201403 4
: 820 | 5.18382 1.85748 0.00453917 0.000479991 197084 5
: 821 | 4.95531 1.97209 0.00450236 0.000451072 197468 6
: 822 | 5.02528 1.92757 0.00454211 0.00045022 195509 7
: 823 | 4.78424 2.02718 0.00453206 0.000452781 196113 8
: 824 | 4.86029 2.4914 0.004559 0.000493851 196795 9
: 825 | 4.60688 1.84562 0.00453534 0.000463061 196450 10
: 826 | 4.6485 2.12162 0.00453351 0.000441931 195524 11
: 827 | 4.68267 2.1654 0.00457567 0.000478691 195266 12
: 828 | 4.67523 1.97762 0.00452054 0.000449592 196514 13
: 829 | 4.53293 2.36971 0.004595 0.00048442 194620 14
: 830 | 4.42362 1.85406 0.00454001 0.000449142 195558 15
: 831 | 4.35332 2.77031 0.00455701 0.00047682 196069 16
: 832 | 4.43752 2.17014 0.0045317 0.000449471 195971 17
: 833 | 4.2965 1.96619 0.00450442 0.00044154 196905 18
: 834 | 4.12807 1.71428 0.00451558 0.00045747 197136 19
: 835 | 4.10655 2.58655 0.00452767 0.000451291 196253 20
: 836 | 4.43946 2.20255 0.00458033 0.000482961 195247 21
:
: Elapsed time for training with 1000 events: 3.83 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00867 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.858 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.17 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.254e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.03228e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0447 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.038 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00196 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.049 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.927 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0198 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00253 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0396 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00452 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0021 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000411 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0507 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00597 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024491 1.1433 [ -3.3781 5.7307 ]
: var2: 0.070022 1.0760 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.931 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.104 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -0.946 -0.0929 5.80 1.62 | 3.206 3.217
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.185 0.00136 2.08 1.15 | 3.337 3.324
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:566
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.