Logo ROOT  
Reference Guide
RooStats::HypoTestInverter Class Reference

A class for performing a hypothesis test inversion by scanning the hypothesis test results of a HypoTestCalculator for various values of the parameter of interest.

By looking at the confidence level curve of the result, an upper limit can be derived by computing the intersection of the confidence level curve with the desired confidence level. The class implements the RooStats::IntervalCalculator interface, and returns a RooStats::HypoTestInverterResult. The result is a SimpleInterval, which via the method UpperLimit() returns to the user the upper limit value.

Scanning options

The HypoTestInverter implements various options for performing the scan.

CLs presciption

The class can scan the CLs+b values or alternatively CLs. For the latter, call HypoTestInverter::UseCLs().

Definition at line 36 of file HypoTestInverter.h.

Public Types

enum  ECalculatorType { kUndefined = 0 , kHybrid = 1 , kFrequentist = 2 , kAsymptotic = 3 }
 

Public Member Functions

 HypoTestInverter ()
 default constructor (doesn't do anything) More...
 
 HypoTestInverter (AsymptoticCalculator &hc, RooRealVar *scannedVariable, double size=0.05)
 Constructor from a reference to a AsymptoticCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model. More...
 
 HypoTestInverter (FrequentistCalculator &hc, RooRealVar *scannedVariable, double size=0.05)
 Constructor from a reference to a FrequentistCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model. More...
 
 HypoTestInverter (HybridCalculator &hc, RooRealVar *scannedVariable=0, double size=0.05)
 Constructor from a reference to a HybridCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model. More...
 
 HypoTestInverter (HypoTestCalculatorGeneric &hc, RooRealVar *scannedVariable=0, double size=0.05)
 Constructor from a HypoTestCalculatorGeneric The HypoTest calculator must be a FrequentistCalculator or HybridCalculator type Other type of calculators are not supported. More...
 
 HypoTestInverter (RooAbsData &data, ModelConfig &sb, ModelConfig &b, RooRealVar *scannedVariable=0, ECalculatorType type=kFrequentist, double size=0.05)
 Constructor from a model for B model and a model for S+B. More...
 
virtual ~HypoTestInverter ()
 destructor (delete the HypoTestInverterResult) More...
 
void Clear ()
 delete contained result and graph More...
 
virtual Double_t ConfidenceLevel () const
 Get the Confidence level for the test. More...
 
HypoTestCalculatorGenericGetHypoTestCalculator () const
 
virtual HypoTestInverterResultGetInterval () const
 Run a fixed scan or the automatic scan depending on the configuration. More...
 
SamplingDistributionGetLowerLimitDistribution (bool rebuild=false, int nToys=100)
 get the distribution of lower limit if rebuild = false (default) it will re-use the results of the scan done for obtained the observed limit and no extra toys will be generated if rebuild a new set of B toys will be done and the procedure will be repeated for each toy More...
 
TestStatisticGetTestStatistic () const
 return the test statistic which is or will be used by the class More...
 
SamplingDistributionGetUpperLimitDistribution (bool rebuild=false, int nToys=100)
 get the distribution of lower limit if rebuild = false (default) it will re-use the results of the scan done for obtained the observed limit and no extra toys will be generated if rebuild a new set of B toys will be done and the procedure will be repeated for each toy The nuisance parameter value used for rebuild is the current one in the model so it is user responsibility to set to the desired value (nomi More...
 
SamplingDistributionRebuildDistributions (bool isUpper=true, int nToys=100, TList *clsDist=0, TList *clsbDist=0, TList *clbDist=0, const char *outputfile="HypoTestInverterRebuiltDist.root")
 rebuild the sampling distributions by generating some toys and find for each of them a new upper limit Return the upper limit distribution and optionally also the pValue distributions for Cls, Clsb and Clbxs as a TList for each scanned point The method uses the present parameter value. More...
 
bool RunFixedScan (int nBins, double xMin, double xMax, bool scanLog=false) const
 Run a fixed scan. More...
 
bool RunLimit (double &limit, double &limitErr, double absTol=0, double relTol=0, const double *hint=0) const
 Run an automatic scan until the desired accuracy is reached. More...
 
bool RunOnePoint (double thisX, bool adaptive=false, double clTarget=-1) const
 run only one point at the given POI value More...
 
void SetAutoScan ()
 Use automatic scanning, i.e. adaptive. More...
 
virtual void SetConfidenceLevel (Double_t cl)
 set the confidence level for the interval (e.g. 0.95 for a 95% Confidence Interval) More...
 
virtual void SetData (RooAbsData &)
 Set the DataSet ( add to the the workspace if not already there ?) More...
 
void SetFixedScan (int nBins, double xMin=1, double xMax=-1, bool scanLog=false)
 Set up to perform a fixed scan. More...
 
void SetMaximumToys (int ntoys)
 
virtual void SetModel (const ModelConfig &)
 Set the Model. More...
 
void SetNumErr (double err)
 
virtual void SetTestSize (Double_t size)
 set the size of the test (rate of Type I error) ( e.g. 0.05 for a 95% Confidence Interval) More...
 
bool SetTestStatistic (TestStatistic &stat)
 set the test statistic to use More...
 
void SetVerbose (int level=1)
 
virtual Double_t Size () const
 Get the size of the test (eg. rate of Type I error) More...
 
void UseCLs (bool on=true)
 
- Public Member Functions inherited from RooStats::IntervalCalculator
virtual ~IntervalCalculator ()
 
virtual Double_t ConfidenceLevel () const =0
 Get the Confidence level for the test. More...
 
virtual ConfIntervalGetInterval () const =0
 Main interface to get a ConfInterval, pure virtual. More...
 
virtual void SetConfidenceLevel (Double_t cl)=0
 set the confidence level for the interval (e.g. 0.95 for a 95% Confidence Interval) More...
 
virtual void SetData (RooAbsData &)=0
 Set the DataSet ( add to the the workspace if not already there ?) More...
 
virtual void SetModel (const ModelConfig &)=0
 Set the Model. More...
 
virtual void SetTestSize (Double_t size)=0
 set the size of the test (rate of Type I error) ( e.g. 0.05 for a 95% Confidence Interval) More...
 
virtual Double_t Size () const =0
 Get the size of the test (eg. rate of Type I error) More...
 

Static Public Member Functions

static void SetCloseProof (Bool_t flag)
 set flag to close proof for every new run More...
 

Protected Member Functions

 HypoTestInverter (const HypoTestInverter &rhs)
 copy-constructor NOTE: this class does not copy the contained result and the HypoTestCalculator, but only the pointers It requires the original HTI to be alive More...
 
void CreateResults () const
 create a new HypoTestInverterResult to hold all computed results More...
 
HypoTestResultEval (HypoTestCalculatorGeneric &hc, bool adaptive, double clsTarget) const
 Run the Hypothesis test at a previous configured point (internal function called by RunOnePoint) More...
 
HypoTestInverteroperator= (const HypoTestInverter &rhs)
 assignment operator NOTE: this class does not copy the contained result and the HypoTestCalculator, but only the pointers It requires the original HTI to be alive More...
 

Static Protected Member Functions

static void CheckInputModels (const HypoTestCalculatorGeneric &hc, const RooRealVar &scanVar)
 check the model given the given hypotestcalculator More...
 
static RooRealVarGetVariableToScan (const HypoTestCalculatorGeneric &hc)
 get the variable to scan try first with null model if not go to alternate model More...
 

Private Attributes

ECalculatorType fCalcType
 
HypoTestCalculatorGenericfCalculator0
 
std::unique_ptr< HypoTestCalculatorGenericfHC
 
std::unique_ptr< TGraphErrorsfLimitPlot
 
int fMaxToys
 
int fNBins
 
double fNumErr
 
HypoTestInverterResultfResults
 
bool fScanLog
 
RooRealVarfScannedVariable
 pointer to the generic hypotest calculator used More...
 
double fSize
 
int fTotalToysRun
 plot of limits More...
 
bool fUseCLs
 
int fVerbose
 
double fXmax
 
double fXmin
 

Static Private Attributes

static double fgAbsAccuracy = 0.05
 
static std::string fgAlgo = "logSecant"
 
static double fgCLAccuracy = 0.005
 
static bool fgCloseProof = false
 
static unsigned int fgNToys = 500
 
static double fgRelAccuracy = 0.05
 

#include <RooStats/HypoTestInverter.h>

Inheritance diagram for RooStats::HypoTestInverter:
[legend]

Member Enumeration Documentation

◆ ECalculatorType

Enumerator
kUndefined 
kHybrid 
kFrequentist 
kAsymptotic 

Definition at line 40 of file HypoTestInverter.h.

Constructor & Destructor Documentation

◆ HypoTestInverter() [1/7]

HypoTestInverter::HypoTestInverter ( )

default constructor (doesn't do anything)

Definition at line 168 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [2/7]

HypoTestInverter::HypoTestInverter ( HypoTestCalculatorGeneric hc,
RooRealVar scannedVariable = 0,
double  size = 0.05 
)

Constructor from a HypoTestCalculatorGeneric The HypoTest calculator must be a FrequentistCalculator or HybridCalculator type Other type of calculators are not supported.

The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model

Definition at line 193 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [3/7]

HypoTestInverter::HypoTestInverter ( HybridCalculator hc,
RooRealVar scannedVariable = 0,
double  size = 0.05 
)

Constructor from a reference to a HybridCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model.

Definition at line 246 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [4/7]

HypoTestInverter::HypoTestInverter ( FrequentistCalculator hc,
RooRealVar scannedVariable,
double  size = 0.05 
)

Constructor from a reference to a FrequentistCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model.

Definition at line 279 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [5/7]

HypoTestInverter::HypoTestInverter ( AsymptoticCalculator hc,
RooRealVar scannedVariable,
double  size = 0.05 
)

Constructor from a reference to a AsymptoticCalculator The calculator must be created before by using the S+B model for the null and the B model for the alt If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model.

Definition at line 311 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [6/7]

HypoTestInverter::HypoTestInverter ( RooAbsData data,
ModelConfig sbModel,
ModelConfig bModel,
RooRealVar scannedVariable = 0,
ECalculatorType  type = kFrequentist,
double  size = 0.05 
)

Constructor from a model for B model and a model for S+B.

An HypoTestCalculator (Hybrid of Frequentis) will be created using the S+B model as the null and the B model as the alternate If no variable to scan are given they are assumed to be the first variable from the parameter of interests of the null model

Definition at line 344 of file HypoTestInverter.cxx.

◆ ~HypoTestInverter()

HypoTestInverter::~HypoTestInverter ( )
virtual

destructor (delete the HypoTestInverterResult)

Definition at line 417 of file HypoTestInverter.cxx.

◆ HypoTestInverter() [7/7]

HypoTestInverter::HypoTestInverter ( const HypoTestInverter rhs)
protected

copy-constructor NOTE: this class does not copy the contained result and the HypoTestCalculator, but only the pointers It requires the original HTI to be alive

Definition at line 380 of file HypoTestInverter.cxx.

Member Function Documentation

◆ CheckInputModels()

void HypoTestInverter::CheckInputModels ( const HypoTestCalculatorGeneric hc,
const RooRealVar scanVar 
)
staticprotected

check the model given the given hypotestcalculator

Definition at line 128 of file HypoTestInverter.cxx.

◆ Clear()

void HypoTestInverter::Clear ( )

delete contained result and graph

Definition at line 450 of file HypoTestInverter.cxx.

◆ ConfidenceLevel()

virtual Double_t RooStats::HypoTestInverter::ConfidenceLevel ( ) const
inlinevirtual

Get the Confidence level for the test.

Implements RooStats::IntervalCalculator.

Definition at line 117 of file HypoTestInverter.h.

◆ CreateResults()

void HypoTestInverter::CreateResults ( ) const
protected

create a new HypoTestInverterResult to hold all computed results

Definition at line 459 of file HypoTestInverter.cxx.

◆ Eval()

HypoTestResult * HypoTestInverter::Eval ( HypoTestCalculatorGeneric hc,
bool  adaptive,
double  clsTarget 
) const
protected

Run the Hypothesis test at a previous configured point (internal function called by RunOnePoint)

Definition at line 522 of file HypoTestInverter.cxx.

◆ GetHypoTestCalculator()

HypoTestCalculatorGeneric * RooStats::HypoTestInverter::GetHypoTestCalculator ( ) const
inline

Definition at line 124 of file HypoTestInverter.h.

◆ GetInterval()

HypoTestInverterResult * HypoTestInverter::GetInterval ( ) const
virtual

Run a fixed scan or the automatic scan depending on the configuration.

Return if needed a copy of the result object which will be managed by the user.

Implements RooStats::IntervalCalculator.

Definition at line 491 of file HypoTestInverter.cxx.

◆ GetLowerLimitDistribution()

SamplingDistribution * HypoTestInverter::GetLowerLimitDistribution ( bool  rebuild = false,
int  nToys = 100 
)

get the distribution of lower limit if rebuild = false (default) it will re-use the results of the scan done for obtained the observed limit and no extra toys will be generated if rebuild a new set of B toys will be done and the procedure will be repeated for each toy

Definition at line 1038 of file HypoTestInverter.cxx.

◆ GetTestStatistic()

TestStatistic * HypoTestInverter::GetTestStatistic ( void  ) const

return the test statistic which is or will be used by the class

Definition at line 426 of file HypoTestInverter.cxx.

◆ GetUpperLimitDistribution()

SamplingDistribution * HypoTestInverter::GetUpperLimitDistribution ( bool  rebuild = false,
int  nToys = 100 
)

get the distribution of lower limit if rebuild = false (default) it will re-use the results of the scan done for obtained the observed limit and no extra toys will be generated if rebuild a new set of B toys will be done and the procedure will be repeated for each toy The nuisance parameter value used for rebuild is the current one in the model so it is user responsibility to set to the desired value (nomi

Definition at line 1065 of file HypoTestInverter.cxx.

◆ GetVariableToScan()

RooRealVar * HypoTestInverter::GetVariableToScan ( const HypoTestCalculatorGeneric hc)
staticprotected

get the variable to scan try first with null model if not go to alternate model

Definition at line 107 of file HypoTestInverter.cxx.

◆ operator=()

HypoTestInverter & HypoTestInverter::operator= ( const HypoTestInverter rhs)
protected

assignment operator NOTE: this class does not copy the contained result and the HypoTestCalculator, but only the pointers It requires the original HTI to be alive

Definition at line 395 of file HypoTestInverter.cxx.

◆ RebuildDistributions()

SamplingDistribution * HypoTestInverter::RebuildDistributions ( bool  isUpper = true,
int  nToys = 100,
TList clsDist = 0,
TList clsbDist = 0,
TList clbDist = 0,
const char *  outputfile = "HypoTestInverterRebuiltDist.root" 
)

rebuild the sampling distributions by generating some toys and find for each of them a new upper limit Return the upper limit distribution and optionally also the pValue distributions for Cls, Clsb and Clbxs as a TList for each scanned point The method uses the present parameter value.

It is user responsibility to give the current parameters to rebuild the distributions It returns a upper or lower limit distribution depending on the isUpper flag, however it computes also the lower limit distribution and it is saved in the output file as an histogram

Definition at line 1097 of file HypoTestInverter.cxx.

◆ RunFixedScan()

bool HypoTestInverter::RunFixedScan ( int  nBins,
double  xMin,
double  xMax,
bool  scanLog = false 
) const

Run a fixed scan.

Run a Fixed scan in npoints between min and max.

Parameters
[in]nBinsNumber of points to scan.
[in]xMinLower limit of range to be scanned.
[in]xMaxUpper limit of range to be scanned.
[in]scanLogRun in logarithmic steps along x.

Definition at line 605 of file HypoTestInverter.cxx.

◆ RunLimit()

bool HypoTestInverter::RunLimit ( double limit,
double limitErr,
double  absAccuracy = 0,
double  relAccuracy = 0,
const double hint = 0 
) const

Run an automatic scan until the desired accuracy is reached.

Start by default from the full interval (min,max) of the POI and then via bisection find the line crossing the target line. Optionally, a hint can be provided and the scan will be done closer to that value. If by bisection the desired accuracy will not be reached, a fit to the points is performed.

Parameters
[out]limitThe limit.
[out]limitErrThe error of the limit.
[in]absAccuracyDesired absolute accuracy.
[in]relAccuracyDesired relative accuracy.
[in]hintHint to start from or nullptr for no hint.

Definition at line 772 of file HypoTestInverter.cxx.

◆ RunOnePoint()

bool HypoTestInverter::RunOnePoint ( double  thisX,
bool  adaptive = false,
double  clTarget = -1 
) const

run only one point at the given POI value

Definition at line 672 of file HypoTestInverter.cxx.

◆ SetAutoScan()

void RooStats::HypoTestInverter::SetAutoScan ( )
inline

Use automatic scanning, i.e. adaptive.

Definition at line 89 of file HypoTestInverter.h.

◆ SetCloseProof()

void HypoTestInverter::SetCloseProof ( Bool_t  flag)
static

set flag to close proof for every new run

Definition at line 99 of file HypoTestInverter.cxx.

◆ SetConfidenceLevel()

virtual void RooStats::HypoTestInverter::SetConfidenceLevel ( Double_t  cl)
inlinevirtual

set the confidence level for the interval (e.g. 0.95 for a 95% Confidence Interval)

Implements RooStats::IntervalCalculator.

Definition at line 113 of file HypoTestInverter.h.

◆ SetData()

void HypoTestInverter::SetData ( RooAbsData )
virtual

Set the DataSet ( add to the the workspace if not already there ?)

Implements RooStats::IntervalCalculator.

Definition at line 1084 of file HypoTestInverter.cxx.

◆ SetFixedScan()

void RooStats::HypoTestInverter::SetFixedScan ( int  nBins,
double  xMin = 1,
double  xMax = -1,
bool  scanLog = false 
)
inline

Set up to perform a fixed scan.

Parameters
[in]nBinsNumber of points to scan.
[in]xMinLower limit of range to be scanned.
[in]xMaxUpper limit of range to be scanned.
[in]scanLogRun in logarithmic steps along x.

Definition at line 82 of file HypoTestInverter.h.

◆ SetMaximumToys()

void RooStats::HypoTestInverter::SetMaximumToys ( int  ntoys)
inline

Definition at line 144 of file HypoTestInverter.h.

◆ SetModel()

virtual void RooStats::HypoTestInverter::SetModel ( const ModelConfig )
inlinevirtual

Set the Model.

Implements RooStats::IntervalCalculator.

Definition at line 108 of file HypoTestInverter.h.

◆ SetNumErr()

void RooStats::HypoTestInverter::SetNumErr ( double  err)
inline

Definition at line 147 of file HypoTestInverter.h.

◆ SetTestSize()

virtual void RooStats::HypoTestInverter::SetTestSize ( Double_t  size)
inlinevirtual

set the size of the test (rate of Type I error) ( e.g. 0.05 for a 95% Confidence Interval)

Implements RooStats::IntervalCalculator.

Definition at line 111 of file HypoTestInverter.h.

◆ SetTestStatistic()

bool HypoTestInverter::SetTestStatistic ( TestStatistic stat)

set the test statistic to use

Definition at line 438 of file HypoTestInverter.cxx.

◆ SetVerbose()

void RooStats::HypoTestInverter::SetVerbose ( int  level = 1)
inline

Definition at line 141 of file HypoTestInverter.h.

◆ Size()

virtual Double_t RooStats::HypoTestInverter::Size ( ) const
inlinevirtual

Get the size of the test (eg. rate of Type I error)

Implements RooStats::IntervalCalculator.

Definition at line 115 of file HypoTestInverter.h.

◆ UseCLs()

void RooStats::HypoTestInverter::UseCLs ( bool  on = true)
inline

Definition at line 104 of file HypoTestInverter.h.

Member Data Documentation

◆ fCalcType

ECalculatorType RooStats::HypoTestInverter::fCalcType
private

Definition at line 197 of file HypoTestInverter.h.

◆ fCalculator0

HypoTestCalculatorGeneric* RooStats::HypoTestInverter::fCalculator0
private

Definition at line 188 of file HypoTestInverter.h.

◆ fgAbsAccuracy

double HypoTestInverter::fgAbsAccuracy = 0.05
staticprivate

Definition at line 175 of file HypoTestInverter.h.

◆ fgAlgo

std::string HypoTestInverter::fgAlgo = "logSecant"
staticprivate

Definition at line 178 of file HypoTestInverter.h.

◆ fgCLAccuracy

double HypoTestInverter::fgCLAccuracy = 0.005
staticprivate

Definition at line 174 of file HypoTestInverter.h.

◆ fgCloseProof

bool HypoTestInverter::fgCloseProof = false
staticprivate

Definition at line 177 of file HypoTestInverter.h.

◆ fgNToys

unsigned int HypoTestInverter::fgNToys = 500
staticprivate

Definition at line 173 of file HypoTestInverter.h.

◆ fgRelAccuracy

double HypoTestInverter::fgRelAccuracy = 0.05
staticprivate

Definition at line 176 of file HypoTestInverter.h.

◆ fHC

std::unique_ptr<HypoTestCalculatorGeneric> RooStats::HypoTestInverter::fHC
private

Definition at line 189 of file HypoTestInverter.h.

◆ fLimitPlot

std::unique_ptr<TGraphErrors> RooStats::HypoTestInverter::fLimitPlot
mutableprivate

Definition at line 181 of file HypoTestInverter.h.

◆ fMaxToys

int RooStats::HypoTestInverter::fMaxToys
private

Definition at line 186 of file HypoTestInverter.h.

◆ fNBins

int RooStats::HypoTestInverter::fNBins
private

Definition at line 198 of file HypoTestInverter.h.

◆ fNumErr

double RooStats::HypoTestInverter::fNumErr
private

Definition at line 201 of file HypoTestInverter.h.

◆ fResults

HypoTestInverterResult* RooStats::HypoTestInverter::fResults
mutableprivate

Definition at line 191 of file HypoTestInverter.h.

◆ fScanLog

bool RooStats::HypoTestInverter::fScanLog
private

Definition at line 194 of file HypoTestInverter.h.

◆ fScannedVariable

RooRealVar* RooStats::HypoTestInverter::fScannedVariable
private

pointer to the generic hypotest calculator used

Definition at line 190 of file HypoTestInverter.h.

◆ fSize

double RooStats::HypoTestInverter::fSize
private

Definition at line 195 of file HypoTestInverter.h.

◆ fTotalToysRun

int RooStats::HypoTestInverter::fTotalToysRun
mutableprivate

plot of limits

Definition at line 185 of file HypoTestInverter.h.

◆ fUseCLs

bool RooStats::HypoTestInverter::fUseCLs
private

Definition at line 193 of file HypoTestInverter.h.

◆ fVerbose

int RooStats::HypoTestInverter::fVerbose
private

Definition at line 196 of file HypoTestInverter.h.

◆ fXmax

double RooStats::HypoTestInverter::fXmax
private

Definition at line 200 of file HypoTestInverter.h.

◆ fXmin

double RooStats::HypoTestInverter::fXmin
private

Definition at line 199 of file HypoTestInverter.h.

Libraries for RooStats::HypoTestInverter:
[legend]

The documentation for this class was generated from the following files: