A class to process the entries of a TTree in parallel.

By means of its Process method, ROOT::TTreeProcessorMT provides a way to process the entries of a TTree in parallel. When invoking TTreeProcessor::Process, the user passes a function whose only parameter is a TTreeReader. The function iterates on a subrange of entries by using that TTreeReader.

The implementation of ROOT::TTreeProcessorMT parallelizes the processing of the subranges, each corresponding to a cluster in the TTree. This is possible thanks to the use of a ROOT::TThreadedObject, so that each thread works with its own TFile and TTree objects.

Definition at line 79 of file TTreeProcessorMT.hxx.

Public Member Functions
	TTreeProcessorMT (const std::vector< std::string_view > &filenames, std::string_view treename="", UInt_t nThreads=0u, const std::pair< Long64_t, Long64_t > &globalRange={0, std::numeric_limits< Long64_t >::max()})

	TTreeProcessorMT (std::initializer_list< std::string_view > filenames, std::string_view treename="", UInt_t nThreads=0u, const std::pair< Long64_t, Long64_t > &globalRange={0, std::numeric_limits< Long64_t >::max()})

	TTreeProcessorMT (std::string_view filename, std::string_view treename="", UInt_t nThreads=0u, const std::pair< Long64_t, Long64_t > &globalRange={0, std::numeric_limits< Long64_t >::max()})

	TTreeProcessorMT (TTree &tree, const TEntryList &entries, UInt_t nThreads=0u)
	Constructor based on a TTree and a TEntryList.

	TTreeProcessorMT (TTree &tree, UInt_t nThreads=0u, const std::pair< Long64_t, Long64_t > &globalRange={0, std::numeric_limits< Long64_t >::max()})

void	Process (std::function< void(TTreeReader &)> func)
	Process the entries of a TTree in parallel.

Static Public Member Functions
static unsigned int	GetTasksPerWorkerHint ()
	Retrieve the current value for the desired number of tasks per worker.

static void	SetTasksPerWorkerHint (unsigned int m)
	Set the hint for the desired number of tasks created per worker.

Private Member Functions
std::vector< std::string >	FindTreeNames ()
	Retrieve the names of the TTrees in each of the input files, throw if a TTree cannot be found.

Private Attributes
TEntryList	fEntryList
	User-defined selection of entry numbers to be processed, empty if none was provided.

const std::vector< std::string >	fFileNames
	Names of the files.

ROOT::TreeUtils::RFriendInfo	fFriendInfo

std::pair< Long64_t, Long64_t >	fGlobalRange {0, std::numeric_limits<Long64_t>::max()}

ROOT::TThreadExecutor	fPool
	! Thread pool for processing.

const std::vector< std::string >	fTreeNames
	TTree names (always same size and ordering as fFileNames)

ROOT::TThreadedObject< ROOT::Internal::TTreeView >	fTreeView {TNumSlots{ROOT::GetThreadPoolSize()}}
	Thread-local TreeViews.

Static Private Attributes
static unsigned int	fgTasksPerWorkerHint = 10U

#include <ROOT/TTreeProcessorMT.hxx>

Constructor & Destructor Documentation

◆ TTreeProcessorMT() [1/5]

ROOT::TTreeProcessorMT::TTreeProcessorMT	(	std::string_view	filename,
		std::string_view	treename = `""`,
		UInt_t	nThreads = `0u`,
		const std::pair< Long64_t, Long64_t > &	globalRange = `{0, std::numeric_limits< Long64_t >::max()}`
	)

◆ TTreeProcessorMT() [2/5]

ROOT::TTreeProcessorMT::TTreeProcessorMT	(	const std::vector< std::string_view > &	filenames,
		std::string_view	treename = `""`,
		UInt_t	nThreads = `0u`,
		const std::pair< Long64_t, Long64_t > &	globalRange = `{0, std::numeric_limits< Long64_t >::max()}`
	)

◆ TTreeProcessorMT() [3/5]

ROOT::TTreeProcessorMT::TTreeProcessorMT	(	std::initializer_list< std::string_view >	filenames,
		std::string_view	treename = `""`,
		UInt_t	nThreads = `0u`,
		const std::pair< Long64_t, Long64_t > &	globalRange = `{0, std::numeric_limits<Long64_t>::max()}`
	)

inline

Definition at line 103 of file TTreeProcessorMT.hxx.

◆ TTreeProcessorMT() [4/5]

TTreeProcessorMT::TTreeProcessorMT	(	TTree &	tree,
		const TEntryList &	entries,
		UInt_t	nThreads = `0u`
	)

Constructor based on a TTree and a TEntryList.

Parameters

[in]	tree	Tree or chain of files containing the tree to process.
[in]	entries	List of entry numbers to process.
[in]	nThreads	Number of threads to create in the underlying thread-pool. The semantics of this argument are the same as for TThreadExecutor.

Definition at line 410 of file TTreeProcessorMT.cxx.

◆ TTreeProcessorMT() [5/5]

ROOT::TTreeProcessorMT::TTreeProcessorMT	(	TTree &	tree,
		UInt_t	nThreads = `0u`,
		const std::pair< Long64_t, Long64_t > &	globalRange = `{0, std::numeric_limits< Long64_t >::max()}`
	)

Member Function Documentation

◆ FindTreeNames()

std::vector< std::string > TTreeProcessorMT::FindTreeNames ( )

private

Retrieve the names of the TTrees in each of the input files, throw if a TTree cannot be found.

Definition at line 326 of file TTreeProcessorMT.cxx.

◆ GetTasksPerWorkerHint()

unsigned int TTreeProcessorMT::GetTasksPerWorkerHint ( )

static

Retrieve the current value for the desired number of tasks per worker.

Returns: The desired number of tasks to be created per worker. TTreeProcessorMT uses this value as an hint.

Definition at line 526 of file TTreeProcessorMT.cxx.

◆ Process()

void TTreeProcessorMT::Process ( std::function< void(TTreeReader &)> func )

Process the entries of a TTree in parallel.

The user-provided function receives a TTreeReader which can be used to iterate on a subrange of entries

TTreeProcessorMT::Process([](TTreeReader& readerSubRange) {
                           // Select branches to read
                           while (readerSubRange.Next()) {
                               // Use content of current entry
                           }
                        });

The user needs to be aware that each of the subranges can potentially be processed in parallel. This means that the code of the user function should be thread safe.

Parameters

[in] func User-defined function that processes a subrange of entries

Definition at line 452 of file TTreeProcessorMT.cxx.

◆ SetTasksPerWorkerHint()

void TTreeProcessorMT::SetTasksPerWorkerHint ( unsigned int tasksPerWorkerHint )

static

Set the hint for the desired number of tasks created per worker.

Parameters

[in] tasksPerWorkerHint Desired number of tasks per worker.

This allows to create a reasonable number of tasks even if any of the processed files features a bad clustering, for example with a lot of entries and just a few entries per cluster, or to limit the number of tasks spawned when a very large number of files and workers is used.

Definition at line 539 of file TTreeProcessorMT.cxx.

Member Data Documentation

◆ fEntryList

TEntryList ROOT::TTreeProcessorMT::fEntryList

private

User-defined selection of entry numbers to be processed, empty if none was provided.

Definition at line 84 of file TTreeProcessorMT.hxx.

◆ fFileNames

const std::vector<std::string> ROOT::TTreeProcessorMT::fFileNames

private

Names of the files.

Definition at line 81 of file TTreeProcessorMT.hxx.

◆ fFriendInfo

ROOT::TreeUtils::RFriendInfo ROOT::TTreeProcessorMT::fFriendInfo

private

Definition at line 85 of file TTreeProcessorMT.hxx.

◆ fGlobalRange

std::pair<Long64_t, Long64_t> ROOT::TTreeProcessorMT::fGlobalRange {0, std::numeric_limits<Long64_t>::max()}

private

Definition at line 95 of file TTreeProcessorMT.hxx.

◆ fgTasksPerWorkerHint

unsigned int ROOT::TTreeProcessorMT::fgTasksPerWorkerHint = 10U

staticprivate

Definition at line 93 of file TTreeProcessorMT.hxx.

◆ fPool

ROOT::TThreadExecutor ROOT::TTreeProcessorMT::fPool

private

! Thread pool for processing.

Definition at line 86 of file TTreeProcessorMT.hxx.

◆ fTreeNames

const std::vector<std::string> ROOT::TTreeProcessorMT::fTreeNames

private

TTree names (always same size and ordering as fFileNames)

Definition at line 82 of file TTreeProcessorMT.hxx.

◆ fTreeView

ROOT::TThreadedObject<ROOT::Internal::TTreeView> ROOT::TTreeProcessorMT::fTreeView {TNumSlots{ROOT::GetThreadPoolSize()}}

private

Thread-local TreeViews.

Definition at line 90 of file TTreeProcessorMT.hxx.

Libraries for ROOT::TTreeProcessorMT:

[legend]

The documentation for this class was generated from the following files:

tree/treeplayer/inc/ROOT/TTreeProcessorMT.hxx
tree/treeplayer/src/TTreeProcessorMT.cxx

Public Member Functions

Static Public Member Functions

Private Member Functions

Private Attributes

Static Private Attributes

Constructor & Destructor Documentation

◆ TTreeProcessorMT() [1/5]

◆ TTreeProcessorMT() [2/5]

◆ TTreeProcessorMT() [3/5]

◆ TTreeProcessorMT() [4/5]

◆ TTreeProcessorMT() [5/5]

Member Function Documentation

◆ FindTreeNames()

◆ GetTasksPerWorkerHint()

◆ Process()

◆ SetTasksPerWorkerHint()

Member Data Documentation

◆ fEntryList

◆ fFileNames

◆ fFriendInfo

◆ fGlobalRange

◆ fgTasksPerWorkerHint

◆ fPool

◆ fTreeNames

◆ fTreeView