Storage provider that reads ntuple pages from a DAOS container.
Definition at line 153 of file RPageStorageDaos.hxx.
Classes | |
struct | RClusterInfo |
Summarizes cluster-level information that are necessary to populate a certain page. More... | |
Protected Member Functions | |
RNTupleDescriptor | AttachImpl () final |
void | UnzipClusterImpl (RCluster *cluster) final |
![]() | |
void | EnableDefaultMetrics (const std::string &prefix) |
Enables the default set of metrics provided by RPageSource. | |
RExclDescriptorGuard | GetExclDescriptorGuard () |
Note that the underlying lock is not recursive. See GetSharedDescriptorGuard() for further information. | |
void | PrepareLoadCluster (const RCluster::RKey &clusterKey, ROnDiskPageMap &pageZeroMap, std::function< void(DescriptorId_t, NTupleSize_t, const RClusterDescriptor::RPageRange::RPageInfo &)> perPageFunc) |
Prepare a page range read for the column set in clusterKey . | |
![]() | |
void | WaitForAllTasks () |
Private Member Functions | |
RPage | PopulatePageFromCluster (ColumnHandle_t columnHandle, const RClusterInfo &clusterInfo, ClusterSize_t::ValueType idxInCluster) |
Private Attributes | |
std::unique_ptr< RClusterPool > | fClusterPool |
The cluster pool asynchronously preloads the next few clusters. | |
RCluster * | fCurrentCluster = nullptr |
The last cluster from which a page got populated. Points into fClusterPool->fPool. | |
std::unique_ptr< RDaosContainer > | fDaosContainer |
A container that stores object data (header/footer, pages, etc.) | |
RNTupleDescriptorBuilder | fDescriptorBuilder |
ntuple_index_t | fNTupleIndex {0} |
std::shared_ptr< RPagePool > | fPagePool |
Populated pages might be shared; the page pool might, at some point, be used by multiple page sources. | |
std::string | fURI |
A URI to a DAOS pool of the form 'daos://pool-label/container-label'. | |
Additional Inherited Members | |
![]() | |
using | ColumnHandle_t = RColumnHandle |
The column handle identifies a column with the current open page storage. | |
using | SealedPageSequence_t = std::deque<RSealedPage> |
![]() | |
static std::unique_ptr< RPageSource > | Create (std::string_view ntupleName, std::string_view location, const RNTupleReadOptions &options=RNTupleReadOptions()) |
Guess the concrete derived page source from the file name (location) | |
![]() | |
RActivePhysicalColumns | fActivePhysicalColumns |
The active columns are implicitly defined by the model fields or views. | |
std::unique_ptr< RCounters > | fCounters |
std::unique_ptr< RNTupleDecompressor > | fDecompressor |
Helper to unzip pages and header/footer; comprises a 16MB (kMAXZIPBUF) unzip buffer. | |
RNTupleReadOptions | fOptions |
![]() | |
Detail::RNTupleMetrics | fMetrics |
std::string | fNTupleName |
RTaskScheduler * | fTaskScheduler = nullptr |
#include <ROOT/RPageStorageDaos.hxx>
ROOT::Experimental::Internal::RPageSourceDaos::RPageSourceDaos | ( | std::string_view | ntupleName, |
std::string_view | uri, | ||
const RNTupleReadOptions & | options ) |
Definition at line 517 of file RPageStorageDaos.cxx.
|
overridedefault |
|
finalprotectedvirtual |
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 534 of file RPageStorageDaos.cxx.
|
finalvirtual |
The cloned page source creates a new connection to the pool/container.
The meta-data (header and footer) is reread and parsed by the clone.
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 733 of file RPageStorageDaos.cxx.
std::string ROOT::Experimental::Internal::RPageSourceDaos::GetObjectClass | ( | ) | const |
Return the object class used for user data OIDs in this ntuple.
Definition at line 570 of file RPageStorageDaos.cxx.
|
finalvirtual |
Populates all the pages of the given cluster ids and columns; it is possible that some columns do not contain any pages.
The page source may load more columns than the minimal necessary set from columns
. To indicate which columns have been loaded, LoadClusters() must mark them with SetColumnAvailable(). That includes the ones from the columns
that don't have pages; otherwise subsequent requests for the cluster would assume an incomplete cluster and trigger loading again. LoadClusters() is typically called from the I/O thread of a cluster pool, i.e. the method runs concurrently to other methods of the page source.
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 740 of file RPageStorageDaos.cxx.
|
finalvirtual |
Read the packed and compressed bytes of a page into the memory buffer provided by selaedPage.
The sealed page can be used subsequently in a call to RPageSink::CommitSealedPage. The fSize and fNElements member of the sealedPage parameters are always set. If sealedPage.fBuffer is nullptr, no data will be copied but the returned size information can be used by the caller to allocate a large enough buffer and call LoadSealedPage again.
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 575 of file RPageStorageDaos.cxx.
|
finalvirtual |
Allocates and fills a page that contains the index-th element.
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 678 of file RPageStorageDaos.cxx.
|
finalvirtual |
Another version of PopulatePage that allows to specify cluster-relative indexes.
Implements ROOT::Experimental::Internal::RPageSource.
Definition at line 704 of file RPageStorageDaos.cxx.
|
private |
Definition at line 608 of file RPageStorageDaos.cxx.
|
finalvirtual |
Every page store needs to be able to free pages it handed out.
But Sinks and sources have different means of allocating pages.
Implements ROOT::Experimental::Internal::RPageStorage.
Definition at line 728 of file RPageStorageDaos.cxx.
|
finalprotectedvirtual |
Reimplemented from ROOT::Experimental::Internal::RPageSource.
Definition at line 838 of file RPageStorageDaos.cxx.
|
private |
The cluster pool asynchronously preloads the next few clusters.
Definition at line 176 of file RPageStorageDaos.hxx.
|
private |
The last cluster from which a page got populated. Points into fClusterPool->fPool.
Definition at line 170 of file RPageStorageDaos.hxx.
|
private |
A container that stores object data (header/footer, pages, etc.)
Definition at line 172 of file RPageStorageDaos.hxx.
|
private |
Definition at line 178 of file RPageStorageDaos.hxx.
|
private |
Definition at line 165 of file RPageStorageDaos.hxx.
|
private |
Populated pages might be shared; the page pool might, at some point, be used by multiple page sources.
Definition at line 168 of file RPageStorageDaos.hxx.
|
private |
A URI to a DAOS pool of the form 'daos://pool-label/container-label'.
Definition at line 174 of file RPageStorageDaos.hxx.