Class ContentItemsSource
java.lang.Object
org.apache.lucene.benchmark.byTask.feeds.ContentItemsSource
- All Implemented Interfaces:
Closeable,AutoCloseable
- Direct Known Subclasses:
ContentSource,FacetSource
Base class for source of data for benchmarking
Keeps track of various statistics, such as how many data items were generated, size in bytes etc.
Supports the following configuration parameters:
- content.source.forever - specifies whether to generate items forever (default=true).
- content.source.verbose - specifies whether messages should be output by the content source (default=false).
- content.source.encoding - specifies which encoding to use when reading the files of that content source. Certain implementations may define a default value if this parameter is not specified. (default=null).
- content.source.log.step - specifies for how many items a message should be logged. If set to 0 it means no logging should occur. NOTE: if verbose is set to false, logging should not occur even if logStep is not 0 (default=0).
-
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected final voidaddBytes(long numBytes) update count of bytes generated by this sourceprotected final voidaddItem()update count of items generated by this sourceabstract voidclose()Called when reading from this content source is no longer required.protected final voidcollectFiles(Path dir, ArrayList<Path> files) A convenience method for collecting all the files of a content source from a given directory.final longReturns the number of bytes generated since last reset.final Configfinal intReturns the number of generated items since last reset.final longReturns the total number of bytes that were generated by this source.final intReturns the total number of generated items.voidprintStatistics(String itemsName) voidResets the input for this content source, so that the test would behave as if it was just started, input-wise.voidSets theConfigfor this content source.protected final booleanReturns true whether it's time to log a message (depending on verbose and the number of items generated).
-
Field Details
-
forever
protected boolean forever -
logStep
protected int logStep -
verbose
protected boolean verbose -
encoding
-
-
Constructor Details
-
ContentItemsSource
public ContentItemsSource()
-
-
Method Details
-
addBytes
protected final void addBytes(long numBytes) update count of bytes generated by this source -
addItem
protected final void addItem()update count of items generated by this source -
collectFiles
A convenience method for collecting all the files of a content source from a given directory. The collectedPathinstances are stored in the givenfiles.- Throws:
IOException
-
shouldLog
protected final boolean shouldLog()Returns true whether it's time to log a message (depending on verbose and the number of items generated). -
close
Called when reading from this content source is no longer required.- Specified by:
closein interfaceAutoCloseable- Specified by:
closein interfaceCloseable- Throws:
IOException
-
getBytesCount
public final long getBytesCount()Returns the number of bytes generated since last reset. -
getItemsCount
public final int getItemsCount()Returns the number of generated items since last reset. -
getConfig
-
getTotalBytesCount
public final long getTotalBytesCount()Returns the total number of bytes that were generated by this source. -
getTotalItemsCount
public final int getTotalItemsCount()Returns the total number of generated items. -
resetInputs
Resets the input for this content source, so that the test would behave as if it was just started, input-wise.NOTE: the default implementation resets the number of bytes and items generated since the last reset, so it's important to call super.resetInputs in case you override this method.
- Throws:
IOException
-
setConfig
Sets theConfigfor this content source. If you override this method, you must call super.setConfig. -
printStatistics
-