@InterfaceAudience.Public @InterfaceStability.Stable public class NLineInputFormat extends FileInputFormat<LongWritable,Text> implements JobConfigurable
INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LOG, NUM_INPUT_FILES| Constructor and Description |
|---|
NLineInputFormat() |
| Modifier and Type | Method and Description |
|---|---|
void |
configure(JobConf conf)
Initializes a new instance from a
JobConf. |
protected static FileSplit |
createFileSplit(Path fileName,
long begin,
long length)
NLineInputFormat uses LineRecordReader, which always reads
(and consumes) at least one character out of its upper split
boundary.
|
RecordReader<LongWritable,Text> |
getRecordReader(InputSplit genericSplit,
JobConf job,
Reporter reporter)
Get the
RecordReader for the given InputSplit. |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
Logically splits the set of input files for the job, splits N lines
of the input as one split.
|
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplitHosts, isSplitable, listStatus, makeSplit, makeSplit, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSizepublic RecordReader<LongWritable,Text> getRecordReader(InputSplit genericSplit, JobConf job, Reporter reporter) throws IOException
InputFormatRecordReader for the given InputSplit.
It is the responsibility of the RecordReader to respect
record boundaries while processing the logical split to present a
record-oriented view to the individual task.
getRecordReader in interface InputFormat<LongWritable,Text>getRecordReader in class FileInputFormat<LongWritable,Text>genericSplit - the InputSplitjob - the job that this split belongs toRecordReaderIOExceptionpublic InputSplit[] getSplits(JobConf job, int numSplits) throws IOException
getSplits in interface InputFormat<LongWritable,Text>getSplits in class FileInputFormat<LongWritable,Text>job - job configuration.numSplits - the desired number of splits, a hint.InputSplits for the job.IOExceptionFileInputFormat.getSplits(JobConf, int)public void configure(JobConf conf)
JobConfigurableJobConf.configure in interface JobConfigurableconf - the configurationprotected static FileSplit createFileSplit(Path fileName, long begin, long length)
fileName - Path of filebegin - the position of the first byte in the file to processlength - number of bytes in InputSplitCopyright © 2022 Apache Software Foundation. All rights reserved.