@InterfaceAudience.Private @InterfaceStability.Unstable public class DelegatingInputFormat<K,V> extends InputFormat<K,V>
InputFormat that delegates behavior of paths to multiple other
InputFormats.| Constructor and Description |
|---|
DelegatingInputFormat() |
| Modifier and Type | Method and Description |
|---|---|
RecordReader<K,V> |
createRecordReader(InputSplit split,
TaskAttemptContext context)
Create a record reader for a given split.
|
List<InputSplit> |
getSplits(JobContext job)
Logically split the set of input files for the job.
|
public List<InputSplit> getSplits(JobContext job) throws IOException, InterruptedException
InputFormatEach InputSplit is then assigned to an individual Mapper
for processing.
Note: The split is a logical split of the inputs and the
input files are not physically split into chunks. For e.g. a split could
be <input-file-path, start, offset> tuple. The InputFormat
also creates the RecordReader to read the InputSplit.
getSplits in class InputFormat<K,V>job - job configuration.InputSplits for the job.IOExceptionInterruptedExceptionpublic RecordReader<K,V> createRecordReader(InputSplit split, TaskAttemptContext context) throws IOException, InterruptedException
InputFormatRecordReader.initialize(InputSplit, TaskAttemptContext) before
the split is used.createRecordReader in class InputFormat<K,V>split - the split to be readcontext - the information about the taskIOExceptionInterruptedExceptionCopyright © 2022 Apache Software Foundation. All rights reserved.