com.mapr.db.mapreduce

Class TableInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

com.mapr.db.mapreduce.TableInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class TableInputFormat
extends org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>
implements org.apache.hadoop.conf.Configurable

This class is used to read JSON table data from MapR-DB in Map/Reduce program.

Field Summary

Fields

Modifier and Type	Field and Description
protected com.mapr.db.impl.ConditionImpl	cond
static String	COND_OBJ
static String	EXCLUDE_EMBEDDEDFAMILY
static String	FIELD_PATH
static String	INPUT_TABLE
protected com.mapr.db.impl.MapRDBTableImpl	jTable
static String	START_ROW
static String	STOP_ROW

Constructor Summary

Constructors

Constructor and Description
TableInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.ojai.Value,org.ojai.Document>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Creates a record reader for a given split.
org.apache.hadoop.conf.Configuration	getConf() Returns the current configuration.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context) Set up the splits which will be served as inputs to map tasks.
void	setConf(org.apache.hadoop.conf.Configuration arg0) This function is used to set parameters in the configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jTable

protected com.mapr.db.impl.MapRDBTableImpl jTable

cond

protected com.mapr.db.impl.ConditionImpl cond

INPUT_TABLE

public static final String INPUT_TABLE

See Also:

Constant Field Values

FIELD_PATH

public static final String FIELD_PATH

See Also:

Constant Field Values

COND_OBJ

public static final String COND_OBJ

See Also:

Constant Field Values

START_ROW

public static final String START_ROW

See Also:

Constant Field Values

STOP_ROW

public static final String STOP_ROW

See Also:

Constant Field Values

EXCLUDE_EMBEDDEDFAMILY

public static final String EXCLUDE_EMBEDDEDFAMILY

See Also:

Constant Field Values

Constructor Detail

TableInputFormat

public TableInputFormat()

Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns the current configuration.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Returns:

: Current Configuration.

See Also:

Configurable.getConf()

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                       throws IOException,
                                                              InterruptedException

Set up the splits which will be served as inputs to map tasks. The number of splits are same as the number of tablets for regular JSON tables. In case of marlin tables, if there is a topicPartition shared between two tablets, they are considered to be part of same split.

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - The current job context.

Returns:

List of input splits.

Throws:

IOException

InterruptedException

See Also:

InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext)

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.ojai.Value,org.ojai.Document> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                            org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                              throws IOException,
                                                                                                     InterruptedException

Creates a record reader for a given split.

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

split - The input split.

context - Current job context.

Returns:

A new record reader.

Throws:

IOException

InterruptedException

See Also:

InputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext)

setConf

public void setConf(org.apache.hadoop.conf.Configuration arg0)

This function is used to set parameters in the configuration. This is used to set relevant parameters for scanning JSON tables.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Parameters:

arg0 - Configuration object with parameters for TableInputFormat.

See Also:

Configurable.setConf( org.apache.hadoop.conf.Configuration)