com.mapr.db.mapreduce

Class TableInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

com.mapr.db.mapreduce.TableInputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class TableInputFormat
extends org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>
implements org.apache.hadoop.conf.Configurable

This class is used to read JSON table data from MapR-DB in Map/Reduce program.

Field Summary

Fields

Modifier and Type	Field and Description
protected com.mapr.db.impl.ConditionImpl	cond
static java.lang.String	COND_OBJ
static java.lang.String	EXCLUDE_EMBEDDEDFAMILY
static java.lang.String	FIELD_PATH
static java.lang.String	GET_DELETES
static java.lang.String	INPUT_TABLE
protected com.mapr.db.impl.MapRDBTableImpl	jTable
static java.lang.String	READ_ALL_CFS
static java.lang.String	START_ROW
static java.lang.String	STOP_ROW

Constructor Summary

Constructors

Constructor and Description
TableInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.ojai.Value,org.ojai.Document>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) Creates a record reader for a given split.
org.apache.hadoop.conf.Configuration	getConf() Returns the current configuration.
java.util.List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context) Set up the splits which will be served as inputs to map tasks.
void	setConf(org.apache.hadoop.conf.Configuration arg0) This function is used to set parameters in the configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jTable

protected com.mapr.db.impl.MapRDBTableImpl jTable

cond

protected com.mapr.db.impl.ConditionImpl cond

INPUT_TABLE

public static final java.lang.String INPUT_TABLE

See Also:

Constant Field Values

FIELD_PATH

public static final java.lang.String FIELD_PATH

See Also:

Constant Field Values

COND_OBJ

public static final java.lang.String COND_OBJ

See Also:

Constant Field Values

START_ROW

public static final java.lang.String START_ROW

See Also:

Constant Field Values

STOP_ROW

public static final java.lang.String STOP_ROW

See Also:

Constant Field Values

EXCLUDE_EMBEDDEDFAMILY

public static final java.lang.String EXCLUDE_EMBEDDEDFAMILY

See Also:

Constant Field Values

GET_DELETES

public static final java.lang.String GET_DELETES

See Also:

Constant Field Values

READ_ALL_CFS

public static final java.lang.String READ_ALL_CFS

See Also:

Constant Field Values

Constructor Detail

TableInputFormat

public TableInputFormat()

Method Detail

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns the current configuration.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Returns:

: Current Configuration.

See Also:

Configurable.getConf()

getSplits

public java.util.List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                                 throws java.io.IOException,
                                                                        java.lang.InterruptedException

Set up the splits which will be served as inputs to map tasks. The number of splits are same as the number of tablets for regular JSON tables. In case of marlin tables, if there is a topicPartition shared between two tablets, they are considered to be part of same split.

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - The current job context.

Returns:

List of input splits.

Throws:

java.io.IOException

java.lang.InterruptedException

See Also:

InputFormat.getSplits(org.apache.hadoop.mapreduce.JobContext)

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.ojai.Value,org.ojai.Document> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                     org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                              throws java.io.IOException,
                                                                                                     java.lang.InterruptedException

Creates a record reader for a given split.

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

split - The input split.

context - Current job context.

Returns:

A new record reader.

Throws:

java.io.IOException

java.lang.InterruptedException

See Also:

InputFormat.createRecordReader(org.apache.hadoop.mapreduce.InputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext)

setConf

public void setConf(org.apache.hadoop.conf.Configuration arg0)

This function is used to set parameters in the configuration. This is used to set relevant parameters for scanning JSON tables.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Parameters:

arg0 - Configuration object with parameters for TableInputFormat.

See Also:

Configurable.setConf( org.apache.hadoop.conf.Configuration)