com.mapr.db.mapreduce

Class TableOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

com.mapr.db.mapreduce.TableOutputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class TableOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>
implements org.apache.hadoop.conf.Configurable

Writes Map/Reduce output to JSON tables. The key is of type Value and the Value is a document. If key is not provided, document is expected to have "_id" field which will be used as key.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	ID_FIELD
static java.lang.String	OUTPUT_TABLE Job parameter that specifies the output table.

Constructor Summary

Constructors

Constructor and Description
TableOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) Checks if the output target exists.
org.apache.hadoop.conf.Configuration	getConf() Returns the current configuration.
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Returns the output committer.
org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.Document>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Creates a new record writer.
void	setConf(org.apache.hadoop.conf.Configuration arg0) This function is used to set parameters in the configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OUTPUT_TABLE

public static final java.lang.String OUTPUT_TABLE

Job parameter that specifies the output table.

See Also:

Constant Field Values

ID_FIELD

public static final java.lang.String ID_FIELD

See Also:

Constant Field Values

Constructor Detail

TableOutputFormat

public TableOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.Document> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                           throws java.io.IOException,
                                                                                                  java.lang.InterruptedException

Creates a new record writer.

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - The current task context.

Returns:

The newly created writer instance.

Throws:

java.io.IOException - When creating the writer fails.

java.lang.InterruptedException - When the jobs is cancelled.

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws java.io.IOException,
                             java.lang.InterruptedException

Checks if the output target exists.

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - The current context.

Throws:

java.io.IOException - When the check fails.

java.lang.InterruptedException - When the job is aborted.

See Also:

OutputFormat.checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext)

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws java.io.IOException,
                                                                      java.lang.InterruptedException

Returns the output committer.

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - The current context.

Returns:

The committer.

Throws:

java.io.IOException - When creating the committer fails.

java.lang.InterruptedException - When the job is aborted.

See Also:

OutputFormat.getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext)

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns the current configuration.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Returns:

: Current Configuration.

See Also:

Configurable.getConf()

setConf

public void setConf(org.apache.hadoop.conf.Configuration arg0)

This function is used to set parameters in the configuration. This is used to set relevant parameters for scanning JSON tables.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Parameters:

arg0 - Configuration object with parameters for TableOutputFormat.

See Also:

Configurable.setConf( org.apache.hadoop.conf.Configuration)