com.mapr.db.mapreduce

Class TableMutationOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.store.DocumentMutation>

com.mapr.db.mapreduce.TableMutationOutputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class TableMutationOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.store.DocumentMutation>
implements org.apache.hadoop.conf.Configurable

Writes DocumentMutation from Map/Reduce phase to JSON tables. The key is of type Value and the Value is a DocumentMutation.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	OUTPUT_TABLE Job parameter that specifies the output table.

Constructor Summary

Constructors

Constructor and Description
TableMutationOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context) Checks if the output target exists.
org.apache.hadoop.conf.Configuration	getConf() Returns the current configuration.
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Returns the output committer.
org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.store.DocumentMutation>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Creates a new DocumentMutation record writer.
void	setConf(org.apache.hadoop.conf.Configuration arg0) This function is used to set parameters in the configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OUTPUT_TABLE

public static final java.lang.String OUTPUT_TABLE

Job parameter that specifies the output table.

See Also:

Constant Field Values

Constructor Detail

TableMutationOutputFormat

public TableMutationOutputFormat()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration arg0)

This function is used to set parameters in the configuration. This is used to set relevant parameters for scanning JSON tables.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Parameters:

arg0 - Configuration object with parameters for TableOutputFormat.

See Also:

Configurable.setConf( org.apache.hadoop.conf.Configuration)

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns the current configuration.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Returns:

: Current Configuration.

See Also:

Configurable.getConf()

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.store.DocumentMutation> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                         throws java.io.IOException,
                                                                                                                java.lang.InterruptedException

Creates a new DocumentMutation record writer.

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.store.DocumentMutation>

Parameters:

context - The current task context.

Returns:

The newly created writer instance.

Throws:

java.io.IOException - When creating the writer fails.

java.lang.InterruptedException - When the jobs is cancelled.

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws java.io.IOException,
                             java.lang.InterruptedException

Checks if the output target exists.

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.store.DocumentMutation>

Parameters:

context - The current context.

Throws:

java.io.IOException - When the check fails.

java.lang.InterruptedException - When the job is aborted.

See Also:

OutputFormat.checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext)

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws java.io.IOException,
                                                                      java.lang.InterruptedException

Returns the output committer.

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.store.DocumentMutation>

Parameters:

context - The current context.

Returns:

The committer.

Throws:

java.io.IOException - When creating the committer fails.

java.lang.InterruptedException - When the job is aborted.

See Also:

OutputFormat.getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext)