com.mapr.db.mapreduce

Class BulkLoadOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

com.mapr.db.mapreduce.BulkLoadOutputFormat

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class BulkLoadOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>
implements org.apache.hadoop.conf.Configurable

This class defines the OutputFormat to be used when Ojai documents have to be imported into MapR Document-DB using Bulkload mode.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	OUTPUT_TABLE

Constructor Summary

Constructors

Constructor and Description
BulkLoadOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
org.apache.hadoop.conf.Configuration	getConf() Returns current configuration object.
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Return the outputCommitter object.
static java.util.List<java.nio.ByteBuffer>	getPartitionSplitPoints(java.lang.String tabName) Returns a list of keys which indicate the starting of each input partition.
org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.Document>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context) Returns a bulkload RecordWriter object which can write a row to a table.
void	setConf(org.apache.hadoop.conf.Configuration conf) Sets parameters in current configuration.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OUTPUT_TABLE

public static final java.lang.String OUTPUT_TABLE

See Also:

Constant Field Values

Constructor Detail

BulkLoadOutputFormat

public BulkLoadOutputFormat()

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Sets parameters in current configuration.

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Parameters:

conf - Current configuration.

See Also:

Configurable.setConf(org.apache.hadoop.conf.Configuration)

getConf

public org.apache.hadoop.conf.Configuration getConf()

Returns current configuration object.

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable

Returns:

current configuration.

See Also:

Configurable.getConf()

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.ojai.Value,org.ojai.Document> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                           throws java.io.IOException,
                                                                                                  java.lang.InterruptedException

Returns a bulkload RecordWriter object which can write a row to a table. The record writer works with key type as ByteBufWritableComparable and value type as a Document.

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - current job context.

Returns:

RecordWriter object.

Throws:

java.io.IOException

java.lang.InterruptedException

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws java.io.IOException,
                             java.lang.InterruptedException

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Throws:

java.io.IOException

java.lang.InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws java.io.IOException,
                                                                      java.lang.InterruptedException

Return the outputCommitter object.

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<org.ojai.Value,org.ojai.Document>

Parameters:

context - current job context.

Returns:

OutputCommitter .

Throws:

java.io.IOException

java.lang.InterruptedException

See Also:

OutputFormat.getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext)

getPartitionSplitPoints

public static java.util.List<java.nio.ByteBuffer> getPartitionSplitPoints(java.lang.String tabName)
                                                                   throws java.io.IOException

Returns a list of keys which indicate the starting of each input partition.

Parameters:

tabName - output table Name.

Returns:

List of partitioning split points for TotalOrderPartitioner

Throws:

java.io.IOException