Type Mapping Between MapR Database JSON and DataFrames
This table maps data types between MapR Database JSON OJAI and Apache Spark DataFrame.
NOTE Not all DataFrame data types are supported by MapR Database, for a list of supported data types, see JSON Documents.
OJAI Data Type | DataFrame Data Type |
---|---|
Boolean | BooleanType |
String | StringType |
Byte | ByteType |
Short | ShortType |
Int | IntegerType |
Long | LongType |
Float | FloatType |
Double | DoubleType |
Decimal | DecimalType |
Date | DateType |
Time | TimestampType |
TimeStamp | TimeStampType |
Interval | CalendarIntervalType |
Binary | BinaryType |
Map | StructType |
Array | ArrayType |
NOTE The OJAI
Time
data type is converted to a Spark
TimestampType
with the date set to the epoch date. Spark SQL does not
support a TIME
type.