org.apache.spark.sql.hive

Class RelationConversions

Object

org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.hive.RelationConversions

All Implemented Interfaces:

java.io.Serializable, Logging, scala.Equals, scala.Product

public class RelationConversions
extends org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>
implements scala.Product, scala.Serializable

Relation conversion from metastore relations to data source relations for better performance

- When writing to non-partitioned Hive-serde Parquet/Orc tables - When scanning Hive-serde Parquet/ORC tables

This rule must be run before all other DDL post-hoc resolution rules, i.e. PreprocessTableCreation, PreprocessTableInsertion, DataSourceAnalysis and HiveAnalysis.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RelationConversions(org.apache.spark.sql.internal.SQLConf conf, org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)
abstract static boolean	canEqual(Object that)
org.apache.spark.sql.internal.SQLConf	conf()
abstract static boolean	equals(Object that)
abstract static int	productArity()
abstract static Object	productElement(int n)
static scala.collection.Iterator<Object>	productIterator()
static String	productPrefix()
static String	ruleName()
org.apache.spark.sql.hive.HiveSessionCatalog	sessionCatalog()

Methods inherited from class org.apache.spark.sql.catalyst.rules.Rule

initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, ruleName

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.internal.Logging

initializeLogging, log_

Constructor Detail

RelationConversions

public RelationConversions(org.apache.spark.sql.internal.SQLConf conf,
                           org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog)

Method Detail

ruleName

public static String ruleName()

canEqual

public abstract static boolean canEqual(Object that)

equals

public abstract static boolean equals(Object that)

productElement

public abstract static Object productElement(int n)

productArity

public abstract static int productArity()

productIterator

public static scala.collection.Iterator<Object> productIterator()

productPrefix

public static String productPrefix()

conf

public org.apache.spark.sql.internal.SQLConf conf()

sessionCatalog

public org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog()

apply

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Specified by:

apply in class org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>