org.apache.spark.sql.hive

Class HiveContext

Object

org.apache.spark.sql.SQLContext

org.apache.spark.sql.hive.HiveContext

All Implemented Interfaces:

java.io.Serializable, Logging

Deprecated.

Use SparkSession.builder.enableHiveSupport instead. Since 2.0.0.

public class HiveContext
extends SQLContext
implements Logging

An instance of the Spark SQL execution engine that integrates with data stored in Hive. Configuration for Hive is read from hive-site.xml on the classpath.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.spark.sql.SQLContext

SQLContext.implicits$

Constructor Summary

Constructors

Constructor and Description
HiveContext(JavaSparkContext sc) Deprecated.
HiveContext(SparkContext sc) Deprecated.

Method Summary

Modifier and Type	Method and Description
HiveContext	newSession() Deprecated. Returns a new HiveContext as new session, which will have separated SQLConf, UDF/UDAF, temporary tables and SessionState, but sharing the same CacheManager, IsolatedClientLoader and Hive client (both of execution and metadata) with existing HiveContext.
void	refreshTable(String tableName) Deprecated. Invalidate and refresh all the cached the metadata of the given table.

Methods inherited from class org.apache.spark.sql.SQLContext

applySchema, applySchema, applySchema, applySchema, baseRelationToDataFrame, cacheTable, clearActive, clearCache, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataFrame, createDataset, createDataset, createDataset, createExternalTable, createExternalTable, createExternalTable, createExternalTable, createExternalTable, createExternalTable, dropTempTable, emptyDataFrame, experimental, getAllConfs, getConf, getConf, getOrCreate, implicits, isCached, jdbc, jdbc, jdbc, jsonFile, jsonFile, jsonFile, jsonRDD, jsonRDD, jsonRDD, jsonRDD, jsonRDD, jsonRDD, listenerManager, load, load, load, load, load, load, parquetFile, parquetFile, range, range, range, range, read, readStream, setActive, setConf, setConf, sparkContext, sparkSession, sql, streams, table, tableNames, tableNames, tables, tables, udf, uncacheTable

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.spark.internal.Logging

initializeLogging, initializeLogIfNecessary, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

HiveContext

public HiveContext(SparkContext sc)

Deprecated.

HiveContext

public HiveContext(JavaSparkContext sc)

Deprecated.

Method Detail

newSession

public HiveContext newSession()

Deprecated.

Returns a new HiveContext as new session, which will have separated SQLConf, UDF/UDAF, temporary tables and SessionState, but sharing the same CacheManager, IsolatedClientLoader and Hive client (both of execution and metadata) with existing HiveContext.

Overrides:

newSession in class SQLContext

Returns:

(undocumented)

refreshTable

public void refreshTable(String tableName)

Deprecated.

Invalidate and refresh all the cached the metadata of the given table. For performance reasons, Spark SQL or the external data source library it uses might cache certain metadata about a table, such as the location of blocks. When those change outside of Spark SQL, users should call this function to invalidate the cache.

Parameters:

tableName - (undocumented)

Since:

1.3.0