Interface | Description |
---|---|
Encoder<T> |
:: Experimental ::
Used to convert a JVM object of type
T to and from the internal Spark SQL representation. |
Row |
Represents one row of output from a relational operator.
|
Class | Description |
---|---|
Column |
:: Experimental ::
A column that will be computed based on the data in a
DataFrame . |
ColumnName |
:: Experimental ::
A convenient class used for constructing schema.
|
DataFrame |
:: Experimental ::
A distributed collection of data organized into named columns.
|
DataFrameHolder |
A container for a
DataFrame , used for implicit conversions. |
DataFrameNaFunctions |
:: Experimental ::
Functionality for working with missing data in
DataFrame s. |
DataFrameReader |
:: Experimental ::
Interface used to load a
DataFrame from external storage systems (e.g. |
DataFrameStatFunctions |
:: Experimental ::
Statistic functions for
DataFrame s. |
DataFrameWriter |
:: Experimental ::
Interface used to write a
DataFrame to external storage systems (e.g. |
Dataset<T> |
:: Experimental ::
A
Dataset is a strongly typed collection of objects that can be transformed in parallel
using functional or relational operations. |
DatasetHolder<T> |
A container for a
Dataset , used for implicit conversions. |
Encoders |
:: Experimental ::
Methods for creating an
Encoder . |
ExperimentalMethods |
:: Experimental ::
Holder for experimental methods for the bravest.
|
functions | |
GroupedData |
:: Experimental ::
A set of methods for aggregations on a
DataFrame , created by DataFrame.groupBy . |
GroupedDataset<K,V> |
:: Experimental ::
A
Dataset has been logically grouped by a user specified grouping key. |
RowFactory |
A factory class used to construct
Row objects. |
SQLContext |
The entry point for working with structured data (rows and columns) in Spark.
|
SQLImplicits |
A collection of implicit methods for converting common Scala objects into
DataFrame s. |
TypedColumn<T,U> | |
UDFRegistration |
Functions for registering user-defined functions.
|
UserDefinedFunction |
A user-defined function.
|
Enum | Description |
---|---|
SaveMode |
SaveMode is used to specify the expected behavior of saving a DataFrame to a data source.
|
Exception | Description |
---|---|
AnalysisException |
:: DeveloperApi ::
Thrown when a query fails to analyze, usually because the query itself is invalid.
|