org.apache.spark.sql.execution

Class GeneratedAggregate

Object

org.apache.spark.sql.catalyst.trees.TreeNode<PlanType>

org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

org.apache.spark.sql.execution.SparkPlan

org.apache.spark.sql.execution.GeneratedAggregate

All Implemented Interfaces:

java.io.Serializable, Logging, scala.Equals, scala.Product

public class GeneratedAggregate
extends SparkPlan
implements scala.Product, scala.Serializable

:: DeveloperApi :: Alternate version of aggregation that leverages projection and thus code generation. Aggregations are converted into a set of projections from a aggregation buffer tuple back onto itself. Currently only used for simple aggregations like SUM, COUNT, or AVERAGE are supported.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
GeneratedAggregate(boolean partial, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions, scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions, SparkPlan child)

Method Summary

Methods

Modifier and Type	Method and Description
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression>	aggregateExpressions()
SparkPlan	child()
RDD<org.apache.spark.sql.catalyst.expressions.Row>	execute() Runs this query returning the result as an RDD.
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression>	groupingExpressions()
scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute>	output()
org.apache.spark.sql.catalyst.plans.physical.Partitioning	outputPartitioning()
boolean	partial()
scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution>	requiredChildDistribution() Specifies any partition requirements on the input data for this operator.

Methods inherited from class org.apache.spark.sql.execution.SparkPlan

codegenEnabled, executeCollect, makeCopy, outputPartitioning

Methods inherited from class org.apache.spark.sql.catalyst.plans.QueryPlan

expressions, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionDown$1, org$apache$spark$sql$catalyst$plans$QueryPlan$$transformExpressionUp$1, outputSet, printSchema, schema, schemaString, transformAllExpressions, transformExpressions, transformExpressionsDown, transformExpressionsUp

Methods inherited from class org.apache.spark.sql.catalyst.trees.TreeNode

apply, argString, asCode, children, collect, fastEquals, flatMap, foreach, generateTreeString, getNodeNumbered, id, map, mapChildren, nextId, nodeName, numberedTreeString, otherCopyArgs, sameInstance, simpleString, stringArgs, toString, transform, transformChildrenDown, transformChildrenUp, transformDown, transformUp, treeString, withNewChildren

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.spark.sql.catalyst.trees.UnaryNode

children

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.Logging

initialized, initializeIfNecessary, initializeLogging, initLock, isTraceEnabled, log_, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning

Constructor Detail

GeneratedAggregate

public GeneratedAggregate(boolean partial,
                  scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions,
                  scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions,
                  SparkPlan child)

Method Detail

partial

public boolean partial()

groupingExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Expression> groupingExpressions()

aggregateExpressions

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.NamedExpression> aggregateExpressions()

child

public SparkPlan child()

requiredChildDistribution

public scala.collection.Seq<org.apache.spark.sql.catalyst.plans.physical.Distribution> requiredChildDistribution()

Description copied from class: SparkPlan

Specifies any partition requirements on the input data for this operator.

Overrides:

requiredChildDistribution in class SparkPlan

output

public scala.collection.Seq<org.apache.spark.sql.catalyst.expressions.Attribute> output()

Specified by:

output in class org.apache.spark.sql.catalyst.plans.QueryPlan<SparkPlan>

execute

public RDD<org.apache.spark.sql.catalyst.expressions.Row> execute()

Description copied from class: SparkPlan

Runs this query returning the result as an RDD.

Specified by:

execute in class SparkPlan

outputPartitioning

public org.apache.spark.sql.catalyst.plans.physical.Partitioning outputPartitioning()