org.apache.spark

ComplexFutureAction

class ComplexFutureAction[T] extends FutureAction[T]

A FutureAction for actions that could trigger multiple Spark jobs. Examples include take, takeSample. Cancellation works by setting the cancelled flag to true and interrupting the action thread if it is being blocked by a job.

Source
FutureAction.scala
Linear Supertypes
FutureAction[T], Future[T], Awaitable[T], AnyRef, Any
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. ComplexFutureAction
  2. FutureAction
  3. Future
  4. Awaitable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ComplexFutureAction()

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  5. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  6. def andThen[U](pf: PartialFunction[Try[T], U])(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  7. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  8. def cancel(): Unit

    Cancels the execution of this action.

    Cancels the execution of this action.

    Definition Classes
    ComplexFutureActionFutureAction
  9. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  10. def collect[S](pf: PartialFunction[T, S])(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  11. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  13. def failed: Future[Throwable]

    Definition Classes
    Future
  14. def fallbackTo[U >: T](that: Future[U]): Future[U]

    Definition Classes
    Future
  15. def filter(pred: (T) ⇒ Boolean)(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  16. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. def flatMap[S](f: (T) ⇒ Future[S])(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  18. def foreach[U](f: (T) ⇒ U)(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  19. def get(): T

    Blocks and returns the result of this job.

    Blocks and returns the result of this job.

    Definition Classes
    FutureAction
    Annotations
    @throws( classOf[Exception] )
  20. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  21. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  22. def isCancelled: Boolean

    Returns whether the action has been cancelled.

    Returns whether the action has been cancelled.

    Definition Classes
    ComplexFutureActionFutureAction
  23. def isCompleted: Boolean

    Returns whether the action has already been completed with a value or an exception.

    Returns whether the action has already been completed with a value or an exception.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  24. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  25. def jobIds: Seq[Int]

    Returns the job IDs run by the underlying async operation.

    Returns the job IDs run by the underlying async operation.

    This returns the current snapshot of the job list. Certain operations may run multiple jobs, so multiple calls to this method may return different lists.

    Definition Classes
    ComplexFutureActionFutureAction
  26. def map[S](f: (T) ⇒ S)(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  27. def mapTo[S](implicit tag: ClassTag[S]): Future[S]

    Definition Classes
    Future
  28. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  29. final def notify(): Unit

    Definition Classes
    AnyRef
  30. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  31. def onComplete[U](func: (Try[T]) ⇒ U)(implicit executor: ExecutionContext): Unit

    When this action is completed, either through an exception, or a value, applies the provided function.

    When this action is completed, either through an exception, or a value, applies the provided function.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  32. def onFailure[U](callback: PartialFunction[Throwable, U])(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  33. def onSuccess[U](pf: PartialFunction[T, U])(implicit executor: ExecutionContext): Unit

    Definition Classes
    Future
  34. def ready(atMost: Duration)(implicit permit: CanAwait): ComplexFutureAction.this.type

    Blocks until this action completes.

    Blocks until this action completes.

    atMost

    maximum wait time, which may be negative (no waiting is done), Duration.Inf for unbounded waiting, or a finite positive duration

    returns

    this FutureAction

    Definition Classes
    ComplexFutureActionFutureAction → Awaitable
    Annotations
    @throws( classOf[InterruptedException] ) @throws( ... )
  35. def recover[U >: T](pf: PartialFunction[Throwable, U])(implicit executor: ExecutionContext): Future[U]

    Definition Classes
    Future
  36. def recoverWith[U >: T](pf: PartialFunction[Throwable, Future[U]])(implicit executor: ExecutionContext): Future[U]

    Definition Classes
    Future
  37. def result(atMost: Duration)(implicit permit: CanAwait): T

    Awaits and returns the result (of type T) of this action.

    Awaits and returns the result (of type T) of this action.

    atMost

    maximum wait time, which may be negative (no waiting is done), Duration.Inf for unbounded waiting, or a finite positive duration

    returns

    the result value if the action is completed within the specific maximum wait time

    Definition Classes
    ComplexFutureActionFutureAction → Awaitable
    Annotations
    @throws( classOf[Exception] )
    Exceptions thrown
    Exception

    exception during action execution

  38. def run(func: ⇒ T)(implicit executor: ExecutionContext): ComplexFutureAction.this.type

    Executes some action enclosed in the closure.

    Executes some action enclosed in the closure. To properly enable cancellation, the closure should use runJob implementation in this promise. See takeAsync for example.

  39. def runJob[T, U, R](rdd: RDD[T], processPartition: (Iterator[T]) ⇒ U, partitions: Seq[Int], resultHandler: (Int, U) ⇒ Unit, resultFunc: ⇒ R): Unit

    Runs a Spark job.

    Runs a Spark job. This is a wrapper around the same functionality provided by SparkContext to enable cancellation.

  40. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  41. def toString(): String

    Definition Classes
    AnyRef → Any
  42. def transform[S](s: (T) ⇒ S, f: (Throwable) ⇒ Throwable)(implicit executor: ExecutionContext): Future[S]

    Definition Classes
    Future
  43. def value: Option[Try[T]]

    The value of this Future.

    The value of this Future.

    If the future is not completed the returned value will be None. If the future is completed the value will be Some(Success(t)) if it contains a valid result, or Some(Failure(error)) if it contains an exception.

    Definition Classes
    ComplexFutureActionFutureAction → Future
  44. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  45. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  46. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  47. final def withFilter(p: (T) ⇒ Boolean)(implicit executor: ExecutionContext): Future[T]

    Definition Classes
    Future
  48. def zip[U](that: Future[U]): Future[(T, U)]

    Definition Classes
    Future

Inherited from FutureAction[T]

Inherited from Future[T]

Inherited from Awaitable[T]

Inherited from AnyRef

Inherited from Any

Ungrouped