org.apache.spark.scheduler

Interface TaskScheduler

All Known Implementing Classes:

TaskSchedulerImpl

public interface TaskScheduler

Low-level task scheduler interface, currently implemented exclusively by TaskSchedulerImpl. This interface allows plugging in different task schedulers. Each TaskScheduler schedules tasks for a single SparkContext. These schedulers get sets of tasks submitted to them from the DAGScheduler for each stage, and are responsible for sending the tasks to the cluster, running them, retrying if there are failures, and mitigating stragglers. They return events to the DAGScheduler.

Method Summary

Methods

Modifier and Type	Method and Description
String	appId()
String	applicationId() Get an application ID associated with the job.
void	cancelTasks(int stageId, boolean interruptThread)
int	defaultParallelism()
boolean	executorHeartbeatReceived(String execId, scala.Tuple2<Object,org.apache.spark.executor.TaskMetrics>[] taskMetrics, BlockManagerId blockManagerId) Update metrics for in-progress tasks and let the master know that the BlockManager is still alive.
void	postStartHook()
Pool	rootPool()
scala.Enumeration.Value	schedulingMode()
void	setDAGScheduler(DAGScheduler dagScheduler)
void	start()
void	stop()
void	submitTasks(TaskSet taskSet)

Method Detail

appId

String appId()

rootPool

Pool rootPool()

schedulingMode

scala.Enumeration.Value schedulingMode()

start

void start()

postStartHook

void postStartHook()

stop

void stop()

submitTasks

void submitTasks(TaskSet taskSet)

cancelTasks

void cancelTasks(int stageId,
               boolean interruptThread)

setDAGScheduler

void setDAGScheduler(DAGScheduler dagScheduler)

defaultParallelism

int defaultParallelism()

executorHeartbeatReceived

boolean executorHeartbeatReceived(String execId,
                                scala.Tuple2<Object,org.apache.spark.executor.TaskMetrics>[] taskMetrics,
                                BlockManagerId blockManagerId)

Update metrics for in-progress tasks and let the master know that the BlockManager is still alive. Return true if the driver knows about the given block manager. Otherwise, return false, indicating that the block manager should re-register.

applicationId

String applicationId()

Get an application ID associated with the job.

Returns:

An application ID