org.apache.spark.ml

Class Pipeline.SharedReadWrite$

Object

org.apache.spark.ml.Pipeline.SharedReadWrite$

Enclosing class:

Pipeline

public static class Pipeline.SharedReadWrite$
extends Object

Methods for MLReader and MLWriter shared between Pipeline and PipelineModel

Field Summary

Fields

Modifier and Type	Field and Description
static Pipeline.SharedReadWrite$	MODULE$ Static reference to the singleton instance of this Scala object.

Constructor Summary

Constructors

Constructor and Description
Pipeline.SharedReadWrite$()

Method Summary

Methods

Modifier and Type	Method and Description
String	getStagePath(String stageUid, int stageIdx, int numStages, String stagesDir) Get path for saving the given stage.
scala.Tuple2<String,PipelineStage[]>	load(String expectedClassName, SparkContext sc, String path) Load metadata and stages for a Pipeline or PipelineModel
void	saveImpl(Params instance, PipelineStage[] stages, SparkContext sc, String path) Save metadata and stages for a Pipeline or PipelineModel - save metadata to path/metadata - save stages to stages/IDX_UID
void	validateStages(PipelineStage[] stages) Check that all stages are Writable

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MODULE$

public static final Pipeline.SharedReadWrite$ MODULE$

Static reference to the singleton instance of this Scala object.

Constructor Detail

Pipeline.SharedReadWrite$

public Pipeline.SharedReadWrite$()

Method Detail

validateStages

public void validateStages(PipelineStage[] stages)

Check that all stages are Writable

saveImpl

public void saveImpl(Params instance,
            PipelineStage[] stages,
            SparkContext sc,
            String path)

Save metadata and stages for a Pipeline or PipelineModel - save metadata to path/metadata - save stages to stages/IDX_UID

Parameters:

instance - (undocumented)

stages - (undocumented)

sc - (undocumented)

path - (undocumented)

load

public scala.Tuple2<String,PipelineStage[]> load(String expectedClassName,
                                        SparkContext sc,
                                        String path)

Load metadata and stages for a Pipeline or PipelineModel

Parameters:

expectedClassName - (undocumented)

sc - (undocumented)

path - (undocumented)

Returns:

(UID, list of stages)

getStagePath

public String getStagePath(String stageUid,
                  int stageIdx,
                  int numStages,
                  String stagesDir)

Get path for saving the given stage.