Package

com.salesforce.op

stages

Permalink

package stages

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. stages
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. final class FeatureGeneratorStage[I, O <: FeatureType] extends PipelineStage with OpPipelineStage[O] with HasIn1

    Permalink

    Origin stage for first features in workflow

    Origin stage for first features in workflow

    I

    input data type

    O

    output feature type

  2. trait HasIn1 extends AnyRef

    Permalink
  3. trait HasIn1PlusN extends HasIn1

    Permalink
  4. trait HasIn2 extends AnyRef

    Permalink
  5. trait HasIn3 extends AnyRef

    Permalink
  6. trait HasIn4 extends AnyRef

    Permalink
  7. trait HasInN extends AnyRef

    Permalink
  8. trait InputParams extends Params

    Permalink

    Parameters and functions shared across the input features

  9. type OPStage = OpPipelineStage[_ <: FeatureType]

    Permalink

    Some common type shortcuts

  10. trait OpPipelineStage[O <: FeatureType] extends OpPipelineStageBase

    Permalink

    TransmogrifAI Base Pipeline Stage allowing to specify Input Feature types and a single Output Feature type

    TransmogrifAI Base Pipeline Stage allowing to specify Input Feature types and a single Output Feature type

    O

    output feature type

  11. trait OpPipelineStage1[I <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1

    Permalink

    Pipeline stage of Feature type I to O

    Pipeline stage of Feature type I to O

    I

    input feature type

    O

    output feature type

  12. trait OpPipelineStage1to2[I <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1

    Permalink

    Pipeline stage of Feature type I to Features O1 and O2

    Pipeline stage of Feature type I to Features O1 and O2

    I

    input feature type

    O1

    first output feature type

    O2

    second output feature type

  13. trait OpPipelineStage1to3[I <: FeatureType, O1 <: FeatureType, O2 <: FeatureType, O3 <: FeatureType] extends OpPipelineStageBase with HasIn1

    Permalink

    Pipeline stage of Feature type I to Features O1, O2 and O3

    Pipeline stage of Feature type I to Features O1, O2 and O3

    I

    input feature type

    O1

    first output feature type

    O2

    second output feature type

    O3

    third output feature type

  14. trait OpPipelineStage2[I1 <: FeatureType, I2 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2

    Permalink

    Pipeline stage of Feature type I1 and I2 to Feature of type O

    Pipeline stage of Feature type I1 and I2 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    O

    output feature type

  15. trait OpPipelineStage2N[I1 <: FeatureType, I2 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1PlusN

    Permalink

    Pipeline stage of single Feature of type I1 with multiple Features of type I2 to output Feature of type O

    Pipeline stage of single Feature of type I1 with multiple Features of type I2 to output Feature of type O

    I1

    input single feature type

    I2

    input sequence feature type

    O

    output feature type

  16. trait OpPipelineStage2to2[I1 <: FeatureType, I2 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2

    Permalink

    Pipeline stage of Feature type I1 and I2 to Feature of type O1 and O2

    Pipeline stage of Feature type I1 and I2 to Feature of type O1 and O2

    I1

    input feature type 1

    I2

    input feature type 2

    O1

    first output feature type

    O2

    second output feature type

  17. trait OpPipelineStage2to3[I1 <: FeatureType, I2 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType, O3 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2

    Permalink

    Pipeline stage of Feature type I1 and I2 to Features O1, O2 and O3

    Pipeline stage of Feature type I1 and I2 to Features O1, O2 and O3

    I1

    input feature type 1

    I2

    input feature type 2

    O1

    first output feature type

    O2

    second output feature type

    O3

    third output feature type

  18. trait OpPipelineStage3[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2 with HasIn3

    Permalink

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    O

    output feature type

  19. trait OpPipelineStage3to2[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2 with HasIn3

    Permalink

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O1 and O2

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O1 and O2

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    O1

    first output feature type

    O2

    second output feature type

  20. trait OpPipelineStage4[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, I4 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2 with HasIn3 with HasIn4

    Permalink

    Pipeline stage of Feature type I1, I2, I3, and I4 to Feature of type O

    Pipeline stage of Feature type I1, I2, I3, and I4 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    I4

    fourth input feature type

    O

    output feature type

  21. trait OpPipelineStageBase extends OpPipelineStageParams with MLWritable

    Permalink

    TransmogrifAI Base Pipeline Stage allowing to specify arbitrary Input and Output Feature types

    TransmogrifAI Base Pipeline Stage allowing to specify arbitrary Input and Output Feature types

    Internally the stage operates and serializes the TransientFeature. However to maintain usability for users, the getters will return FeatureLike objects. It is important that during development these features are not captured into a UDF since the entire DAG will be serialized onto worker nodes. All stage method, when referring to inputs, should access them via HasIn[1,2,3,4,N] traits.

  22. trait OpPipelineStageN[I <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasInN

    Permalink

    Pipeline stage of multiple Features of type I to Feature of type O

    Pipeline stage of multiple Features of type I to Feature of type O

    I

    input feature type

    O

    output feature type

  23. trait OpPipelineStageParams extends InputParams

    Permalink

    Parameters shared across all TransmogrifAI base stages

  24. final class OpPipelineStageReader extends MLReader[OpPipelineStageBase]

    Permalink

    Reads the serialized output of OpPipelineStageWriter

  25. final class OpPipelineStageWriter extends MLWriter

    Permalink

    MLWriter class used to write TransmogrifAI stages to disk

  26. class SparkStageParam[S <: PipelineStage with Params] extends Param[Option[S]]

    Permalink

Value Members

  1. object OpPipelineStageParamsNames

    Permalink
  2. object OpPipelineStageReadWriteShared

    Permalink
  3. object SparkStageParam extends Serializable

    Permalink
  4. package base

    Permalink
  5. package impl

    Permalink
  6. package sparkwrappers

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped