Package

com.salesforce.op

stages

Permalink

package stages

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. stages
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. final class DefaultOpPipelineStageReaderWriter[StageType <: OpPipelineStageBase] extends OpPipelineStageReaderWriter[StageType] with OpPipelineStageSerializationFuns

    Permalink

    Default reader/writer for stages that uses reflection to reflect stage ctor arguments

    Default reader/writer for stages that uses reflection to reflect stage ctor arguments

    StageType

    stage type to read/write

  2. final class DefaultValueReaderWriter[T <: AnyRef] extends ValueReaderWriter[T] with OpPipelineStageReadWriteFormats with OpPipelineStageSerializationFuns

    Permalink

    Default value reader/writer implementation used to (de)serialize stage arguments from/to trained models based on their class name and no args ctor.

    Default value reader/writer implementation used to (de)serialize stage arguments from/to trained models based on their class name and no args ctor.

    T

    value type to read/write

  3. final class FeatureGeneratorStage[I, O <: FeatureType] extends PipelineStage with OpPipelineStage[O] with HasIn1

    Permalink

    Origin stage for first features in workflow

    Origin stage for first features in workflow

    I

    input data type

    O

    output feature type

    Annotations
    @ReaderWriter()
  4. class FeatureGeneratorStageReaderWriter[I, O <: FeatureType] extends OpPipelineStageReaderWriter[FeatureGeneratorStage[I, O]] with OpPipelineStageSerializationFuns

    Permalink

    Stage reader/writer implementation used to (de)serialize FeatureGeneratorStage

  5. trait HasIn1 extends AnyRef

    Permalink
  6. trait HasIn1PlusN extends HasIn1

    Permalink
  7. trait HasIn2 extends AnyRef

    Permalink
  8. trait HasIn3 extends AnyRef

    Permalink
  9. trait HasIn4 extends AnyRef

    Permalink
  10. trait HasInN extends AnyRef

    Permalink
  11. trait InputParams extends Params

    Permalink

    Parameters and functions shared across the input features

  12. type OPStage = OpPipelineStage[_ <: FeatureType]

    Permalink

    Some common type shortcuts

  13. trait OpPipelineStage[O <: FeatureType] extends OpPipelineStageBase

    Permalink

    TransmogrifAI Base Pipeline Stage allowing to specify Input Feature types and a single Output Feature type

    TransmogrifAI Base Pipeline Stage allowing to specify Input Feature types and a single Output Feature type

    O

    output feature type

  14. trait OpPipelineStage1[I <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasOut[O]

    Permalink

    Pipeline stage of Feature type I to O

    Pipeline stage of Feature type I to O

    I

    input feature type

    O

    output feature type

  15. trait OpPipelineStage1to2[I <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1

    Permalink

    Pipeline stage of Feature type I to Features O1 and O2

    Pipeline stage of Feature type I to Features O1 and O2

    I

    input feature type

    O1

    first output feature type

    O2

    second output feature type

  16. trait OpPipelineStage1to3[I <: FeatureType, O1 <: FeatureType, O2 <: FeatureType, O3 <: FeatureType] extends OpPipelineStageBase with HasIn1

    Permalink

    Pipeline stage of Feature type I to Features O1, O2 and O3

    Pipeline stage of Feature type I to Features O1, O2 and O3

    I

    input feature type

    O1

    first output feature type

    O2

    second output feature type

    O3

    third output feature type

  17. trait OpPipelineStage2[I1 <: FeatureType, I2 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2 with HasOut[O]

    Permalink

    Pipeline stage of Feature type I1 and I2 to Feature of type O

    Pipeline stage of Feature type I1 and I2 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    O

    output feature type

  18. trait OpPipelineStage2N[I1 <: FeatureType, I2 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1PlusN with HasOut[O]

    Permalink

    Pipeline stage of single Feature of type I1 with multiple Features of type I2 to output Feature of type O

    Pipeline stage of single Feature of type I1 with multiple Features of type I2 to output Feature of type O

    I1

    input single feature type

    I2

    input sequence feature type

    O

    output feature type

  19. trait OpPipelineStage2to2[I1 <: FeatureType, I2 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2

    Permalink

    Pipeline stage of Feature type I1 and I2 to Feature of type O1 and O2

    Pipeline stage of Feature type I1 and I2 to Feature of type O1 and O2

    I1

    input feature type 1

    I2

    input feature type 2

    O1

    first output feature type

    O2

    second output feature type

  20. trait OpPipelineStage2to3[I1 <: FeatureType, I2 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType, O3 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2

    Permalink

    Pipeline stage of Feature type I1 and I2 to Features O1, O2 and O3

    Pipeline stage of Feature type I1 and I2 to Features O1, O2 and O3

    I1

    input feature type 1

    I2

    input feature type 2

    O1

    first output feature type

    O2

    second output feature type

    O3

    third output feature type

  21. trait OpPipelineStage3[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2 with HasIn3 with HasOut[O]

    Permalink

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    O

    output feature type

  22. trait OpPipelineStage3to2[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, O1 <: FeatureType, O2 <: FeatureType] extends OpPipelineStageBase with HasIn1 with HasIn2 with HasIn3

    Permalink

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O1 and O2

    Pipeline stage of Feature type I1, I2 and I3 to Feature of type O1 and O2

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    O1

    first output feature type

    O2

    second output feature type

  23. trait OpPipelineStage4[I1 <: FeatureType, I2 <: FeatureType, I3 <: FeatureType, I4 <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasIn1 with HasIn2 with HasIn3 with HasIn4 with HasOut[O]

    Permalink

    Pipeline stage of Feature type I1, I2, I3, and I4 to Feature of type O

    Pipeline stage of Feature type I1, I2, I3, and I4 to Feature of type O

    I1

    first input feature type

    I2

    second input feature type

    I3

    third input feature type

    I4

    fourth input feature type

    O

    output feature type

  24. trait OpPipelineStageBase extends OpPipelineStageParams with MLWritable

    Permalink

    TransmogrifAI Base Pipeline Stage allowing to specify arbitrary Input and Output Feature types

    TransmogrifAI Base Pipeline Stage allowing to specify arbitrary Input and Output Feature types

    Internally the stage operates and serializes the TransientFeature. However to maintain usability for users, the getters will return FeatureLike objects. It is important that during development these features are not captured into a UDF since the entire DAG will be serialized onto worker nodes. All stage method, when referring to inputs, should access them via HasIn[1,2,3,4,N] traits.

  25. trait OpPipelineStageN[I <: FeatureType, O <: FeatureType] extends OpPipelineStage[O] with HasInN with HasOut[O]

    Permalink

    Pipeline stage of multiple Features of type I to Feature of type O

    Pipeline stage of multiple Features of type I to Feature of type O

    I

    input feature type

    O

    output feature type

  26. trait OpPipelineStageParams extends InputParams

    Permalink

    Parameters shared across all TransmogrifAI base stages

  27. trait OpPipelineStageReadWriteFormats extends AnyRef

    Permalink
  28. final class OpPipelineStageReader extends MLReader[OpPipelineStageBase]

    Permalink

    Reads the serialized output of OpPipelineStageWriter

  29. trait OpPipelineStageReaderWriter[StageType <: OpPipelineStageBase] extends ValueReaderWriter[StageType] with OpPipelineStageReadWriteFormats

    Permalink

    Stage reader/writer implementation used to (de)serialize stages from/to trained models

    Stage reader/writer implementation used to (de)serialize stages from/to trained models

    StageType

    stage type to read/write

  30. final class OpPipelineStageWriter extends MLWriter

    Permalink

    MLWriter class used to write TransmogrifAI stages to disk

  31. class ReaderWriter extends Annotation with Annotation with ClassfileAnnotation

    Permalink
  32. class SparkStageParam[S <: PipelineStage with Params] extends Param[Option[S]]

    Permalink
  33. trait ValueReaderWriter[T <: AnyRef] extends AnyRef

    Permalink

    Value reader/writer implementation used to (de)serialize stage arguments from/to trained models

    Value reader/writer implementation used to (de)serialize stage arguments from/to trained models

    T

    value type to read/write

Value Members

  1. object OpPipelineStageParamsNames

    Permalink
  2. object OpPipelineStageReaderWriter extends OpPipelineStageReadWriteFormats

    Permalink
  3. object SparkStageParam extends Serializable

    Permalink
  4. object ValueReaderWriter

    Permalink
  5. package base

    Permalink
  6. package impl

    Permalink
  7. package sparkwrappers

    Permalink

Inherited from AnyRef

Inherited from Any

Ungrouped