Trait/Object

com.salesforce.op.stages.sparkwrappers.generic

SparkWrapperParams

Related Docs: object SparkWrapperParams | package generic

Permalink

trait SparkWrapperParams[S <: PipelineStage with Params] extends Params

Object to allow generic string based access to parameters of wrapped spark class

S

type of Spark stage to wrap

Self Type
SparkWrapperParams[S] with OpPipelineStageBase
Linear Supertypes
Params, Serializable, Serializable, Identifiable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkWrapperParams
  2. Params
  3. Serializable
  4. Serializable
  5. Identifiable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def copy(extra: ParamMap): Params

    Permalink
    Definition Classes
    Params
  2. abstract val uid: String

    Permalink
    Definition Classes
    Identifiable

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. final def clear(param: Param[_]): SparkWrapperParams.this

    Permalink
    Definition Classes
    Params
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  9. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  13. def explainParams(): String

    Permalink
    Definition Classes
    Params
  14. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  15. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  19. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  20. def getInputColParamNames(): Array[String]

    Permalink

    Gets names of parameters that control input columns for Spark stage

  21. def getLocalMlStage(): Option[Transformer]

    Permalink

    Method to access the local version of stage being wrapped

    Method to access the local version of stage being wrapped

    returns

    Option of ml leap runtime version of the spark stage after reloading as local

  22. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  23. def getOutputColParamNames(): Array[String]

    Permalink

    Gets names of parameters that control output columns for Spark stage

  24. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  25. def getSparkMlStage(): Option[S]

    Permalink

    Method to access the spark stage being wrapped

    Method to access the spark stage being wrapped

    returns

    Option of spark ml stage

  26. def getStageSavePath(): Option[String]

    Permalink

    Gets a save path for wrapped spark stage

  27. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  28. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  29. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  30. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  31. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  32. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  33. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  34. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  35. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  36. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  37. final def set(paramPair: ParamPair[_]): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  38. final def set(param: String, value: Any): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  39. final def set[T](param: Param[T], value: T): SparkWrapperParams.this

    Permalink
    Definition Classes
    Params
  40. final def setDefault(paramPairs: ParamPair[_]*): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  41. final def setDefault[T](param: Param[T], value: T): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  42. def setOutputDF(df: DataFrame): Unit

    Permalink
  43. def setSparkMlStage(stage: Option[S]): SparkWrapperParams.this

    Permalink
    Attributes
    protected
  44. def setStageSavePath(path: String): SparkWrapperParams.this

    Permalink

    Sets a save path for wrapped spark stage

  45. final val sparkInputColParamNames: StringArrayParam

    Permalink
  46. final val sparkMlStage: SparkStageParam[S]

    Permalink
  47. final val sparkOutputColParamNames: StringArrayParam

    Permalink
  48. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  49. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  50. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  51. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  52. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped