Trait/Object

com.salesforce.op.stages.sparkwrappers.generic

SparkWrapperParams

Related Docs: object SparkWrapperParams | package generic

Permalink

trait SparkWrapperParams[S <: PipelineStage with Params] extends Params

Object to allow generic string based access to parameters of wrapped spark class

S

type of Spark stage to wrap

Self Type
SparkWrapperParams[S] with PipelineStage
Linear Supertypes
Params, Serializable, Serializable, Identifiable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkWrapperParams
  2. Params
  3. Serializable
  4. Serializable
  5. Identifiable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Abstract Value Members

  1. abstract def copy(extra: ParamMap): Params

    Permalink
    Definition Classes
    Params
  2. abstract val uid: String

    Permalink
    Definition Classes
    Identifiable

Concrete Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def $[T](param: Param[T]): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  4. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  5. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  6. final def clear(param: Param[_]): SparkWrapperParams.this

    Permalink
    Definition Classes
    Params
  7. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  8. def copyValues[T <: Params](to: T, extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  9. final def defaultCopy[T <: Params](extra: ParamMap): T

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  10. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  12. def explainParam(param: Param[_]): String

    Permalink
    Definition Classes
    Params
  13. def explainParams(): String

    Permalink
    Definition Classes
    Params
  14. final def extractParamMap(): ParamMap

    Permalink
    Definition Classes
    Params
  15. final def extractParamMap(extra: ParamMap): ParamMap

    Permalink
    Definition Classes
    Params
  16. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  17. final def get[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  18. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  19. final def getDefault[T](param: Param[T]): Option[T]

    Permalink
    Definition Classes
    Params
  20. def getInputColParamNames(): Array[String]

    Permalink

    Gets names of parameters that control input columns for Spark stage

  21. final def getOrDefault[T](param: Param[T]): T

    Permalink
    Definition Classes
    Params
  22. def getOutputColParamNames(): Array[String]

    Permalink

    Gets names of parameters that control output columns for Spark stage

  23. def getParam(paramName: String): Param[Any]

    Permalink
    Definition Classes
    Params
  24. def getSparkMlStage(): Option[S]

    Permalink

    Method to access the spark stage being wrapped

    Method to access the spark stage being wrapped

    returns

    Option of spark ml stage

  25. def getStageSavePath(): Option[String]

    Permalink

    Gets a save path for wrapped spark stage

  26. final def hasDefault[T](param: Param[T]): Boolean

    Permalink
    Definition Classes
    Params
  27. def hasParam(paramName: String): Boolean

    Permalink
    Definition Classes
    Params
  28. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  29. final def isDefined(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  30. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  31. final def isSet(param: Param[_]): Boolean

    Permalink
    Definition Classes
    Params
  32. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  33. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  34. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  35. lazy val params: Array[Param[_]]

    Permalink
    Definition Classes
    Params
  36. final def set(paramPair: ParamPair[_]): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  37. final def set(param: String, value: Any): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  38. final def set[T](param: Param[T], value: T): SparkWrapperParams.this

    Permalink
    Definition Classes
    Params
  39. final def setDefault(paramPairs: ParamPair[_]*): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  40. final def setDefault[T](param: Param[T], value: T): SparkWrapperParams.this

    Permalink
    Attributes
    protected
    Definition Classes
    Params
  41. def setSparkMlStage(stage: Option[S]): SparkWrapperParams.this

    Permalink
    Attributes
    protected
  42. def setStageSavePath(path: String): SparkWrapperParams.this

    Permalink

    Sets a save path for wrapped spark stage

  43. final val sparkInputColParamNames: StringArrayParam

    Permalink
  44. final val sparkMlStage: SparkStageParam[S]

    Permalink
  45. final val sparkOutputColParamNames: StringArrayParam

    Permalink
  46. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  47. def toString(): String

    Permalink
    Definition Classes
    Identifiable → AnyRef → Any
  48. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  49. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  50. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Params

Inherited from Serializable

Inherited from Serializable

Inherited from Identifiable

Inherited from AnyRef

Inherited from Any

Ungrouped