Object

org.apache.spark.ml

SparkDefaultParamsReadWrite

Related Doc: package ml

Permalink

object SparkDefaultParamsReadWrite extends Product with Serializable

Direct wrappers for ml private DefaultParamsWriter and DefaultParamsReader needed to read/write Spark stages in OP

Linear Supertypes
Serializable, Serializable, Product, Equals, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkDefaultParamsReadWrite
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type Metadata = util.DefaultParamsReader.Metadata

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  6. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. implicit val formats: DefaultFormats.type

    Permalink
  10. def getAndSetParams(stage: OpPipelineStageBase, metadata: Metadata): Unit

    Permalink

    Extract Params from metadata, and set them in the instance.

    Extract Params from metadata, and set them in the instance. This works if all Params implement org.apache.spark.ml.param.Param.jsonDecode(). TODO: Move to Metadata method

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  12. def getMetadataToSave(stage: OpPipelineStageBase, extraMetadata: Option[JObject] = None, paramMap: Option[JValue] = None): JObject

    Permalink

    Helper for OpPipelineStageWriter which extracts the JSON to save.

    Helper for OpPipelineStageWriter which extracts the JSON to save. This is useful for ensemble models which need to save metadata for many sub-models.

    Note: this method was taken from DefaultParamsWriter.getMetadataToSave, but modified to avoid requiring Spark session instead use org.apache.spark.SPARK_VERSION

    See also

    OpPipelineStageWriter for details on what this includes.

  13. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  15. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  16. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  17. def parseMetadata(jsonStr: String): Metadata

    Permalink

    Parse metadata JSON string produced by DefaultParamsWriter.getMetadataToSave().

    Parse metadata JSON string produced by DefaultParamsWriter.getMetadataToSave(). This is a helper function for loadMetadata().

    Exceptions thrown

    IllegalArgumentException if expectedClassName is specified and does not match metadata

  18. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  19. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  20. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  21. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from AnyRef

Inherited from Any

Ungrouped