SparkDefaultParamsReadWrite

Value Members

1. final def !=(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

2. final def ##(): Int

   

   Definition Classes

   AnyRef → Any

3. final def ==(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

4. final def asInstanceOf[T0]: T0

   

   Definition Classes

   Any

5. def clone(): AnyRef

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

6. final def eq(arg0: AnyRef): Boolean

   

   Definition Classes

   AnyRef

7. def equals(arg0: Any): Boolean

   

   Definition Classes

   AnyRef → Any

8. def finalize(): Unit

   

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( classOf[java.lang.Throwable] )

9. implicit val formats: DefaultFormats.type

   

10. def getAndSetParams(stage: OpPipelineStageBase, metadata: Metadata, skipParams: Option[List[String]] = None): Unit

    

    Extract Params from metadata, and set them in the instance.

    Extract Params from metadata, and set them in the instance. This works if all Params (except params included by skipParams list) implement org.apache.spark.ml.param.Param.jsonDecode().

    skipParams

    The params included in skipParams won't be set. This is useful if some params don't implement org.apache.spark.ml.param.Param.jsonDecode() and need special handling.

11. final def getClass(): Class[_]

    

    Definition Classes

    AnyRef → Any

12. def getMetadataToSave(instance: OpPipelineStageBase, extraMetadata: Option[JObject] = None, paramMap: Option[JValue] = None): JObject

    

    Helper for OpPipelineStageWriter which extracts the JSON to save.

    Helper for OpPipelineStageWriter which extracts the JSON to save. This is useful for ensemble models which need to save metadata for many sub-models.

    Note: this method was taken from DefaultParamsWriter.getMetadataToSave, but modified to avoid requiring Spark session instead use org.apache.spark.SPARK_VERSION

    See also

    OpPipelineStageWriter for details on what this includes.

13. final def isInstanceOf[T0]: Boolean

    

    Definition Classes

    Any

14. final def ne(arg0: AnyRef): Boolean

    

    Definition Classes

    AnyRef

15. final def notify(): Unit

    

    Definition Classes

    AnyRef

16. final def notifyAll(): Unit

    

    Definition Classes

    AnyRef

17. def parseMetadata(metadataStr: String, expectedClassName: String = ""): Metadata

    

    Parse metadata JSON string produced by DefaultParamsWriter.getMetadataToSave().

    Parse metadata JSON string produced by DefaultParamsWriter.getMetadataToSave(). This is a helper function for loadMetadata().

    Note: this method was taken from DefaultParamsWriter.parseMetadata, but modified to avoid failing on loading of Spark models prior to 2.4.x

    metadataStr

    JSON string of metadata

    expectedClassName

    If non empty, this is checked against the loaded metadata.

    Exceptions thrown

    IllegalArgumentException if expectedClassName is specified and does not match metadata

18. final def synchronized[T0](arg0: ⇒ T0): T0

    

    Definition Classes

    AnyRef

19. final def wait(): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

20. final def wait(arg0: Long, arg1: Int): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

21. final def wait(arg0: Long): Unit

    

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )