OpVectorColumnHistory

Full history for each column element in a vector

columnName: name for feature in column
parentFeatureName: name of immediate parent feature that was used to create the vector
parentFeatureOrigins: names of raw features that went into the parent feature
parentFeatureStages: stageNames of all stages applied to the parent feature before conversion to a vector
parentFeatureType: type of the parent feature
grouping: The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None
indicatorValue: A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None
descriptorValue: A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None
index: the index of the vector column this information is tied to

Linear Supertypes

Product, Equals, JsonLike, Serializable, Serializable, AnyRef, Any

Instance Constructors

new OpVectorColumnHistory(columnName: String, parentFeatureName: Seq[String], parentFeatureOrigins: Seq[String], parentFeatureStages: Seq[String], parentFeatureType: Seq[String], grouping: Option[String], indicatorValue: Option[String], descriptorValue: Option[String], index: Int)

columnName

name for feature in column

parentFeatureName

name of immediate parent feature that was used to create the vector

parentFeatureOrigins

names of raw features that went into the parent feature

parentFeatureStages

stageNames of all stages applied to the parent feature before conversion to a vector

parentFeatureType

type of the parent feature

grouping

The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None

indicatorValue

A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None

descriptorValue

A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None

index

the index of the vector column this information is tied to

Value Members

final def !=(arg0: Any): Boolean

Definition Classes

AnyRef → Any
final def ##(): Int

Definition Classes

AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes

AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes

Any
def clone(): AnyRef

Attributes

protected[java.lang]

Definition Classes

AnyRef

Annotations

@throws( ... )
val columnName: String

name for feature in column
val descriptorValue: Option[String]

A name for a value that is continuous (not a binary indicator) eg for geolocation (lat, lon, accuracy) or for dates that have been converted to a circular representation the time window and x or y coordinate, otherwise None
final def eq(arg0: AnyRef): Boolean

Definition Classes

AnyRef
def finalize(): Unit

Attributes

protected[java.lang]

Definition Classes

AnyRef

Annotations

@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes

AnyRef → Any
val grouping: Option[String]

The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too).

The name of the group a column belongs to (usually the parent feature, but in the case of TextMapVectorizer, this includes keys in maps too). Every other vector column in the same vector that has this same indicator group should be mutually exclusive to this one. If this is not an indicator, then this field is None
val index: Int

the index of the vector column this information is tied to
val indicatorValue: Option[String]

A name for a binary indicator value (null indicator or result of a pivot or whatever that value is), otherwise None
final def isInstanceOf[T0]: Boolean

Definition Classes

Any
final def ne(arg0: AnyRef): Boolean

Definition Classes

AnyRef
final def notify(): Unit

Definition Classes

AnyRef
final def notifyAll(): Unit

Definition Classes

AnyRef
val parentFeatureName: Seq[String]

name of immediate parent feature that was used to create the vector
val parentFeatureOrigins: Seq[String]

names of raw features that went into the parent feature
val parentFeatureStages: Seq[String]

stageNames of all stages applied to the parent feature before conversion to a vector
val parentFeatureType: Seq[String]

type of the parent feature
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes

AnyRef
def toJson(pretty: Boolean = true): String

Write this instance to json string

Write this instance to json string

pretty

should pretty print

returns

json string of the instance

Definition Classes

JsonLike
def toString(): String

This instance json string

This instance json string

returns

json string of the instance

Definition Classes

JsonLike → AnyRef → Any
final def wait(): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )

Related Docs: object OpVectorColumnHistory | package spark

Instance Constructors

new OpVectorColumnHistory(columnName: String, parentFeatureName: Seq[String], parentFeatureOrigins: Seq[String], parentFeatureStages: Seq[String], parentFeatureType: Seq[String], grouping: Option[String], indicatorValue: Option[String], descriptorValue: Option[String], index: Int)

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

val columnName: String

val descriptorValue: Option[String]

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

val grouping: Option[String]

val index: Int

val indicatorValue: Option[String]

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

val parentFeatureName: Seq[String]

val parentFeatureOrigins: Seq[String]

val parentFeatureStages: Seq[String]

val parentFeatureType: Seq[String]

final def synchronized[T0](arg0: ⇒ T0): T0

def toJson(pretty: Boolean = true): String

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Product

Inherited from Equals

Inherited from JsonLike

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped