MulticlassThresholdMetrics

Threshold-based metrics for multiclass classification

Classifications being correct, incorrect, or no classification are defined in terms of the topN and score threshold to be: Correct - score of the true label is in the top N scores AND the score of the true label is >= threshold Incorrect - score of top predicted label >= threshold AND (true label NOT in top N predicted labels OR score of true label < threshold) No prediction - otherwise (score of top predicted label < threshold)

topNs: list of topN values (used as keys for the count maps)
thresholds: list of threshold values (correspond to thresholds at the indices of the arrays in the count maps)
correctCounts: map from topN value to an array of counts of correct classifications at each threshold
incorrectCounts: map from topN value to an array of counts of incorrect classifications at each threshold
noPredictionCounts: map from topN value to an array of counts of no prediction at each threshold

Linear Supertypes

Product, Equals, EvaluationMetrics, JsonLike, Serializable, Serializable, AnyRef, Any

Instance Constructors

new MulticlassThresholdMetrics(topNs: Seq[Int], thresholds: Seq[Double], correctCounts: Map[Int, Seq[Long]], incorrectCounts: Map[Int, Seq[Long]], noPredictionCounts: Map[Int, Seq[Long]])

topNs

list of topN values (used as keys for the count maps)

thresholds

list of threshold values (correspond to thresholds at the indices of the arrays in the count maps)

correctCounts

map from topN value to an array of counts of correct classifications at each threshold

incorrectCounts

map from topN value to an array of counts of incorrect classifications at each threshold

noPredictionCounts

map from topN value to an array of counts of no prediction at each threshold

Value Members

final def !=(arg0: Any): Boolean

Definition Classes

AnyRef → Any
final def ##(): Int

Definition Classes

AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes

AnyRef → Any
final def asInstanceOf[T0]: T0

Definition Classes

Any
def clone(): AnyRef

Attributes

protected[java.lang]

Definition Classes

AnyRef

Annotations

@throws( ... )
val correctCounts: Map[Int, Seq[Long]]

map from topN value to an array of counts of correct classifications at each threshold
final def eq(arg0: AnyRef): Boolean

Definition Classes

AnyRef
def finalize(): Unit

Attributes

protected[java.lang]

Definition Classes

AnyRef

Annotations

@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes

AnyRef → Any
val incorrectCounts: Map[Int, Seq[Long]]

map from topN value to an array of counts of incorrect classifications at each threshold
final def isInstanceOf[T0]: Boolean

Definition Classes

Any
final def ne(arg0: AnyRef): Boolean

Definition Classes

AnyRef
val noPredictionCounts: Map[Int, Seq[Long]]

map from topN value to an array of counts of no prediction at each threshold
final def notify(): Unit

Definition Classes

AnyRef
final def notifyAll(): Unit

Definition Classes

AnyRef
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes

AnyRef
val thresholds: Seq[Double]

list of threshold values (correspond to thresholds at the indices of the arrays in the count maps)
def toJson(pretty: Boolean = true): String

Write this instance to json string

Write this instance to json string

pretty

should pretty print

returns

json string of the instance

Definition Classes

JsonLike
def toMap: Map[String, Any]

Convert metrics class to a map

Convert metrics class to a map

returns

a map from metric name to metric value

Definition Classes

EvaluationMetrics
def toMetadata(skipUnsupported: Boolean = false): Metadata

Convert metrics into Metadata for saving

Convert metrics into Metadata for saving

skipUnsupported

skip unsupported values

returns

Metadata metadata

Definition Classes

EvaluationMetrics

Exceptions thrown

RuntimeException in case of unsupported value type
def toString(): String

This instance json string

This instance json string

returns

json string of the instance

Definition Classes

JsonLike → AnyRef → Any
val topNs: Seq[Int]

list of topN values (used as keys for the count maps)
final def wait(): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes

AnyRef

Annotations

@throws( ... )

Related Doc: package evaluators

case class MulticlassThresholdMetrics(topNs: Seq[Int], thresholds: Seq[Double], correctCounts: Map[Int, Seq[Long]], incorrectCounts: Map[Int, Seq[Long]], noPredictionCounts: Map[Int, Seq[Long]]) extends EvaluationMetrics with Product with Serializable

Instance Constructors

new MulticlassThresholdMetrics(topNs: Seq[Int], thresholds: Seq[Double], correctCounts: Map[Int, Seq[Long]], incorrectCounts: Map[Int, Seq[Long]], noPredictionCounts: Map[Int, Seq[Long]])

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

final def asInstanceOf[T0]: T0

def clone(): AnyRef

val correctCounts: Map[Int, Seq[Long]]

final def eq(arg0: AnyRef): Boolean

def finalize(): Unit

final def getClass(): Class[_]

val incorrectCounts: Map[Int, Seq[Long]]

final def isInstanceOf[T0]: Boolean

final def ne(arg0: AnyRef): Boolean

val noPredictionCounts: Map[Int, Seq[Long]]

final def notify(): Unit

final def notifyAll(): Unit

final def synchronized[T0](arg0: ⇒ T0): T0

val thresholds: Seq[Double]

def toJson(pretty: Boolean = true): String

def toMap: Map[String, Any]

def toMetadata(skipUnsupported: Boolean = false): Metadata

def toString(): String

val topNs: Seq[Int]

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from Product

Inherited from Equals

Inherited from EvaluationMetrics

Inherited from JsonLike

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped