Package

com.salesforce.op

test

Permalink

package test

Visibility
  1. Public
  2. All

Type Members

  1. trait FeatureTestBase extends TestSparkContext with PropertyChecks

    Permalink

    Common functionality for testing Feature operations (transformers / estimators)

  2. trait FeatureTypeEquality[O <: FeatureType] extends AnyRef

    Permalink

    Feature Type equality instances mixin.

    Feature Type equality instances mixin. Allowing users to customize equality in tests, for example to allow numerical tolerance.

    O

    feature type

  3. final class Gender extends Enum[Gender]

    Permalink
  4. class JoinTestData extends SpecificRecordBase with SpecificRecord

    Permalink
  5. abstract class OpEstimatorSpec[O <: FeatureType, ModelType <: Model[ModelType] with OpPipelineStage[O] with OpTransformer, EstimatorType <: Estimator[ModelType] with OpPipelineStage[O]] extends OpPipelineStageSpec[O, EstimatorType]

    Permalink

    Base test class for testing OP estimator instances.

    Base test class for testing OP estimator instances. Includes common tests for fitting estimator and verifying the fitted model.

    O

    output feature type

    ModelType

    model type produced by this estimator

    EstimatorType

    type of the estimator being tested

  6. trait OpPipelineStageAsserts extends AppendedClues

    Permalink

    Stage assertion for OpPipelineStage

  7. abstract class OpPipelineStageSpec[O <: FeatureType, StageType <: OpPipelineStage[O]] extends FlatSpec with FeatureTypeEquality[O] with TestSparkContext with OpPipelineStageAsserts

    Permalink

    Spec for testing OpPipelineStage instances (transformers or estimators).

    Spec for testing OpPipelineStage instances (transformers or estimators). Includes common tests for output feature, copy, serialization, json read/write etc.

    O

    output feature type

    StageType

    OpPipelineStage type being tested (transformer or estimator)

  8. abstract class OpTransformerSpec[O <: FeatureType, TransformerType <: OpPipelineStage[O] with Transformer with OpTransformer] extends OpPipelineStageSpec[O, TransformerType]

    Permalink

    Base test class for testing OpPipelineStage instances (transformers or estimators).

    Base test class for testing OpPipelineStage instances (transformers or estimators). Includes common tests for schema and data transformations.

    O

    output feature type

    TransformerType

    type of the transformer being tested

  9. class Passenger extends SpecificRecordBase with SpecificRecord

    Permalink
  10. class PassengerCSV extends SpecificRecordBase with SpecificRecord

    Permalink
  11. trait PassengerFeaturesTest extends AnyRef

    Permalink
  12. class PassengerProfile extends SpecificRecordBase with SpecificRecord

    Permalink
  13. trait PassengerSparkFixtureTest extends TestSparkContext with PassengerFeaturesTest

    Permalink
  14. case class Prestige(education: Double, income: Double, women: Double, prestige: Double) extends Product with Serializable

    Permalink
  15. trait PrestigeData extends AnyRef

    Permalink
  16. class SparkExample extends SpecificRecordBase with SpecificRecord

    Permalink
  17. class SparkExampleJoin extends SpecificRecordBase with SpecificRecord

    Permalink
  18. trait TempDirectoryTest extends BeforeAndAfterAll

    Permalink

    Trait that creates a temporary directory before all tests and deletes it after all.

    Trait that creates a temporary directory before all tests and deletes it after all. Modified version of Spark 2.x test suite trait

  19. trait TestCommon extends Matchers with Assertions

    Permalink

    Trait with test commons such as Spec and Resource functions

  20. sealed trait TestOpVectorColumnType extends AnyRef

    Permalink

    Represents a type of column associated with a feature in a vector metadata.

  21. trait TestSparkContext extends TempDirectoryTest with TestCommon

    Permalink

    Trait to enable Spark context for tests Modified version of Spark 2.x test suite trait

  22. trait TestSparkStreamingContext extends TestSparkContext

    Permalink

    Trait to enable Spark streaming context for tests

Value Members

  1. object SparkMatchers

    Permalink

    Convenient matchers for spark functionality.

    Convenient matchers for spark functionality.

    Examples of usage:

     in(myDF) allOf "MyNumericColumn" should beBetween(-1, 1)
    
     in(myDF) someOf "MyStringColumn" should (
       (x: String) => (x contains "Country") || (x contains "State")
    )
    
    in(myDF) noneOf "UserName" shouldContain "Snowden"
  2. object TestFeatureBuilder extends Product with Serializable

    Permalink

    Test Feature Builder is a factory for creating datasets and features for tests

  3. object TestOpVectorColumnType

    Permalink
  4. object TestOpVectorMetadataBuilder

    Permalink

    Helps construct OpVectorMetadata as expected from a stage

  5. object TestOpWorkflowBuilder

    Permalink

    A factory to create OpWorkflow instances for tests

Ungrouped