Class

com.alpine.plugin.test.utils

SimpleAbstractSparkJobSuite

Related Doc: package utils

Permalink

class SimpleAbstractSparkJobSuite extends FunSuite

Linear Supertypes
FunSuite, FunSuiteLike, Documenting, Alerting, Notifying, Informing, TestRegistration, Suite, Serializable, AbstractSuite, Assertions, TripleEquals, TripleEqualsSupport, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SimpleAbstractSparkJobSuite
  2. FunSuite
  3. FunSuiteLike
  4. Documenting
  5. Alerting
  6. Notifying
  7. Informing
  8. TestRegistration
  9. Suite
  10. Serializable
  11. AbstractSuite
  12. Assertions
  13. TripleEquals
  14. TripleEqualsSupport
  15. AnyRef
  16. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SimpleAbstractSparkJobSuite()

    Permalink

Type Members

  1. class AssertionsHelper extends AnyRef

    Permalink
    Definition Classes
    Assertions
  2. class CheckingEqualizer[L] extends AnyRef

    Permalink
    Definition Classes
    TripleEqualsSupport
  3. class Equalizer[L] extends AnyRef

    Permalink
    Definition Classes
    TripleEqualsSupport
  4. class LegacyCheckingEqualizer[L] extends AnyRef

    Permalink
    Definition Classes
    TripleEqualsSupport
  5. class LegacyEqualizer[L] extends AnyRef

    Permalink
    Definition Classes
    TripleEqualsSupport
  6. trait NoArgTest extends () ⇒ Outcome with TestData

    Permalink
    Attributes
    protected
    Definition Classes
    Suite

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. def !==[T](right: Spread[T]): TripleEqualsInvocationOnSpread[T]

    Permalink
    Definition Classes
    TripleEqualsSupport
  3. def !==(right: Null): TripleEqualsInvocation[Null]

    Permalink
    Definition Classes
    TripleEqualsSupport
  4. def !==[T](right: T): TripleEqualsInvocation[T]

    Permalink
    Definition Classes
    TripleEqualsSupport
  5. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  6. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  7. def ===[T](right: Spread[T]): TripleEqualsInvocationOnSpread[T]

    Permalink
    Definition Classes
    TripleEqualsSupport
  8. def ===(right: Null): TripleEqualsInvocation[Null]

    Permalink
    Definition Classes
    TripleEqualsSupport
  9. def ===[T](right: T): TripleEqualsInvocation[T]

    Permalink
    Definition Classes
    TripleEqualsSupport
  10. def alert: Alerter

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Alerting
  11. def alpineSparkEnvironment(appConf: Map[String, String]): AlpineSparkEnvironment

    Permalink
  12. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  13. macro def assert(condition: Boolean, clue: Any): Unit

    Permalink
    Definition Classes
    Assertions
  14. macro def assert(condition: Boolean): Unit

    Permalink
    Definition Classes
    Assertions
  15. macro def assertCompiles(code: String): Unit

    Permalink
    Definition Classes
    Assertions
  16. macro def assertDoesNotCompile(code: String): Unit

    Permalink
    Definition Classes
    Assertions
  17. def assertResult(expected: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
  18. def assertResult(expected: Any, clue: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
  19. macro def assertTypeError(code: String): Unit

    Permalink
    Definition Classes
    Assertions
  20. val assertionsHelper: AssertionsHelper

    Permalink
    Definition Classes
    Assertions
  21. macro def assume(condition: Boolean, clue: Any): Unit

    Permalink
    Definition Classes
    Assertions
  22. macro def assume(condition: Boolean): Unit

    Permalink
    Definition Classes
    Assertions
  23. def cancel(cause: Throwable): Nothing

    Permalink
    Definition Classes
    Assertions
  24. def cancel(message: String, cause: Throwable): Nothing

    Permalink
    Definition Classes
    Assertions
  25. def cancel(message: String): Nothing

    Permalink
    Definition Classes
    Assertions
  26. def cancel(): Nothing

    Permalink
    Definition Classes
    Assertions
  27. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. def conversionCheckedConstraint[A, B](implicit equivalenceOfA: Equivalence[A], cnv: (B) ⇒ A): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  29. def convertEquivalenceToAToBConstraint[A, B](equivalenceOfB: Equivalence[B])(implicit ev: <:<[A, B]): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  30. def convertEquivalenceToAToBConversionConstraint[A, B](equivalenceOfB: Equivalence[B])(implicit ev: (A) ⇒ B): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  31. def convertEquivalenceToBToAConstraint[A, B](equivalenceOfA: Equivalence[A])(implicit ev: <:<[B, A]): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  32. def convertEquivalenceToBToAConversionConstraint[A, B](equivalenceOfA: Equivalence[A])(implicit ev: (B) ⇒ A): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  33. def convertToCheckingEqualizer[T](left: T): CheckingEqualizer[T]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  34. implicit def convertToEqualizer[T](left: T): Equalizer[T]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  35. def convertToLegacyCheckingEqualizer[T](left: T): LegacyCheckingEqualizer[T]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  36. def convertToLegacyEqualizer[T](left: T): LegacyEqualizer[T]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  37. def createHdfsTabularDatasetLocal(dataFrame: DataFrame, path: String): HdfsDelimitedTabularDatasetDefault

    Permalink

    Writes the contents of the dataFrame to a file and creates and "HdfsTabularDatasetObject" corresponding to that data.

    Writes the contents of the dataFrame to a file and creates and "HdfsTabularDatasetObject" corresponding to that data. Use this method to convert from a dataFrame, to the HdfsTabularDataset type which Custom Operators take as input. This method deletes what is written at the path before writing to it.

  38. def defaultEquality[A]: Equality[A]

    Permalink
    Definition Classes
    TripleEqualsSupport
  39. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  40. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  41. final def execute: Unit

    Permalink
    Definition Classes
    Suite
  42. final def execute(testName: String, configMap: ConfigMap, color: Boolean, durations: Boolean, shortstacks: Boolean, fullstacks: Boolean, stats: Boolean): Unit

    Permalink
    Definition Classes
    Suite
  43. def expectedTestCount(filter: Filter): Int

    Permalink
    Definition Classes
    Suite → AbstractSuite
  44. def fail(cause: Throwable): Nothing

    Permalink
    Definition Classes
    Assertions
  45. def fail(message: String, cause: Throwable): Nothing

    Permalink
    Definition Classes
    Assertions
  46. def fail(message: String): Nothing

    Permalink
    Definition Classes
    Assertions
  47. def fail(): Nothing

    Permalink
    Definition Classes
    Assertions
  48. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  49. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  50. def getNewParametersFromDataFrameGui[T <: SparkDataFrameJob](testGUI: SparkDataFrameGUINode[T], inputHdfs: HdfsTabularDataset, inputParameters: OperatorParametersMock, dataSourceName: String = "dataSource"): OperatorParametersMock

    Permalink
  51. def getNewParametersFromGUI[I <: IOBase, O <: IOBase](input: I, operatorGUINode: OperatorGUINode[I, O], inputParameters: OperatorParametersMock, dataSourceName: String = "dataSource"): OperatorParametersMock

    Permalink
  52. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  53. def ignore(testName: String, testTags: Tag*)(testFun: ⇒ Unit): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike
  54. def info: Informer

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Informing
  55. def intercept[T <: AnyRef](f: ⇒ Any)(implicit manifest: Manifest[T]): T

    Permalink
    Definition Classes
    Assertions
  56. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  57. def lowPriorityConversionCheckedConstraint[A, B](implicit equivalenceOfB: Equivalence[B], cnv: (A) ⇒ B): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  58. def lowPriorityTypeCheckedConstraint[A, B](implicit equivalenceOfB: Equivalence[B], ev: <:<[A, B]): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  59. def markup: Documenter

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Documenting
  60. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  61. def nestedSuites: IndexedSeq[Suite]

    Permalink
    Definition Classes
    Suite → AbstractSuite
  62. def note: Notifier

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Notifying
  63. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  64. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  65. def pending: PendingNothing

    Permalink
    Definition Classes
    Suite
  66. def pendingUntilFixed(f: ⇒ Unit): Unit

    Permalink
    Definition Classes
    Suite
  67. final def registerIgnoredTest(testText: String, testTags: Tag*)(testFun: ⇒ Unit): Unit

    Permalink
    Definition Classes
    FunSuiteLike → TestRegistration
  68. final def registerTest(testText: String, testTags: Tag*)(testFun: ⇒ Unit): Unit

    Permalink
    Definition Classes
    FunSuiteLike → TestRegistration
  69. def rerunner: Option[String]

    Permalink
    Definition Classes
    Suite → AbstractSuite
  70. def run(testName: Option[String], args: Args): Status

    Permalink
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  71. final def run(testName: Option[String], reporter: Reporter, stopper: Stopper, filter: Filter, configMap: Map[String, Any], distributor: Option[Distributor], tracker: Tracker): Status

    Permalink
    Definition Classes
    AbstractSuite
  72. def runDataFrameThroughDFTemplate(dataFrame: DataFrame, operator: SparkDataFrameJob, params: OperatorParametersMock): (DataFrame, Map[String, AnyRef])

    Permalink

    Test the transform with addendum method of an operator written using the DataFrame template.

  73. def runDataFrameThroughEntireDFTemplate[T <: SparkDataFrameJob](operatorGUI: SparkDataFrameGUINode[T], operatorJob: T, inputParams: OperatorParametersMock, dataFrameInput: DataFrame, path: String = "target/testResults"): (DataFrame, Map[String, AnyRef])

    Permalink
  74. def runDataFrameThroughOperator(dataFrame: DataFrame, operator: SparkIOTypedPluginJob[HdfsTabularDataset, HdfsTabularDataset], appConf: Map[String, String] = collection.mutable.Map.empty, parameters: OperatorParametersMock): DataFrame

    Permalink

    Use to test the saving and reading of a Operator with HdfsTabularDataset as input and Output.

    Use to test the saving and reading of a Operator with HdfsTabularDataset as input and Output. Will work for plugins written using DataFrame template.

  75. def runInputThroughEntireOperator[I <: IOBase, O <: IOBase](input: I, operatorGUINode: OperatorGUINode[I, O], operatorSparkJob: SparkIOTypedPluginJob[I, O], inputParameters: OperatorParametersMock, appConf: Map[String, String] = collection.mutable.Map.empty): O

    Permalink
  76. def runInputThroughOperator[I <: IOBase, O <: IOBase](input: I, operator: SparkIOTypedPluginJob[I, O], parameters: OperatorParametersMock, appConf: Map[String, String] = collection.mutable.Map.empty): O

    Permalink

    Use to test Custom Operators that use SparkIOTypedPluginJob, but do not use the DataFrame template.

    Use to test Custom Operators that use SparkIOTypedPluginJob, but do not use the DataFrame template. This method runs the onExecution method with using the giving input, operator, and parameters. Default appConf is an empty map.

  77. def runNestedSuites(args: Args): Status

    Permalink
    Attributes
    protected
    Definition Classes
    Suite → AbstractSuite
  78. def runTest(testName: String, args: Args): Status

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  79. def runTests(testName: Option[String], args: Args): Status

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  80. lazy val sparkUtils: SparkRuntimeUtils

    Permalink
  81. final val styleName: String

    Permalink
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  82. def suiteId: String

    Permalink
    Definition Classes
    Suite
  83. def suiteName: String

    Permalink
    Definition Classes
    Suite
  84. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  85. def tags: Map[String, Set[String]]

    Permalink
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  86. def test(testName: String, testTags: Tag*)(testFun: ⇒ Unit): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike
  87. def testDataFor(testName: String, theConfigMap: ConfigMap): TestData

    Permalink
    Definition Classes
    FunSuiteLike → Suite
  88. def testNames: Set[String]

    Permalink
    Definition Classes
    FunSuiteLike → Suite → AbstractSuite
  89. def testsFor(unit: Unit): Unit

    Permalink
    Attributes
    protected
    Definition Classes
    FunSuiteLike
  90. def toString(): String

    Permalink
    Definition Classes
    FunSuite → AnyRef → Any
  91. def trap[T](f: ⇒ T): Throwable

    Permalink
    Definition Classes
    Assertions
  92. def typeCheckedConstraint[A, B](implicit equivalenceOfA: Equivalence[A], ev: <:<[B, A]): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  93. implicit def unconstrainedEquality[A, B](implicit equalityOfA: Equality[A]): Constraint[A, B]

    Permalink
    Definition Classes
    TripleEquals → TripleEqualsSupport
  94. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  95. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  96. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  97. def withClue[T](clue: Any)(fun: ⇒ T): T

    Permalink
    Definition Classes
    Assertions
  98. def withFixture(test: NoArgTest): Outcome

    Permalink
    Attributes
    protected
    Definition Classes
    Suite → AbstractSuite

Deprecated Value Members

  1. def assert(o: Option[String]): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This method has been deprecated in favor of macro assertion and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.

  2. def assert(o: Option[String], clue: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This method has been deprecated in favor of macro assertion and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.

  3. def assume(o: Option[String]): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This method has been deprecated in favor of macro assumption and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.

  4. def assume(o: Option[String], clue: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This method has been deprecated in favor of macro assumption and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.

  5. def expect(expected: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This expect method has been deprecated. Please replace all invocations of expect with an identical invocation of assertResult instead.

  6. def expect(expected: Any, clue: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This expect method has been deprecated. Please replace all invocations of expect with an identical invocation of assertResult instead.

  7. def expectResult(expected: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This expectResult method has been deprecated. Please replace all invocations of expectResult with an identical invocation of assertResult instead.

  8. def expectResult(expected: Any, clue: Any)(actual: Any): Unit

    Permalink
    Definition Classes
    Assertions
    Annotations
    @deprecated
    Deprecated

    This expectResult method has been deprecated. Please replace all invocations of expectResult with an identical invocation of assertResult instead.

Inherited from FunSuite

Inherited from FunSuiteLike

Inherited from Documenting

Inherited from Alerting

Inherited from Notifying

Inherited from Informing

Inherited from TestRegistration

Inherited from Suite

Inherited from Serializable

Inherited from AbstractSuite

Inherited from Assertions

Inherited from TripleEquals

Inherited from TripleEqualsSupport

Inherited from AnyRef

Inherited from Any

Ungrouped