Writes the contents of the dataFrame to a file and creates and "HdfsTabularDatasetObject" corresponding to that data.
Writes the contents of the dataFrame to a file and creates and "HdfsTabularDatasetObject" corresponding to that data. Use this method to convert from a dataFrame, to the HdfsTabularDataset type which Custom Operators take as input. This method deletes what is written at the path before writing to it.
Test the transform with addendum method of an operator written using the DataFrame template.
Use to test the saving and reading of a Operator with HdfsTabularDataset as input and Output.
Use to test the saving and reading of a Operator with HdfsTabularDataset as input and Output. Will work for plugins written using DataFrame template.
Use to test Custom Operators that use SparkIOTypedPluginJob, but do not use the DataFrame template.
Use to test Custom Operators that use SparkIOTypedPluginJob, but do not use the DataFrame template. This method runs the onExecution method with using the giving input, operator, and parameters. Default appConf is an empty map.
This method has been deprecated in favor of macro assertion and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.
This method has been deprecated in favor of macro assertion and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.
This method has been deprecated in favor of macro assumption and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.
This method has been deprecated in favor of macro assumption and will be removed in a future version of ScalaTest. If you need this, please copy the source code into your own trait instead.
This expect method has been deprecated. Please replace all invocations of expect with an identical invocation of assertResult instead.
This expect method has been deprecated. Please replace all invocations of expect with an identical invocation of assertResult instead.
This expectResult method has been deprecated. Please replace all invocations of expectResult with an identical invocation of assertResult instead.
This expectResult method has been deprecated. Please replace all invocations of expectResult with an identical invocation of assertResult instead.