The Delete From HDFS stage deletes an HDFS folder/file.

Communication to HDFS will be through the HDFS API FileSystem methods.

Configuration

ElementTypeDefaultDescription
hdfsLocationStringhdfs://localhost:8020The HDFS Namenode URL.
hdfsPathString
The path within the HDFS server where the data will be copied to.


Example

This section provides an example of Copy To HDFS configuration to a local HDFS server.

<component name="PostHDFS" subType="delete-from-hdfs" factoryName="aspire-hadoop-hdfs">
  <hdfsLocation>hdfs://localhost:8020/</hdfsLocation>
  <folderPath>/user/jsmith/testData/</folderPath>
</component>

Output

The AspireObject output will be the same as the input AspireObject as the job acts just like a trigger to perform the copy.

  • No labels