Configuration
Element | Type | Default | Description |
---|---|---|---|
hdfsLocation | String | hdfs://localhost:8020 | The HDFS Namenode URL. |
hdfsPath | String | The path within the HDFS server where the data will be copied to. | |
localPath | String | The folder where the data to be copied to HDFS is located. | |
overwrite | boolean | false | Whether or not to overwrite the HDFS folder when copying |
validate | boolean | false | Whether or not to validate if the local file/folder data contains valid AspireInputFormat |
Example
This section provides an example of Copy To HDFS configuration to a local HDFS server.
<component name="PostHDFS" subType="copy-to-hdfs" factoryName="aspire-hadoop-hdfs"> <hdfsLocation>hdfs://localhost:8020/</hdfsLocation> <folderPath>/user/jsmith/testData/</folderPath> <localPath>C:\LocalData\testData</localPath> <overwrite>true</overwrite> <validate>true</validate> </component>
Output
The AspireObject output will be the same as the input AspireObject as the job acts just like a trigger to perform the copy.
Overview
Content Tools