Publish to HDFS Aspire Components

• Image Added Post HDFS
  • Use this stage to write AspireObjects of each processed Aspire job to HDFS
• Image Added Post WebHDFS
  • Use this stage to write AspireObjects of each processed Aspire job to the WebHDFS REST API

Aspire for Hadoop Components

• Image Added  Emit
  • Use this stage to write a key and the AspireObject of the incoming job to the Hadoop context
• Image Added  Reducer Subjob Extractor
  • From a Reduce job, for every AspireObjectWritable entry associated with the key, creates a subjob with the embedded AspireObject

Hadoop Map Reduce Job

• Image Added  Aspire Hadoop Map Reduce Job
  • A generic Hadoop Job Driver that can be configured to execute map, reduce or/and combine tasks using Aspire pipelines.

HDFS Utilities

• Image Added  Load HDFS
  • Loads an AspireObject json from HDFS using a key
• Image Added  Copy To HDFS
  • Copies a local file/folder into HDFS
• Image Added  Delete From HDFS
  • Deletes an HDFS file/folder

Hadoop Solutions

• Image Added  Semantic Co-occurrence Solution
  • The co-occurrence or collocation of words to form short phrases (2-4 words) can be useful in tagging content and performing query enhancement by adding a level of meaning to these phrases and therefore improved relevancy for result sets.