The Apache Kafka Connector will crawl content from a repository.
Easy Heading Free | ||||||
---|---|---|---|---|---|---|
|
The Apache Kafka Connector will crawl content from a file system with PLAINTEXT protocol.
The Apache Kafka connector supports crawling the following the repositories:
Repository | Version | Connector Version |
---|---|---|
Windows | Kafkaall | 5.0.2 |
Linux | all | 5.0.2 |
For the Apache Kafka connector the Apache Kafka connector to be able to crawl content, the Aspire Worker nodes must be run with an account with with.
Requirement | version |
---|---|
Apache Kafka | 3.0.0 |
Name | Supported |
---|---|
Content Crawling | yes Yes |
Identity Crawling | noNo |
Snapshot-based Incrementals | yesYes |
Non-snapshot-based Incrementals | yesNo |
Document Hierarchy | noNo |
The Apache Kafka connector has the following features:
The Apache Kafka connector is able to crawl the following objects:
Name | TypeRelevant Metadata | Content Fetch and Extraction | Description | |
---|---|---|---|---|
FileTopicdocument | System.Stringpartition | Yes | offsetThe topic name | N/A |
Partitions | System.Collections.Generic.List<PartitionMetadata> | Yes | Metadata for the partitions of the topic | The files contained by the directories in the crawled file system. |
The Apache Kafka Connector has the following limitations: