The Apache Kafka Connector will crawl content from a repository.
Introduction
The Apache Kafka Connector will crawl content from a file system with PLAINTEXT protocol.
Environment and Access Requirements
Repository Support
The Apache Kafka connector supports crawling the following the repositories:
| Repository | Version | Connector Version |
|---|---|---|
| Windows | all | 5.0.2 |
| Linux | all | 5.0.2 |
Account Privileges
For the Apache Kafka connector to be able to crawl content, the Aspire Worker nodes must be run with an account with.
Environment Requirements
| Requirement | version |
|---|---|
| Apache Kafka | 3.0.0 |
Framework and Connector Features
Framework Features
| Name | Supported |
|---|---|
| Content Crawling | Yes |
| Identity Crawling | No |
| Snapshot-based Incrementals | Yes |
| Non-snapshot-based Incrementals | No |
| Document Hierarchy | No |
Connector Features
The Apache Kafka connector has the following features:
- Extract documents from multiple Kafka topics.
- Select between one and multiple servers to crawl.
Content Crawled
The Apache Kafka connector is able to crawl the following objects:
| Name | Type | Content Fetch and Extraction | Description |
|---|---|---|---|
| Topic | System.String | Yes | The topic name |
| Partitions | System.Collections.Generic.List<PartitionMetadata> | Yes | Metadata for the partitions of the topic. |
Limitations
The Apache Kafka Connector has the following limitations:
- REST API implementation is part of our future development plan.
- No authentication mechanisms have been implemented to date.
Overview
Content Tools
Copyright © 2024 Accenture
