Skip to content

kafka-connect Build a Kafka Source connector to pull Adobe IO Events and stream these in Kafka #159

Open

Description

@francoisledroff

Build a Kafka Source kafka-connect connector :

  • that leverages aio-lib-java sdk to pull Adobe IO Events from the journaling API
  • and stream these Events in Kafka.

see https://kafka.apache.org/documentation/#connect

Activity

  1. OneCricketeer commented on Jun 6, 2023

    @OneCricketeer

    There already exists a sink connector. Perhaps add the source connector class to that?

    One concern I had with the journalling API, however was that it presents a "single partitioned" endpoint, so something to either consider for Kafka consumer scalability, or to document that connector producer should write to a single partitioned topic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions