Document toolboxDocument toolbox

Apache Kafka

Owned by Anthony Shevlin (Deactivated)
Jan 23, 2024
2 min read

Apache Kafka is a stream-processing software platform which aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds.

Connect Apache Kafka with Devo SOAR

  1. Navigate to Automations > Integrations.

  2. Search for Apache Kafka.

  3. Click Details, then the + icon. Enter the required information in the following fields.

    • Label: Enter a connection name.

    • Reference Values: Define variables here to templatize integration connections and actions. For example, you can use https://www.{{hostname}}.com where, hostname is a variable defined in this input.

    • Verify SSL: Select option to verify connecting server's SSL certificate (Default is Verify SSL Certificate).

    • Remote Agent: Run this integration using the Devo SOAR Remote Agent.

    • Server IP or Hostname for Kafka: Server address for Apache Kafka.

    • Port Number for Kafka: Server port to connect to Apache Kafka.

    • API version for Kafka: api_version for Apache Kafka. Some example : [(0, 10, 1), (0, 10, 0), (0, 10), (0, 9),
      (0, 8, 2), (0, 8, 1), (0, 8, 0)].

    • Username: Username to connect to Apache Kafka.

    • Password: Password to connect to Apache Kafka.

  4. After you've entered all the details, click Connect.

Actions for Apache Kafka

Publish feed to Kafka

Publish a feed (message) to the given topic in Apache Kafka.

Input Field

Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.

Input Name

Description

Required

Input Name

Description

Required

Topic of Kafka

Column name from parent table that contains Topic.

Required

Feed for Kafka

Column name from parent table that contains Feed.

Required

Output

A JSON object containing multiple rows of results:

  • has_error: True/False

  • error: message/null

  • result: Successfully published message

Get feeds from Kafka

Get feeds from the topic in Apache Kafka.

Input Field

Choose a connection that you have previously created and then fill in the necessary information in the following input fields to complete the connection.

Input Name

Description

Required

Input Name

Description

Required

Topic of Kafka

Column name from parent table that contains Topic.

Required

Limit of rows

Limit of records to be fetched.

Optional

Output

A JSON object containing multiple rows of results:

  • has_error: True/False

  • error: message/null

  • result: feed

Release Notes

  • v2.0.0 - Updated architecture to support IO via filesystem