diff --git a/24/connect.html b/24/connect.html index d3f75c9ad..4c07b3aa8 100644 --- a/24/connect.html +++ b/24/connect.html @@ -241,6 +241,24 @@

REST API

  • PUT /connector-plugins/{connector-type}/config/validate - validate the provided configuration values against the configuration definition. This API performs per config validation, returns suggested values and error messages during validation.
  • +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    8.3 Connector Development Guide

    This guide describes how developers can write new connectors for Kafka Connect to move data between Kafka and other systems. It briefly reviews a few key concepts and then describes how to create a simple connector.

    diff --git a/25/connect.html b/25/connect.html index ceb25d851..eea70cd2d 100644 --- a/25/connect.html +++ b/25/connect.html @@ -262,6 +262,24 @@

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    8.3 Connector Development Guide diff --git a/26/connect.html b/26/connect.html index a0b129e9c..71e27be48 100644 --- a/26/connect.html +++ b/26/connect.html @@ -309,6 +309,24 @@

    GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + +
      +
    • GET /admin/loggers - list the current loggers that have their levels explicitly set and their log levels
    • +
    • GET /admin/loggers/{name} - get the log level for the specified logger
    • +
    • PUT /admin/loggers/{name} - set the log level for the specified logger
    • +
    + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/27/connect.html b/27/connect.html index 797c1fe9a..645d5a4e4 100644 --- a/27/connect.html +++ b/27/connect.html @@ -327,6 +327,24 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/28/connect.html b/28/connect.html index ef4cfe966..b473211f3 100644 --- a/28/connect.html +++ b/28/connect.html @@ -327,6 +327,24 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/30/connect.html b/30/connect.html index 07f8778f0..579ac7ea3 100644 --- a/30/connect.html +++ b/30/connect.html @@ -335,6 +335,24 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/31/connect.html b/31/connect.html index f1b4da155..2fc38ad2d 100644 --- a/31/connect.html +++ b/31/connect.html @@ -336,6 +336,24 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/32/connect.html b/32/connect.html index 1251c3ce6..d5f7e4d64 100644 --- a/32/connect.html +++ b/32/connect.html @@ -327,6 +327,24 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    +

    Error Reporting in Connect

    Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.

    diff --git a/33/connect.html b/33/connect.html index 05a1dddae..c0ffde62f 100644 --- a/33/connect.html +++ b/33/connect.html @@ -327,7 +327,25 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. -

    For the complete specification of the REST API, see the OpenAPI documentation

    +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    + +

    For the complete specification of the Kafka Connect REST API, see the OpenAPI documentation

    Error Reporting in Connect

    diff --git a/34/connect.html b/34/connect.html index 4c9a8d970..aac6d4683 100644 --- a/34/connect.html +++ b/34/connect.html @@ -327,7 +327,25 @@

    REST API

  • GET /- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to. -

    For the complete specification of the REST API, see the OpenAPI documentation

    +

    The admin.listeners configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the listeners configuration, this field should contain a list of listeners in the following format: protocol://host:port,protocol2://host2:port2. Currently supported protocols are http and https. + For example:

    + +
    +admin.listeners=http://localhost:8080,https://localhost:8443
    + +

    By default, if admin.listeners is not configured, the admin REST APIs will be available on the regular listeners.

    + +

    The following are the currently supported admin REST API endpoints:

    + + + +

    See KIP-495 for more details about the admin logger REST APIs.

    + +

    For the complete specification of the Kafka Connect REST API, see the OpenAPI documentation

    Error Reporting in Connect