Skip to content

Commit

Permalink
Port KAFKA-14933 (Connect admin REST API)
Browse files Browse the repository at this point in the history
  • Loading branch information
C0urante committed May 2, 2023
1 parent 0d4f5b1 commit 262566e
Show file tree
Hide file tree
Showing 10 changed files with 182 additions and 2 deletions.
18 changes: 18 additions & 0 deletions 24/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -241,6 +241,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>PUT /connector-plugins/{connector-type}/config/validate</code> - validate the provided configuration values against the configuration definition. This API performs per config validation, returns suggested values and error messages during validation.</li>
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h3><a id="connect_development" href="#connect_development">8.3 Connector Development Guide</a></h3>

<p>This guide describes how developers can write new connectors for Kafka Connect to move data between Kafka and other systems. It briefly reviews a few key concepts and then describes how to create a simple connector.</p>
Expand Down
18 changes: 18 additions & 0 deletions 25/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -262,6 +262,24 @@ <h4 class="anchor-heading">
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h3 class="anchor-heading">
<a class="anchor-link" id="connect_development" href="#connect_development"></a>
<a href="#connect_development">8.3 Connector Development Guide
Expand Down
18 changes: 18 additions & 0 deletions 26/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -309,6 +309,24 @@ <h4 class="anchor-heading"><a id="connect_rest" class="anchor-link"></a><a href=
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4 class="anchor-heading"><a id="connect_errorreporting" class="anchor-link"></a><a href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
18 changes: 18 additions & 0 deletions 27/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -327,6 +327,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4><a id="connect_errorreporting" href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
18 changes: 18 additions & 0 deletions 28/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -327,6 +327,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4><a id="connect_errorreporting" href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
18 changes: 18 additions & 0 deletions 30/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -335,6 +335,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4><a id="connect_errorreporting" href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
18 changes: 18 additions & 0 deletions 31/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -336,6 +336,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4><a id="connect_errorreporting" href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
18 changes: 18 additions & 0 deletions 32/connect.html
Original file line number Diff line number Diff line change
Expand Up @@ -327,6 +327,24 @@ <h4><a id="connect_rest" href="#connect_rest">REST API</a></h4>
<li><code>GET /</code>- return basic information about the Kafka Connect cluster such as the version of the Connect worker that serves the REST request (including git commit ID of the source code) and the Kafka cluster ID that is connected to.
</ul>

<p>The <code>admin.listeners</code> configuration can be used to configure admin REST APIs on Kafka Connect's REST API server. Similar to the <code>listeners</code> configuration, this field should contain a list of listeners in the following format: <code>protocol://host:port,protocol2://host2:port2</code>. Currently supported protocols are <code>http</code> and <code>https</code>.
For example:</p>

<pre class="brush: text;">
admin.listeners=http://localhost:8080,https://localhost:8443</pre>

<p>By default, if <code>admin.listeners</code> is not configured, the admin REST APIs will be available on the regular listeners.</p>

<p>The following are the currently supported admin REST API endpoints:</p>

<ul>
<li><code>GET /admin/loggers</code> - list the current loggers that have their levels explicitly set and their log levels</li>
<li><code>GET /admin/loggers/{name}</code> - get the log level for the specified logger</li>
<li><code>PUT /admin/loggers/{name}</code> - set the log level for the specified logger</li>
</ul>

<p>See <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-495%3A+Dynamically+Adjust+Log+Levels+in+Connect">KIP-495</a> for more details about the admin logger REST APIs.</p>

<h4><a id="connect_errorreporting" href="#connect_errorreporting">Error Reporting in Connect</a></h4>

<p>Kafka Connect provides error reporting to handle errors encountered along various stages of processing. By default, any error encountered during conversion or within transformations will cause the connector to fail. Each connector configuration can also enable tolerating such errors by skipping them, optionally writing each error and the details of the failed operation and problematic record (with various levels of detail) to the Connect application log. These mechanisms also capture errors when a sink connector is processing the messages consumed from its Kafka topics, and all of the errors can be written to a configurable "dead letter queue" (DLQ) Kafka topic.</p>
Expand Down
Loading

0 comments on commit 262566e

Please sign in to comment.