Skip to content

[improve][client][PIP-389] Add a producer config to improve compression performance #22023

[improve][client][PIP-389] Add a producer config to improve compression performance

[improve][client][PIP-389] Add a producer config to improve compression performance #22023

Re-run triggered December 28, 2024 04:46
Status Failure
Total duration 1h 16m 21s
Artifacts 49

pulsar-ci.yaml

on: pull_request
Preconditions
8s
Preconditions
Build and License check
10m 29s
Build and License check
Matrix: unit-tests
Build Pulsar docker image
19m 8s
Build Pulsar docker image
Matrix: Build Pulsar java-test-image docker image
CI - Unit - Upload Coverage
0s
CI - Unit - Upload Coverage
Run CodeQL Analysis
0s
Run CodeQL Analysis
Matrix: system-tests
Matrix: flaky-system-tests
Matrix: integration-tests
CI - System - Upload Coverage
0s
CI - System - Upload Coverage
CI - Integration - Upload Coverage
0s
CI - Integration - Upload Coverage
Build Pulsar on MacOS
0s
Build Pulsar on MacOS
OWASP dependency check
0s
OWASP dependency check
Delete system test docker image artifact
0s
Delete system test docker image artifact
Delete integration test docker image artifact
0s
Delete integration test docker image artifact
Pulsar CI checks completed
4s
Pulsar CI checks completed
Fit to window
Zoom out
Zoom in

Annotations

47 errors and 58 warnings
CI - Unit - Brokers - Broker Group 2
Process completed with exit code 1.
ClusterMigrationTest.testClusterMigration: pulsar-broker/src/test/java/org/apache/pulsar/broker/service/ClusterMigrationTest.java#L274
java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: HTTP get request failed: Service Unavailable
CI - Unit - Brokers - Broker Group 4
Process completed with exit code 1.
ProxyWithExtensibleLoadManagerTest.testClientReconnectsToBrokerOnProxyClosing: pulsar-proxy/src/test/java/org/apache/pulsar/proxy/server/ProxyWithExtensibleLoadManagerTest.java#L270
Method org.apache.pulsar.proxy.server.ProxyWithExtensibleLoadManagerTest.testClientReconnectsToBrokerOnProxyClosing() didn't finish within the time-out 30000
CI - Unit - Proxy
Process completed with exit code 1.
CI - Unit - Brokers - Broker Group 1
Process completed with exit code 1.
SimpleProducerConsumerTest.testECDSAEncryption: pulsar-broker/src/test/java/org/apache/pulsar/client/api/SimpleProducerConsumerTest.java#L2750
Received message �my-message-0 did not match the expected message my-message-0 expected [my-message-0] but found [�my-message-0]
CI - Unit - Brokers - Client Api
Process completed with exit code 1.
CI - Integration - Shade on Java 21
Process completed with exit code 1.
CI - Integration - Shade on Java 8
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
CI - Integration - Shade on Java 8
Process completed with exit code 1.
CI - Integration - Shade on Java 17
Process completed with exit code 1.
CI - Integration - Shade on Java 17
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
CI - Unit - Brokers - Client Impl
Process completed with exit code 1.
CI - Integration - Shade on Java 11
Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
CI - Integration - Shade on Java 11
Process completed with exit code 1.
CI - Unit - Brokers - Broker Group 3
Process completed with exit code 1.
CI - System - Pulsar IO
Process completed with exit code 1.
MessagingSmokeTest.testNonPartitionedTopicMessagingWithExclusive: tests/integration/src/test/java/org/apache/pulsar/tests/integration/messaging/MessagingSmokeTest.java#L63
{"errorMsg":"Lookup request timeout {'durationMs': '30000', 'reqId':'1720350334153808196', 'remote':'pulsar-broker-1/172.26.0.7:6650', 'local':'/172.26.0.8:41956'}","reqId":4213371926883973845, "remote":"localhost/127.0.0.1:32876", "local":"/127.0.0.1:58896"}
CI - Integration - Messaging
Process completed with exit code 1.
CI - System - Function
Process completed with exit code 1.
CI Flaky - System - Pulsar IO - Oracle
Process completed with exit code 1.
CI - System - Pulsar Connectors - Thread
Process completed with exit code 1.
PulsarFunctionsJavaThreadTest.testAutoSchemaFunctionTest: tests/integration/src/test/java/org/apache/pulsar/tests/integration/functions/java/PulsarFunctionsJavaThreadTest.java#L1
Method org.apache.pulsar.tests.integration.functions.java.PulsarFunctionsJavaTest.testAutoSchemaFunctionTest() didn't finish within the time-out 300000
PulsarFunctionsJavaProcessTest.testAutoSchemaFunctionTest: tests/integration/src/test/java/org/apache/pulsar/tests/integration/functions/java/PulsarFunctionsJavaProcessTest.java#L1
Method org.apache.pulsar.tests.integration.functions.java.PulsarFunctionsJavaTest.testAutoSchemaFunctionTest() didn't finish within the time-out 300000
CI - System - Pulsar Connectors - Process
Process completed with exit code 1.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
ExtensibleLoadManagerTest.startBroker: tests/integration/src/test/java/org/apache/pulsar/tests/integration/loadbalance/ExtensibleLoadManagerTest.java#L146
Condition org.apache.pulsar.tests.integration.loadbalance.ExtensibleLoadManagerTest$$Lambda/0x00007f7b2071d608 was not fulfilled within 2 minutes.
CI - Integration - LoadBalance
Process completed with exit code 1.
Pulsar CI checks completed
Process completed with exit code 1.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyStuckConnectionTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.UnauthedAdminProxyHandlerTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyWithAuthorizationTest created 49 new threads. There are now 60 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyWithExtensibleLoadManagerTest created 4 new threads. There are now 14 threads in total.
CI - Unit - Proxy
Summary: Tests in class org.apache.pulsar.proxy.server.ProxyRolesEnforcementTest created 57 new threads. There are now 67 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.PulsarBrokerStarterTest created 4 new threads. There are now 14 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.service.ReplicatedSubscriptionWithTransactionTest created 605 new threads. There are now 615 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.service.BrokerServiceThrottlingTest created 63 new threads. There are now 73 threads in total.
CI - Unit - Brokers - Broker Group 1
Summary: Tests in class org.apache.pulsar.broker.stats.PrometheusMetricsTest created 64 new threads. There are now 78 threads in total.
CI - Unit - Brokers - Client Api
Summary: Tests in class org.apache.pulsar.client.api.SimpleProducerConsumerStatTest created 59 new threads. There are now 69 threads in total.
CI - Integration - Shade on Java 21
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
CI - Integration - Shade on Java 8
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
CI - Integration - Shade on Java 17
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.ProduceWithMessageIdTest created 68 new threads. There are now 78 threads in total.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.BatchMessageIndexAckTest created 59 new threads. There are now 69 threads in total.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.TopicFromMessageTest created 59 new threads. There are now 69 threads in total.
CI - Unit - Brokers - Client Impl
Summary: Tests in class org.apache.pulsar.client.impl.TransactionEndToEndWithoutBatchIndexAckTest created 105 new threads. There are now 115 threads in total.
CI - Integration - Shade on Java 11
No files were found with the provided path: tests/integration/target/container-logs. No artifacts will be uploaded.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchBWCTests created 6 new threads. There are now 16 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8ClientTests created 8 new threads. There are now 24 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8AuthTests created 11 new threads. There are now 34 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkTests created 1 new threads. There are now 35 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v8.ElasticSearch8SinkRawDataTests created 3 new threads. There are now 38 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.ElasticSearchRawRecordTests created 96 new threads. There are now 134 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.v7.ElasticSearch7ClientTests created 3 new threads. There are now 137 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientTests created 1 new threads. There are now 135 threads in total.
CI - Unit - Pulsar IO - Elastic Search
Summary: Tests in class org.apache.pulsar.io.elasticsearch.opensearch.OpenSearchClientSslTests created 18 new threads. There are now 152 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminRestTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.AdminApiTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Brokers - Broker Group 3
Summary: Tests in class org.apache.pulsar.broker.admin.TopicMessageTTLTest created 65 new threads. There are now 75 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.pulsar.metadata.MetadataStoreTest created 8 new threads. There are now 19 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorCheckAllLedgersTaskTest created 1 new threads. There are now 12 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.BookieAutoRecoveryTest created 14 new threads. There are now 25 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorBookieTest created 28 new threads. There are now 39 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.TestReplicationWorker created 35 new threads. There are now 46 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorRollingRestartTest created 47 new threads. There are now 58 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AutoRecoveryMainTest created 18 new threads. There are now 29 threads in total.
CI - Unit - Pulsar Metadata
Summary: Tests in class org.apache.bookkeeper.replication.AuditorPeriodicCheckTest created 11 new threads. There are now 22 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.http.HttpSinkTest created 76 new threads. There are now 86 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.kinesis.KinesisSinkTest created 9 new threads. There are now 20 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.text.HdfsStringSinkTests created 1 new threads. There are now 11 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsTextSinkTests created 1 new threads. There are now 11 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.hdfs3.sink.seq.HdfsSequentialSinkTests created 2 new threads. There are now 12 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.node.TestPollingZooKeeperConfigurationProvider created 4 new threads. There are now 14 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.source.StringSourceTests created 20 new threads. There are now 30 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.flume.sink.StringSinkTests created 16 new threads. There are now 26 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.redis.sink.RedisSinkTest created 11 new threads. There are now 22 threads in total.
CI - Unit - Pulsar IO
Summary: Tests in class org.apache.pulsar.io.solr.SolrGenericRecordSinkTest created 1 new threads. There are now 12 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.bookie.rackawareness.BookieRackAffinityMappingTest created 1 new threads. There are now 12 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedLedgerFactoryChangeLedgerPathTest created 16 new threads. There are now 27 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.ManagedCursorTest created 5 new threads. There are now 16 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.impl.OffloadPrefixTest created 8 new threads. There are now 31 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemOffloaderLocalFileTest created 3 new threads. There are now 15 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloaderTest created 6 new threads. There are now 17 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.utils.FunctionCommonTest created 1 new threads. There are now 11 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v3.FunctionApiV3ResourceTest created 1 new threads. There are now 12 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.functions.worker.rest.api.v2.FunctionApiV2ResourceTest created 1 new threads. There are now 12 threads in total.
CI - Unit - Other
Summary: Tests in class org.apache.pulsar.testclient.PerformanceProducerTest created 8 new threads. There are now 19 threads in total.

Artifacts

Produced during runtime
Name Size
Integration-LOADBALANCE-container-logs Expired
26.6 MB
Integration-LOADBALANCE-surefire-reports Expired
33.6 MB
Integration-MESSAGING-container-logs Expired
1010 KB
Integration-MESSAGING-surefire-reports Expired
588 KB
Integration-SHADE_RUN-surefire-reports Expired
70.6 KB
System-FUNCTION-container-logs Expired
309 KB
System-Function-surefire-reports Expired
145 KB
System-PULSAR_CONNECTORS_PROCESS-container-logs Expired
403 KB
System-PULSAR_CONNECTORS_THREAD-container-logs Expired
375 KB
System-PULSAR_IO-container-logs Expired
285 KB
System-PULSAR_IO_ORA-container-logs Expired
138 KB
System-Pulsar Connectors - Process-surefire-reports Expired
248 KB
System-Pulsar Connectors - Thread-surefire-reports Expired
227 KB
System-Pulsar IO - Oracle-surefire-reports Expired
132 KB
System-Pulsar IO-surefire-reports Expired
171 KB
Unit-BROKER_CLIENT_API-dumps Expired
9.16 KB
Unit-BROKER_CLIENT_API-surefire-reports Expired
13.3 MB
Unit-BROKER_CLIENT_IMPL-dumps Expired
40.4 KB
Unit-BROKER_CLIENT_IMPL-surefire-reports Expired
15.9 MB
Unit-BROKER_GROUP_1-dumps Expired
71.4 KB
Unit-BROKER_GROUP_1-surefire-reports Expired
13.6 MB
Unit-BROKER_GROUP_2-surefire-reports Expired
11.1 MB
Unit-BROKER_GROUP_3-dumps Expired
17.8 KB
Unit-BROKER_GROUP_3-surefire-reports Expired
23.9 MB
Unit-BROKER_GROUP_4-surefire-reports Expired
9.34 MB
Unit-METADATA-dumps Expired
48.3 KB
Unit-OTHER-dumps Expired
70.2 KB
Unit-PROXY-dumps Expired
31.7 KB
Unit-PROXY-surefire-reports Expired
2.06 MB
Unit-PULSAR_IO-dumps Expired
63.1 KB
Unit-PULSAR_IO_ELASTIC-dumps Expired
74.7 KB
coverage_and_deps_inttest_CLI.tar.zst Expired
89.6 MB
coverage_and_deps_inttest_METRICS.tar.zst Expired
302 KB
coverage_and_deps_inttest_STANDALONE.tar.zst Expired
297 KB
coverage_and_deps_inttest_TRANSACTION.tar.zst Expired
306 KB
coverage_and_deps_inttest_UPGRADE.tar.zst Expired
300 KB
coverage_and_deps_systest_SCHEMA.tar.zst Expired
309 KB
coverage_and_deps_systest_TIERED_FILESYSTEM.tar.zst Expired
89.6 MB
coverage_and_deps_systest_TIERED_JCLOUD.tar.zst Expired
300 KB
coverage_and_deps_unittest_CLIENT.tar.zst Expired
659 KB
coverage_and_deps_unittest_METADATA.tar.zst Expired
261 KB
coverage_and_deps_unittest_OTHER.tar.zst Expired
10 MB
coverage_and_deps_unittest_PULSAR_IO.tar.zst Expired
359 KB
coverage_and_deps_unittest_PULSAR_IO_ELASTIC.tar.zst Expired
90.7 KB
coverage_and_deps_unittest_PULSAR_IO_KAFKA_CONNECT.tar.zst Expired
204 KB
pulsar-java-test-image.zst Expired
300 MB
pulsar-maven-repository-binaries.tar.zst Expired
318 MB
pulsar-server-distribution.tar.zst Expired
228 MB
pulsar-test-latest-version-image.zst Expired
1.73 GB