Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Debezium connetor does not create heartbeat topic #20594

Open
1 of 2 tasks
yurymuski opened this issue Jun 16, 2023 · 2 comments
Open
1 of 2 tasks

[Bug] Debezium connetor does not create heartbeat topic #20594

yurymuski opened this issue Jun 16, 2023 · 2 comments
Labels
Stale type/bug The PR fixed a bug or issue reported a bug

Comments

@yurymuski
Copy link

yurymuski commented Jun 16, 2023

Search before asking

  • I searched in the issues and found nothing similar.

Version

Ubuntu 20.04

Pulsar 2.10.4

Minimal reproduce step

Setting up Debezium source via example doc
https://pulsar.apache.org/docs/2.10.x/io-cdc-debezium/#example-of-postgresql

add to debezium-postgres-source-config.yaml heartbeat configs

    heartbeat.interval.ms: 1000
    heartbeat.topics.prefix: debezium-heartbeat
    heartbeat.action.query: "SELECT pg_logical_emit_message(false, 'heartbeat', now()::varchar);"

heartbeat.action.query may be any insert for example

What did you expect to see?

heartbeat crates topic, updates DB, sends events to it

What did you see instead?

no topic, no DB updates

Anything else?

No response

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@yurymuski yurymuski added the type/bug The PR fixed a bug or issue reported a bug label Jun 16, 2023
@github-actions
Copy link

The issue had no activity for 30 days, mark with Stale label.

@github-actions github-actions bot added the Stale label Jul 17, 2023
@MissakaI-Cloudtrix
Copy link

AFAIK the Pulsar's Debezium connector doesn't have all the features in Debezium itself.

All configuration properties found in https://debezium.io/documentation/reference/3.0/connectors/postgresql.html#postgresql-connector-properties

Not available in https://pulsar.apache.org/docs/4.0.x/io-cdc-debezium/#configuration

Not available even in latest Pulsar implementation.

Would like to have this feature implemented. As I am maxing out my db slots as the table I monitor doesn't have high traffic. Therefore the pg_replication_slot size increases to max.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Stale type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Development

No branches or pull requests

2 participants