Commit Graph

1751 Commits

Author SHA1 Message Date
“vsantonastaso”
64eaf72665 DBZ-6689 make kafka signal consumer group configurable 2023-08-11 13:20:07 +02:00
Anil Dasari
b7e0e1cd2a DBZ-6641: Schema name changed with Custom topic naming strategy 2023-08-10 11:53:31 +02:00
Anil Dasari
a4c0bf5614 DBZ-6641: Schema name changed with Custom topic naming strategy 2023-08-10 11:53:31 +02:00
Jiri Pechanec
ec100d6127 DBZ-6240 Rename vars to reflect the semantics 2023-08-10 07:04:17 +02:00
sunxiaojian
43c7c0a3f6 DBZ-6240 Rename the configuration name 'schema.change.event.include.list' to 'schema.change.event.exclude.list' 2023-08-10 07:04:17 +02:00
sunxiaojian
6451c93256 DBZ-6240 Add an STM to filter schema change event 2023-08-10 07:04:17 +02:00
Debezium Builder
3c72f071b0 [maven-release-plugin] prepare for next development iteration 2023-08-09 10:33:06 +00:00
Debezium Builder
915c465440 [maven-release-plugin] prepare release v2.4.0.Alpha2 2023-08-09 10:33:06 +00:00
david remy
565075a320 DBZ-2862 Improved OpenTelemetry Handling in Debezium
- Implemented a dynamic solution for handling version changes in OpenTelemetry, using Java introspection to determine the correct interceptor class at runtime.
- Utilized a custom "ProducerInterceptor" to delegate logic based on the presence of specific OpenTelemetry classes.
- Removed direct usage of OpenTelemetry's internal API 'ConfigUtils'.
- Aligned solution with Debezium's aim of ensuring compatibility with Strimzi.

This update ensures a more robust handling of OpenTelemetry's version transitions.
2023-08-08 21:34:04 +02:00
REMY David
15fdcb5027 DBZ-2862 Performance optimization
- Changing the traceRecord method to be static. This avoids creating an instance on each call.
- Caching the results of isOpenTelemetryJavaagentEnable() and isOpenTelemetryApiEnable().
- Using isDebugEnabled() to avoid the costs of constructing strings when it's not necessary.
- Reorganizing some conditions to minimize the operations performed.
- Moving the static instances TEXT_MAP_PROPAGATOR, SETTER, and GETTER into the traceRecord method. This will prevent them from being held in memory when not in use.
2023-08-08 21:34:04 +02:00
REMY David
86e5288656 DBZ-2862 Removed reference to Strimzi in comment 2023-08-08 21:34:04 +02:00
REMY David
76c536ec23 DBZ-2862 Adaptation of traceability with OpenTelemetry dependencies in the scope provided. Moved the interceptor to a new module. 2023-08-08 21:34:04 +02:00
REMY David
5846446672 DBZ-2862 Switch tracing to OpenTelemetry, Rewrite SMT with Otel API, Add Interceptor for e2e tracing, add Otel TextMap getter and setter 2023-08-08 21:34:04 +02:00
mfvitale
df52a1068a DBZ-6777 Fix wrong static notification and signals lists that lead to be wrongly shared between connectors instances 2023-08-08 13:01:37 +02:00
Vojtech Juranek
41cdaeb170 DBZ-6213 Adjust connector restart
* Try to start the connector in BaseSourceTask::start(). This is the
  root cause of DBZ-6213 as EmbeddedEngine calls start() and assumes
  it really tries to start the connector.
* Simplify the code by removing unnecessary checks.
2023-08-08 10:27:33 +02:00
Jiri Pechanec
e5ca8c5000 DBZ-6684 Use more descriptive class name 2023-08-08 10:22:10 +02:00
harveyyue
b16d991a25 DBZ-6684 Rename back fields with avro_unicode 2023-08-08 10:22:10 +02:00
tyrantlucifer
32d2bf1fac DBZ-6745 Remove redundant filter logic from SingleProcessor 2023-08-03 16:52:41 +02:00
mfvitale
524987227f DBZ-6566 Shutdown blockingSnapshotExecutor when ChangeEventSourceCoordinator stops 2023-08-03 09:22:24 +02:00
mfvitale
61651a94b5 DBZ-6566 Force blocking snapshot even if a snapshot has already executed 2023-08-03 09:22:24 +02:00
mfvitale
def7379a0d DBZ-6566 Support Blocking snapshot for MySQL 2023-08-03 09:22:24 +02:00
mfvitale
6e0b323e83 DBZ-6566 Set correct log context during blocking snapshot 2023-08-03 09:22:24 +02:00
mfvitale
70f16af7c4 DBZ-6566 Support Blocking snapshot for PostgreSQL 2023-08-03 09:22:24 +02:00
jcechace
699a1612ae DBZ-6670 Replace error handler instead of recreate in order to keep retry counter 2023-07-25 13:46:56 +02:00
mfvitale
8ea2b3c5b7 DBZ-6669 Snapshot will get data when only signal data collection table is specified 2023-07-24 10:02:13 -04:00
Debezium Builder
267dfda8a6 [maven-release-plugin] prepare for next development iteration 2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29 [maven-release-plugin] prepare release v2.4.0.Alpha1 2023-07-17 10:40:52 +00:00
Chris Cranford
de8cf36b2c DBZ-6660 Introduce internal.log.mining.max.scn.deviation.ms
We hypothesize that there could be a situation where we may be mining precisely
around the CURRENT_SCN and this may lead to situations where LGWR may not have
flushed all records for the same SCN before being mined by the connector.
2023-07-17 10:22:46 +02:00
Chris Cranford
56ddbe21d5 DBZ-6650 Avoid ConcurrentModificationException during dispatch 2023-07-14 11:21:39 +02:00
harveyyue
e3f684170e DBZ-6472 MySqlSnapshotChangeEventSource parallel execute createSchemaEventsForTables 2023-07-13 13:21:59 +02:00
Adam Strickland
0b15fe4556 [docs] Doc of type of return value 2023-07-13 13:08:41 +02:00
Jiri Pechanec
764427081b DBZ-6517 DBZ-6654 Make CE converter compatible with Kafka 3.5 2023-07-13 11:26:21 +02:00
harveyyue
aa139203aa DBZ-6603 Update property "custom.metric.tags" to connector docs 2023-07-13 09:52:33 +02:00
harveyyue
5bc7fd1f7c DBZ-6603 Support for custom tags in the connector metrics 2023-07-13 09:52:33 +02:00
jcechace
5cb579bf12 DBZ-6525 Removing runtime dependency on core for testcontainers module in order to prevent logback.xml downstream conflicts 2023-07-11 12:07:04 +02:00
Chris Cranford
6a41761f85 DBZ-6573 Restore spacing 2023-06-30 09:39:32 +02:00
tjwornjs
2767f469aa DBZ-6573 add max retries config to common config 2023-06-30 09:39:32 +02:00
bdbene
6f29ce08ef DBZ-6605 Fix DataCollections for snapshot completion notification
DBZ-6605 Use new 'scanned_collection' field for snapshot completion signal

Updated the docs for fixed snapshot completion notification
2023-06-27 12:01:26 +02:00
mfvitale
d5febcc054 DBZ-6417 Provide extensible signal action mechanism through SPI 2023-06-23 15:03:27 +02:00
mfvitale
9ed928a1c9 DBZ-6416 Improve tests stability 2023-06-22 13:22:34 +02:00
mfvitale
34e28ac52d DBZ-6416 Add initial snapshot notifications 2023-06-22 13:22:34 +02:00
mfvitale
7d28833ba8 DBZ-6588 Skip tombstone record on HeaderToValue SMT 2023-06-21 14:11:44 +02:00
jcechace
8f70de42c1 DBZ-6578 Cleaning up connection string propagation between discovery and tasks 2023-06-21 12:22:23 +02:00
Debezium Builder
60f730d383 [maven-release-plugin] prepare for next development iteration 2023-06-20 13:21:31 +00:00
Debezium Builder
150396e4c8 [maven-release-plugin] prepare release v2.3.0.Final 2023-06-20 13:21:31 +00:00
mfvitale
91152c4c5d DBZ-6559 Add test to cover topic name strategy 2023-06-16 11:48:34 +02:00
Jiri Pechanec
7f81f4bc6b DBZ-6559 Handle keeping the first char as exception 2023-06-16 11:48:34 +02:00
mfvitale
87217a1474 DBZ-6559 Restore backward compatibility for field that stars with a digit 2023-06-16 11:48:34 +02:00
Jiri Pechanec
067683e56a DBZ-6076 Consistent config for all connectors 2023-06-15 11:55:28 +02:00
Anil Dasari
0431a8b9fc DBZ-6076: Add support for custom SourceInfoStructMaker for adding new fields to source field 2023-06-15 11:55:28 +02:00