Commit Graph

1770 Commits

Author SHA1 Message Date
Jiri Pechanec
f1e7999431 DBZ-6481 Support Postgres enum as key in incremental snapshot 2023-09-11 06:08:57 +02:00
ani-sha
087362bfcc DBZ-6567 Use optional seconds in TIMEZONE_OFFSET_PATTERN, handle sub-milliseconds precision loss, correct the DST time values 2023-09-07 11:00:26 +02:00
ani-sha
d46744aa06 DBZ-6567 Add a test case for checking DST 2023-09-07 11:00:26 +02:00
ani-sha
78477e7622 DBZ-6567 Handle DST for test cases, use correct zone rules 2023-09-07 11:00:26 +02:00
ani-sha
22500839de DBZ-6567 SMT for handling timezone based fields 2023-09-07 11:00:26 +02:00
Chris Cranford
c86b2648a5 DBZ-6864 Checkstyle fixes 2023-09-04 09:02:16 +02:00
Breno Moreira
3a2e141c56 DBZ-6864 - Debezium-MySQL not filtering AWS RDS internal events 2023-09-04 09:02:16 +02:00
Jiri Pechanec
0dd0ff7306 DBZ-6865 Clarify error message 2023-09-04 08:59:31 +02:00
harveyyue
fe300784b0 DBZ-6865 Avoid getting NPE when executing the arrived method in ExecuteSnapshot 2023-09-04 08:59:31 +02:00
Debezium Builder
d97a18e8dc [maven-release-plugin] prepare for next development iteration 2023-08-29 11:41:08 +00:00
Debezium Builder
5ce25f2cfe [maven-release-plugin] prepare release v2.4.0.Beta1 2023-08-29 11:41:08 +00:00
“vsantonastaso”
3ec6a3f18e DBZ-6843 change skipped change event log to debug 2023-08-29 12:18:17 +02:00
Chris Cranford
ed88a73510 DBZ-6840 Add test case 2023-08-29 11:56:12 +02:00
harveyyue
c03b2249d8 DBZ-6840 Wrong filtered comments 2023-08-29 11:56:12 +02:00
Vojtech Juranek
c2b48312a6 DBZ-6841 Fix randomly failing BaseSourceTaskTest#verifyTaskRestartsSuccessfully
Test was passing locally and in the CI as the start was very fast and
after the first start retriable wait condition wasn't met, so we
actually sleep and while the sleep we doesn't increment the counter
and the state is still `RESTARTING`. On slower machines when start
takes longer time and we don't wait, the test is actualy wrong.
The correct test either should remove last assert for `RESTARTING`
state or increase number of failures and add a sleep time after initial
start, so that there is no retry wait time.
This PR implements the later option.
2023-08-29 10:27:56 +02:00
“vsantonastaso”
43adc59292 DBZ-6742 use JSON format for JMX Notitication userData 2023-08-22 06:42:51 +02:00
Chris Beard
2d6490e3f8 [docs] Fix minor typos in ExtractNewRecordState docs 2023-08-20 22:37:03 -04:00
Matan Cohen
40ac4662fb DBZ-6712 fix snapshot to history internal topic to respect schema.history.internal.store.only.captured.databases.ddl flag 2023-08-15 19:34:40 +02:00
mfvitale
542b3619fa DBZ-6731 Blocking snapshot takes configuration from signal payload 2023-08-15 12:43:43 +02:00
“vsantonastaso”
64eaf72665 DBZ-6689 make kafka signal consumer group configurable 2023-08-11 13:20:07 +02:00
Anil Dasari
b7e0e1cd2a DBZ-6641: Schema name changed with Custom topic naming strategy 2023-08-10 11:53:31 +02:00
Anil Dasari
a4c0bf5614 DBZ-6641: Schema name changed with Custom topic naming strategy 2023-08-10 11:53:31 +02:00
Jiri Pechanec
ec100d6127 DBZ-6240 Rename vars to reflect the semantics 2023-08-10 07:04:17 +02:00
sunxiaojian
43c7c0a3f6 DBZ-6240 Rename the configuration name 'schema.change.event.include.list' to 'schema.change.event.exclude.list' 2023-08-10 07:04:17 +02:00
sunxiaojian
6451c93256 DBZ-6240 Add an STM to filter schema change event 2023-08-10 07:04:17 +02:00
Debezium Builder
3c72f071b0 [maven-release-plugin] prepare for next development iteration 2023-08-09 10:33:06 +00:00
Debezium Builder
915c465440 [maven-release-plugin] prepare release v2.4.0.Alpha2 2023-08-09 10:33:06 +00:00
david remy
565075a320 DBZ-2862 Improved OpenTelemetry Handling in Debezium
- Implemented a dynamic solution for handling version changes in OpenTelemetry, using Java introspection to determine the correct interceptor class at runtime.
- Utilized a custom "ProducerInterceptor" to delegate logic based on the presence of specific OpenTelemetry classes.
- Removed direct usage of OpenTelemetry's internal API 'ConfigUtils'.
- Aligned solution with Debezium's aim of ensuring compatibility with Strimzi.

This update ensures a more robust handling of OpenTelemetry's version transitions.
2023-08-08 21:34:04 +02:00
REMY David
15fdcb5027 DBZ-2862 Performance optimization
- Changing the traceRecord method to be static. This avoids creating an instance on each call.
- Caching the results of isOpenTelemetryJavaagentEnable() and isOpenTelemetryApiEnable().
- Using isDebugEnabled() to avoid the costs of constructing strings when it's not necessary.
- Reorganizing some conditions to minimize the operations performed.
- Moving the static instances TEXT_MAP_PROPAGATOR, SETTER, and GETTER into the traceRecord method. This will prevent them from being held in memory when not in use.
2023-08-08 21:34:04 +02:00
REMY David
86e5288656 DBZ-2862 Removed reference to Strimzi in comment 2023-08-08 21:34:04 +02:00
REMY David
76c536ec23 DBZ-2862 Adaptation of traceability with OpenTelemetry dependencies in the scope provided. Moved the interceptor to a new module. 2023-08-08 21:34:04 +02:00
REMY David
5846446672 DBZ-2862 Switch tracing to OpenTelemetry, Rewrite SMT with Otel API, Add Interceptor for e2e tracing, add Otel TextMap getter and setter 2023-08-08 21:34:04 +02:00
mfvitale
df52a1068a DBZ-6777 Fix wrong static notification and signals lists that lead to be wrongly shared between connectors instances 2023-08-08 13:01:37 +02:00
Vojtech Juranek
41cdaeb170 DBZ-6213 Adjust connector restart
* Try to start the connector in BaseSourceTask::start(). This is the
  root cause of DBZ-6213 as EmbeddedEngine calls start() and assumes
  it really tries to start the connector.
* Simplify the code by removing unnecessary checks.
2023-08-08 10:27:33 +02:00
Jiri Pechanec
e5ca8c5000 DBZ-6684 Use more descriptive class name 2023-08-08 10:22:10 +02:00
harveyyue
b16d991a25 DBZ-6684 Rename back fields with avro_unicode 2023-08-08 10:22:10 +02:00
tyrantlucifer
32d2bf1fac DBZ-6745 Remove redundant filter logic from SingleProcessor 2023-08-03 16:52:41 +02:00
mfvitale
524987227f DBZ-6566 Shutdown blockingSnapshotExecutor when ChangeEventSourceCoordinator stops 2023-08-03 09:22:24 +02:00
mfvitale
61651a94b5 DBZ-6566 Force blocking snapshot even if a snapshot has already executed 2023-08-03 09:22:24 +02:00
mfvitale
def7379a0d DBZ-6566 Support Blocking snapshot for MySQL 2023-08-03 09:22:24 +02:00
mfvitale
6e0b323e83 DBZ-6566 Set correct log context during blocking snapshot 2023-08-03 09:22:24 +02:00
mfvitale
70f16af7c4 DBZ-6566 Support Blocking snapshot for PostgreSQL 2023-08-03 09:22:24 +02:00
jcechace
699a1612ae DBZ-6670 Replace error handler instead of recreate in order to keep retry counter 2023-07-25 13:46:56 +02:00
mfvitale
8ea2b3c5b7 DBZ-6669 Snapshot will get data when only signal data collection table is specified 2023-07-24 10:02:13 -04:00
Debezium Builder
267dfda8a6 [maven-release-plugin] prepare for next development iteration 2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29 [maven-release-plugin] prepare release v2.4.0.Alpha1 2023-07-17 10:40:52 +00:00
Chris Cranford
de8cf36b2c DBZ-6660 Introduce internal.log.mining.max.scn.deviation.ms
We hypothesize that there could be a situation where we may be mining precisely
around the CURRENT_SCN and this may lead to situations where LGWR may not have
flushed all records for the same SCN before being mined by the connector.
2023-07-17 10:22:46 +02:00
Chris Cranford
56ddbe21d5 DBZ-6650 Avoid ConcurrentModificationException during dispatch 2023-07-14 11:21:39 +02:00
harveyyue
e3f684170e DBZ-6472 MySqlSnapshotChangeEventSource parallel execute createSchemaEventsForTables 2023-07-13 13:21:59 +02:00
Adam Strickland
0b15fe4556 [docs] Doc of type of return value 2023-07-13 13:08:41 +02:00