Commit Graph

2013 Commits

Author SHA1 Message Date
twthorn
430b8125a8 DBZ-7925 Expand truncate support to byte arrays in addition to strings 2024-06-06 11:41:02 +02:00
Debezium Builder
5273bb1601 [maven-release-plugin] prepare for next development iteration 2024-06-06 05:44:28 +00:00
Debezium Builder
a79c9ef799 [maven-release-plugin] prepare release v2.7.0.Beta1 2024-06-06 05:44:27 +00:00
rajdangwal
889a18f9dc DBZ-7902: Addressed review comments 2024-06-03 14:29:27 +02:00
rajdangwal
e390275d91 DBZ-7902: Add configurable delay after snapshotting, before starting streaming 2024-06-03 14:29:27 +02:00
mfvitale
87f18eac8a DBZ-7886 Skip current data collection snapshot when SQLException occurs 2024-05-31 08:30:16 +02:00
Ankur Gupta
1cf3b72f1b DBZ-7906 Enhancing the threads utility class for broader use 2024-05-31 08:26:15 +02:00
Vadzim Ramanenka
2917b78881 DBZ-7889: Multiple completed reading from a capture instance notifications
There is a small chance the connector doesn't advance and re-reads
the same LSN range. This happens under the following conditions:
* a new capture instance has been added in the current LSN range;
* while reading CDC changes one of existing capture instances
  dissapears.
The dissapeared capture instance causes an exception which is catched
and processed in `processErrorFromChangeTableQuery`. This leads to
the current connector iteration to be correctly exited without
advancing. On the next iteration the connector starts from the same
LSN as the previous iteration and finds the same new capture instance.
Although `Set` was used to track the list of tables to be removed
`SqlServerChangeTable` doesn't implement `hashCode` so same table
could be added multiple times to the same set.

The fix is to implement `hashCode` and `equals` methods in `ChangeTable`
which is the parent class of `SqlServerChangeTable`.

Additionally a synchronisation block is needed where the tables
are added to the hash map as it happens in a different thread from
the one that removes the tables from the hash map.
2024-05-31 07:24:40 +02:00
Mark Banierink
4bc98c6661 DBZ-7887 added additional JsonSerde constructor 2024-05-29 09:08:08 +02:00
Jiri Pechanec
b052d8a472 DBZ-7880 Make schema backward compatible 2024-05-22 14:20:02 +02:00
Jiri Pechanec
2dd6b4629e DBZ-7871 Use log level on first invocation 2024-05-16 13:28:14 +02:00
Roman Kudryashov
178b964b67 DBZ-7871 Change logging level for Found previous partition offset 2024-05-16 13:28:14 +02:00
sullis
369d95aa0c DBZ-7859: reduce enum array allocation 2024-05-14 13:33:17 +02:00
mfvitale
730eabc1f9 DBZ-7858 Initial snapshot completed/aborted notification will the correct offset 2024-05-14 12:14:53 +02:00
Debezium Builder
34a7c11de6 [maven-release-plugin] prepare for next development iteration 2024-05-13 06:42:03 +00:00
Debezium Builder
ebf74a8933 [maven-release-plugin] prepare release v2.7.0.Alpha2 2024-05-13 06:42:03 +00:00
mfvitale
c3a8ba4afb DBZ-7828 Correct filter query in snapshot task to handle SQLServer table quote 2024-05-10 07:42:09 +02:00
Debezium Builder
bcac0c5c7a [maven-release-plugin] prepare for next development iteration 2024-04-25 09:21:27 +00:00
Debezium Builder
0be6e6b8fd [maven-release-plugin] prepare release v2.7.0.Alpha1 2024-04-25 09:21:26 +00:00
mfvitale
f554d7f60d DBZ-7780 Avoid throw exception when snapshot is not completed and snapshot mode is no_data 2024-04-22 09:52:16 +02:00
mfvitale
30c11242ac DBZ-7616 Avoid to filter out every SET STATEMENT queries and filter just the ones related to Amazon RDS 2024-04-22 09:17:44 +02:00
mfvitale
8206d2d98d DBZ-7616 Add query timeout on JdbcConnection controlled by query.timeout.ms property 2024-04-22 09:17:44 +02:00
twthorn
3a9ea7ac4e DBZ-7698 Refactor to single factory interface/class/config 2024-04-19 10:23:30 +02:00
twthorn
0b80389f92 DBZ-7698 Rename from basic to default transaction info, add documentation, other minor changes 2024-04-19 10:23:30 +02:00
twthorn
0131401a19 DBZ-7698 Add instance method for load 2024-04-19 10:23:30 +02:00
twthorn
46ee422b53 DBZ-7698 Update config docs 2024-04-19 10:23:30 +02:00
twthorn
68cd944dc4 DBZ-7698 Add more tests 2024-04-19 10:23:30 +02:00
twthorn
993b6e73cc DBZ-7698 Fix variable definition 2024-04-19 10:23:30 +02:00
twthorn
261253d9f0 DBZ-7698 Refactor to generic transaction block customization 2024-04-19 10:23:30 +02:00
twthorn
efdc92a926 DBZ-7698 add method for backward compatibility 2024-04-19 10:23:30 +02:00
twthorn
24e4e4eb80 DBZ-7698 fix some failing tests 2024-04-19 10:23:30 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
Chris Cranford
60ac3c00a1 DBZ-7693 Add MariaDB connector 2024-04-18 10:27:21 +02:00
mfvitale
64454cc378 DBZ-7716 Correct IncrementalSnapshotContext dataCollectionsToSnapshot cache update 2024-04-11 07:53:48 +02:00
Fiore Mario Vitale
f37129dded DBZ-7765 Let LOG_POSITION_CHECK_ENABLED property as internal
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2024-04-11 07:35:49 +02:00
mfvitale
6f0a56fc6f DBZ-7765 Add property to eventually disable log position validation on startup 2024-04-11 07:35:49 +02:00
mfvitale
717888f6f6 DBZ-7765 Use different query for validating log position for SQLServer 2024-04-11 07:35:49 +02:00
Roman Kudryashov
50c9f042a3 DBZ-7755 Refactor exporting to CloudEvents: remove RecordParser 2024-04-08 13:22:31 +02:00
mfvitale
ae7628a732 DBZ-7732 Add ConnectorSpecific annotation to manage multiple SPI connector specific implementation 2024-04-08 12:46:53 +02:00
mfvitale
ec3c68b0d8 DBZ-7717 Move LogPositionValidator outside JdbcConnection 2024-04-05 11:57:43 +02:00
mfvitale
ba2f893168 DBZ-7718 Support table name escaping in data collection to be snapshotted 2024-04-04 14:58:24 +02:00
Debezium Builder
ea182d83f3 [maven-release-plugin] prepare for next development iteration 2024-04-02 07:38:53 +00:00
Debezium Builder
7dcd94d19e [maven-release-plugin] prepare release v2.6.0.Final 2024-04-02 07:38:53 +00:00
mfvitale
213456c5af DBZ-7497 Properties related to configuration based snapshot mode are now optional 2024-03-28 08:59:54 +01:00
mfvitale
ee5f25ccc9 DBZ-7497 Add a configuration based snapshot modes configurable via connector properties 2024-03-28 08:59:54 +01:00
Debezium Builder
4df18d9f43 [maven-release-plugin] prepare for next development iteration 2024-03-25 09:57:05 +00:00
Debezium Builder
9656da1fad [maven-release-plugin] prepare release v2.6.0.CR1 2024-03-25 09:57:04 +00:00
mfvitale
8a6e7e93fa DBZ-7308 Manage when snapshot service is not available for connectors not supporting it 2024-03-25 05:46:46 +01:00
mfvitale
662a0518ac DBZ-7308 Fix MySQL tests 2024-03-25 05:46:46 +01:00
mfvitale
c7a28021a6 DBZ-7308 Remove connector specific SnapshotLockProvider and SnapshotterServiceProvider 2024-03-25 05:46:46 +01:00