Commit Graph

898 Commits

Author SHA1 Message Date
mfvitale
1f0a61fb30 DBZ-7601 Stabilize SqlServerMetricsIT tests 2024-08-20 13:23:34 +02:00
mfvitale
f3d43a8755 DBZ-8035 Uniform metrics tests 2024-08-20 13:23:34 +02:00
mfvitale
65436fec23 DBZ-8035 Add connector config to CdcSourceTaskContext 2024-08-20 13:23:34 +02:00
Debezium Builder
17aca64cec [maven-release-plugin] prepare for next development iteration 2024-08-02 06:20:37 -04:00
Debezium Builder
5d54d75362 [maven-release-plugin] prepare release v3.0.0.Alpha2 2024-08-02 06:20:36 -04:00
Debezium Builder
53b14371e5 [maven-release-plugin] prepare for next development iteration 2024-07-11 03:24:06 -04:00
Debezium Builder
61fb58f24f [maven-release-plugin] prepare release v3.0.0.Alpha1 2024-07-11 03:24:06 -04:00
rkerner
56e63b98a8 DBZ-7223 Add the MongoDB sink connector
* add basic tests for MongoDB sink connector (MySQL to MongoDB 1 node ReplicaSet and multi-node sharded cluster)

closes https://issues.redhat.com/browse/DBZ-7223
2024-07-04 13:21:46 +02:00
Debezium Builder
ee2c192ae0 [maven-release-plugin] prepare for next development iteration 2024-06-28 04:36:37 -04:00
Debezium Builder
d47ba9bcb0 [maven-release-plugin] prepare release v2.7.0.Final 2024-06-28 04:36:37 -04:00
Jakub Cechacek
cac16464b4 DBZ-7964 (quickfix) Only reset error retry counter if poll() successfully produced records 2024-06-27 13:14:14 +02:00
Debezium Builder
db691fd16f [maven-release-plugin] prepare for next development iteration 2024-06-13 09:04:36 +00:00
Debezium Builder
73ce5c5058 [maven-release-plugin] prepare release v2.7.0.Beta2 2024-06-13 09:04:36 +00:00
Chris Cranford
c792a94e44 DBZ-7801 Add SQL Server heartbeat.action.query support 2024-06-12 06:12:33 +02:00
Chris Cranford
26af1c967a DBZ-7933 Fix streaming TIME precision for micro/nano -seconds 2024-06-10 14:27:50 +02:00
Chris Cranford
212fe3db38 DBZ-7933 Fix default value TIME precision for micro/nano -seconds 2024-06-10 14:27:50 +02:00
Jiri Pechanec
b3eaab178b DBZ-7936 Fix test by removing earlier validation 2024-06-10 10:15:36 +02:00
Debezium Builder
5273bb1601 [maven-release-plugin] prepare for next development iteration 2024-06-06 05:44:28 +00:00
Debezium Builder
a79c9ef799 [maven-release-plugin] prepare release v2.7.0.Beta1 2024-06-06 05:44:27 +00:00
rajdangwal
e390275d91 DBZ-7902: Add configurable delay after snapshotting, before starting streaming 2024-06-03 14:29:27 +02:00
Vadzim Ramanenka
2917b78881 DBZ-7889: Multiple completed reading from a capture instance notifications
There is a small chance the connector doesn't advance and re-reads
the same LSN range. This happens under the following conditions:
* a new capture instance has been added in the current LSN range;
* while reading CDC changes one of existing capture instances
  dissapears.
The dissapeared capture instance causes an exception which is catched
and processed in `processErrorFromChangeTableQuery`. This leads to
the current connector iteration to be correctly exited without
advancing. On the next iteration the connector starts from the same
LSN as the previous iteration and finds the same new capture instance.
Although `Set` was used to track the list of tables to be removed
`SqlServerChangeTable` doesn't implement `hashCode` so same table
could be added multiple times to the same set.

The fix is to implement `hashCode` and `equals` methods in `ChangeTable`
which is the parent class of `SqlServerChangeTable`.

Additionally a synchronisation block is needed where the tables
are added to the hash map as it happens in a different thread from
the one that removes the tables from the hash map.
2024-05-31 07:24:40 +02:00
Vadzim Ramanenka
1045ecf604 DBZ-7893: Account for possible # in a column name
In the case when there is a `#` in a column name it gets replaced with
the capture instance name according to how the CDC data query is built.

This patch makes the replacement more specific by changing the
replacement placeholder from `#` to `#table` in this particular case.
2024-05-29 09:23:55 +02:00
Jiri Pechanec
b052d8a472 DBZ-7880 Make schema backward compatible 2024-05-22 14:20:02 +02:00
Jiri Pechanec
c09c2c6712 DBZ-7641 Update tests 2024-05-15 05:42:12 +02:00
Debezium Builder
34a7c11de6 [maven-release-plugin] prepare for next development iteration 2024-05-13 06:42:03 +00:00
Debezium Builder
ebf74a8933 [maven-release-plugin] prepare release v2.7.0.Alpha2 2024-05-13 06:42:03 +00:00
mfvitale
c3a8ba4afb DBZ-7828 Correct filter query in snapshot task to handle SQLServer table quote 2024-05-10 07:42:09 +02:00
Debezium Builder
bcac0c5c7a [maven-release-plugin] prepare for next development iteration 2024-04-25 09:21:27 +00:00
Debezium Builder
0be6e6b8fd [maven-release-plugin] prepare release v2.7.0.Alpha1 2024-04-25 09:21:26 +00:00
mfvitale
8206d2d98d DBZ-7616 Add query timeout on JdbcConnection controlled by query.timeout.ms property 2024-04-22 09:17:44 +02:00
mfvitale
717888f6f6 DBZ-7765 Use different query for validating log position for SQLServer 2024-04-11 07:35:49 +02:00
Roman Kudryashov
50c9f042a3 DBZ-7755 Refactor exporting to CloudEvents: remove RecordParser 2024-04-08 13:22:31 +02:00
mfvitale
ae7628a732 DBZ-7732 Add ConnectorSpecific annotation to manage multiple SPI connector specific implementation 2024-04-08 12:46:53 +02:00
rajdangwal
3a8421ba4a DBZ-7750: Set default for max.iteration.transactions to 500 2024-04-08 10:32:12 +02:00
mfvitale
ec3c68b0d8 DBZ-7717 Move LogPositionValidator outside JdbcConnection 2024-04-05 11:57:43 +02:00
mfvitale
1190389edc DBZ-7718 Support table name escaping in BlockingSnapshotIT 2024-04-04 14:58:24 +02:00
mfvitale
5ce6fc8196 DBZ-7729 Fix shouldNotStreamWhenUsingSnapshotModeInitialOnly test assertion due to log message change 2024-04-04 14:52:45 +02:00
Debezium Builder
ea182d83f3 [maven-release-plugin] prepare for next development iteration 2024-04-02 07:38:53 +00:00
Debezium Builder
7dcd94d19e [maven-release-plugin] prepare release v2.6.0.Final 2024-04-02 07:38:53 +00:00
mfvitale
213456c5af DBZ-7497 Properties related to configuration based snapshot mode are now optional 2024-03-28 08:59:54 +01:00
mfvitale
ee5f25ccc9 DBZ-7497 Add a configuration based snapshot modes configurable via connector properties 2024-03-28 08:59:54 +01:00
Ciaran O'Reilly
d8c323a520 DBZ-7359 incorporate 1st set of review feedback 2024-03-26 11:10:53 +01:00
Ciaran O'Reilly
1070e5f505 DBZ-7359 fix checkstyle and formatting check failures 2024-03-26 11:10:53 +01:00
Ciaran O'Reilly
fefcd4e79c DBZ-7359 Added setQueryColumnValue fix and supporting Integration Tests 2024-03-26 11:10:53 +01:00
Vojtech Juranek
3f3672c9e7 [ci] Mark stopCurrentIncrementalSnapshotWithoutCollectionsAndTakeNewNewIncrementalSnapshotAfterRestart as flaky 2024-03-25 17:48:31 +01:00
Debezium Builder
4df18d9f43 [maven-release-plugin] prepare for next development iteration 2024-03-25 09:57:05 +00:00
Debezium Builder
9656da1fad [maven-release-plugin] prepare release v2.6.0.CR1 2024-03-25 09:57:04 +00:00
mfvitale
c7a28021a6 DBZ-7308 Remove connector specific SnapshotLockProvider and SnapshotterServiceProvider 2024-03-25 05:46:46 +01:00
mfvitale
60a0b1b5c3 DBZ-7308 tableLockingStatement from SnapshotLock interface now takes just one table in input 2024-03-25 05:46:46 +01:00
mfvitale
ae9009303c DBZ-7308 Move getSnapshottingTask to RelationalSnapshotChangeEventSource 2024-03-25 05:46:46 +01:00