Commit Graph

656 Commits

Author SHA1 Message Date
Vojtech Juranek
4140078db7 DBZ-5045 Remove deprecated Mongo DB ADD_SOURCE_FIELDS option
Adjust the tests as source `ts_ms` is different.
2022-06-08 09:11:00 +02:00
Vojtech Juranek
0ddcd93167 DBZ-5045 Remove deprecated POLL_INTERVAL_SEC 2022-06-08 09:11:00 +02:00
Vojtech Juranek
64ef812cc9 DBZ-5045 Remove deprecated MAX_COPY_THREADS 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0d6bfec265 DBZ-5045 Remove deprecated FIELD_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
d66d86a3ac DBZ-5045 Remove deprecated COLLECTION_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
2484faaffe DBZ-5045 Remove deprecated COLLECTION_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b3a6131cee DBZ-5045 Remove deprecated DATABASE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0cbb57f4bf DBZ-5045 Remove deprecated DATABASE_WHITELIST 2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34 DBZ-5206 Remove the deprecated monitored tables metrics 2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Chris Cranford
28cd36edff DBZ-5011 Set task metrics attribute when using only 1 task 2022-06-01 09:41:36 +02:00
Chris Cranford
9fa5a48274 DBZ-5011 Register MongoDB metrics with task id when more than one task 2022-06-01 09:41:36 +02:00
Yang
75d3b716ab DBZ-5113 Use generic bson value 2022-05-17 14:32:51 +02:00
Yang
5c190f7584 DBZ-5113 Use bson document 2022-05-17 14:32:51 +02:00
Jiri Pechanec
707eeab3d8 DBZ-4951 Remove oplog suppport 2022-05-11 16:04:04 +02:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
Jiri Pechanec
ee78ba6ad6 DBZ-5015 Fix formatting 2022-04-21 07:09:18 +02:00
chadthamn
1b23507504 DBZ-5015 Get the json value of a Document when parsing signaling message 2022-04-21 07:09:18 +02:00
jchipmunk
2c2a81b12b DBZ-5003 Can't use 'local' database through mongos
MongoDb connector should use "config" database if the database exists. Otherwise, "local" database should be used to get MongoDB version during connector validation.

This is similar to the approach implemented in ReplicaSetDiscovery class.
2022-04-20 09:36:50 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
rkerner
8127985da0 [docs] fix Mongo DB Connector Config typo for mongodb.name field description 2022-02-08 15:14:28 +01:00
Chris Cranford
bbd963549e DBZ-4676 Fix MongoUtilIT test failure 2022-02-04 12:14:06 -05:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
ce41b0734c DBZ-4575 Filter events based on database name 2022-01-20 19:13:44 +01:00
Jiri Pechanec
022f480ebf
DBZ-4415 oplog mode is not supported for MongoDB 5+
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-01-18 14:09:11 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
Gunnar Morling
92665f1799 DBZ-4472 Improving log output 2021-12-20 15:58:14 +01:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Mario Mueller
9330efaaa2 DBZ-4413 - Do not remove _id and do not overwrite any given field named "id".
IT test expectations are adjusted accordingly.
Removed leading zero from ZonedDateTime
Signed-off-by: Mario Mueller <mario@xenji.com>
2021-12-16 09:48:26 +01:00
Gunnar Morling
0023cb10a5
DBZ-4393 Create a Debezium Schema Generator for Debezium connectors
* added an API generator for Debezium connectors and static API definitions for connectors in a separate module
* added Maven plug-in
* added GH workflow for debezium-schema-generator

Co-authored-by: rkerner <rkerner.mobil@gmail.com>
Co-authored-by: Anisha Mohanty <anishamohanty23@gmail.com>
2021-12-10 12:35:09 +01:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Jiri Pechanec
9e5661b573 DBZ-3342 Addressed review comments 2021-12-09 10:03:41 +01:00
Jiri Pechanec
b1dcfcb0b8 DBZ-3342 Incremental snapshot support for MongoDB 2021-12-09 10:03:41 +01:00
Jiri Pechanec
4cd5b092e9 DBZ-4205 Address review comments 2021-12-08 15:48:49 +01:00
Gunnar Morling
72a8662bd3 DBZ-4205 Document fixes and other misc. adjustments 2021-12-08 15:48:49 +01:00
Jiri Pechanec
25b29673db DBZ-4205 Support for cloud events 2021-12-08 15:48:49 +01:00
Jiri Pechanec
9901c43c8a DBZ-4205 Switch oplug to change streams is safe 2021-12-08 15:48:49 +01:00
Jiri Pechanec
a181d3c910 DBZ-4205 Test safety against capture mode switch 2021-12-08 15:48:49 +01:00
Jiri Pechanec
f037b35954 DBZ-4205 Document change streams capture mode 2021-12-08 15:48:49 +01:00
Jiri Pechanec
af401a0d71 DBZ-4205 Handle new transaction id format 2021-12-08 15:48:49 +01:00
Jiri Pechanec
6dcd3c0eab DBZ-4205 Decouple change stream session TX id 2021-12-08 15:48:49 +01:00
Jiri Pechanec
39140a07b4 DBZ-4205 Add missing assertions 2021-12-08 15:48:49 +01:00
Jiri Pechanec
a516e78d94 DBZ-4205 Make config class immutable again 2021-12-08 15:48:49 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
lairen
a0898ed440 DBZ-2363 Adding support for pg_logical_emit messages in Postgres connector for the pgoutput plugin 2021-11-26 14:29:15 +01:00
Sungho Hwang
d811b5ed1d DBZ-4337 Fixed a bug for configuration field for expanding JSON payload in MongoDB Outbox Event Router 2021-11-22 09:14:11 +01:00
Sungho Hwang
64a9c91abb DBZ-4318 Modified default type of aggregateid In outbox collection expected by MongoDB Outbox Event Router for both tests and documentation. 2021-11-21 09:16:58 +01:00
Jiri Pechanec
74db20de7d DBZ-3938 Add config database among builtins 2021-11-19 09:54:52 +01:00
Chris Cranford
2730187a4b DBZ-4012 Deprecate table.field.event.payload.id 2021-11-18 21:45:41 +01:00
Chris Cranford
ab86cd18a9 DBZ-4012 Suggested changes 2021-11-18 21:45:41 +01:00
Chris Cranford
0df5c6219b DBZ-4012 Bubble up SMT validation failures to Kafka Connect 2021-11-18 21:45:41 +01:00
Chris Cranford
970792bc40 DBZ-4012 Deprecate/Rename debezium namespace config options 2021-11-18 21:45:41 +01:00
Jiri Pechanec
212fdb7912 DBZ-3938 Make assertions order independent 2021-11-18 20:24:53 +01:00
Jiri Pechanec
974c5df579 DBZ-3938 Add CI for MongoDB 5.0 2021-11-18 20:24:53 +01:00
Sungho Hwang
c9eb0f9157 DBZ-3528 Refactored several parts according to the feedbacks
A delegate class for common logic between two Outbox Event Routers has been created.
Documentation has been fixed.
The configuration properties for MongoDB Outbox Event Router have been changed to use existing Outbox Event Router's.
2021-11-17 16:02:06 +01:00
Sungho Hwang
0cbf324e31 DBZ-3528 Refactored codes 2021-11-17 16:02:06 +01:00
Sungho Hwang
482cc2d529 DBZ-3528 Modified code formatting 2021-11-17 16:02:06 +01:00
Sungho Hwang
0b9fc88ea6 DBZ-3528 Applied the code style rules 2021-11-17 16:02:06 +01:00
Sungho Hwang
2c279b07f6 DBZ-3528 Wrote MongoDB Outbox Event Router with documentation and its unit & integration tests 2021-11-17 16:02:06 +01:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Jiri Pechanec
6163421199 DBZ-435 Fixes after review 2021-10-26 18:13:16 +02:00
Jiri Pechanec
a1084360da DBZ-435 Too fast delete can prevent from obtaining the full document 2021-10-26 18:13:16 +02:00
Jiri Pechanec
17df080717 DBZ-435 Fix test failures 2021-10-26 18:13:16 +02:00
Jiri Pechanec
8cb1954e08 DBZ-435 Converting FieldRenamesIT test 2021-10-26 18:13:16 +02:00
Jiri Pechanec
72e57483da DBZ-435 Add support of oplog test runs 2021-10-26 18:13:16 +02:00
Jiri Pechanec
8733e39643 DBZ-435 Converting SMT tests 2021-10-26 18:13:16 +02:00
Jiri Pechanec
c8317857db DBZ-435 Converting FieldExludeListIT test 2021-10-26 18:13:16 +02:00