Vojtech Juranek
8d7611bfcb
DBZ-5043 Remove unused DB_HISTORY_PATH constant
2022-09-07 12:57:31 +02:00
Vojtech Juranek
eb6e2648f4
DBZ-5043 Replace mongodb.name with topic.prefix
...
To be consistent with specifying topic prefix, replace also MongoDB
`mongodb.name` with `topic.prefix`.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6
DBZ-5043 Use topic prefix as the logical name
...
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.
Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
ggaborg
664fd9e1b0
DBZ-3293 unit tests for filters
2022-09-01 20:16:47 +02:00
ggaborg
244de2bd96
DBZ-3293 Add signal table automatically to include list
2022-09-01 20:16:47 +02:00
Jiri Pechanec
de53591dba
DBZ-5244 Retry all communication exceptions by default
2022-08-31 09:45:09 -04:00
jcechace
5c61bc4341
DBZ-4733 Reordering fileds in MongoDbConnectorConfig
2022-08-19 12:55:58 +02:00
jcechace
b61319feb7
DBZ-4733 Basic integration test for connection string support
2022-08-19 12:55:58 +02:00
jcechace
7670c4ba74
DBZ-4733 working POC for connection String support
2022-08-19 12:55:58 +02:00
jcechace
521156f5c2
DBZ-4733 Refactored MongoUtil.getPrimaryAddress to properly use mongo driver 4.x
2022-08-19 12:55:58 +02:00
jcechace
21ed5f9b9f
DBZ-4733 Refactor ReplicaSets.parse into more readable form
2022-08-19 12:55:58 +02:00
jcechace
752062c1a3
DBZ-4733 Fixed thread safety of MongoClients
2022-08-19 12:55:58 +02:00
jcechace
1d9d75754c
DBZ-4733 Refactoring ReplicaSetDiscovery to properly use mongodb driver 4.x
2022-08-19 12:55:58 +02:00
jcechace
3a385aa768
DBZ-4733 Refactoring: unified client factory method names
2022-08-19 12:55:58 +02:00
jcechace
cc04a94fd5
DBZ-4733 Ininital connection string filed introduction
2022-08-19 12:55:58 +02:00
Chris Cranford
b7e2112603
DBZ-5497 Align test behavior
2022-08-19 11:05:29 +02:00
Vivek Wassan
d89e71ebeb
DBZ-5327 Smart Backfills
2022-08-17 10:05:55 +02:00
nicholas-fwang
58a91cddb4
DBZ-5479 Retry MongoNodeIsRecoveringException when failover
2022-08-05 10:52:46 -04:00
Chris Cranford
90a4c0059a
DBZ-5434 Fix test failure
2022-08-01 14:36:09 -04:00
harveyyue
7c93c597f7
DBZ-5434 Translation from mongodb document to kafka connect schema fails when nested arrays contain no elements
2022-08-01 10:07:28 -04:00
Vojtech Juranek
c7d8353d7b
DBZ-4727 Add snapshot paused JXM metrics
...
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
snapshot was paused. The time adds up - if the snapshot was paused
e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
these two paused times.
2022-07-29 12:41:58 -04:00
Vojtech Juranek
ed504173e1
DBZ-4727 Implement incremental snaphost pause/resume
...
Intorduce two new signals:
* `pause-snapshot` - pauses running incremental snapshot
* `resume-snapshot` - resumes paused incremental snapshot
If the incremental snapshot is running and pause signal is sent,
currently processed chunk is finished and then no other chunk is read.
Snapshot state is kept in running state. Once snapshot is resume,
chunk is reverted to position which was last sent to the broker and
process of reading chunks and emitting `read` events continues until
all tables are read and sent.
This patch handles only table-based signals. MySQL Kafka-based signals
will be addressed later.
2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e
DBZ-5457 Deprecate legacy topic selector for all connectors
2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0
[maven-release-plugin] prepare for next development iteration
2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79
[maven-release-plugin] prepare release v2.0.0.Beta1
2022-07-26 18:13:09 +00:00
Chris Cranford
de4d8e17d3
DBZ-5371 Check for $natural not supported, treat as no oplog entry
2022-07-25 10:20:46 -04:00
harveyyue
6ea7abc8fc
DBZ-4180 Pluggable topic selector
2022-07-13 14:45:25 +02:00
harveyyue
e8405bc376
DBZ-4846 MongoConnector's field exclusion configuration does not work with fields with the same name but from different collections
2022-07-12 17:26:36 +02:00
Debezium Builder
6fd1441af3
[maven-release-plugin] prepare for next development iteration
2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634
[maven-release-plugin] prepare release v2.0.0.Alpha3
2022-07-01 09:21:48 +00:00
harveyyue
2a2b5462db
DBZ-5328 field.exclude.list doesn't accept dashes (-) in database name
2022-06-30 10:47:56 +02:00
Mickael Maison
5ff71aa992
DBZ-5335 Fix formatting issues in the connectors configdefs
2022-06-30 09:35:54 +02:00
kanha gupta
1b17372d2d
DBZ-4902 Replace long durations with Duration
2022-06-27 14:29:51 +02:00
Jiri Pechanec
38726a8451
DBZ-5260 Fix imports
2022-06-20 09:22:24 +02:00
Tim Patterson
c0323305ac
DBZ-5260 Filter out unavailable replicaset members
2022-06-20 08:56:57 +02:00
Debezium Builder
6fff3a2876
[maven-release-plugin] prepare for next development iteration
2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df
[maven-release-plugin] prepare release v2.0.0.Alpha2
2022-06-09 11:49:26 +00:00
Vojtech Juranek
4a48eb33df
DBZ-5045 Remove legacy V1 source info
2022-06-08 09:11:00 +02:00
Vojtech Juranek
76c8550e7b
DBZ-5045 Remove deprecated Mongo DB OPERATION_HEADER option
2022-06-08 09:11:00 +02:00
Vojtech Juranek
4140078db7
DBZ-5045 Remove deprecated Mongo DB ADD_SOURCE_FIELDS option
...
Adjust the tests as source `ts_ms` is different.
2022-06-08 09:11:00 +02:00
Vojtech Juranek
0ddcd93167
DBZ-5045 Remove deprecated POLL_INTERVAL_SEC
2022-06-08 09:11:00 +02:00
Vojtech Juranek
64ef812cc9
DBZ-5045 Remove deprecated MAX_COPY_THREADS
2022-06-08 09:11:00 +02:00
Vojtech Juranek
0d6bfec265
DBZ-5045 Remove deprecated FIELD_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
d66d86a3ac
DBZ-5045 Remove deprecated COLLECTION_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
2484faaffe
DBZ-5045 Remove deprecated COLLECTION_WHITELIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
b3a6131cee
DBZ-5045 Remove deprecated DATABASE_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
0cbb57f4bf
DBZ-5045 Remove deprecated DATABASE_WHITELIST
2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34
DBZ-5206 Remove the deprecated monitored tables metrics
2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c
DBZ-4251 Support stopping incremental snapshots
2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050
DBZ-5136 Move sourceInfo to common class
2022-06-01 16:56:29 +02:00