alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
7,226 Commits 3 Branches 0 Tags 51 MiB
5c61bc4341
Commit Graph

424 Commits

Author SHA1 Message Date
jcechace
5c61bc4341 DBZ-4733 Reordering fileds in MongoDbConnectorConfig 2022-08-19 12:55:58 +02:00
jcechace
b61319feb7 DBZ-4733 Basic integration test for connection string support 2022-08-19 12:55:58 +02:00
jcechace
7670c4ba74 DBZ-4733 working POC for connection String support 2022-08-19 12:55:58 +02:00
jcechace
521156f5c2 DBZ-4733 Refactored MongoUtil.getPrimaryAddress to properly use mongo driver 4.x 2022-08-19 12:55:58 +02:00
jcechace
21ed5f9b9f DBZ-4733 Refactor ReplicaSets.parse into more readable form 2022-08-19 12:55:58 +02:00
jcechace
752062c1a3 DBZ-4733 Fixed thread safety of MongoClients 2022-08-19 12:55:58 +02:00
jcechace
1d9d75754c DBZ-4733 Refactoring ReplicaSetDiscovery to properly use mongodb driver 4.x 2022-08-19 12:55:58 +02:00
jcechace
3a385aa768 DBZ-4733 Refactoring: unified client factory method names 2022-08-19 12:55:58 +02:00
jcechace
cc04a94fd5 DBZ-4733 Ininital connection string filed introduction 2022-08-19 12:55:58 +02:00
Chris Cranford
b7e2112603 DBZ-5497 Align test behavior 2022-08-19 11:05:29 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
nicholas-fwang
58a91cddb4 DBZ-5479 Retry MongoNodeIsRecoveringException when failover 2022-08-05 10:52:46 -04:00
Chris Cranford
90a4c0059a
DBZ-5434 Fix test failure 2022-08-01 14:36:09 -04:00
harveyyue
7c93c597f7 DBZ-5434 Translation from mongodb document to kafka connect schema fails when nested arrays contain no elements 2022-08-01 10:07:28 -04:00
Vojtech Juranek
c7d8353d7b DBZ-4727 Add snapshot paused JXM metrics 
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
  or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
  snapshot was paused. The time adds up - if the snapshot was paused
  e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
  these two paused times.
 2022-07-29 12:41:58 -04:00
Vojtech Juranek
ed504173e1 DBZ-4727 Implement incremental snaphost pause/resume 
Intorduce two new signals:
* `pause-snapshot` - pauses running incremental snapshot
* `resume-snapshot` - resumes paused incremental snapshot

If the incremental snapshot is running and pause signal is sent,
currently processed chunk is finished and then no other chunk is read.
Snapshot state is kept in running state. Once snapshot is resume,
chunk is reverted to position which was last sent to the broker and
process of reading chunks and emitting `read` events continues until
all tables are read and sent.

This patch handles only table-based signals. MySQL Kafka-based signals
will be addressed later.
 2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Chris Cranford
de4d8e17d3 DBZ-5371 Check for $natural not supported, treat as no oplog entry 2022-07-25 10:20:46 -04:00
harveyyue
6ea7abc8fc DBZ-4180 Pluggable topic selector 2022-07-13 14:45:25 +02:00
harveyyue
e8405bc376 DBZ-4846 MongoConnector's field exclusion configuration does not work with fields with the same name but from different collections 2022-07-12 17:26:36 +02:00
harveyyue
2a2b5462db DBZ-5328 field.exclude.list doesn't accept dashes (-) in database name 2022-06-30 10:47:56 +02:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
kanha gupta
1b17372d2d DBZ-4902 Replace long durations with Duration 2022-06-27 14:29:51 +02:00
Jiri Pechanec
38726a8451 DBZ-5260 Fix imports 2022-06-20 09:22:24 +02:00
Tim Patterson
c0323305ac DBZ-5260 Filter out unavailable replicaset members 2022-06-20 08:56:57 +02:00
Vojtech Juranek
4a48eb33df DBZ-5045 Remove legacy V1 source info 2022-06-08 09:11:00 +02:00
Vojtech Juranek
76c8550e7b DBZ-5045 Remove deprecated Mongo DB OPERATION_HEADER option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
4140078db7 DBZ-5045 Remove deprecated Mongo DB ADD_SOURCE_FIELDS option 
Adjust the tests as source `ts_ms` is different.
 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0ddcd93167 DBZ-5045 Remove deprecated POLL_INTERVAL_SEC 2022-06-08 09:11:00 +02:00
Vojtech Juranek
64ef812cc9 DBZ-5045 Remove deprecated MAX_COPY_THREADS 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0d6bfec265 DBZ-5045 Remove deprecated FIELD_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
d66d86a3ac DBZ-5045 Remove deprecated COLLECTION_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
2484faaffe DBZ-5045 Remove deprecated COLLECTION_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b3a6131cee DBZ-5045 Remove deprecated DATABASE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0cbb57f4bf DBZ-5045 Remove deprecated DATABASE_WHITELIST 2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34 DBZ-5206 Remove the deprecated monitored tables metrics 2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Chris Cranford
28cd36edff DBZ-5011 Set task metrics attribute when using only 1 task 2022-06-01 09:41:36 +02:00
Chris Cranford
9fa5a48274 DBZ-5011 Register MongoDB metrics with task id when more than one task 2022-06-01 09:41:36 +02:00
Yang
75d3b716ab DBZ-5113 Use generic bson value 2022-05-17 14:32:51 +02:00
Yang
5c190f7584 DBZ-5113 Use bson document 2022-05-17 14:32:51 +02:00
Jiri Pechanec
707eeab3d8 DBZ-4951 Remove oplog suppport 2022-05-11 16:04:04 +02:00
Jiri Pechanec
ee78ba6ad6 DBZ-5015 Fix formatting 2022-04-21 07:09:18 +02:00