alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
8,044 Commits 3 Branches 0 Tags 51 MiB
472162e46e
Commit Graph

731 Commits

Author SHA1 Message Date
PlugaruT
472162e46e DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots 
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
 2023-03-06 10:25:59 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
jcechace
aedb4fdd6a DBZ-6032 Making MongoDbConnectorConfig.REPLICA_SETS internal 2023-03-03 05:46:33 +01:00
jcechace
7d3cca89bd DBZ-6032 MongoConnection allways rethrows InterruptedException 2023-03-03 05:46:33 +01:00
jcechace
67d3f5b373 DBZ-6032 Removing obsolete retry configuration 2023-03-03 05:46:33 +01:00
jcechace
f305bcd9ab DBZ-6032 Further simplifying connection logic 2023-03-03 05:46:33 +01:00
jcechace
ecdb4729af DBZ-6032 Introducing connection package to mongo connector 2023-03-03 05:46:33 +01:00
jcechace
922191cdd7 DBZ-6032 Connection management refactoring 2023-03-03 05:46:33 +01:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Bobby Tiernay
37a6fea350 DBZ-6152: Remove hardcoded list of system database exclusions that are not required for change streaming. 2023-02-24 09:43:39 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams. 
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
 2023-02-23 18:14:08 +01:00
Xinbin Huang
76a8f8dbe1 DBZ-6118: Update ExtractNewDocumentState to parse change stream output 2023-02-23 09:09:04 +01:00
Xinbin Huang
2c57b93384 DBZ-6118: Cleanup Mongo oplog code logic 2023-02-23 09:09:04 +01:00
Eugene Abramchuk
fcc44edf0b DBZ-6113 Correct max reconnect attempts 
Originally there are max+1 attempts
 2023-02-21 08:10:26 +01:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Yang Wu
e98089e9a3 DBZ-6038 Expose walltime from mongo record parser 2023-02-14 09:48:17 +01:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
jcechace
e982033961 DBZ-6064 masking sensitive information in connection string on close 2023-02-01 11:05:16 +01:00
jcechace
0918c34b38 DBZ-5973 Support for more types as key in mongodb incremental snapshot implementation 2023-02-01 08:47:14 +01:00
Yang Wu
2a366cf398 DBZ-6038 Add wallTime in mongo source info 2023-01-25 10:30:32 +01:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
jcechace
351a0d73fe DBZ-4339 Preferring secondaries to perform incremental snapshot where possible 2022-12-20 15:03:17 +01:00
jcechace
3966a4099a DBZ-4339 MongoDbIncrementalSnapshotChangeEventSource uses MongoPreferredNode 2022-12-20 15:03:17 +01:00
jcechace
27cea0e5e6 DBZ-4339 Preferring secondaries to perform snapshot 2022-12-20 15:03:17 +01:00
jcechace
44ae4697d7 DBZ-4339 Preferring secondaries for opening mongodb change stream during streaming phase 2022-12-20 15:03:17 +01:00
jcechace
434322256c DBZ-4339 Generalising MongoPrimary into MongoPreferredNode 2022-12-20 15:03:17 +01:00
harveyyue
03933f61ea DBZ-5818 field.exclude.list in MongoDB Connector v2.0 doesn't accept * as a wildcard for collectionName 2022-12-19 13:39:37 +01:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
jcechace
60910872b9 DBZ-5857 Using single member replica as default 2022-12-16 08:43:25 +01:00
jcechace
c9ef1136b5 DBZ-5857 Excluding JUnit5 from debezium-testing-testcontainers dependency in mongo module 2022-12-16 08:43:25 +01:00
jcechace
0951f9994f DBZ-5857 Migrated MongoDB integration tests to test-containers 2022-12-16 08:43:25 +01:00
Vojtech Juranek
9494552a3a DBZ-5838 Add missing Apicurio converter dependency 2022-12-12 14:44:05 +01:00
Marcelo Avancini
7754163c5d DBZ-2432: Fixing misuse of assertj 
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
 2022-12-08 13:10:26 +01:00
Vojtech Juranek
e1b65cd6f7 DBZ-5889 Run integration tests in specified order 
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
 2022-12-08 13:00:41 +01:00
Jiri Pechanec
97ea30f25d DBZ-5893 Mask connection string in connector option logging 2022-12-07 08:41:34 +01:00
jcechace
2468d73783 DBZ-5893 Masking credentials in connection string when logging 2022-12-07 05:45:58 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Bobby Tiernay
adb672a87c DBZ-4339 Migrate from JUnit 4 to 5, rename utility class, fix formatting. 2022-11-30 07:00:56 +01:00
Bobby Tiernay
950a2a8bdf DBZ-4339 Migrate MongoDB Testcontainer support to debezium-testing-testcontainers module. 2022-11-30 07:00:56 +01:00
Bobby Tiernay
5c94151b1f DBZ-4339 Make mongosh more resilient to various output conditions. 2022-11-30 07:00:56 +01:00
Bobby Tiernay
849347b7ec DBZ-4339 Remove reliance on MongoDB driver in non-IT code. 2022-11-30 07:00:56 +01:00