jcechace
a393930de9
DBZ-5987 Removing unnecessary getOffset() call during streaming
2023-03-16 13:20:19 +01:00
jcechace
a536952779
DBZ-5987 Code cleanup in MongoDb SourceInfo
2023-03-16 13:20:19 +01:00
jcechace
0f10c71642
DBZ-5987 Using consistent approach when extracting change event timestampt acroos different event types
2023-03-16 13:20:19 +01:00
jcechace
6d7b655273
DBZ-5987 cleanup of connection management in *ChangeEventSource classes
2023-03-16 13:20:19 +01:00
jcechace
04dbae17ad
DBZ-5987 Cleaning up and updating its test coverage
2023-03-16 13:20:19 +01:00
jcechace
a39c084259
DBZ-5987 Replacing remaining usages of oplog with resume tokens retrieved from either change stream even or cursor
2023-03-16 13:20:19 +01:00
jcechace
bfdba1fb25
DBZ-5987 Removing obsolete ReplicaSetChangeStreamsContext from MongoDbStreamingChangeEventSource in order to simplify the implementation
2023-03-16 13:20:19 +01:00
Debezium Builder
55d65e9618
[maven-release-plugin] prepare for next development iteration
2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1
[maven-release-plugin] prepare release v2.2.0.Alpha3
2023-03-08 11:38:16 +00:00
Jiri Pechanec
98dcdb8f55
DBZ-6023 Remove nnecessary code
2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e
DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
...
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
ggaborg
065dc997b9
DBZ-823 Optionally parallelize initial snapshots
2023-03-03 12:47:15 +01:00
jcechace
aedb4fdd6a
DBZ-6032 Making MongoDbConnectorConfig.REPLICA_SETS internal
2023-03-03 05:46:33 +01:00
jcechace
7d3cca89bd
DBZ-6032 MongoConnection allways rethrows InterruptedException
2023-03-03 05:46:33 +01:00
jcechace
67d3f5b373
DBZ-6032 Removing obsolete retry configuration
2023-03-03 05:46:33 +01:00
jcechace
f305bcd9ab
DBZ-6032 Further simplifying connection logic
2023-03-03 05:46:33 +01:00
jcechace
ecdb4729af
DBZ-6032 Introducing connection package to mongo connector
2023-03-03 05:46:33 +01:00
jcechace
922191cdd7
DBZ-6032 Connection management refactoring
2023-03-03 05:46:33 +01:00
Bobby Tiernay
fe3135f28d
DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step.
2023-02-28 20:17:05 +01:00
Bobby Tiernay
37a6fea350
DBZ-6152: Remove hardcoded list of system database exclusions that are not required for change streaming.
2023-02-24 09:43:39 +01:00
Bobby Tiernay
5d80712781
DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
...
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Xinbin Huang
76a8f8dbe1
DBZ-6118: Update ExtractNewDocumentState to parse change stream output
2023-02-23 09:09:04 +01:00
Xinbin Huang
2c57b93384
DBZ-6118: Cleanup Mongo oplog code logic
2023-02-23 09:09:04 +01:00
Eugene Abramchuk
fcc44edf0b
DBZ-6113 Correct max reconnect attempts
...
Originally there are max+1 attempts
2023-02-21 08:10:26 +01:00
Xinbin Huang
a3d75e798a
DBZ-6116: Support String type for key in Mongo incremental snapshot
2023-02-20 13:55:54 +01:00
Debezium Builder
2245ceda44
[maven-release-plugin] prepare for next development iteration
2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a
[maven-release-plugin] prepare release v2.2.0.Alpha2
2023-02-16 11:28:25 +00:00
Yang Wu
e98089e9a3
DBZ-6038 Expose walltime from mongo record parser
2023-02-14 09:48:17 +01:00
harveyyue
57b902ff8c
DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector
2023-02-02 13:21:45 +01:00
jcechace
e982033961
DBZ-6064 masking sensitive information in connection string on close
2023-02-01 11:05:16 +01:00
jcechace
0918c34b38
DBZ-5973 Support for more types as key in mongodb incremental snapshot implementation
2023-02-01 08:47:14 +01:00
Yang Wu
2a366cf398
DBZ-6038 Add wallTime in mongo source info
2023-01-25 10:30:32 +01:00
Debezium Builder
04f5291a2d
[maven-release-plugin] prepare for next development iteration
2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e
[maven-release-plugin] prepare release v2.2.0.Alpha1
2023-01-19 11:32:10 +00:00
Jiri Pechanec
8ca5e0a9b5
DBZ-4669 Reformat after plugin version consolidation
2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6
DBZ-2439 Remove redundant modifiers
2023-01-11 06:44:53 +01:00
Debezium Builder
cf1720e4cb
[maven-release-plugin] prepare for next development iteration
2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd
[maven-release-plugin] prepare release v2.1.0.Final
2022-12-22 10:11:53 +00:00
jcechace
351a0d73fe
DBZ-4339 Preferring secondaries to perform incremental snapshot where possible
2022-12-20 15:03:17 +01:00
jcechace
3966a4099a
DBZ-4339 MongoDbIncrementalSnapshotChangeEventSource uses MongoPreferredNode
2022-12-20 15:03:17 +01:00
jcechace
27cea0e5e6
DBZ-4339 Preferring secondaries to perform snapshot
2022-12-20 15:03:17 +01:00
jcechace
44ae4697d7
DBZ-4339 Preferring secondaries for opening mongodb change stream during streaming phase
2022-12-20 15:03:17 +01:00
jcechace
434322256c
DBZ-4339 Generalising MongoPrimary into MongoPreferredNode
2022-12-20 15:03:17 +01:00
harveyyue
03933f61ea
DBZ-5818 field.exclude.list in MongoDB Connector v2.0 doesn't accept * as a wildcard for collectionName
2022-12-19 13:39:37 +01:00
Debezium Builder
177a60a9d3
[maven-release-plugin] prepare for next development iteration
2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c
[maven-release-plugin] prepare release v2.1.0.Beta1
2022-12-16 09:33:38 +00:00
jcechace
60910872b9
DBZ-5857 Using single member replica as default
2022-12-16 08:43:25 +01:00
jcechace
c9ef1136b5
DBZ-5857 Excluding JUnit5 from debezium-testing-testcontainers dependency in mongo module
2022-12-16 08:43:25 +01:00
jcechace
0951f9994f
DBZ-5857 Migrated MongoDB integration tests to test-containers
2022-12-16 08:43:25 +01:00
Vojtech Juranek
9494552a3a
DBZ-5838 Add missing Apicurio converter dependency
2022-12-12 14:44:05 +01:00