Debezium Builder
485fa82a8f
[maven-release-plugin] prepare release v2.6.0.Alpha1
2024-01-21 10:12:44 +00:00
Roman Kudryashov
0c80f1f38d
DBZ-7284 Provide config option to customize CloudEvents.data schema name
2024-01-11 13:20:35 +01:00
Jakub Cechacek
716630043c
DBZ-7260 Added validation guard against the use of removed RS connection mode configuration
2024-01-11 09:58:24 +01:00
Jakub Cechacek
5dbe073d3b
DBZ-7260 Offset value conversion extracted into common util class
2024-01-11 09:58:24 +01:00
Jakub Cechacek
8132c601ce
DBZ-7260 Code cleanup and naming alignment
2024-01-11 09:58:24 +01:00
Jakub Cechacek
7333b2effb
DBZ-7260 Completely removed RS name from partition
2024-01-11 09:58:24 +01:00
Jakub Cechacek
ce8a5431fa
DBZ-7260 Fixed MongoDbPartition toString()
2024-01-11 09:58:24 +01:00
Jakub Cechacek
aa0c53ec2a
DBZ-7260 Offset consolidation test coverage
2024-01-11 09:58:24 +01:00
Jakub Cechacek
acdb8bee8d
DBZ-7260 Merge now unnecessary client factory into MongoDbConnectionContext
2024-01-11 09:58:24 +01:00
Jakub Cechacek
26e46c9f55
DBZ-7260 Streamlined MongoDbConnection handling
2024-01-11 09:58:24 +01:00
Jakub Cechacek
6e946cfa60
DBZ-7260 Replaced raw config with typed connector configuration
2024-01-11 09:58:24 +01:00
Jakub Cechacek
4397468baa
DBZ-7260 MongoDB connector validation now requires RS name to be specified when connecting to RS cluster
2024-01-11 09:58:24 +01:00
Jakub Cechacek
a5c24787ba
DBZ-7260 MongoDbConnector javadoc + making LOGGER static to allign with the prevalent style used elsewhere
2024-01-11 09:58:24 +01:00
Jakub Cechacek
e7c7131e05
DBZ-7260 Ability to consolidate previous offsets from replica_set connection mode and some surounding refactorings
2024-01-11 09:58:24 +01:00
Jakub Cechacek
e01b847f7d
DBZ-7260 Ability to consolidate offsets previously recorded by the removed replica_set connection mode
2024-01-11 09:58:24 +01:00
Jakub Cechacek
0442fcf6fa
DBZ-7260 Removed unused code
2024-01-11 09:58:24 +01:00
Jakub Cechacek
99439c3cfa
DBZ-7260 Removed RS name from CollectionId
2024-01-11 09:58:24 +01:00
Jakub Cechacek
4c64e28832
DBZ-7260 Merged connection string and task connection string properties to futher simplify RS name usage
2024-01-11 09:58:24 +01:00
Jakub Cechacek
8def3bf82c
DBZ-7260 Moved offset management from SourceInfo to MongoDbOffsetContext
2024-01-11 09:58:24 +01:00
Jakub Cechacek
7ad4701253
DBZ-7260 Further elimination of RS references, mainly from SourceInfo
2024-01-11 09:58:24 +01:00
Jakub Cechacek
15d9b8a791
DBZ-7260 Removed ReplicaSet class
2024-01-11 09:58:24 +01:00
Jakub Cechacek
85536fbf59
DBZ-7260 Flattening offsetContext and partition structue
2024-01-11 09:58:24 +01:00
Jakub Cechacek
2aa072830a
DBZ-7260 Adjusted snapshot threads to reflect RS connection mode removal
2024-01-11 09:58:24 +01:00
Jakub Cechacek
1c413db228
DBZ-7260 Removed redundant RS parameters from event sources
2024-01-11 09:58:24 +01:00
Jakub Cechacek
d564261e6e
DBZ-7260 Compeltely removed ReplicaSetDiscovery
2024-01-11 09:58:24 +01:00
Jakub Cechacek
1f61140e40
DBZ-7260 Removed RS from connection management
2024-01-11 09:58:24 +01:00
Jakub Cechacek
86ce26bf4a
DBZ-7260 Removed RS from MongoDbChangeEventSourceFactory
2024-01-11 09:58:24 +01:00
Jakub Cechacek
85fdf034e5
DBZ-7260 Removed ReplicaSets class
2024-01-11 09:58:24 +01:00
Jakub Cechacek
17cd2158bd
DBZ-7260 Removed RS monitoring as there is now only single RS which is always a wrapper around provided connection string
2024-01-11 09:58:24 +01:00
Jakub Cechacek
72e88ffc7d
DBZ-7260 Removed RS connection mode, there is always only single RS now
2024-01-11 09:58:24 +01:00
mfvitale
20fbe73bc8
DBZ-7311 Use a more meaningful name for identify an on demand blocking snapshot
2024-01-08 12:52:03 +01:00
mfvitale
47cbdee526
DBZ-7311 Permits to execute a blocking snapshot even if snapshot.mode=never
2024-01-08 12:52:03 +01:00
Richard Harrington
da5143a7ee
DBZ-7287 Clarify comment about how we extract and serialize document ids
2024-01-05 11:20:24 +01:00
Mickael Maison
70e7186868
DBZ-7298 Add service loader manifests for all Connect plugins
...
Add manifests for source/sink connectors, converters and transformations.
2024-01-04 09:22:29 +01:00
Debezium Builder
3853d20f44
[maven-release-plugin] prepare for next development iteration
2023-12-21 06:52:01 +00:00
Debezium Builder
5d35e9caaa
[maven-release-plugin] prepare release v2.5.0.Final
2023-12-21 06:52:01 +00:00
ani-sha
4b36ed9975
DBZ-7177 DBZ-6764 Use correct context name and add suggestions for code review
2023-12-20 08:56:56 +01:00
ani-sha
5a27d42257
DBZ-7177 Add isStreaming check for all tests, remove unused files
2023-12-20 08:56:56 +01:00
ani-sha
a12b1a9872
DBZ-6764 Connector metrics implementation for REST extension
2023-12-20 08:56:56 +01:00
ani-sha
e535e5b78d
DBZ-7177 Add suggestions from code review, adjust code style changes
2023-12-20 08:56:56 +01:00
ani-sha
2555a1cee2
DBZ-6764 DBZ-7178 DBZ-7177 Use MBeanServer to query metrics for REST endpoint and create new metrics descriptor
2023-12-20 08:56:56 +01:00
ani-sha
2165d9bed1
DBZ-6764 Connector metrics implementation for REST extension
2023-12-20 08:56:56 +01:00
Roman Kudryashov
516aa87fad
DBZ-7235 Add option to customize CloudEvents schema name
2023-12-20 06:53:37 +01:00
harveyyue
225277c5c0
DBZ-7251 Return generic DataCollectionId instead of REST response DataCollection in getMatchingCollections method
2023-12-19 12:53:57 +01:00
harveyyue
4719396ffc
DBZ-7145 Introduce a common parent connect for all Debezium source connectors
2023-12-19 12:53:57 +01:00
harveyyue
5553059fb8
DBZ-7167 Provide a public API from the connector implementations to retrieve the list of matching collections or tables based on the different include-/exclude lists
2023-12-19 12:53:57 +01:00
Jakub Cechacek
67260f8286
DBZ-7272 Guarding against implicit offset invalidation cause by the change of default connection mode
2023-12-19 06:45:02 +01:00
Jakub Cechacek
0dc97b4d79
DBZ-7264: Propagating exception when using multiple snapshotting threads
2023-12-19 06:25:22 +01:00
Debezium Builder
2c1def7241
[maven-release-plugin] prepare for next development iteration
2023-12-14 09:43:13 +00:00
Debezium Builder
ef8260f802
[maven-release-plugin] prepare release v2.5.0.CR1
2023-12-14 09:43:12 +00:00
Chris Cranford
ada157d117
DBZ-4321 Introduce BeanRegistry
and ServiceRegistry
...
As a part of this work to handle injection in a cleaner way, this commit
adds two new broad concepts called `BeanRegistry` and `ServiceRegistry`.
A BeanRegistry is a glorified registry of different objects that are not
necessarily services but may be desired by a service. This contract will
allow Debezium to integrate in the future with other CDI providers.
A ServiceRegistry is more of an internal concept, where various systems
can be started based on their dependency order and provides a universal
way to split larger parts of the code into smaller, focused modules that
can be accessed using the Service Locator pattern.
2023-12-13 11:27:40 -05:00
Chris Cranford
26b3881941
DBZ-4321 Add MongoDB hook & polish injection handler
2023-12-13 11:27:40 -05:00
Jakub Cechacek
bde91ecf0f
DBZ-7252 Using correct offsets in table/collection notifications for MongoDB
2023-12-12 19:52:14 +01:00
Chris Cranford
aea6cc003d
[ci] Use a relaxed property check for tests
2023-12-06 18:04:59 -05:00
mfvitale
5ed16284f4
DBZ-6834 Provide INSERT/DELETE semantics for MongoDb incremental snapshot watermarking
2023-12-06 14:10:26 +01:00
Debezium Builder
0fd1c0dc9a
[maven-release-plugin] prepare for next development iteration
2023-12-04 13:55:35 +00:00
Debezium Builder
3e2d75f0da
[maven-release-plugin] prepare release v2.5.0.Beta1
2023-12-04 13:55:35 +00:00
Jakub Cechacek
355041dbaf
DBZ-7184 buffer lock is now acquired with timeout and reattempted on failure
2023-12-04 06:58:28 +01:00
Jakub Cechacek
88a64bf3d5
DBZ-7184 Resumable events are now guaranteed to contain resume token
2023-12-04 06:58:28 +01:00
Jakub Cechacek
9ad6f9c7db
DBZ-7184 Streaming loop now always uses resumable event to get resume token
2023-12-04 06:58:28 +01:00
Jakub Cechacek
8a5007a738
DBZ-7184 Refactored streaming loop of MongoDB connector
2023-12-04 06:58:28 +01:00
Jakub Cechacek
c7e87c5382
DBZ-7184 Using buffering cursor in straming change event source
2023-12-04 06:58:28 +01:00
Jakub Cechacek
93e8570fb6
DBZ-7184 Implementation of buffering change stream cursor
2023-12-04 06:58:28 +01:00
Jakub Cechacek
2c8277fcf6
DBZ-7162 Removed duplicit source event count metric for MongoDB
2023-12-01 11:38:21 +01:00
Jakub Cechacek
79230c6014
DBZ-7206 Always check for blocking snapshot pause request when processing change events in MongoDB connector
2023-11-29 14:56:41 +01:00
“vsantonastaso”
8c1c369449
DBZ-6878 add table specific notification in initial snapshot
2023-11-29 08:32:21 +01:00
Jakub Cechacek
0ff0ff54ae
DBZ-7186 Removing unsued offset parameter
2023-11-28 07:27:34 +01:00
Jakub Cechacek
03e305e835
DBZ-7184 Extracted split event handling from streaming source
2023-11-28 07:27:34 +01:00
Jakub Cechacek
3f0eeebf10
DBZ-7184 Extracted change stream initialisation
2023-11-28 07:27:34 +01:00
Roman Kudryashov
1992c1e7e4
DBZ-7159 Fail fast during deserialization if a value is not a CloudEvent
2023-11-23 14:19:37 +01:00
Jiri Pechanec
e57c607bcf
DBZ-6762 Rename to general name
2023-11-22 06:10:40 +01:00
rkerner
aeaba3ae70
DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions
...
closes to https://issues.redhat.com/browse/DBZ-6762
2023-11-22 06:10:40 +01:00
Jakub Cechacek
ae6e7d03cc
DBZ-7157 Unified MongoDB document key serialisation for snapshot and streaming
2023-11-21 13:29:12 +01:00
Jakub Cechacek
fb23ce13a1
DBZ-7157 JsonSerialization#getDocumentIdChangeStream now uses the same implementation as getDocumentIdSnaphsot
2023-11-21 13:29:12 +01:00
Jakub Cechacek
d2eca450d5
DBZ-7157 Added test case for key generation with composite document ids
2023-11-21 13:29:12 +01:00
mfvitale
2f8482d284
DBZ-7139 Use namespace instead of identifier for matching collections to be snapshotted
2023-11-21 11:13:39 +01:00
Jakub Cechacek
687f2858e3
DBZ-7162 Added various streaming metrics to MongoDB connector
2023-11-21 11:09:09 +01:00
Jakub Cechacek
7d4ca05ef6
DBZ-7162 Passing streaming metrics to MongoDbStreamingChangeEventSource
2023-11-21 11:09:09 +01:00
Jakub Cechacek
17464f5fe2
DBZ-7146 Configurable inactivity pause duration in MongoDB connector
2023-11-20 13:59:44 +01:00
Jiri Pechanec
e654dc228f
DBZ-7066 Code reorganization
2023-11-14 11:56:16 +01:00
harveyyue
41f9423caf
DBZ-7066 Add test cases synchronously from "DBZ-6809"
2023-11-14 11:56:16 +01:00
harveyyue
223b6e4335
DBZ-7066 Extract common creating transformation methods to ConnectRecordUtil
2023-11-14 11:56:16 +01:00
harveyyue
4c3b5540ec
DBZ-7066 Add NewExtractNewDocumentStateTest and NewExtractNewDocumentStateTestIT for new option "delete.tombstone.handling.mode"
2023-11-14 11:56:16 +01:00
harveyyue
5e8287eb40
DBZ-7066 The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value
2023-11-14 11:56:16 +01:00
Jiri Pechanec
ef69dbe91c
DBZ-6809 Fix imports
2023-11-10 16:06:43 +01:00
Jakub Cechacek
e88d00badb
DBZ-6809 Added test for ExtractNewDocumentState with avro enabled on connector and transformation levels
2023-11-10 16:06:43 +01:00
Debezium Builder
1521445908
[maven-release-plugin] prepare for next development iteration
2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138
[maven-release-plugin] prepare release v2.5.0.Alpha2
2023-11-10 10:26:05 +00:00
Jiri Pechanec
9d84d01f64
DBZ-6726 Switch to ArrayList for repeated iteration
2023-11-09 07:57:12 +01:00
Jakub Cechacek
89b07a013e
DBZ-6726 support for $changeStreamSplitLargeEvent aggregation in MongoDB connector
2023-11-09 07:57:12 +01:00
Jakub Cechacek
bddf8802ec
DBZ-7108 Switched default connection mode for sharded clusters from replica_set to sharded
2023-11-07 10:36:53 +01:00
Vojtech Juranek
11d2ff0b9b
DBZ-7007 Use better name for auxiliary variable detecing if engine is running
2023-11-06 10:50:21 +01:00
Vojtech Juranek
fdab2cd61b
DBZ-7007 Remove engine.isRunning() from testsuite
2023-11-06 10:50:21 +01:00
Jakub Cechacek
a3affaf6a8
DBZ-7058 Fixed index handling in FieldSelector
2023-11-02 13:29:39 +01:00
Debezium Builder
78c5204444
[maven-release-plugin] prepare for next development iteration
2023-10-26 15:39:35 +00:00
Debezium Builder
356e488e83
[maven-release-plugin] prepare release v2.5.0.Alpha1
2023-10-26 15:39:35 +00:00
Roman Kudryashov
b0d7d60b5d
DBZ-7016 Optimize retrieval of id and type
2023-10-19 11:35:18 +02:00
Roman Kudryashov
22f6b083b1
DBZ-7016 Change metadata.location property syntax
2023-10-19 11:35:18 +02:00
Roman Kudryashov
ee64c70546
DBZ-7016 id
and type
of a CloudEvent can be retrieved from headers
2023-10-19 11:35:18 +02:00
harveyyue
4836fcf1ea
DBZ-6907 Introduce a new handling deleted record option "delete.tombstone.handling.mode"
2023-10-19 09:35:15 +02:00