Commit Graph

897 Commits

Author SHA1 Message Date
Mickael Maison
70e7186868 DBZ-7298 Add service loader manifests for all Connect plugins
Add manifests for source/sink connectors, converters and transformations.
2024-01-04 09:22:29 +01:00
Debezium Builder
3853d20f44 [maven-release-plugin] prepare for next development iteration 2023-12-21 06:52:01 +00:00
Debezium Builder
5d35e9caaa [maven-release-plugin] prepare release v2.5.0.Final 2023-12-21 06:52:01 +00:00
ani-sha
4b36ed9975 DBZ-7177 DBZ-6764 Use correct context name and add suggestions for code review 2023-12-20 08:56:56 +01:00
ani-sha
5a27d42257 DBZ-7177 Add isStreaming check for all tests, remove unused files 2023-12-20 08:56:56 +01:00
ani-sha
a12b1a9872 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
ani-sha
e535e5b78d DBZ-7177 Add suggestions from code review, adjust code style changes 2023-12-20 08:56:56 +01:00
ani-sha
2555a1cee2 DBZ-6764 DBZ-7178 DBZ-7177 Use MBeanServer to query metrics for REST endpoint and create new metrics descriptor 2023-12-20 08:56:56 +01:00
ani-sha
2165d9bed1 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
Roman Kudryashov
516aa87fad DBZ-7235 Add option to customize CloudEvents schema name 2023-12-20 06:53:37 +01:00
harveyyue
225277c5c0 DBZ-7251 Return generic DataCollectionId instead of REST response DataCollection in getMatchingCollections method 2023-12-19 12:53:57 +01:00
harveyyue
4719396ffc DBZ-7145 Introduce a common parent connect for all Debezium source connectors 2023-12-19 12:53:57 +01:00
harveyyue
5553059fb8 DBZ-7167 Provide a public API from the connector implementations to retrieve the list of matching collections or tables based on the different include-/exclude lists 2023-12-19 12:53:57 +01:00
Jakub Cechacek
67260f8286 DBZ-7272 Guarding against implicit offset invalidation cause by the change of default connection mode 2023-12-19 06:45:02 +01:00
Jakub Cechacek
0dc97b4d79 DBZ-7264: Propagating exception when using multiple snapshotting threads 2023-12-19 06:25:22 +01:00
Debezium Builder
2c1def7241 [maven-release-plugin] prepare for next development iteration 2023-12-14 09:43:13 +00:00
Debezium Builder
ef8260f802 [maven-release-plugin] prepare release v2.5.0.CR1 2023-12-14 09:43:12 +00:00
Chris Cranford
ada157d117 DBZ-4321 Introduce BeanRegistry and ServiceRegistry
As a part of this work to handle injection in a cleaner way, this commit
adds two new broad concepts called `BeanRegistry` and `ServiceRegistry`.

A BeanRegistry is a glorified registry of different objects that are not
necessarily services but may be desired by a service. This contract will
allow Debezium to integrate in the future with other CDI providers.

A ServiceRegistry is more of an internal concept, where various systems
can be started based on their dependency order and provides a universal
way to split larger parts of the code into smaller, focused modules that
can be accessed using the Service Locator pattern.
2023-12-13 11:27:40 -05:00
Chris Cranford
26b3881941 DBZ-4321 Add MongoDB hook & polish injection handler 2023-12-13 11:27:40 -05:00
Jakub Cechacek
bde91ecf0f DBZ-7252 Using correct offsets in table/collection notifications for MongoDB 2023-12-12 19:52:14 +01:00
Chris Cranford
aea6cc003d
[ci] Use a relaxed property check for tests 2023-12-06 18:04:59 -05:00
mfvitale
5ed16284f4 DBZ-6834 Provide INSERT/DELETE semantics for MongoDb incremental snapshot watermarking 2023-12-06 14:10:26 +01:00
Debezium Builder
0fd1c0dc9a [maven-release-plugin] prepare for next development iteration 2023-12-04 13:55:35 +00:00
Debezium Builder
3e2d75f0da [maven-release-plugin] prepare release v2.5.0.Beta1 2023-12-04 13:55:35 +00:00
Jakub Cechacek
355041dbaf DBZ-7184 buffer lock is now acquired with timeout and reattempted on failure 2023-12-04 06:58:28 +01:00
Jakub Cechacek
88a64bf3d5 DBZ-7184 Resumable events are now guaranteed to contain resume token 2023-12-04 06:58:28 +01:00
Jakub Cechacek
9ad6f9c7db DBZ-7184 Streaming loop now always uses resumable event to get resume token 2023-12-04 06:58:28 +01:00
Jakub Cechacek
8a5007a738 DBZ-7184 Refactored streaming loop of MongoDB connector 2023-12-04 06:58:28 +01:00
Jakub Cechacek
c7e87c5382 DBZ-7184 Using buffering cursor in straming change event source 2023-12-04 06:58:28 +01:00
Jakub Cechacek
93e8570fb6 DBZ-7184 Implementation of buffering change stream cursor 2023-12-04 06:58:28 +01:00
Jakub Cechacek
2c8277fcf6 DBZ-7162 Removed duplicit source event count metric for MongoDB 2023-12-01 11:38:21 +01:00
Jakub Cechacek
79230c6014 DBZ-7206 Always check for blocking snapshot pause request when processing change events in MongoDB connector 2023-11-29 14:56:41 +01:00
“vsantonastaso”
8c1c369449 DBZ-6878 add table specific notification in initial snapshot 2023-11-29 08:32:21 +01:00
Jakub Cechacek
0ff0ff54ae DBZ-7186 Removing unsued offset parameter 2023-11-28 07:27:34 +01:00
Jakub Cechacek
03e305e835 DBZ-7184 Extracted split event handling from streaming source 2023-11-28 07:27:34 +01:00
Jakub Cechacek
3f0eeebf10 DBZ-7184 Extracted change stream initialisation 2023-11-28 07:27:34 +01:00
Roman Kudryashov
1992c1e7e4 DBZ-7159 Fail fast during deserialization if a value is not a CloudEvent 2023-11-23 14:19:37 +01:00
Jiri Pechanec
e57c607bcf DBZ-6762 Rename to general name 2023-11-22 06:10:40 +01:00
rkerner
aeaba3ae70 DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions
closes to https://issues.redhat.com/browse/DBZ-6762
2023-11-22 06:10:40 +01:00
Jakub Cechacek
ae6e7d03cc DBZ-7157 Unified MongoDB document key serialisation for snapshot and streaming 2023-11-21 13:29:12 +01:00
Jakub Cechacek
fb23ce13a1 DBZ-7157 JsonSerialization#getDocumentIdChangeStream now uses the same implementation as getDocumentIdSnaphsot 2023-11-21 13:29:12 +01:00
Jakub Cechacek
d2eca450d5 DBZ-7157 Added test case for key generation with composite document ids 2023-11-21 13:29:12 +01:00
mfvitale
2f8482d284 DBZ-7139 Use namespace instead of identifier for matching collections to be snapshotted 2023-11-21 11:13:39 +01:00
Jakub Cechacek
687f2858e3 DBZ-7162 Added various streaming metrics to MongoDB connector 2023-11-21 11:09:09 +01:00
Jakub Cechacek
7d4ca05ef6 DBZ-7162 Passing streaming metrics to MongoDbStreamingChangeEventSource 2023-11-21 11:09:09 +01:00
Jakub Cechacek
17464f5fe2 DBZ-7146 Configurable inactivity pause duration in MongoDB connector 2023-11-20 13:59:44 +01:00
Jiri Pechanec
e654dc228f DBZ-7066 Code reorganization 2023-11-14 11:56:16 +01:00
harveyyue
41f9423caf DBZ-7066 Add test cases synchronously from "DBZ-6809" 2023-11-14 11:56:16 +01:00
harveyyue
223b6e4335 DBZ-7066 Extract common creating transformation methods to ConnectRecordUtil 2023-11-14 11:56:16 +01:00
harveyyue
4c3b5540ec DBZ-7066 Add NewExtractNewDocumentStateTest and NewExtractNewDocumentStateTestIT for new option "delete.tombstone.handling.mode" 2023-11-14 11:56:16 +01:00