Commit Graph

592 Commits

Author SHA1 Message Date
Jakub Cechacek
79230c6014 DBZ-7206 Always check for blocking snapshot pause request when processing change events in MongoDB connector 2023-11-29 14:56:41 +01:00
“vsantonastaso”
8c1c369449 DBZ-6878 add table specific notification in initial snapshot 2023-11-29 08:32:21 +01:00
Jakub Cechacek
0ff0ff54ae DBZ-7186 Removing unsued offset parameter 2023-11-28 07:27:34 +01:00
Jakub Cechacek
03e305e835 DBZ-7184 Extracted split event handling from streaming source 2023-11-28 07:27:34 +01:00
Jakub Cechacek
3f0eeebf10 DBZ-7184 Extracted change stream initialisation 2023-11-28 07:27:34 +01:00
Roman Kudryashov
1992c1e7e4 DBZ-7159 Fail fast during deserialization if a value is not a CloudEvent 2023-11-23 14:19:37 +01:00
Jiri Pechanec
e57c607bcf DBZ-6762 Rename to general name 2023-11-22 06:10:40 +01:00
rkerner
aeaba3ae70 DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions
closes to https://issues.redhat.com/browse/DBZ-6762
2023-11-22 06:10:40 +01:00
Jakub Cechacek
ae6e7d03cc DBZ-7157 Unified MongoDB document key serialisation for snapshot and streaming 2023-11-21 13:29:12 +01:00
Jakub Cechacek
fb23ce13a1 DBZ-7157 JsonSerialization#getDocumentIdChangeStream now uses the same implementation as getDocumentIdSnaphsot 2023-11-21 13:29:12 +01:00
Jakub Cechacek
d2eca450d5 DBZ-7157 Added test case for key generation with composite document ids 2023-11-21 13:29:12 +01:00
mfvitale
2f8482d284 DBZ-7139 Use namespace instead of identifier for matching collections to be snapshotted 2023-11-21 11:13:39 +01:00
Jakub Cechacek
687f2858e3 DBZ-7162 Added various streaming metrics to MongoDB connector 2023-11-21 11:09:09 +01:00
Jakub Cechacek
7d4ca05ef6 DBZ-7162 Passing streaming metrics to MongoDbStreamingChangeEventSource 2023-11-21 11:09:09 +01:00
Jakub Cechacek
17464f5fe2 DBZ-7146 Configurable inactivity pause duration in MongoDB connector 2023-11-20 13:59:44 +01:00
Jiri Pechanec
e654dc228f DBZ-7066 Code reorganization 2023-11-14 11:56:16 +01:00
harveyyue
41f9423caf DBZ-7066 Add test cases synchronously from "DBZ-6809" 2023-11-14 11:56:16 +01:00
harveyyue
223b6e4335 DBZ-7066 Extract common creating transformation methods to ConnectRecordUtil 2023-11-14 11:56:16 +01:00
harveyyue
4c3b5540ec DBZ-7066 Add NewExtractNewDocumentStateTest and NewExtractNewDocumentStateTestIT for new option "delete.tombstone.handling.mode" 2023-11-14 11:56:16 +01:00
harveyyue
5e8287eb40 DBZ-7066 The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value 2023-11-14 11:56:16 +01:00
Jiri Pechanec
ef69dbe91c DBZ-6809 Fix imports 2023-11-10 16:06:43 +01:00
Jakub Cechacek
e88d00badb DBZ-6809 Added test for ExtractNewDocumentState with avro enabled on connector and transformation levels 2023-11-10 16:06:43 +01:00
Jiri Pechanec
9d84d01f64 DBZ-6726 Switch to ArrayList for repeated iteration 2023-11-09 07:57:12 +01:00
Jakub Cechacek
89b07a013e DBZ-6726 support for $changeStreamSplitLargeEvent aggregation in MongoDB connector 2023-11-09 07:57:12 +01:00
Jakub Cechacek
bddf8802ec DBZ-7108 Switched default connection mode for sharded clusters from replica_set to sharded 2023-11-07 10:36:53 +01:00
Vojtech Juranek
11d2ff0b9b DBZ-7007 Use better name for auxiliary variable detecing if engine is running 2023-11-06 10:50:21 +01:00
Vojtech Juranek
fdab2cd61b DBZ-7007 Remove engine.isRunning() from testsuite 2023-11-06 10:50:21 +01:00
Jakub Cechacek
a3affaf6a8 DBZ-7058 Fixed index handling in FieldSelector 2023-11-02 13:29:39 +01:00
Roman Kudryashov
b0d7d60b5d DBZ-7016 Optimize retrieval of id and type 2023-10-19 11:35:18 +02:00
Roman Kudryashov
22f6b083b1 DBZ-7016 Change metadata.location property syntax 2023-10-19 11:35:18 +02:00
Roman Kudryashov
ee64c70546 DBZ-7016 id and type of a CloudEvent can be retrieved from headers 2023-10-19 11:35:18 +02:00
harveyyue
4836fcf1ea DBZ-6907 Introduce a new handling deleted record option "delete.tombstone.handling.mode" 2023-10-19 09:35:15 +02:00
harveyyue
fccaf37549 DBZ-6907 Remove unused method from ExtractNewDocumentState 2023-10-19 09:35:15 +02:00
harveyyue
f64ea1a5f8 DBZ-6907 Extract an abstract transformation class from ExtractNewRecordState 2023-10-19 09:35:15 +02:00
Roman Kudryashov
01485aceb3 DBZ-6982 Provide configuration option to exclude extension attributes from a CloudEvent 2023-10-04 13:58:53 +02:00
Jakub Cechacek
9b3b718612 DBZ-6973 Fixed insufficient test isolation 2023-10-02 08:25:53 +02:00
Jakub Cechacek
baafe602ce DBZ-6973 Literal matching mode for database/collection filters and ability to override internal aggregation pipeline for MongoDB conenctor 2023-10-02 08:25:53 +02:00
mfvitale
56795732b5 DBZ-6793 Add timestamp for notifications into documentation 2023-09-28 14:20:17 -04:00
Roman Kudryashov
98c426dec4 DBZ-3642 CloudEventsConverter can retrieve metadata info from headers 2023-09-26 13:06:09 +02:00
mfvitale
5d7ba3e951 DBZ-6957 Remove spaces in Signal and Notification JMX ObjectName 2023-09-21 12:04:33 -04:00
rkerner
6d3528d4fb DBZ-4395 Add connector specific Debezium Connect REST Extension/s and move logic from UI backend to the Debezium Connect REST Extension (part 2 of the re-architecturing/re-factoring)
DBZ-6761 Add "validate connection" endpoints in connector specific Connect REST extensions

closes to https://issues.redhat.com/browse/DBZ-4395
closes to https://issues.redhat.com/browse/DBZ-6761
2023-09-21 13:29:59 +02:00
mfvitale
ae199d2053 DBZ-6828 Blocking snapshot will generate schema events only for signaled tables 2023-09-20 08:18:33 +02:00
Jiri Pechanec
a064fc42e5 DBZ-6518 Fix imports 2023-09-13 13:00:03 +02:00
Yue Wang
199bf775ed DBZ-6518 use multipe threads to query chunks 2023-09-13 13:00:03 +02:00
Jakub Cechacek
fd5c8353b2 DBZ-6883 Documenting oversized document handling 2023-09-13 11:04:07 +02:00
Jakub Cechacek
9aadc38414 DBZ-6892 Removing all code related to previously deprecated MongoDB conenctor configuration 2023-09-12 13:03:40 +02:00
Jakub Cechacek
eaa24ea91e DBZ-6871 MongoDB connector is now able to skip events for oversized documents 2023-09-11 15:28:27 +02:00
Jakub Cechacek
3efe8c0e51 DBZ-6872 Ability to switch the order of user defined and internal aggregation pipeline used by MongoDB connector when streaming changes 2023-09-11 13:15:10 +02:00
Nir Levy
454a9ac914 DBZ-6741 Support custom authentication on MongoDB connector 2023-09-07 14:49:04 +02:00
Jiri Pechanec
41135efa74 DBZ-6773 Remove typo 2023-09-06 15:08:24 +02:00