alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
10,313 Commits 3 Branches 0 Tags 51 MiB
2b9236e318
Commit Graph

1014 Commits

Author SHA1 Message Date
Roman Kudryashov
50c9f042a3 DBZ-7755 Refactor exporting to CloudEvents: remove RecordParser 2024-04-08 13:22:31 +02:00
mfvitale
ae7628a732 DBZ-7732 Add ConnectorSpecific annotation to manage multiple SPI connector specific implementation 2024-04-08 12:46:53 +02:00
Jakub Cechacek
1bf9e802f1 DBZ-7744 RS name is not required when cluster type is not REPLICA_SET instead of when cluster type is SHARDED in order to accomodate LOAD_BALANCED clusters 2024-04-05 09:40:35 -04:00
Debezium Builder
ea182d83f3 [maven-release-plugin] prepare for next development iteration 2024-04-02 07:38:53 +00:00
Debezium Builder
7dcd94d19e [maven-release-plugin] prepare release v2.6.0.Final 2024-04-02 07:38:53 +00:00
mfvitale
213456c5af DBZ-7497 Properties related to configuration based snapshot mode are now optional 2024-03-28 08:59:54 +01:00
mfvitale
ee5f25ccc9 DBZ-7497 Add a configuration based snapshot modes configurable via connector properties 2024-03-28 08:59:54 +01:00
Debezium Builder
4df18d9f43 [maven-release-plugin] prepare for next development iteration 2024-03-25 09:57:05 +00:00
Debezium Builder
9656da1fad [maven-release-plugin] prepare release v2.6.0.CR1 2024-03-25 09:57:04 +00:00
mfvitale
689818aec3 DBZ-7308 Remove MongoDbSnapshotterServiceProvider.java 2024-03-25 05:46:46 +01:00
mfvitale
c7a28021a6 DBZ-7308 Remove connector specific SnapshotLockProvider and SnapshotterServiceProvider 2024-03-25 05:46:46 +01:00
mfvitale
3c4eed0918 DBZ-7304 Add tests for Always and Custom snapshot mode for MongoDb connector 2024-03-21 08:23:30 +01:00
mfvitale
3962e34664 DBZ-7304 Align snapshot modes for MongoDb connector 2024-03-21 08:23:30 +01:00
harveyyue
48c67e40fb DBZ-7618 Implement Versioned interfaces in Transformation and Converter plugins 2024-03-14 06:35:42 +01:00
Debezium Builder
2fb8fc3004 [maven-release-plugin] prepare for next development iteration 2024-03-06 07:47:33 +00:00
Debezium Builder
cd46b2b998 [maven-release-plugin] prepare release v2.6.0.Beta1 2024-03-06 07:47:33 +00:00
mfvitale
8a47b2333d DBZ-7588 Disable debug prints on tests 2024-03-02 11:33:48 -05:00
mfvitale
ce17bdcce6 DBZ-7461 Add generic properties for redo log archive and retention 2024-03-01 14:12:31 +01:00
mfvitale
4ade54351f DBZ-7461 Rename SCHEMA_ONLY_RECOVERY to RECOVERY and SCHEMA_ONLY to NO_DATA 2024-03-01 14:12:31 +01:00
ani-sha
04061eeaf5 DBZ-6434 Handle NPE due to missing credentials 2024-03-01 10:25:01 +01:00
Bue-Von-Hun
94e24532f6 DBZ-2015 Remove redundant fields 2024-02-27 15:30:48 +01:00
rkerner
1e69e40ec2 DBZ-7416 Fix duplicate SMTs sometimes returned by Kafka Connect. Moved deduplication from Map to LinkedHashSet. 
+ minor fixes added for cleanup and centralization of common code

closes https://issues.redhat.com/browse/DBZ-7416
 2024-02-22 13:34:08 -05:00
Jiri Pechanec
68b6591142 DBZ-7416 Fix duplicate SMTs sometimes returned by Kafka Connect. Moved deduplication from Map to LinkedHashSet. 
closes https://issues.redhat.com/browse/DBZ-7416
 2024-02-22 13:34:08 -05:00
harveyyue
82f5e6ea77 DBZ-7480 Allow special characters in signal table name 2024-02-19 11:43:20 +01:00
Chris Cranford
928aa26cdb DBZ-7107 Fix source info test failures 2024-02-16 12:52:20 +01:00
Debezium Builder
10e327602c [maven-release-plugin] prepare for next development iteration 2024-02-13 09:20:04 +00:00
Debezium Builder
0c5b05738c [maven-release-plugin] prepare release v2.6.0.Alpha2 2024-02-13 09:20:04 +00:00
Vojtech Juranek
4452e3d095 DBZ-7024 Move EmbeddedConfig into separate class 
`EmbeddedConfig` needs to be shared with other implmentations of
`DebeziumEngine` as long as Debezium embedded depends on the Kafka
model.
 2024-02-12 13:43:21 +01:00
Jakub Cechacek
7f3210214c DBZ-7451 Support for standard BSON representation of UUID in incremental snapshots 2024-02-12 13:19:13 +01:00
mfvitale
f78d0cbd19 DBZ-7301 Add SnapshotterService to ChangeEventSourceFactory and SnapshotChangeEventSource 2024-02-06 07:12:42 +01:00
Jakub Cechacek
31dac84135 DBZ-7379 Cleaned up MongoClient creating and added ability to use connector specific keystore/truststore 2024-01-31 15:01:04 +01:00
Jakub Cechacek
b80b568e6c DBZ-7299 Test coverage for lookup and post-image full updates 2024-01-29 14:03:57 +01:00
Jakub Cechacek
4ea39b7d98 DBZ-7299 Ability to use post images for full document update 2024-01-29 14:03:57 +01:00
Debezium Builder
65d63ed42d [maven-release-plugin] prepare for next development iteration 2024-01-21 10:12:45 +00:00
Debezium Builder
485fa82a8f [maven-release-plugin] prepare release v2.6.0.Alpha1 2024-01-21 10:12:44 +00:00
Roman Kudryashov
0c80f1f38d DBZ-7284 Provide config option to customize CloudEvents.data schema name 2024-01-11 13:20:35 +01:00
Jakub Cechacek
716630043c DBZ-7260 Added validation guard against the use of removed RS connection mode configuration 2024-01-11 09:58:24 +01:00
Jakub Cechacek
5dbe073d3b DBZ-7260 Offset value conversion extracted into common util class 2024-01-11 09:58:24 +01:00
Jakub Cechacek
8132c601ce DBZ-7260 Code cleanup and naming alignment 2024-01-11 09:58:24 +01:00
Jakub Cechacek
7333b2effb DBZ-7260 Completely removed RS name from partition 2024-01-11 09:58:24 +01:00
Jakub Cechacek
ce8a5431fa DBZ-7260 Fixed MongoDbPartition toString() 2024-01-11 09:58:24 +01:00
Jakub Cechacek
aa0c53ec2a DBZ-7260 Offset consolidation test coverage 2024-01-11 09:58:24 +01:00
Jakub Cechacek
acdb8bee8d DBZ-7260 Merge now unnecessary client factory into MongoDbConnectionContext 2024-01-11 09:58:24 +01:00
Jakub Cechacek
26e46c9f55 DBZ-7260 Streamlined MongoDbConnection handling 2024-01-11 09:58:24 +01:00
Jakub Cechacek
6e946cfa60 DBZ-7260 Replaced raw config with typed connector configuration 2024-01-11 09:58:24 +01:00
Jakub Cechacek
4397468baa DBZ-7260 MongoDB connector validation now requires RS name to be specified when connecting to RS cluster 2024-01-11 09:58:24 +01:00
Jakub Cechacek
a5c24787ba DBZ-7260 MongoDbConnector javadoc + making LOGGER static to allign with the prevalent style used elsewhere 2024-01-11 09:58:24 +01:00
Jakub Cechacek
e7c7131e05 DBZ-7260 Ability to consolidate previous offsets from replica_set connection mode and some surounding refactorings 2024-01-11 09:58:24 +01:00
Jakub Cechacek
e01b847f7d DBZ-7260 Ability to consolidate offsets previously recorded by the removed replica_set connection mode 2024-01-11 09:58:24 +01:00
Jakub Cechacek
0442fcf6fa DBZ-7260 Removed unused code 2024-01-11 09:58:24 +01:00
Jakub Cechacek
99439c3cfa DBZ-7260 Removed RS name from CollectionId 2024-01-11 09:58:24 +01:00
Jakub Cechacek
4c64e28832 DBZ-7260 Merged connection string and task connection string properties to futher simplify RS name usage 2024-01-11 09:58:24 +01:00
Jakub Cechacek
8def3bf82c DBZ-7260 Moved offset management from SourceInfo to MongoDbOffsetContext 2024-01-11 09:58:24 +01:00
Jakub Cechacek
7ad4701253 DBZ-7260 Further elimination of RS references, mainly from SourceInfo 2024-01-11 09:58:24 +01:00
Jakub Cechacek
15d9b8a791 DBZ-7260 Removed ReplicaSet class 2024-01-11 09:58:24 +01:00
Jakub Cechacek
85536fbf59 DBZ-7260 Flattening offsetContext and partition structue 2024-01-11 09:58:24 +01:00
Jakub Cechacek
2aa072830a DBZ-7260 Adjusted snapshot threads to reflect RS connection mode removal 2024-01-11 09:58:24 +01:00
Jakub Cechacek
1c413db228 DBZ-7260 Removed redundant RS parameters from event sources 2024-01-11 09:58:24 +01:00
Jakub Cechacek
d564261e6e DBZ-7260 Compeltely removed ReplicaSetDiscovery 2024-01-11 09:58:24 +01:00
Jakub Cechacek
1f61140e40 DBZ-7260 Removed RS from connection management 2024-01-11 09:58:24 +01:00
Jakub Cechacek
86ce26bf4a DBZ-7260 Removed RS from MongoDbChangeEventSourceFactory 2024-01-11 09:58:24 +01:00
Jakub Cechacek
85fdf034e5 DBZ-7260 Removed ReplicaSets class 2024-01-11 09:58:24 +01:00
Jakub Cechacek
17cd2158bd DBZ-7260 Removed RS monitoring as there is now only single RS which is always a wrapper around provided connection string 2024-01-11 09:58:24 +01:00
Jakub Cechacek
72e88ffc7d DBZ-7260 Removed RS connection mode, there is always only single RS now 2024-01-11 09:58:24 +01:00
mfvitale
20fbe73bc8 DBZ-7311 Use a more meaningful name for identify an on demand blocking snapshot 2024-01-08 12:52:03 +01:00
mfvitale
47cbdee526 DBZ-7311 Permits to execute a blocking snapshot even if snapshot.mode=never 2024-01-08 12:52:03 +01:00
Richard Harrington
da5143a7ee DBZ-7287 Clarify comment about how we extract and serialize document ids 2024-01-05 11:20:24 +01:00
Mickael Maison
70e7186868 DBZ-7298 Add service loader manifests for all Connect plugins 
Add manifests for source/sink connectors, converters and transformations.
 2024-01-04 09:22:29 +01:00
Debezium Builder
3853d20f44 [maven-release-plugin] prepare for next development iteration 2023-12-21 06:52:01 +00:00
Debezium Builder
5d35e9caaa [maven-release-plugin] prepare release v2.5.0.Final 2023-12-21 06:52:01 +00:00
ani-sha
4b36ed9975 DBZ-7177 DBZ-6764 Use correct context name and add suggestions for code review 2023-12-20 08:56:56 +01:00
ani-sha
5a27d42257 DBZ-7177 Add isStreaming check for all tests, remove unused files 2023-12-20 08:56:56 +01:00
ani-sha
a12b1a9872 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
ani-sha
e535e5b78d DBZ-7177 Add suggestions from code review, adjust code style changes 2023-12-20 08:56:56 +01:00
ani-sha
2555a1cee2 DBZ-6764 DBZ-7178 DBZ-7177 Use MBeanServer to query metrics for REST endpoint and create new metrics descriptor 2023-12-20 08:56:56 +01:00
ani-sha
2165d9bed1 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
Roman Kudryashov
516aa87fad DBZ-7235 Add option to customize CloudEvents schema name 2023-12-20 06:53:37 +01:00
harveyyue
225277c5c0 DBZ-7251 Return generic DataCollectionId instead of REST response DataCollection in getMatchingCollections method 2023-12-19 12:53:57 +01:00
harveyyue
4719396ffc DBZ-7145 Introduce a common parent connect for all Debezium source connectors 2023-12-19 12:53:57 +01:00
harveyyue
5553059fb8 DBZ-7167 Provide a public API from the connector implementations to retrieve the list of matching collections or tables based on the different include-/exclude lists 2023-12-19 12:53:57 +01:00
Jakub Cechacek
67260f8286 DBZ-7272 Guarding against implicit offset invalidation cause by the change of default connection mode 2023-12-19 06:45:02 +01:00
Jakub Cechacek
0dc97b4d79 DBZ-7264: Propagating exception when using multiple snapshotting threads 2023-12-19 06:25:22 +01:00
Debezium Builder
2c1def7241 [maven-release-plugin] prepare for next development iteration 2023-12-14 09:43:13 +00:00
Debezium Builder
ef8260f802 [maven-release-plugin] prepare release v2.5.0.CR1 2023-12-14 09:43:12 +00:00
Chris Cranford
ada157d117 DBZ-4321 Introduce BeanRegistry and ServiceRegistry 
As a part of this work to handle injection in a cleaner way, this commit
adds two new broad concepts called `BeanRegistry` and `ServiceRegistry`.

A BeanRegistry is a glorified registry of different objects that are not
necessarily services but may be desired by a service. This contract will
allow Debezium to integrate in the future with other CDI providers.

A ServiceRegistry is more of an internal concept, where various systems
can be started based on their dependency order and provides a universal
way to split larger parts of the code into smaller, focused modules that
can be accessed using the Service Locator pattern.
 2023-12-13 11:27:40 -05:00
Chris Cranford
26b3881941 DBZ-4321 Add MongoDB hook & polish injection handler 2023-12-13 11:27:40 -05:00
Jakub Cechacek
bde91ecf0f DBZ-7252 Using correct offsets in table/collection notifications for MongoDB 2023-12-12 19:52:14 +01:00
Chris Cranford
aea6cc003d
[ci] Use a relaxed property check for tests 2023-12-06 18:04:59 -05:00
mfvitale
5ed16284f4 DBZ-6834 Provide INSERT/DELETE semantics for MongoDb incremental snapshot watermarking 2023-12-06 14:10:26 +01:00
Debezium Builder
0fd1c0dc9a [maven-release-plugin] prepare for next development iteration 2023-12-04 13:55:35 +00:00
Debezium Builder
3e2d75f0da [maven-release-plugin] prepare release v2.5.0.Beta1 2023-12-04 13:55:35 +00:00
Jakub Cechacek
355041dbaf DBZ-7184 buffer lock is now acquired with timeout and reattempted on failure 2023-12-04 06:58:28 +01:00
Jakub Cechacek
88a64bf3d5 DBZ-7184 Resumable events are now guaranteed to contain resume token 2023-12-04 06:58:28 +01:00
Jakub Cechacek
9ad6f9c7db DBZ-7184 Streaming loop now always uses resumable event to get resume token 2023-12-04 06:58:28 +01:00
Jakub Cechacek
8a5007a738 DBZ-7184 Refactored streaming loop of MongoDB connector 2023-12-04 06:58:28 +01:00
Jakub Cechacek
c7e87c5382 DBZ-7184 Using buffering cursor in straming change event source 2023-12-04 06:58:28 +01:00
Jakub Cechacek
93e8570fb6 DBZ-7184 Implementation of buffering change stream cursor 2023-12-04 06:58:28 +01:00
Jakub Cechacek
2c8277fcf6 DBZ-7162 Removed duplicit source event count metric for MongoDB 2023-12-01 11:38:21 +01:00
Jakub Cechacek
79230c6014 DBZ-7206 Always check for blocking snapshot pause request when processing change events in MongoDB connector 2023-11-29 14:56:41 +01:00
“vsantonastaso”
8c1c369449 DBZ-6878 add table specific notification in initial snapshot 2023-11-29 08:32:21 +01:00