Commit Graph

304 Commits

Author SHA1 Message Date
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
chriscollingwood
6225e124bb DBZ-3522 Ensure that there is an active session on the replica set mongo client before using clusterDescription and ServerDescriptions to determine primary node. 2021-06-03 08:28:58 +02:00
Chris Cranford
d31d562376 DBZ-3331 Do not stream if offset no longer in the MongoDB oplog 2021-05-14 09:07:32 +02:00
Gunnar Morling
42a7b74725 DBZ-3403 Misc. improvements 2021-04-14 11:14:07 +02:00
Hossein Torabi
ba048cf47d DBZ-3403 Semi Optimisation on MongoDB and MySQL connector for skipped.operations 2021-04-14 11:14:07 +02:00
JLDLaughlin
06b0475f17 DBZ-2911 Add additional LSN information to all sources
Adds a new "sequence" field to all sources via the AbstractSourceInfo
class. Specifically, this field is required to deduplicate records
from PostgreSQL sources in O(1) time. The sequence field is a stringified
list of metadata. For PostgreSQL sources, this will include the last
committed LSN and the current LSN. For other sources, this will be NULL
until implemented. A new integration test was added for PostgreSQL.
2021-03-26 09:19:17 +01:00
Gunnar Morling
c7b7d5303a DBZ-3218 Avoiding duplicated validation (again ;) 2021-03-19 15:04:20 +01:00
Gunnar Morling
178140ae9c DBZ-3218 Removing superfluous method parameter 2021-03-19 15:04:20 +01:00
Anisha Mohanty
c761d92b2a DBZ-3218 Add separate method for logging warnings 2021-03-19 15:04:20 +01:00
Jiri Pechanec
495be2659b DBZ-2511 Dedicated logger for schema name adjuster 2021-03-18 14:42:34 +01:00
Frank Koornstra
cdc7abdf28 DBZ-3278 Add timeout exceptions to MongoDBErrorHandler
When connecting to the server or executing some queries, due to
networking issues, timeouts sometimes occur which would crash the whole
connector. By including a few extra exceptions in the error handler we
make sure it will retry in these situations.
2021-03-15 12:27:03 +01:00
Thomas Prelle
15887077ff DBZ-2680 Sanitize field name do not santize sub struct field
Their are an issue during the sanitisation to avro on mongodb connector.
The sanitization failed on sub struct like
{​
"_id": "222",
"metrics": {​
"metric::fct":

{​"min": 0, "max": 1 }
​
}
2021-02-17 09:09:00 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Gunnar Morling
6d441bc538 DBZ-2938 Centralizing listener handling; avoiding some empty methods 2021-01-19 15:16:46 +01:00
rkerner
15064f42b1 DBZ-2831 allow non default Mongo DB ports 2020-12-10 05:33:00 +01:00
Gunnar Morling
9bb53b9e2d DBZ-2138 Static loggers 2020-11-30 10:33:05 +01:00
Jiri Pechanec
83df96ff70 DBZ-2138 Add defensive checks 2020-11-30 10:33:05 +01:00
Jiri Pechanec
349fcdad07 DBZ-2138 Handle lsid as Binary for MongoDB 4.2 2020-11-30 10:33:05 +01:00
Jiri Pechanec
e8aecd7b45 DBZ-2138 Use MongoDB 4.x driver 2020-11-30 10:33:05 +01:00
Jiri Pechanec
ea019c3b2c DBZ-1322 Removed dependency on deprecated MongoDB driver code 2020-11-27 17:37:57 +01:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
Chris Cranford
aea26a2949 DBZ-2742 Migrate initial.sync.max.threads to snapshot.max.threads 2020-11-11 09:08:05 +01:00
Faizan
f5f6abfc7b DBZ-2496 Corrections to code formatting and improving doc text for consistency 2020-10-22 06:30:40 +02:00
Faizan
0adaed07d2 DBZ-2496 Updating documentation and test case as per review comment 2020-10-22 06:30:40 +02:00
Faizan
24f375aa3d DBZ-2496 Corrections to code formatting 2020-10-22 06:30:40 +02:00
Faizan
925c7e35f5 DBZ-2496 Added snapshot override behavior for MongoDB using filter query 2020-10-22 06:30:40 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
d758491dba DBZ-2456 style change fixes 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e08cea175f DBZ-2456 style change fixes 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
Chris Cranford
85821b4975 DBZ-2597 Suggested changes 2020-10-03 13:36:17 +02:00
Chris Cranford
0126e44ad1 DBZ-2597 Fix ConcurrentModificationException when schema modified in sharded cluster 2020-10-03 13:36:17 +02:00
Gunnar Morling
eeec1e7638 DBZ-2585 Simpler boolean condition 2020-10-01 10:27:43 +02:00
Thomas Prelle
d4ad6d525d DBZ-2585 Skipping empty arrays when preparing values for Avro 2020-10-01 10:27:43 +02:00
Gunnar Morling
1dd6293325 DBZ-2569 Adding some line breaks 2020-09-30 09:16:23 +02:00
Thomas Prelle
3951540082 DBZ-2569 : MongoDB ExtractNewDocumentState can not extract array of array 2020-09-30 09:14:34 +02:00
Chris Cranford
0040eca740 DBZ-2316 Throw DataException with non-uniform array elements
While using array.encoding=array, array elements that do not have
uniform structures should throw a DataException with a meaningful
message rather than throw a NullPointerException.
2020-09-29 22:12:43 +02:00
Ganesh Ramasubramanian
6ca025b1bb DBZ-2504: Add support for field and header prefix
Added support for field and header prefix.
Updated the documentation to include the options
 'add.fields.prefix' and 'add.headers.prefix'.
2020-09-16 11:31:05 +02:00
Chris Cranford
e5c01c6b09 DBZ-137 Fix compilation problems 2020-09-14 12:33:43 +02:00
AndreyIg
77662a0dde DBZ-137 contribution to the core, Oracle related 2020-09-14 12:33:43 +02:00
Gunnar Morling
193541800d DBZ-2455 Adding constant for some MongoDB specific field names 2020-09-02 17:41:49 +02:00
Chris Cranford
642fda71d9 DBZ-2455 Fix test compatibility with MongoDB 3.2 2020-09-02 17:41:49 +02:00
Chris Cranford
2b5c2e3ec7 DBZ-2455 ExtractNewDocumentState support patch in add.fields 2020-09-02 17:41:49 +02:00
Chris Cranford
f74da055b8 DBZ-2429 Clarify Field descriptions for include/exclude for MongoDB
The include/exclude Field descriptions do not explicitly state if
the input argument is a comma-separated list of regex values and
should since that the expected format of the option.
2020-09-01 09:50:34 +02:00
Chris Cranford
2e800756b8 DBZ-2464 Add debezium.test.records.waittime support 2020-09-01 07:49:10 +02:00
Chris Cranford
94a4019f9a DBZ-2464 Fix intermittent failures with FieldRenamesIT 2020-09-01 07:49:10 +02:00