Commit Graph

157 Commits

Author SHA1 Message Date
Jiri Pechanec
72b751b528 DBZ-1333 Upgrade MongoDb driver to 3.10.1 2019-06-17 20:53:07 +02:00
Gunnar Morling
5d01f409f0 DBZ-1317 Separating update and query methods for MongoDB's SourceInfo;
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
2019-06-11 10:07:36 +02:00
Chris Cranford
0aadaa10dc DBZ-1242 Fixed typo and added negative test checks 2019-06-05 13:31:25 -04:00
Chris Cranford
c53435c26b DBZ-1242 Checkstyle fix - Remove unused import 2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a DBZ-1242 Issue warning when filters produce an empty schema 2019-06-05 13:31:25 -04:00
Ching Tsai
f8cb51545f DBZ-1315 UNDEFINED field causes exception 2019-06-03 13:51:01 +02:00
Jiri Pechanec
d1bc1c218c DBZ-1295 3state snapshot for MongoDB 2019-05-31 10:56:05 +02:00
Gunnar Morling
b8eede2f41 DBZ-1235 Misc. clean-up;
* Putting collection name after replica set name for MongoDB
* Removing redundant method for converting schema to string
* Removing redundant keys from PG SourceInfo
2019-05-28 09:35:15 +02:00
Jiri Pechanec
526e780513 DBZ-1235 Misc fixes 2019-05-28 09:35:15 +02:00
Jiri Pechanec
80afd4975a DBZ-1235 Changes missed in refactoring 2019-05-28 09:35:15 +02:00
Gunnar Morling
8f28f323e7 DBZ-1235 Using Instant to represent timestamps internally;
Only "rendered" as epoch milli-seconds at the system boundaries.
2019-05-28 09:35:15 +02:00
Jiri Pechanec
6f6c8ddf06 DBZ-1235 Refactored to unify the code 2019-05-28 09:35:15 +02:00
Jiri Pechanec
c1bf1752fe DBZ-1235 Pluggable source maker for MongoDB 2019-05-28 09:35:15 +02:00
Jiri Pechanec
f5757dbd9f DBZ-1235 Extract serverName to common source 2019-05-28 09:35:15 +02:00
Gunnar Morling
cf4db8c1a1 DBZ-677 Extracting shared configuration options for both new state extraction SMTs 2019-05-27 13:52:58 +02:00
Gunnar Morling
cb9e916616 DBZ-677 Renaming record state SMTs;
Keeping old names in deprecated sub-classes for the time being.
2019-05-27 13:52:58 +02:00
Chris Cranford
e2c74111ad DBZ-1234 Removed deprecated configuration options 2019-05-22 10:19:05 +02:00
jchipmunk
72b06366fe Removing extra initialisation of "config" variable in PG config 2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24 DBZ-1247 Specifying default snapshot fetch size for each connector config 2019-04-30 09:57:11 +02:00
jchipmunk
a5cc83c0d1 DBZ-1247 Adding property to specify snapshot fetch size 2019-04-30 09:57:11 +02:00
jchipmunk
2c79d901c5 DBZ-1247 Using isNonNegativeInteger instead of isPositiveInteger 2019-04-30 09:57:11 +02:00
jchipmunk
3ca47b1055 DBZ-1247 Adding property to specify batch size of MongoDB cursor
The "documents.fetch.size" configuration property is an positive integer value that specifies the maximum number of documents that should be read in one go from each collection while taking a snapshot. The connector will read the collection contents in multiple batches of this size. Default to "0", which indicates that the server chooses an appropriate fetch size.
2019-04-30 09:57:11 +02:00
krizhan
70c564b4c2 DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig 2019-04-23 12:29:44 +02:00
jchipmunk
7c0ae3ee20 DBZ-1212 SLF4J usage issues 2019-04-04 21:32:12 +02:00
ShubhamRwt
540a951211 DBZ- 362 Adding WhitespaceAfter check to Checkstyle 2019-03-28 09:24:11 +01:00
Jiri Pechanec
9b405aa84d DBZ-1039 Add missing spaces 2019-03-25 10:23:14 +01:00
shubham
8cca21e969 DBZ-1039 Make all ifs with braces 2019-03-25 10:23:14 +01:00
Renato Mefi
2f187fd1cb DBZ-354 Improve MongoDB hosts validation
The previous statement was never achievable since `ReplicaSets.parse(hosts)` can never return null
Also removed some code duplication for better readability
2019-03-14 16:53:51 +01:00
Gunnar Morling
d2b26d03a7 DBZ-867 Misc clean-up;
* Exposing new config via MongoDbConnectorConfig
* Removing superfluous connector restart in the test
2019-02-21 17:00:12 +01:00
krizhan
652f3b1c59 DBZ-867 Added integration test and updated enum names 2019-02-21 17:00:12 +01:00
krizhan
441228a989 DBZ-867 Add snapshot mode NONE for MongoDB connector 2019-02-21 17:00:12 +01:00
Gunnar Morling
2a486ecfff DBZ-1019 Removing legacy methods from Metronome 2019-02-11 18:11:34 +01:00
Renato Mefi
5810014fda DBZ-988 Migrate UnwrapFromMongoDbEnvelopeTestIT to new Abstract TestIT 2019-01-07 13:42:40 +01:00
Renato Mefi
8a22b6666f DBZ-988 Break down Unwrap TestIT Abstract
This allows other tests to also take advantages of the testing structure
2019-01-07 13:42:40 +01:00
Renato Mefi
82bd0bb657 DBZ-988 Test all Array Update operators
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update-array/#update-operators

The operations: `$(update)`, `$[]` and `$[<identifier>]` are skipped
since the're Mongo 3.6+ only.
2019-01-07 13:42:40 +01:00
Renato Mefi
6fc010867e DBZ-988 Test all Bitwise Update operators
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update/bit/#bit
2019-01-07 13:42:40 +01:00
Renato Mefi
20cc350891 DBZ-988 Test all Field Update operators
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update-field/#field-update-operators
2019-01-07 13:42:40 +01:00
Renato Mefi
c43c9ecc54 DBZ-988 MongoDB unwrap Update operators base test 2019-01-07 13:42:40 +01:00
Jiri Pechanec
edec1c3090 DBZ-978 Added last event and captured tables metrics 2018-12-13 20:52:11 +01:00
Gunnar Morling
91b571059e DBZ-966 Making sure MongoDB connector can be stopped while awaiting initial sync delay 2018-12-13 14:29:54 +01:00
Grzegorz Kołakowski
e2942ab72a DBZ-966 Replace sleep with polling loop 2018-12-13 14:29:54 +01:00
Grzegorz Kołakowski
c5fac7d3b2 DBZ-966 Enable to delay initial snapshot in MongoDB connector 2018-12-13 14:29:54 +01:00
Renato Mefi
1f3791cea9 DBZ-1032 Test tombstones have a DELETE header 2018-12-11 13:50:42 +01:00
Renato Mefi
8d04aab6a4 DBZ-1032 Fix issue for tombstone operation headers
Since the bomstone has no value it's not possible to imply the header
from the message content, thus if the value is null we set the header to
DELETE
2018-12-11 13:50:42 +01:00
Gunnar Morling
5aeb589932 DBZ-848 Adding Tautvydas Januskevicius to COPYRIGHT.txt 2018-12-11 12:00:59 +01:00
Tautvydas Januskevicius
addf13ca06 DBZ-848 Removed explicit primary node change handling. It is handled by mongoDb driver internally. Explicit primary node change event handling was causing issue that no mongo events were read after primary change. This issue only happened when rs.stepDown(<time s>) was used on mongo node. 2018-12-11 12:00:59 +01:00
Renato Mefi
4ba3213338 DBZ-1020 Refactor UnwrapFromMongoDbEnvelope logic
Now it's easier to follow what makes an insert, update or delete within
the transformer, also reduced the amount of npath complexity by doing
early returns and certain extractions.
2018-12-07 09:16:36 +01:00
Renato Mefi
8d8ef26dae DBZ-563 MongoDB Unwrapper tests for "delete.handling.mode" 2018-11-30 12:06:18 +01:00
Renato Mefi
fcef819dc8 DBZ-563 MongoDB Unwrapper supports "delete.handling.mode" 2018-11-30 12:06:18 +01:00
Renato Mefi
de7c065b43 DBZ-971 Mongo Unwrap can add data operation header 2018-11-30 12:06:18 +01:00