alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
4,958 Commits 3 Branches 0 Tags 51 MiB
2d87fa9b3d
Commit Graph

462 Commits

Author SHA1 Message Date
Chris Cranford
baffcbdfd9 DBZ-1726 Added TransactionMonitor hooks 2020-03-11 10:15:00 +01:00
Chris Cranford
6f1eb49b32 DBZ-1726 Fix formatting failures 2020-03-11 10:15:00 +01:00
Chris Cranford
ab8359b9cc DBZ-1726 Implemented getting transaction-id metadata 2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33 DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations 2020-03-11 10:15:00 +01:00
Gunnar Morling
8f1edb0881 DBZ-1726 Removing some unused fields 2020-03-11 10:15:00 +01:00
Chris Cranford
38cf4ceae1 DBZ-1726 Introduce DataCollectionId#identifier() 2020-03-11 10:15:00 +01:00
Chris Cranford
4b6f0588c9 DBZ-1726 Fix oplog cursor filter 2020-03-11 10:15:00 +01:00
Chris Cranford
71bf17b24f DBZ-1726 Fix formatting 2020-03-11 10:15:00 +01:00
Chris Cranford
65e324d61f DBZ-1726 Removed an unintended dependency. 2020-03-11 10:15:00 +01:00
Chris Cranford
4e27c90028 DBZ-1726 Move MongoDB connector to common framework 2020-03-11 10:15:00 +01:00
Chris Cranford
4752078ee0 DBZ-1848 Skip adding rename field if source field does not exist. 2020-03-04 17:54:03 +01:00
Gunnar Morling
8744bb6a16 DBZ-1781 Making idObjToJson() method more specific 2020-03-04 09:10:49 +01:00
jgraf50
c84a8a28b4 DBZ-1781 Added support for sharded MongoDB collections. 2020-03-04 09:10:49 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Jiri Pechanec
a998db9caa DBZ-1767 Support field sanitization for MongoDB unwrap 2020-02-12 18:49:32 +01:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
77f9a61b95 DBZ-1751 Centralize envelope schema naming 2020-02-04 20:37:19 +01:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Gunnar Morling
d5bbc7a123 DBZ-1717 Misc. clean-up; 
* Expanding test
* Removing obsolete deprecation warning
* Adding Jan Uyttenhove to COPYRIGHT.txt
 2020-01-28 12:41:12 +01:00
Jan Uyttenhove
144936363f DBZ-1717 Usage of java.util.Date and Kafka Connect Timestamp to create Date(Time) field types 2020-01-28 12:41:12 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema; 
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
 2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Jiri Pechanec
4102d39aba DBZ-1168 Suport non-admin authSources 2020-01-06 12:28:49 +01:00
Debezium Builder
9723c93db9 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2 [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:44:33 -05:00
Debezium Builder
b1c62fe306 [maven-release-plugin] prepare for next development iteration 2019-12-10 06:39:17 -05:00
Debezium Builder
ad2efdb9a6 [maven-release-plugin] prepare release v1.0.0.CR1 2019-12-10 06:39:17 -05:00
Brandon Brown
a0f7f6ec6b DBZ-1402 Support for JDK 11 2019-11-25 11:53:19 +01:00
Gunnar Morling
bf25aeb1de DBZ-1215 Formatting 2019-11-25 11:52:48 +01:00
Gunnar Morling
0fa29a0163 DBZ-1215 Misc. clean-up; 
* long ms -> Instant
* Using OptionalLong as return value for optional value
 2019-11-22 11:42:42 +01:00
Jiri Pechanec
6cadff8c36 DBZ-1215 Added support for transactions 2019-11-22 11:42:42 +01:00
Debezium Builder
38279cc2dd [maven-release-plugin] prepare for next development iteration 2019-11-14 02:56:07 -05:00
Debezium Builder
868faf4412 [maven-release-plugin] prepare release v1.0.0.Beta3 2019-11-14 02:56:07 -05:00
Gunnar Morling
2c569977d7 DBZ-1392 Applying formatter; 
* Keeping indentation formatting for JSON


Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
 2019-11-01 13:20:43 +02:00
Chris Cranford
c25bb23a04 DBZ-1583 Propagate Replicator exception to Kafka Connect 2019-10-29 16:17:27 +01:00
Debezium Builder
b08f523ed7 [maven-release-plugin] prepare for next development iteration 2019-10-24 07:42:49 -04:00
Debezium Builder
8ecd9e28cf [maven-release-plugin] prepare release v1.0.0.Beta2 2019-10-24 07:42:49 -04:00
Jiri Pechanec
b2a70889f5 DBZ-1563 Collection names can contain dots 2019-10-23 14:40:15 -04:00
Debezium Builder
519dc011ff [maven-release-plugin] prepare for next development iteration 2019-10-17 04:20:13 -04:00
Debezium Builder
51ef6b9470 [maven-release-plugin] prepare release v1.0.0.Beta1 2019-10-17 04:20:12 -04:00
Jiri Pechanec
b88d9b06d4 DBZ-1513 Align test names 2019-10-07 18:38:35 +02:00
Jiri Pechanec
2c4cb83259 DBZ-1513 Centralize handling of non-data messages in SMT 2019-10-07 18:38:35 +02:00
Gunnar Morling
92885ebe99 DBZ-1392 Removing trailing whitespace from Java files 2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1 DBZ-1392 Moving static imports up and applying this to all files 2019-10-07 12:11:43 +03:00
Chris Cranford
ca5517746a DBZ-1341 Checkstyle flag missing whitespace 2019-10-03 19:44:43 +02:00
Chris Cranford
7442670692 DBZ-1355 Fix checkstyle problems detected after upgrade to 8.19 2019-10-03 19:44:43 +02:00
Chris Cranford
5ac2318d84 DBZ-1391 Do not allow code after closing brace (#1065) 
* DBZ-1391 Do not allow code after closing brace
 2019-10-02 20:44:40 +02:00
Debezium Builder
2ff77b993b [maven-release-plugin] prepare for next development iteration 2019-10-01 15:34:23 -04:00
Debezium Builder
e09d584b11 [maven-release-plugin] prepare release v0.10.0.Final 2019-10-01 15:34:23 -04:00
Debezium Builder
2f5960c5d2 [maven-release-plugin] prepare for next development iteration 2019-09-27 01:03:50 -04:00
Debezium Builder
e3b44ffb12 [maven-release-plugin] prepare release v0.10.0.CR2 2019-09-27 01:03:50 -04:00
jerrinot
3064a4af06 DBZ-1438 Fix InterruptedException handling 
It appears there is an intent to restore the interruption flag
when catching InterruptedException. However the old code was just
checking the current state of the flag instead of raising it.
 2019-09-24 12:51:48 +02:00
Ching Tsai
80210f7f8b DBZ-1442 Add test for a rewrite delete event 2019-09-13 11:23:26 +02:00
Ching Tsai
b8d565ffe0 DBZ-1442 Add @FixFor 2019-09-13 11:23:26 +02:00
Ching Tsai
486973ad12 DBZ-1442 Porting insert source fields feature to ExtractNewDocumentState 2019-09-13 11:23:26 +02:00
Debezium Builder
9b7e09fdda [maven-release-plugin] prepare for next development iteration 2019-09-10 09:12:12 -04:00
Debezium Builder
a1c2861458 [maven-release-plugin] prepare release v0.10.0.CR1 2019-09-10 09:12:11 -04:00
Gunnar Morling
1e0859588f DBZ-1464 Misc. clean-up; 
* logger -> LOGGER
* making op literals map unmodifiable
* Adding Lev Zemlyanov to COPYRIGHT.txt
 2019-09-06 11:02:45 +02:00
Lev Zemlyanov
8cbb8eb63b DBZ-1464 Fixed NPE when op is not u/i/d 
Signed-off-by: Lev Zemlyanov <lev@confluent.io>
 2019-09-06 11:02:27 +02:00
Debezium Builder
4ae105bdce [maven-release-plugin] prepare for next development iteration 2019-08-16 03:42:55 -04:00
Debezium Builder
945ccf68cb [maven-release-plugin] prepare release v0.10.0.Beta4 2019-08-16 03:42:54 -04:00
Renato Mefi
a9c8a825c3 DBZ-1430 Support heartbeat ExtractNewDocumentState 2019-08-14 23:56:45 +02:00
Jiri Pechanec
0742e5775f Revert "[maven-release-plugin] prepare release v0.10.0.Beta4" 
This reverts commit c7340e5152.
 2019-07-23 14:54:55 +02:00
Jiri Pechanec
f7d20635ce Revert "[maven-release-plugin] prepare for next development iteration" 
This reverts commit 22879777e4.
 2019-07-23 14:54:49 +02:00
Jiri Pechanec
22879777e4 [maven-release-plugin] prepare for next development iteration 2019-07-23 14:10:03 +02:00
Jiri Pechanec
c7340e5152 [maven-release-plugin] prepare release v0.10.0.Beta4 2019-07-23 14:10:02 +02:00
Debezium Builder
71333fda98 [maven-release-plugin] prepare for next development iteration 2019-07-23 02:55:08 -04:00
Debezium Builder
20d006fac7 [maven-release-plugin] prepare release v0.10.0.Beta3 2019-07-23 02:55:08 -04:00
Gunnar Morling
287551294f DBZ-1198 Adding comments 2019-07-11 07:43:32 +02:00
Jiri Pechanec
0316ac7fc0 DBZ-1198 Heartbeat for MongoDB connector 2019-07-10 11:16:26 +02:00
Jiri Pechanec
13d638fd43 DBZ-1356 Metrics for schema history (#947) 
* DBZ-1356 Metrics for schema history
 2019-07-02 13:26:17 +02:00
Gunnar Morling
a991ea97d7 Handling option for emitting tombstones conistently 2019-07-01 08:27:33 +02:00
Jenkins user
e95d656bca [maven-release-plugin] prepare for next development iteration 2019-06-27 07:36:13 +00:00
Jenkins user
d95fd87311 [maven-release-plugin] prepare release v0.10.0.Beta2 2019-06-27 07:36:12 +00:00
Jiri Pechanec
72b751b528 DBZ-1333 Upgrade MongoDb driver to 3.10.1 2019-06-17 20:53:07 +02:00
Jenkins user
5fdb0ca81b [maven-release-plugin] prepare for next development iteration 2019-06-11 11:20:46 +00:00
Jenkins user
61729b9e00 [maven-release-plugin] prepare release v0.10.0.Beta1 2019-06-11 11:20:46 +00:00
Gunnar Morling
5d01f409f0 DBZ-1317 Separating update and query methods for MongoDB's SourceInfo; 
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
 2019-06-11 10:07:36 +02:00
Chris Cranford
0aadaa10dc DBZ-1242 Fixed typo and added negative test checks 2019-06-05 13:31:25 -04:00
Chris Cranford
c53435c26b DBZ-1242 Checkstyle fix - Remove unused import 2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a DBZ-1242 Issue warning when filters produce an empty schema 2019-06-05 13:31:25 -04:00
Ching Tsai
f8cb51545f DBZ-1315 UNDEFINED field causes exception 2019-06-03 13:51:01 +02:00
Jenkins user
056730d06a [maven-release-plugin] prepare for next development iteration 2019-06-03 10:24:08 +00:00
Jenkins user
7aeaec236e [maven-release-plugin] prepare release v0.10.0.Alpha2 2019-06-03 10:24:08 +00:00
Jiri Pechanec
d1bc1c218c DBZ-1295 3state snapshot for MongoDB 2019-05-31 10:56:05 +02:00
Jiri Pechanec
946019982e DBZ-1303 Assembly without database drivers 2019-05-30 14:32:47 +02:00
Jenkins user
ac5c76e431 [maven-release-plugin] prepare for next development iteration 2019-05-28 14:38:32 +00:00
Jenkins user
35f59ba460 [maven-release-plugin] prepare release v0.10.0.Alpha1 2019-05-28 14:38:32 +00:00
Gunnar Morling
b8eede2f41 DBZ-1235 Misc. clean-up; 
* Putting collection name after replica set name for MongoDB
* Removing redundant method for converting schema to string
* Removing redundant keys from PG SourceInfo
 2019-05-28 09:35:15 +02:00
Jiri Pechanec
526e780513 DBZ-1235 Misc fixes 2019-05-28 09:35:15 +02:00
Jiri Pechanec
80afd4975a DBZ-1235 Changes missed in refactoring 2019-05-28 09:35:15 +02:00
Gunnar Morling
8f28f323e7 DBZ-1235 Using Instant to represent timestamps internally; 
Only "rendered" as epoch milli-seconds at the system boundaries.
 2019-05-28 09:35:15 +02:00
Jiri Pechanec
6f6c8ddf06 DBZ-1235 Refactored to unify the code 2019-05-28 09:35:15 +02:00
Jiri Pechanec
c1bf1752fe DBZ-1235 Pluggable source maker for MongoDB 2019-05-28 09:35:15 +02:00
Jiri Pechanec
f5757dbd9f DBZ-1235 Extract serverName to common source 2019-05-28 09:35:15 +02:00
Gunnar Morling
cf4db8c1a1 DBZ-677 Extracting shared configuration options for both new state extraction SMTs 2019-05-27 13:52:58 +02:00
Gunnar Morling
cb9e916616 DBZ-677 Renaming record state SMTs; 
Keeping old names in deprecated sub-classes for the time being.
 2019-05-27 13:52:58 +02:00
Chris Cranford
e2c74111ad DBZ-1234 Removed deprecated configuration options 2019-05-22 10:19:05 +02:00
Jenkins user
7748be6056 [maven-release-plugin] prepare for next development iteration 2019-05-02 16:04:56 +00:00
Jenkins user
5af083b86e [maven-release-plugin] prepare release v0.9.5.Final 2019-05-02 16:04:55 +00:00
jchipmunk
72b06366fe Removing extra initialisation of "config" variable in PG config 2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24 DBZ-1247 Specifying default snapshot fetch size for each connector config 2019-04-30 09:57:11 +02:00
jchipmunk
a5cc83c0d1 DBZ-1247 Adding property to specify snapshot fetch size 2019-04-30 09:57:11 +02:00
jchipmunk
2c79d901c5 DBZ-1247 Using isNonNegativeInteger instead of isPositiveInteger 2019-04-30 09:57:11 +02:00
jchipmunk
3ca47b1055 DBZ-1247 Adding property to specify batch size of MongoDB cursor 
The "documents.fetch.size" configuration property is an positive integer value that specifies the maximum number of documents that should be read in one go from each collection while taking a snapshot. The connector will read the collection contents in multiple batches of this size. Default to "0", which indicates that the server chooses an appropriate fetch size.
 2019-04-30 09:57:11 +02:00
krizhan
70c564b4c2 DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig 2019-04-23 12:29:44 +02:00
Jenkins user
cefc5ccfb9 [maven-release-plugin] prepare for next development iteration 2019-04-11 12:07:16 +00:00
Jenkins user
fc3026adc3 [maven-release-plugin] prepare release v0.9.4.Final 2019-04-11 12:07:15 +00:00
jchipmunk
7c0ae3ee20 DBZ-1212 SLF4J usage issues 2019-04-04 21:32:12 +02:00
ShubhamRwt
540a951211 DBZ- 362 Adding WhitespaceAfter check to Checkstyle 2019-03-28 09:24:11 +01:00
Jenkins user
8b0edd1871 [maven-release-plugin] prepare for next development iteration 2019-03-25 12:16:31 +00:00
Jenkins user
56f98a48b2 [maven-release-plugin] prepare release v0.9.3.Final 2019-03-25 12:16:30 +00:00
Jiri Pechanec
9b405aa84d DBZ-1039 Add missing spaces 2019-03-25 10:23:14 +01:00
shubham
8cca21e969 DBZ-1039 Make all ifs with braces 2019-03-25 10:23:14 +01:00
Renato Mefi
2f187fd1cb DBZ-354 Improve MongoDB hosts validation 
The previous statement was never achievable since `ReplicaSets.parse(hosts)` can never return null
Also removed some code duplication for better readability
 2019-03-14 16:53:51 +01:00
Jenkins user
50a7c568fa [maven-release-plugin] prepare for next development iteration 2019-02-23 09:53:58 +00:00
Jenkins user
28f3839804 [maven-release-plugin] prepare release v0.9.2.Final 2019-02-23 09:53:58 +00:00
Gunnar Morling
d2b26d03a7 DBZ-867 Misc clean-up; 
* Exposing new config via MongoDbConnectorConfig
* Removing superfluous connector restart in the test
 2019-02-21 17:00:12 +01:00
krizhan
652f3b1c59 DBZ-867 Added integration test and updated enum names 2019-02-21 17:00:12 +01:00
krizhan
441228a989 DBZ-867 Add snapshot mode NONE for MongoDB connector 2019-02-21 17:00:12 +01:00
Jenkins user
b96e5fee0d [maven-release-plugin] prepare for next development iteration 2019-02-13 11:13:44 +00:00
Jenkins user
3de2d04bcd [maven-release-plugin] prepare release v0.9.1.Final 2019-02-13 11:13:44 +00:00
Gunnar Morling
2a486ecfff DBZ-1019 Removing legacy methods from Metronome 2019-02-11 18:11:34 +01:00
Jenkins user
c5b7d21d3e [maven-release-plugin] prepare for next development iteration 2019-01-28 11:07:04 +00:00
Jenkins user
f1ae79ff73 [maven-release-plugin] prepare release v0.9.0.CR1 2019-01-28 11:07:04 +00:00
Renato Mefi
5810014fda DBZ-988 Migrate UnwrapFromMongoDbEnvelopeTestIT to new Abstract TestIT 2019-01-07 13:42:40 +01:00
Renato Mefi
8a22b6666f DBZ-988 Break down Unwrap TestIT Abstract 
This allows other tests to also take advantages of the testing structure
 2019-01-07 13:42:40 +01:00
Renato Mefi
82bd0bb657 DBZ-988 Test all Array Update operators 
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update-array/#update-operators

The operations: `$(update)`, `$[]` and `$[<identifier>]` are skipped
since the're Mongo 3.6+ only.
 2019-01-07 13:42:40 +01:00
Renato Mefi
6fc010867e DBZ-988 Test all Bitwise Update operators 
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update/bit/#bit
 2019-01-07 13:42:40 +01:00
Renato Mefi
20cc350891 DBZ-988 Test all Field Update operators 
As in the official documentation:
https://docs.mongodb.com/v3.6/reference/operator/update-field/#field-update-operators
 2019-01-07 13:42:40 +01:00
Renato Mefi
c43c9ecc54 DBZ-988 MongoDB unwrap Update operators base test 2019-01-07 13:42:40 +01:00
Jenkins user
5275f73424 [maven-release-plugin] prepare for next development iteration 2018-12-19 13:06:12 +00:00
Jenkins user
b6569c18ae [maven-release-plugin] prepare release v0.9.0.Beta2 2018-12-19 13:06:12 +00:00
Jiri Pechanec
edec1c3090 DBZ-978 Added last event and captured tables metrics 2018-12-13 20:52:11 +01:00
Gunnar Morling
91b571059e DBZ-966 Making sure MongoDB connector can be stopped while awaiting initial sync delay 2018-12-13 14:29:54 +01:00
Grzegorz Kołakowski
e2942ab72a DBZ-966 Replace sleep with polling loop 2018-12-13 14:29:54 +01:00
Grzegorz Kołakowski
c5fac7d3b2 DBZ-966 Enable to delay initial snapshot in MongoDB connector 2018-12-13 14:29:54 +01:00
Renato Mefi
1f3791cea9 DBZ-1032 Test tombstones have a DELETE header 2018-12-11 13:50:42 +01:00
Renato Mefi
8d04aab6a4 DBZ-1032 Fix issue for tombstone operation headers 
Since the bomstone has no value it's not possible to imply the header
from the message content, thus if the value is null we set the header to
DELETE
 2018-12-11 13:50:42 +01:00
Gunnar Morling
5aeb589932 DBZ-848 Adding Tautvydas Januskevicius to COPYRIGHT.txt 2018-12-11 12:00:59 +01:00
Tautvydas Januskevicius
addf13ca06 DBZ-848 Removed explicit primary node change handling. It is handled by mongoDb driver internally. Explicit primary node change event handling was causing issue that no mongo events were read after primary change. This issue only happened when rs.stepDown(<time s>) was used on mongo node. 2018-12-11 12:00:59 +01:00
Renato Mefi
4ba3213338 DBZ-1020 Refactor UnwrapFromMongoDbEnvelope logic 
Now it's easier to follow what makes an insert, update or delete within
the transformer, also reduced the amount of npath complexity by doing
early returns and certain extractions.
 2018-12-07 09:16:36 +01:00
Renato Mefi
8d8ef26dae DBZ-563 MongoDB Unwrapper tests for "delete.handling.mode" 2018-11-30 12:06:18 +01:00
Renato Mefi
fcef819dc8 DBZ-563 MongoDB Unwrapper supports "delete.handling.mode" 2018-11-30 12:06:18 +01:00
Renato Mefi
de7c065b43 DBZ-971 Mongo Unwrap can add data operation header 2018-11-30 12:06:18 +01:00
Renato Mefi
4b0a84f587 DBZ-971 Ensure Mongo unwrap propagates headers 2018-11-30 12:06:18 +01:00
Renato Mefi
312b976c0d DBZ-563 Test MongoDB Unwrapper tombstone drop 2018-11-30 12:06:18 +01:00
Renato Mefi
0d6236c8d8 DBZ-563 Support tombstone drop on MongoDB Unwrapper 2018-11-30 12:06:18 +01:00
Renato Mefi
16ba3764e5 DBZ-989 Support tombstone on MongoDB unwrapper 2018-11-30 12:06:18 +01:00
Renato Mefi
488dfe4f72 DBZ-989 Provide test for the bug confirmation 2018-11-30 12:06:18 +01:00
Renato Mefi
b2aed1f46e DBZ-987 Allow to processes full document updates 2018-11-30 12:06:18 +01:00
Renato Mefi
c540391db2 DBZ-987 Test Full Document replacement 
As documented here:
https://docs.mongodb.com/manual/reference/method/db.collection.update/#replace-a-document-entirely
Mongo supports full document updates, currently the Unwrap expects the
operation to always be a patch update, this test proves the bug to be
patched in the next commits.
 2018-11-30 12:06:18 +01:00
Renato Mefi
df738a2abd DBZ-612 Support MongoDB CDC full $unset operation 
Mongo internally transforms everything into $set and $unset operations
when they are in the oplog, this guarantees that you can have operations
which are $set, $unset or combined.
 2018-11-30 12:06:18 +01:00
Renato Mefi
d44a44aee5 DBZ-612 Test Mongo CDC multiple $set operations 2018-11-30 12:06:18 +01:00
Renato Mefi
7a4e1c48f1 DBZ-612 Transform $unset into null values 2018-11-30 12:06:18 +01:00
Renato Mefi
6e115043ca DBZ-612 Support mongo NULL type 
Since we can't trace back the original value since mongo is a
schema-less storage we fallback to string as strategy.
 2018-11-30 12:06:18 +01:00
Jenkins user
db1d3a7fb8 [maven-release-plugin] prepare for next development iteration 2018-11-20 16:15:14 +00:00
Jenkins user
f83db82cea [maven-release-plugin] prepare release v0.9.0.Beta1 2018-11-20 16:15:14 +00:00
Renato Mefi
13dfa8d9bf DBZ-974 Pair mongo-initiator with Server version 
Avoiding client and servers mismatches, that's outside of debezium scope
to test whether the user has this sort of version mismatch.
 2018-11-16 06:58:09 +01:00
Renato Mefi
beb069fc9d DBZ-974 Replace Mongo deprecations for count usage 
As in
http://mongodb.github.io/mongo-java-driver/3.8/javadoc/deprecated-list.html
 2018-11-16 06:58:09 +01:00
Renato Mefi
7c59023b9a Fix documentation for Mongo CDC encoding type 2018-11-12 11:47:18 +01:00
Jenkins user
d952f5dfb0 [maven-release-plugin] prepare for next development iteration 2018-10-04 11:59:14 +00:00
Jenkins user
ff9b70278b [maven-release-plugin] prepare release v0.9.0.Alpha2 2018-10-04 11:59:13 +00:00
Jiri Pechanec
d933c150ad DBZ-928 NULL field values are not put into struct 2018-10-04 09:24:04 +02:00
jchipmunk
3ec0b3be81 DBZ-918 Moving connector identifier from SourceInfo to Module class 2018-10-04 09:00:13 +02:00
jchipmunk
05ba99bb0a DBZ-918 Adding Debezium connector field to source info 
This will allow consumers to recognize the Debezium connector used for creating a given message, helping them to adjust their behavior for a variety of connectors.
 2018-10-04 09:00:13 +02:00
Jiri Pechanec
bf6b2827c8 DBZ-784 Correct condition for stopped running projection 2018-09-18 13:12:21 +02:00
Gunnar Morling
6f0d11cc64 DBZ-784 Changing var name 2018-09-18 09:55:43 +02:00
Jiri Pechanec
a459c2cc4d DBZ-784 Terminate execute loops during shutdown 2018-09-18 09:54:46 +02:00
jchipmunk
6e9e803e73 DBZ-633 Changes of field.renames format. Misc improvements. 
* Changing field.renames delimiter from equal to colon character
* Adding examples of source document structure to tests
* Adding tests for case: two renames have the same target field
* Adding missing return
* Changing Path interface to abstract class
 2018-09-14 12:54:11 +02:00
Gunnar Morling
aac24b1ed1 DBZ-633 Misc. improvements around FieldSelector; 
* Adding some comments
* Adding missing return
* More expressive names
* Formatting
 2018-09-14 12:54:11 +02:00
jchipmunk
b93551f977 DBZ-881 Adding "field.renames" property for MongoDB connector 
The "field.renames" configuration property is an optional comma-separated list of the fully-qualified replacements of fields that should be used to rename fields in change event message values. Fully-qualified replacements for fields are of the form "databaseName.collectionName.fieldName.nestedFieldName=newNestedFieldName", where "databaseName" and "collectionName" may contain the wildcard (*) which matches any characters, the equal character (=) is used to determine rename mapping of field.
 2018-09-14 12:54:11 +02:00
jchipmunk
b0feaf496a DBZ-633 Adding "field.blacklist" property for MongoDB connector 
The "field.blacklist" configuration property is an optional comma-separated list of the fully-qualified names of fields that should be excluded from change event message values. Fully-qualified names for fields are of the form "databaseName.collectionName.fieldName.nestedFieldName", where "databaseName" and "collectionName" may contain the wildcard (*) which matches any characters.

Although the "field.blacklist" configuration property allows you to remove fields from the event values, the "_id" field is always included in the event’s key.
 2018-09-14 12:54:11 +02:00
jchipmunk
e9ef4f9068 DBZ-908 Removing obsolete config parameters: DATABASE_LIST_NAME and COLLECTION_LIST_NAME 2018-09-13 12:21:29 +02:00
Gunnar Morling
e1bbbd7992 DBZ-865 DBZ-878 Replacing invalid topic name characters with "_"; 2018-09-05 12:56:53 +02:00
Gunnar Morling
72925a3060 DBZ-838 Formatting 2018-07-27 20:33:45 +02:00
jchipmunk
6c18a81faa DBZ-838 Adding condition to interrupt initial sync if task is stopped 2018-07-26 19:53:27 +03:00
Jenkins user
e00dad127f [maven-release-plugin] prepare for next development iteration 2018-07-26 08:00:12 +00:00
Jenkins user
16bfd5c700 [maven-release-plugin] prepare release v0.9.0.Alpha1 2018-07-26 08:00:12 +00:00
Gunnar Morling
a5b5e7d9eb DBZ-627 Using unfified TopicSelector for MongoDB, too 2018-07-18 12:36:07 +02:00
Jenkins user
f9b8d830a8 [maven-release-plugin] prepare for next development iteration 2018-07-11 07:36:30 +00:00
Jenkins user
290ded678f [maven-release-plugin] prepare release v0.8.0.Final 2018-07-11 07:36:29 +00:00
Jenkins user
033db6659d [maven-release-plugin] prepare for next development iteration 2018-07-04 07:07:44 +00:00
Jenkins user
696f35f2c0 [maven-release-plugin] prepare release v0.8.0.CR1 2018-07-04 07:07:44 +00:00
Gunnar Morling
e1cf34dc43 DBZ-713 Extracting constaint for expected exception message 2018-07-03 14:41:47 +02:00
Gunnar Morling
c5f9d99644 DBZ-713 Adding overload of execute() that returns a result; 
This simplifies interaction with execute(), as we don't need to alter collections, references as a side effect but instead can work with the return value.
 2018-07-03 14:41:47 +02:00
Gunnar Morling
d6b897f43d DBZ-713 Applying database and collection filters within MongoPrimary; 
This protects against authorization failures when listing collections
from DBs the connector user isn't authorized for. It also simplifies
usage of MongoPrimary#databaseNames() and collections() as consumers
don't need to apply filtering themselves.
 2018-07-03 14:41:47 +02:00
Gunnar Morling
d72d3fcbc9 DBZ-782 Propagating authorization failures 2018-07-03 14:41:47 +02:00
Jiri Pechanec
d4c9d24b22 DBZ-779 Detect mongo replicator init completion 2018-07-03 12:24:06 +02:00
Gunnar Morling
dcd6b01134 DBZ-644 Simplifying RelationalDatabaseSchema constructor; 
Also retrieving logical name via CommonConnectorConfig#getLogicalName() in more places
 2018-07-03 07:03:59 +02:00
Gunnar Morling
bf7a5018ca Setting POM version back to 0.8.0-SNAPSHOT 2018-06-22 12:21:03 +02:00