Commit Graph

393 Commits

Author SHA1 Message Date
Gunnar Morling
f1cfb3313f DBZ-1988 Misc clean-up;
* Adding integration test
* Actually applying option
2020-05-18 16:41:37 +02:00
Juan Antonio Pedraza
5f7ba1da5d DBZ-1988: Skip LSN timestamp query when using Oracle CDC jobs 2020-05-18 16:41:37 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Gunnar Morling
043f1c4101 DBZ-2078 Making EventProcessingFailureHandlingIT resilient against timing issues 2020-05-15 17:43:28 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Gunnar Morling
9235732681 DBZ-1904 Typo and wording fixes 2020-05-04 12:31:05 +02:00
Jiri Pechanec
1b3fba4b8c DBZ-1904 Add drop table support 2020-05-04 12:31:05 +02:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
a6d1383122 DBZ-2030 Use Awaitility to manage database drops 2020-04-29 08:44:43 +02:00
Gunnar Morling
8b2448440b Revert "DBZ-2025 Reduce capture job poll interval"
This reverts commit 131063fb2be38f865019e5dcff74b6d78299f6d2; it prove
unstable on CI.
2020-04-27 16:38:01 +02:00
Jiri Pechanec
131063fb2b DBZ-2025 Reduce capture job poll interval 2020-04-27 13:56:29 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Chris Cranford
f974f9f4ab DBZ-1753 Refactor common code between SQL Server and DB2 2020-04-24 13:45:06 -04:00
Gunnar Morling
03ce403972 DBZ-1750 Separating config definition editor and immutable config definitions 2020-04-24 15:35:28 +02:00
Jiri Pechanec
37f0dbcaf8 DBZ-1750 Limit access to parent defs; dont share the parent defs 2020-04-24 15:35:28 +02:00
Jiri Pechanec
af90507fa6 DBZ-1750 Centralize shared config definitions 2020-04-24 15:35:28 +02:00
Gunnar Morling
391fdf1231 DBZ-1923 Using Awaitility to wait for CDC being enablement 2020-04-24 12:10:17 +02:00
Jiri Pechanec
412f288e88 DBZ-1923 Detect lost database history 2020-04-24 10:22:06 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
Chris Cranford
57af80afd5 DBZ-1859 Enhance MongoDB connector metrics 2020-04-15 08:04:23 +02:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00
Jiri Pechanec
e81aec0ed1 DBZ-1905 Validate database history topic 2020-04-08 12:18:32 +02:00
Chris Cranford
6df5e60efd DBZ-1945 Remove deprecated connector option "initial_schema_only" 2020-04-07 17:23:48 +02:00
Chris Cranford
af42f5b03c DBZ-1882 Added additional retry error conditions 2020-04-07 08:52:57 +02:00
Chris Cranford
91d38a0b68 DBZ-1882 Restarting after connection losses in SQL Server 2020-04-07 08:52:57 +02:00
Debezium Builder
ab54ce062f [maven-release-plugin] prepare for next development iteration 2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:23:05 -04:00
Gunnar Morling
449154beaa DBZ-1863 Centralizing coordinator shutdown 2020-03-12 11:28:08 +01:00
Debezium Builder
86c1ed90ed [maven-release-plugin] prepare for next development iteration 2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 09:54:44 -04:00
Gunnar Morling
3437da00d7 DBZ-1723 Simplifying shutdown handling;
doStop() is already called from stop(), no need to do it again via the error handler.
2020-03-11 13:57:23 +01:00
Gunnar Morling
c156d30048 DBZ-1723 Centralizing stopping() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597 DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Chris Cranford
6f1eb49b32 DBZ-1726 Fix formatting failures 2020-03-11 10:15:00 +01:00
Chris Cranford
3a4788cc33 DBZ-1726 Introduced AbstractSnapshotChangeEventSource and refactor implementations 2020-03-11 10:15:00 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
be77831e7d DBZ-1778 Trigger migration only for change tables planned to discontinue 2020-02-28 07:56:44 +01:00
Jiri Pechanec
436615934d DBZ-1760 Align code and docs 2020-02-25 10:43:11 +01:00
Jiri Pechanec
2b6e50daff DBZ-1760 Allow skipping of invalid events 2020-02-25 10:43:11 +01:00
jcechace
3209de3e5f DBZ-924 Adding integration tests for OpenShift and Strimzi 2020-02-20 12:48:08 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Jiri Pechanec
c512929097 DBZ-1764 Reorg test code for stabilization 2020-02-12 18:46:08 +01:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
4fdda6c101 DBZ-1052 Add tx enable option to connector definitions 2020-02-03 09:29:10 +01:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
0e671d6167 DBZ-1052 Add counts per table to END 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
0d7ce9b20e DBZ-1052 Remove suprfluous test 2020-02-03 09:29:10 +01:00
Jiri Pechanec
4867c8a298 DBZ-1052 Change TX topic name 2020-02-03 09:29:10 +01:00
Jiri Pechanec
e198cb0f45 DBZ-1052 Fix test for offset size 2020-02-03 09:29:10 +01:00
Jiri Pechanec
cd6a1f942d DBZ-1052 Transaction metadata for Postgres/pgoutput 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema;
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Gunnar Morling
f110c13e2d DBZ-1688 Misc clean-up 2020-01-02 12:32:03 +01:00
liulangwa
6028d78e76 DBZ-1688 Fix SQLserver type time(4)...time(7) lost nanoseconds 2020-01-02 12:26:28 +01:00
Debezium Builder
9723c93db9 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2 [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:44:33 -05:00
Gunnar Morling
66feaa0f22 DBZ-1643 Formatting fix 2019-12-17 18:19:30 +01:00
Gunnar Morling
91a4d83c4d DBZ-1643 Another go at fixing non-UTC timestamps 2019-12-17 14:07:34 +01:00
Jiri Pechanec
a80892f628 DBZ-1643 Test timestamp TZ 2019-12-17 09:04:08 +01:00
Gunnar Morling
eb4b1dad45 DBZ-1643 Normalizing TZ value to UTC
This avoids the need for the database.server.timezone option when running on SQL Server 2016 or newer.
2019-12-17 08:59:55 +01:00
Jiri Pechanec
d886a56596 DBZ-1643 Autoformat the code 2019-12-17 08:59:55 +01:00
Johan Venant
c8070d19b8 DBZ-1643 Manage sql server timestamp timezone 2019-12-17 08:59:55 +01:00
Jiri Pechanec
b338660283 DBZ-824 Skip validation for keyless tombstone 2019-12-16 14:31:15 +01:00
Jiri Pechanec
1de53607dc DBZ-824 Fix tests with invalid field names 2019-12-16 14:31:15 +01:00
Jiri Pechanec
71ca62a692 DBZ-1642 Added test for changing TX 2019-12-16 06:17:21 +01:00
Jiri Pechanec
c5a4106f3f DBZ-1642 Snapshot isolation for snapshot; test added 2019-12-13 13:00:39 +01:00
Jiri Pechanec
ea56b636fe DBZ-1642 Commit tx only for read-only connections 2019-12-13 10:36:02 +01:00
Cobolbaby
641e24b483 DBZ-1642 Create method called commit() in JdbcConnection class 2019-12-13 10:34:52 +01:00
cobolbaby
8306864c00 DBZ-1642 Support SQL Server Alwayson node
Ref: https://issues.redhat.com/browse/DBZ-1642
2019-12-13 10:34:52 +01:00
Debezium Builder
b1c62fe306 [maven-release-plugin] prepare for next development iteration 2019-12-10 06:39:17 -05:00
Debezium Builder
ad2efdb9a6 [maven-release-plugin] prepare release v1.0.0.CR1 2019-12-10 06:39:17 -05:00
Gunnar Morling
c0710e5336 DBZ-585 Renaming 'initial_schema_only' snapshot mode for SQL Server into 'schema_only' 2019-12-10 08:25:22 +01:00
Ivan San Jose
cc8dd160f5 DBZ-1617 Blacklisted columns are not being filtered out when generating a Kafka message from a CDC event 2019-11-25 13:23:03 +01:00
Brandon Brown
a0f7f6ec6b DBZ-1402 Support for JDK 11 2019-11-25 11:53:19 +01:00
Grzegorz Kołakowski
ce1857e172 DBZ-1480 Add read_committed snapshot isolation level 2019-11-22 11:46:59 +01:00
Debezium Builder
38279cc2dd [maven-release-plugin] prepare for next development iteration 2019-11-14 02:56:07 -05:00
Debezium Builder
868faf4412 [maven-release-plugin] prepare release v1.0.0.Beta3 2019-11-14 02:56:07 -05:00
Luis Garcés-Erice
0198bceffa DBZ-1555 Enabling configuration of table parse mode to support DB2 2019-11-08 15:07:25 +01:00
Jiri Pechanec
27eee9d5ff DBZ-1593 Add tombstones.on.delete to options list 2019-11-06 15:27:36 +01:00
Gunnar Morling
2c569977d7 DBZ-1392 Applying formatter;
* Keeping indentation formatting for JSON


Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
2019-11-01 13:20:43 +02:00
Debezium Builder
b08f523ed7 [maven-release-plugin] prepare for next development iteration 2019-10-24 07:42:49 -04:00
Debezium Builder
8ecd9e28cf [maven-release-plugin] prepare release v1.0.0.Beta2 2019-10-24 07:42:49 -04:00
Jiri Pechanec
526dfb9a4f DBZ-1554 Add connection parameters into params list 2019-10-23 14:48:17 -04:00
Debezium Builder
519dc011ff [maven-release-plugin] prepare for next development iteration 2019-10-17 04:20:13 -04:00
Debezium Builder
51ef6b9470 [maven-release-plugin] prepare release v1.0.0.Beta1 2019-10-17 04:20:12 -04:00
Grant Cooksey
eee18e27c0 DBZ-1546 Match shema used in similar tests 2019-10-17 10:13:44 +03:00
Grant Cooksey
18ca6ec72e DBZ-1546 Comma-separated regular expressions remove whitespace.
The table whitespace parameter should remove whitespace between regular expressions
since tables cannot start with whitespace characters.
2019-10-17 10:13:44 +03:00
Jiri Pechanec
4fdf1f8556 DBZ-1401 Use awaitility 2019-10-10 09:37:52 +02:00
Jiri Pechanec
55b11d60e6 DBZ-1401 Wait for CDC enabled status 2019-10-10 09:37:52 +02:00
Jiri Pechanec
71b8739565 DBZ-1401 SQL Server improved test 2019-10-10 09:37:52 +02:00
Jiri Pechanec
ae4b5d6764 DBZ-1401 Longer time to wait for records from new CDC tables 2019-10-10 09:37:52 +02:00
Jiri Pechanec
06509d26ce DBZ-1401 Database blocked after test 2019-10-10 09:37:52 +02:00
Jiri Pechanec
7c4203cf60 DBZ-1401 Handle tables without explicit PK 2019-10-10 09:37:52 +02:00
Gunnar Morling
92885ebe99 DBZ-1392 Removing trailing whitespace from Java files 2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1 DBZ-1392 Moving static imports up and applying this to all files 2019-10-07 12:11:43 +03:00
Chris Cranford
ca5517746a DBZ-1341 Checkstyle flag missing whitespace 2019-10-03 19:44:43 +02:00
Jiri Pechanec
f868cb87c0 DBZ-1280 Lock timeout for SQL Server 2019-10-02 10:34:25 +02:00
Debezium Builder
2ff77b993b [maven-release-plugin] prepare for next development iteration 2019-10-01 15:34:23 -04:00
Debezium Builder
e09d584b11 [maven-release-plugin] prepare release v0.10.0.Final 2019-10-01 15:34:23 -04:00
Debezium Builder
2f5960c5d2 [maven-release-plugin] prepare for next development iteration 2019-09-27 01:03:50 -04:00
Debezium Builder
e3b44ffb12 [maven-release-plugin] prepare release v0.10.0.CR2 2019-09-27 01:03:50 -04:00
Gunnar Morling
2fba51863e DBZ-1015 Unifying the retrieval of custom key mappers 2019-09-26 10:14:48 +02:00
Guillaume Rosauro
1405889bef DBZ-1015-allow-user-to-customize-key 2019-09-26 10:14:21 +02:00
Jiri Pechanec
88aeb6803a DBZ-1483 Update documentation 2019-09-25 10:18:24 +02:00
Jiri Pechanec
26bdeee885 DBZ-1483 Expose event serial number in source block 2019-09-25 10:18:24 +02:00
jerrinot
3064a4af06 DBZ-1438 Fix InterruptedException handling
It appears there is an intent to restore the interruption flag
when catching InterruptedException. However the old code was just
checking the current state of the flag instead of raising it.
2019-09-24 12:51:48 +02:00
Chris Cranford
130210b5ad DBZ-1044 Add config option sanitize.field.names and FieldNameSelector 2019-09-20 07:40:23 +03:00
Debezium Builder
9b7e09fdda [maven-release-plugin] prepare for next development iteration 2019-09-10 09:12:12 -04:00
Debezium Builder
a1c2861458 [maven-release-plugin] prepare release v0.10.0.CR1 2019-09-10 09:12:11 -04:00
Gunnar Morling
dd94857d92 DBZ-1419 Adding test for adaptive time precision mode 2019-08-20 18:43:03 +02:00
Jiri Pechanec
51c12d930d DBZ-1419 Support for Connect temporal types in SQL Server 2019-08-20 18:43:03 +02:00
Debezium Builder
4ae105bdce [maven-release-plugin] prepare for next development iteration 2019-08-16 03:42:55 -04:00
Debezium Builder
945ccf68cb [maven-release-plugin] prepare release v0.10.0.Beta4 2019-08-16 03:42:54 -04:00
Gunnar Morling
d961d21ae4 DBZ-777 Using correct type 2019-08-15 20:43:31 +02:00
Jiri Pechanec
f4246df6e4 DBZ-777 PostgreSQL connector rewrite to the standard framework 2019-08-15 20:43:31 +02:00
Jiri Pechanec
8e28e38859 DBZ-1417 Lock is tablewide, remove fullscan 2019-08-08 21:21:10 +02:00
Guillaume Rosauro
4b44e5f925 [DBZ-1254] Re-order the captured tables in the same order as the
'table.whitelist' parameter
2019-07-25 07:33:22 +02:00
Jiri Pechanec
0742e5775f Revert "[maven-release-plugin] prepare release v0.10.0.Beta4"
This reverts commit c7340e5152.
2019-07-23 14:54:55 +02:00
Jiri Pechanec
f7d20635ce Revert "[maven-release-plugin] prepare for next development iteration"
This reverts commit 22879777e4.
2019-07-23 14:54:49 +02:00
Jiri Pechanec
22879777e4 [maven-release-plugin] prepare for next development iteration 2019-07-23 14:10:03 +02:00
Jiri Pechanec
c7340e5152 [maven-release-plugin] prepare release v0.10.0.Beta4 2019-07-23 14:10:02 +02:00
Debezium Builder
71333fda98 [maven-release-plugin] prepare for next development iteration 2019-07-23 02:55:08 -04:00
Debezium Builder
20d006fac7 [maven-release-plugin] prepare release v0.10.0.Beta3 2019-07-23 02:55:08 -04:00
Jiri Pechanec
3008339142 DBZ-916 Keyless tables have null key by default 2019-07-17 14:41:37 -04:00
Jiri Pechanec
13d638fd43 DBZ-1356 Metrics for schema history (#947)
* DBZ-1356 Metrics for schema history
2019-07-02 13:26:17 +02:00
Jenkins user
e95d656bca [maven-release-plugin] prepare for next development iteration 2019-06-27 07:36:13 +00:00
Jenkins user
d95fd87311 [maven-release-plugin] prepare release v0.10.0.Beta2 2019-06-27 07:36:12 +00:00
Gunnar Morling
d6a8504279 DBZ-1065 Some clean-up 2019-06-19 13:06:20 +02:00
Jiri Pechanec
31417868ab DBZ-1065 Use separate connection for metadata
Adaptive streaming does not work in SQL Server JDBC driver when more
than one query are executed on the same database connection.
As we are querying additional metadata while iterating the change table
the whole result set would be read into the memory if the metadata would
not be queried on a separate connection.
2019-06-19 13:06:20 +02:00
Jiri Pechanec
9b5640ddde DBZ-835 Emit tombstone optionally 2019-06-12 21:39:13 +02:00
Jenkins user
5fdb0ca81b [maven-release-plugin] prepare for next development iteration 2019-06-11 11:20:46 +00:00
Jenkins user
61729b9e00 [maven-release-plugin] prepare release v0.10.0.Beta1 2019-06-11 11:20:46 +00:00
Gunnar Morling
3f00e7155f DBZ-1152 Misc. clean-up;
* operationOrder -> eventSerialNo
* using long consistently
2019-06-11 12:27:14 +02:00
Jiri Pechanec
87663389ef DBZ-1152 Record operation order for changes with the same LSNs 2019-06-11 12:27:14 +02:00
Gunnar Morling
5d01f409f0 DBZ-1317 Separating update and query methods for MongoDB's SourceInfo;
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
2019-06-11 10:07:36 +02:00
Chris Cranford
0aadaa10dc DBZ-1242 Fixed typo and added negative test checks 2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a DBZ-1242 Issue warning when filters produce an empty schema 2019-06-05 13:31:25 -04:00
Jenkins user
056730d06a [maven-release-plugin] prepare for next development iteration 2019-06-03 10:24:08 +00:00