Commit Graph

1075 Commits

Author SHA1 Message Date
Jiri Pechanec
2b67e26407 DBZ-2130 Avoid ambiguity between type and charset keyword 2020-06-03 11:04:49 +02:00
Jiri Pechanec
06f8023a54 DBZ-2130 CHARACTER keyword used also as a type 2020-06-02 15:11:53 +02:00
Jiri Pechanec
20b45f84f3 DBZ-1657 Remove duplicate option definitions 2020-05-22 12:07:29 +02:00
Debezium Builder
dc25c379e5 [maven-release-plugin] prepare for next development iteration 2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9 [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:40:25 -04:00
Jiri Pechanec
e676d715c3 DBZ-2085 Apply custom converters to default values 2020-05-18 17:27:59 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Fándly Gergő
9cea694510 DBZ-2067 Add support for ALGORITHM=INSTANT on alter table statements 2020-05-14 12:31:14 +02:00
Max Kaplan
1b89b89301 DBZ-2062 allowing compression keyword to contain backticks in create table 2020-05-14 11:21:25 +02:00
Jiri Pechanec
c4f975bd0a DBZ-2061 Handle change of default value 2020-05-14 08:31:27 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
11c8e9df3d DBZ-1953 Rework configuration files 2020-04-29 12:27:38 +02:00
Chris Cranford
230ddaebdc DBZ-1953 Generalized SkipWhenDatabaseVersion functionality 2020-04-29 12:27:38 +02:00
Chris Cranford
bcae276234 DBZ-1953 MySQL 5.5 and 5.6 added to test matrix 2020-04-29 12:27:38 +02:00
Gunnar Morling
3d0606b348 DBZ-2027 Small speed-up of PG test execution;
* Using Awaitility so we can use 100ms looping intervals; also it's more concise
* Avoiding creation of one temporary connection
2020-04-29 09:56:59 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Jiri Pechanec
0d8d6a41c5 DBZ-1750 Validate Kafka params only for Kafka history 2020-04-24 15:35:28 +02:00
Gunnar Morling
0998fc533a DBZ-1895 Completing implementation;
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Hossein Torabi
9ddd893074 DBZ-1895 Implement SKIPPED_OPERATIONS for mysql 2020-04-22 15:04:36 +02:00
Ivan Klass
75f19239d1 DBZ-1886 Introduce separate storageExists() method to support manual topic creation 2020-04-20 17:46:03 +02:00
Jos Huiting
a0f65830de DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig 2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef DBZ-1962 Introduce column.whitelist for the Postgres connector 2020-04-17 15:24:42 +02:00
Chris Cranford
e7d7456a3f DBZ-1947 Remove obsolete MySQL metrics 2020-04-16 09:31:29 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00
Jiri Pechanec
318d1d3cc7 DBZ-1905 Make thread-naming params internal and optional 2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1 DBZ-1905 Validate database history topic 2020-04-08 12:18:32 +02:00
Chris Cranford
35eaf9828f DBZ-1950 Make validation of binlog_row_image compatible with MySQL 5.5 2020-04-08 10:28:12 +02:00
Chris Cranford
44bdf429c5 DBZ-1926 Properly log failed SQL during snapshot failure 2020-04-07 08:36:22 +02:00
Jiri Pechanec
242f50b2f3 DBZ-1932 Snapshot events calculated from table stats 2020-04-06 08:52:30 +02:00
Gunnar Morling
3d58d6cf32 DBZ-1911 Formatting; adding Nayana Hettiarachchi to authors list 2020-03-31 13:37:54 +02:00
Nayana Hettiarachchi
2c6e33ac76 DBZ-1911 - improve error messaging for binlog configuration validation 2020-03-31 13:34:06 +02:00
Gunnar Morling
89bb6eba6c DBZ-1531 Misc. clean-up;
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Gunnar Morling
aaffae2964 DBZ-1531 Typo fix 2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f [maven-release-plugin] prepare for next development iteration 2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:23:05 -04:00
Debezium Builder
86c1ed90ed [maven-release-plugin] prepare for next development iteration 2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 09:54:44 -04:00
Gunnar Morling
c156d30048 DBZ-1723 Centralizing stopping() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597 DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Jiri Pechanec
082761effc DBZ-1856 Deprecation process is not necessary 2020-03-11 12:02:07 +01:00
Fabio Cantarini
62b46ae596 DBZ-1830 Enhancement to datatype.propagate.source.type connector property
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32 DBZ-1830 Add support for new connector property datatype.propagate.source.type 2020-03-10 14:58:16 +01:00
Chris Cranford
01b4137a13 DBZ-1664 Fix metrics test failures 2020-03-09 23:30:24 +01:00
Chris Cranford
5506fadd2d DBZ-1664 Verify correctness of JMX metrics 2020-03-09 23:30:24 +01:00
Ruslan Gibaiev
4e45347f8e DBZ-1833 - CREATE TABLE [IF NOT EXISTS] shouldn't update state for existing table 2020-03-03 13:11:03 +01:00
Jiri Pechanec
504648d367 DBZ-1801 Fix typo
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2020-03-03 12:14:16 +01:00
Jiri Pechanec
51b9a732b9 DBZ-1801 TinyInt1 to boolean converter 2020-03-03 12:14:16 +01:00
Jiri Pechanec
e4b4aa818a DBZ-1834 Support for escaping 2020-03-03 10:56:19 +01:00
Jiri Pechanec
0f11f7e6de DBZ-1834 Support separately quoted schema and table 2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29 DBZ-1834 Support dots in table names 2020-03-03 10:56:19 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
1b77cf21b6 DBZ-1826 Avoid default false warning with default value 2020-02-26 16:55:19 +01:00
Gunnar Morling
c7c7183b11 DBZ-1826 Formatting 2020-02-26 15:49:26 +01:00
Jiri Pechanec
06049a5e9d DBZ-1826 Rename error handling config field 2020-02-26 15:49:26 +01:00
Jiri Pechanec
e3ce802c36 DBZ-1705 Switch new GTID process to earliest 2020-02-25 16:19:22 +01:00
Jiri Pechanec
f0cc055833 DBZ-1773 Change test for null value 2020-02-17 16:40:52 +01:00
Jiri Pechanec
a4d3c1e89a DBZ-1773 Process TINYINT(1) as number 2020-02-17 16:40:52 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Aykut Farsak
26cdc58efc
Fixing missing whitespace in exception message 2020-02-06 17:23:29 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema;
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Chris Cranford
1ec377224a DBZ-1712 MySQL connector use default port when database.port option not specified 2020-01-15 21:24:55 +01:00
Jiri Pechanec
88e280d89e DBZ-1693 Replace other instances of schema with catalog 2020-01-10 22:02:49 +01:00
Jiri Pechanec
6163f46585 DBZ-1693 Use corrent TableId component 2020-01-10 22:02:49 +01:00
Vasily Ulianko
8e342bea84 DBZ-1689 Allow setting boolean as default value for INT 2020-01-02 11:55:22 +01:00
Debezium Builder
9723c93db9 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2 [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:44:33 -05:00
Gunnar Morling
f5b563ff87 DBZ-1671 Propagating exception instead of message only 2019-12-17 07:25:51 +01:00
John Martin
fc24de8dde DBZ-1671 add innodb_lock_wait_timeout and update info log 2019-12-17 07:23:29 +01:00
John Martin
3f006f8c0e DBZ-1671 Adding configurable lock_wait_timeout for mysql connector SnapshotReader 2019-12-17 07:23:29 +01:00
Nikhil Benesch
afd69fc7fc DBZ-1667 Regression test for MySQL dates in snapshot being off by one
In Debezium 0.9, if the timezone of the JVM running Debezium had an
earlier offset than the timezone of the MySQL server, any values of type
DATE read by the snapshot reader would be incorrectly shifted backwards
by one day. This was the result of a known bug/deficiency in MySQL's
JDBC connector [0].

This bug was inadvertently fixed in Debezium 0.10 by #913, which
bypassed the JDBC date retrieval logic to support zero dates, thus also
avoiding the inappropriate timezone shifting logic. However, since the
fix was inadvertent, there was no test to protect against regression.

This commit adds such a regression test. Since the MySQL server used in
tests uses timezone GMT-11, we just need to run a SnapshotReader in
timezone GMT-12 and verify that the dates are computed correctly. This
test fails if added to Debezium 0.9, but passes now thanks to #913.

Humorously, it is likely someone would have noticed this bug long ago
had the test MySQL server used any other timezone; for example, if the
MySQL server used EST as its timezone, anyone running the tests from the
International Date Line to Chicago would have seen the failure.  Bt with
GMT-11 there is only one timezone with a smaller offset, GMT-12, which
is only used by tiny outlying islands of the US.

[0]: https://bugs.mysql.com/bug.php?id=91112
2019-12-12 12:53:44 +01:00
Debezium Builder
b1c62fe306 [maven-release-plugin] prepare for next development iteration 2019-12-10 06:39:17 -05:00
Debezium Builder
ad2efdb9a6 [maven-release-plugin] prepare release v1.0.0.CR1 2019-12-10 06:39:17 -05:00
Chris Cranford
5e680a1d05 DBZ-1636 Add MySQL ENUM test propagating source type schema parameters 2019-12-10 09:24:34 +01:00
Jiri Pechanec
249e54ac3c DBZ-1645 Allow alter and rename table in a single step 2019-12-04 17:11:03 +01:00
Jiri Pechanec
e551e89a92 DBZ-1201 Always store SET commands 2019-11-28 17:28:42 +01:00
Brandon Brown
a0f7f6ec6b DBZ-1402 Support for JDK 11 2019-11-25 11:53:19 +01:00
Gunnar Morling
ded3174d55 DBZ-1632 Exposing connection timeout as Duration in one single method 2019-11-22 14:45:18 +01:00
Collin Van Dyck
b817f2fa38 DBZ-1632 Making connection timeout configurable in MySQL connection URL
Without this setting, if someone POSTs a connector config with
an unreachable db hostname, the verify routine of the mySQL
connector will hang indefinitely.  Interestingly, this
prevents other connectors from being submitted (a synchronization
issue that this does not address).

With this patch, though, the value for the `connect.timeout.ms`
connector property will be set as the `connectTimeout` URL parameter,
which, if nonzero, will cause the connection to eventually
time out.
2019-11-22 14:44:32 +01:00
Debezium Builder
38279cc2dd [maven-release-plugin] prepare for next development iteration 2019-11-14 02:56:07 -05:00
Debezium Builder
868faf4412 [maven-release-plugin] prepare release v1.0.0.Beta3 2019-11-14 02:56:07 -05:00
David Feinblum
2b9fbcd5f6 DBZ-1519 Avoid erroneously logging there are no monitored tables 2019-11-14 05:44:37 +01:00
Jiri Pechanec
eb27cc5c54 DBZ-1613 Fix schema snapshotting of unlocked tables 2019-11-13 09:18:10 -05:00
Jiri Pechanec
2b9536f24d DBZ-1607 use Instant for envelope timestamps 2019-11-12 16:36:11 -05:00
Jiri Pechanec
fd62e7d3ef DBZ-1588 Fresh timestamp for each snapshot event 2019-11-12 16:36:11 -05:00
Luis Garcés-Erice
0198bceffa DBZ-1555 Enabling configuration of table parse mode to support DB2 2019-11-08 15:07:25 +01:00
Gunnar Morling
2c569977d7 DBZ-1392 Applying formatter;
* Keeping indentation formatting for JSON


Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
Co-authored-by: Chris Cranford <chris@hibernate.org>
2019-11-01 13:20:43 +02:00
Debezium Builder
b08f523ed7 [maven-release-plugin] prepare for next development iteration 2019-10-24 07:42:49 -04:00
Debezium Builder
8ecd9e28cf [maven-release-plugin] prepare release v1.0.0.Beta2 2019-10-24 07:42:49 -04:00
Jiri Pechanec
776414a4f8 DBZ-1428 Restore TX isolation level after table read lock 2019-10-21 12:23:51 +02:00
Jiri Pechanec
a92b93182e DBZ-1560 Removed dropped PK from the list 2019-10-20 22:13:02 +02:00
Debezium Builder
519dc011ff [maven-release-plugin] prepare for next development iteration 2019-10-17 04:20:13 -04:00
Debezium Builder
51ef6b9470 [maven-release-plugin] prepare release v1.0.0.Beta1 2019-10-17 04:20:12 -04:00
Grant Cooksey
f0bd58c8ff DBZ-1546 Correct fix number test annotation 2019-10-17 10:13:44 +03:00
Grant Cooksey
18ca6ec72e DBZ-1546 Comma-separated regular expressions remove whitespace.
The table whitespace parameter should remove whitespace between regular expressions
since tables cannot start with whitespace characters.
2019-10-17 10:13:44 +03:00
Gunnar Morling
92885ebe99 DBZ-1392 Removing trailing whitespace from Java files 2019-10-07 12:11:43 +03:00
Gunnar Morling
8d6f5409b1 DBZ-1392 Moving static imports up and applying this to all files 2019-10-07 12:11:43 +03:00
Chris Cranford
ca5517746a DBZ-1341 Checkstyle flag missing whitespace 2019-10-03 19:44:43 +02:00
Chris Cranford
7442670692 DBZ-1355 Fix checkstyle problems detected after upgrade to 8.19 2019-10-03 19:44:43 +02:00
Chris Cranford
5ac2318d84 DBZ-1391 Do not allow code after closing brace (#1065)
* DBZ-1391 Do not allow code after closing brace
2019-10-02 20:44:40 +02:00
Gunnar Morling
d94b37c693 DBZ-1507 Misc. clean-up;
* Removing unused Table methods
* Re-using primaryKeyColumnNames() instead of custom predicate
2019-10-02 10:25:37 +02:00
Debezium Builder
2ff77b993b [maven-release-plugin] prepare for next development iteration 2019-10-01 15:34:23 -04:00
Debezium Builder
e09d584b11 [maven-release-plugin] prepare release v0.10.0.Final 2019-10-01 15:34:23 -04:00
Debezium Builder
2f5960c5d2 [maven-release-plugin] prepare for next development iteration 2019-09-27 01:03:50 -04:00
Debezium Builder
e3b44ffb12 [maven-release-plugin] prepare release v0.10.0.CR2 2019-09-27 01:03:50 -04:00
Gunnar Morling
2fba51863e DBZ-1015 Unifying the retrieval of custom key mappers 2019-09-26 10:14:48 +02:00
Guillaume Rosauro
1405889bef DBZ-1015-allow-user-to-customize-key 2019-09-26 10:14:21 +02:00
Jiri Pechanec
0f61a0c8de DBZ-1501 Support partial timstamps in default values 2019-09-25 23:49:25 +02:00
Chris Cranford
dc3f07d9d2 DBZ-1500 Fix race condition in mysql connector test suite 2019-09-25 08:02:42 +03:00
jerrinot
3064a4af06 DBZ-1438 Fix InterruptedException handling
It appears there is an intent to restore the interruption flag
when catching InterruptedException. However the old code was just
checking the current state of the flag instead of raising it.
2019-09-24 12:51:48 +02:00
Chris Cranford
130210b5ad DBZ-1044 Add config option sanitize.field.names and FieldNameSelector 2019-09-20 07:40:23 +03:00
Debezium Builder
9b7e09fdda [maven-release-plugin] prepare for next development iteration 2019-09-10 09:12:12 -04:00
Debezium Builder
a1c2861458 [maven-release-plugin] prepare release v0.10.0.CR1 2019-09-10 09:12:11 -04:00
Gunnar Morling
2a065686bd DBZ-1255 Exporting null value when temporal precision mode is "connect" and the value is out of the supported range 2019-08-21 07:50:40 +02:00
Gunnar Morling
a85f975d18 DBZ-1419 Avoiding redundancy in field definition; updating description 2019-08-20 18:43:03 +02:00
Gunnar Morling
cb66fdafdc DBZ-1419 Avoiding redundancy in field definition 2019-08-20 18:43:03 +02:00
Jiri Pechanec
0e39965c0e DBZ-1419 Override time precision for MySQL 2019-08-20 18:43:03 +02:00
Jiri Pechanec
51c12d930d DBZ-1419 Support for Connect temporal types in SQL Server 2019-08-20 18:43:03 +02:00
Debezium Builder
4ae105bdce [maven-release-plugin] prepare for next development iteration 2019-08-16 03:42:55 -04:00
Debezium Builder
945ccf68cb [maven-release-plugin] prepare release v0.10.0.Beta4 2019-08-16 03:42:54 -04:00
Jiri Pechanec
af50ea64a4 DBZ-1414 Rename to captured 2019-08-06 10:59:41 +02:00
Jiri Pechanec
6276b4817a DBZ-1414 Fix test for correct DDL output 2019-08-06 10:59:41 +02:00
Jiri Pechanec
93fc39d92c DBZ-1414 Lock only monitored tables 2019-08-06 10:59:41 +02:00
Jiri Pechanec
360bcc6f36 DBZ-1411 Support unquted full names in GRANT 2019-07-29 15:49:55 +02:00
Jiri Pechanec
0742e5775f Revert "[maven-release-plugin] prepare release v0.10.0.Beta4"
This reverts commit c7340e5152.
2019-07-23 14:54:55 +02:00
Jiri Pechanec
f7d20635ce Revert "[maven-release-plugin] prepare for next development iteration"
This reverts commit 22879777e4.
2019-07-23 14:54:49 +02:00
Jiri Pechanec
22879777e4 [maven-release-plugin] prepare for next development iteration 2019-07-23 14:10:03 +02:00
Jiri Pechanec
c7340e5152 [maven-release-plugin] prepare release v0.10.0.Beta4 2019-07-23 14:10:02 +02:00
Debezium Builder
71333fda98 [maven-release-plugin] prepare for next development iteration 2019-07-23 02:55:08 -04:00
Debezium Builder
20d006fac7 [maven-release-plugin] prepare release v0.10.0.Beta3 2019-07-23 02:55:08 -04:00
Jiri Pechanec
55c267557f DBZ-1410 Filter DML before throwing an invalid replication format error 2019-07-22 14:19:06 -04:00
Jiri Pechanec
ff87bb1ab7 DBZ-1409 Built-in database filter throws NPE 2019-07-22 14:18:36 -04:00
Jiri Pechanec
d3b33e5fbd DBZ-1376 Both ALGORTIHM and LOCK are allowed for INDEX 2019-07-17 16:09:21 -04:00
Jiri Pechanec
558d97aa82 DBZ-1398 Support for arbitrary third party engine name 2019-07-17 15:15:11 -04:00
Jiri Pechanec
fbeb0076dc DBZ-1397 Support CHARSET in CAST function 2019-07-17 14:50:40 -04:00
Jiri Pechanec
c9997a5fd6 DBZ-599 Emit schema change only for DDL with no errors 2019-07-10 08:38:08 +02:00
Jiri Pechanec
67ca8a2d76 DBZ-794 Filter out savepoints from database history 2019-07-08 12:54:01 +02:00
BinLi1988
3b14c13bbb DBZ-1338 Support for ensuring keepalive by using MySQL heartbeat 2019-07-05 09:10:30 +02:00
Jiri Pechanec
c08a5374fe DBZ-1222 Improve error event method name 2019-07-04 21:31:32 +02:00
Jiri Pechanec
2b365be63c DBZ-1222 EventsInError metric added 2019-07-04 21:31:32 +02:00
Jiri Pechanec
13d638fd43 DBZ-1356 Metrics for schema history (#947)
* DBZ-1356 Metrics for schema history
2019-07-02 13:26:17 +02:00
Gunnar Morling
a991ea97d7 Handling option for emitting tombstones conistently 2019-07-01 08:27:33 +02:00
Jenkins user
e95d656bca [maven-release-plugin] prepare for next development iteration 2019-06-27 07:36:13 +00:00
Jenkins user
d95fd87311 [maven-release-plugin] prepare release v0.10.0.Beta2 2019-06-27 07:36:12 +00:00
Jiri Pechanec
9c22da610a DBZ-1353 MySQL 8 returns null for unspecified timestmap column 2019-06-25 12:13:53 +02:00
Jiri Pechanec
6e5f633e40 DBZ-1350 NO_AUTO_CREATE_USER unsupported on MySQL 8 2019-06-24 14:18:31 +02:00
Jiri Pechanec
257f900abb DBZ-1349 Support for UTF8mb3 charset 2019-06-24 14:03:23 +02:00
Jiri Pechanec
c88e454809 DBZ-1348 Add INTERNAL among allowed ids 2019-06-21 19:27:21 +02:00
Gunnar Morling
d3e399e167 DBZ-1340 Avoiding repeated case conversion of incoming DML statements;
Also adding startsWithIgnoreCase() method.
2019-06-20 13:33:12 +02:00
Jiri Pechanec
ace742a43e DBZ-1340 Guard against binlog misconfiguration 2019-06-20 13:33:12 +02:00
Jiri Pechanec
807da1f9b8 DBZ-1278 Change log message wording
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2019-06-19 17:05:26 +02:00
Jiri Pechanec
3012524ea1 DBZ-1278 Rename to non-whitelisted table sends warn 2019-06-19 17:05:26 +02:00
Jiri Pechanec
e2f2c88952 DBZ-1329 Support for rename index 2019-06-17 20:55:04 +02:00
Jenkins user
5fdb0ca81b [maven-release-plugin] prepare for next development iteration 2019-06-11 11:20:46 +00:00
Jenkins user
61729b9e00 [maven-release-plugin] prepare release v0.10.0.Beta1 2019-06-11 11:20:46 +00:00
Gunnar Morling
5d01f409f0 DBZ-1317 Separating update and query methods for MongoDB's SourceInfo;
* Avoids access to collection id after events which don't have one
* Pulling up struct() and schema() methods to common base class
2019-06-11 10:07:36 +02:00
Jiri Pechanec
6a412eb72f DBZ-1318 Log when conversion happens 2019-06-07 09:44:46 +02:00
Jiri Pechanec
3e94fc2ef8 DBZ-1318 Handle invalid dates in non-strict mode (#913)
* DBZ-1318 Handle invalid dates in non-strict mode
2019-06-06 11:40:11 +02:00
pancheng
1180736124 DBZ-1321 Add test case 2019-06-06 10:38:56 +02:00
pancheng
bc17bc90d1 DBZ-1321 Fix alter by modify column about default value 2019-06-06 10:38:56 +02:00
Chris Cranford
0aadaa10dc DBZ-1242 Fixed typo and added negative test checks 2019-06-05 13:31:25 -04:00
Chris Cranford
b3ca33287a DBZ-1242 Issue warning when filters produce an empty schema 2019-06-05 13:31:25 -04:00
Jenkins user
056730d06a [maven-release-plugin] prepare for next development iteration 2019-06-03 10:24:08 +00:00
Jenkins user
7aeaec236e [maven-release-plugin] prepare release v0.10.0.Alpha2 2019-06-03 10:24:08 +00:00
Gunnar Morling
246c1be305 DBZ-1283 Enforcing presence of database.server.name globally 2019-06-03 10:58:14 +02:00
Chris Cranford
5f0b44b4ec DBZ-1283 Only validate history topic name for affected connectors 2019-06-03 10:58:14 +02:00
Jiri Pechanec
4b64c8e447 DBZ-1295 3state snapshot for MySQL 2019-05-31 10:56:05 +02:00
Jiri Pechanec
37d2b6964f DBZ-1303 Remove protobuf dependency for MySQL 2019-05-30 14:32:47 +02:00
Jiri Pechanec
946019982e DBZ-1303 Assembly without database drivers 2019-05-30 14:32:47 +02:00
Bartosz Miedlar
ead68b1b14 DBZ-1300 DDL that contains user are unparsable by antlr 2019-05-30 11:40:55 +02:00
Gunnar Morling
0c7763c68a DBZ-871 Simplifying test assertions 2019-05-30 08:51:28 +02:00
Jiri Pechanec
4209900731 DBZ-871 Test for multitable statement 2019-05-30 08:51:28 +02:00
Gunnar Morling
ca361bd122 DBZ-871 Clearly separating between DB and table events 2019-05-30 08:51:28 +02:00
Jiri Pechanec
e826599e2e DBZ-871 Add table(s) name to schema change event 2019-05-30 08:51:27 +02:00
Gunnar Morling
7759333fe3 DBZ-1092 Using ColumnNameFilter instead of Predicate<Column> 2019-05-29 15:49:49 +02:00
Jenkins user
ac5c76e431 [maven-release-plugin] prepare for next development iteration 2019-05-28 14:38:32 +00:00
Jenkins user
35f59ba460 [maven-release-plugin] prepare release v0.10.0.Alpha1 2019-05-28 14:38:32 +00:00
Jiri Pechanec
ab460c86af DBZ-1235 Return server name to legacy MySQL 2019-05-28 09:35:15 +02:00
Gunnar Morling
3377b96ca8 DBZ-1235 Removing redundant method 2019-05-28 09:35:15 +02:00
Jiri Pechanec
526e780513 DBZ-1235 Misc fixes 2019-05-28 09:35:15 +02:00
Jiri Pechanec
80afd4975a DBZ-1235 Changes missed in refactoring 2019-05-28 09:35:15 +02:00
Gunnar Morling
eef37cb567 DBZ-1235 Misc adjustments;
* Removing superfluous parameter from getSourceInfoStructMaker()
* JavaDoc
* Renaming field to "source.struct.version"
2019-05-28 09:35:15 +02:00
Gunnar Morling
8f28f323e7 DBZ-1235 Using Instant to represent timestamps internally;
Only "rendered" as epoch milli-seconds at the system boundaries.
2019-05-28 09:35:15 +02:00
Jiri Pechanec
6f6c8ddf06 DBZ-1235 Refactored to unify the code 2019-05-28 09:35:15 +02:00
Jiri Pechanec
0ec2d651fe DBZ-1235 Timestamp in ms for MySQL connector 2019-05-28 09:35:15 +02:00
Jiri Pechanec
f5757dbd9f DBZ-1235 Extract serverName to common source 2019-05-28 09:35:15 +02:00
Gunnar Morling
4ed8b4636c DBZ-1224 Completing implementation;
* Further unification of override handling;
* Undoing change related to SnapshotStatementFactory as it seems not needed
* Adding test
2019-05-27 08:44:42 +02:00
mokkara
b3de0250a9 DBZ-1224 Snapshot SELECT support for SQL Server 2019-05-27 08:44:42 +02:00
Chris Cranford
377728ef87 DBZ-1127 Synchronize MySQL grammar with upstream grammar. 2019-05-22 17:05:11 +02:00
Chris Cranford
778b394085 DBZ-1127 Synchronize MySQL grammar with upstream grammar. 2019-05-22 17:05:11 +02:00
Jiri Pechanec
c1c4d3d149 DBZ-683 After review changes 2019-05-22 14:52:06 +02:00
Jiri Pechanec
540196091c DBZ-683 Snapshot supports storing only whitelisted tables setting 2019-05-22 14:52:06 +02:00
Chris Cranford
1603ebda89 DBZ-1234 Remove support for adaptive time precision mode 2019-05-22 10:19:05 +02:00
Chris Cranford
e2c74111ad DBZ-1234 Removed deprecated configuration options 2019-05-22 10:19:05 +02:00
Gunnar Morling
7519623c58 DBZ-1244 Fixing formatting glitch 2019-05-21 15:53:55 +02:00
Jiri Pechanec
c8c6360095 DBZ-1244 Detecting unreplicated purged GTIDs;
The purpose of this change is to provide the same functionality for
when_needed snapshot for GTID enabled database like for non-GTID.
The non-GTID just relies on missing replication log to detect the
new snapshot needs to be triggered. This does not work in GTID
environment as we need to compare the GTIDs that are available on
the server with those we have already processed - stored in the
offsets.

If there is a set of GTIDs that were not replicated by Debezium
and at the same time have been already purged then we detect the
situation and trigger a new snapshot when required.

We thus

* Take all GTIDs ever processed by the server
* Filter out GTIDs that were processed by Debezium
* Compare them with purged GTID set
* If the interesction is not empty we know we have not replicated
transaction that have already been removed from the server
2019-05-21 15:51:17 +02:00
Jiri Pechanec
29c10c27ea DBZ-1276 Skip events upon connector restart 2019-05-21 10:38:41 +02:00
Chris Cranford
9afe06945e DBZ-736 Fixed compilation problem with duplicate test class. 2019-05-20 13:38:01 -04:00
Gunnar Morling
d35e401e34 DBZ-736 Removing obsolete MySqlDefaultValueTest;
* Removing old test for legacy parser
* Pulling Antlr-specific methods up to base class
* Renaming that one into MySqlDefaultValueTest
2019-05-20 13:38:01 -04:00
Gunnar Morling
3f0e2c7758 DBZ-1246 Removing obsolete exclusion of legacy parser during test 2019-05-20 16:38:03 +02:00
Jiri Pechanec
30c2df4f23 DBZ-1246 Convert unique index to primary key 2019-05-20 16:38:03 +02:00
Gunnar Morling
c72a2fb14d DBZ-844 Expanding test 2019-05-20 15:33:39 +02:00
Jiri Pechanec
d35c2ec347 DBZ-844 Use table charset for parsing string defaults 2019-05-20 15:33:39 +02:00
jcechace
d9657dab1a [DBZ-1273] Bumping JDBC and Mongo driver versions 2019-05-18 05:50:27 +02:00
Gunnar Morling
c7d2a35a0e DBZ-1264 Member ordering 2019-05-18 05:48:54 +02:00
Jiri Pechanec
a8f6533c66 DBZ-1264 Ignore unique index for non-monitored tables 2019-05-18 05:46:56 +02:00
Chris Cranford
f67ce1b8be DBZ-733 Consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
efa22016a8 DBZ-736 DBZ-733 Removed MySQL legacy parser and consolidate parser tests 2019-05-17 13:18:24 -04:00
Chris Cranford
373e508d70 DBZ-736 Remove MySQL legacy parser 2019-05-17 13:18:24 -04:00
Jiri Pechanec
13e5fe4537 DBZ-1228 Simplify error handling 2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
ceb56c1c57 DBZ-1228 Changes as suggested in PR #867
Used multiple catch statements and handle in 1 branch.

Not using static modifier for keymanager.
2019-05-17 10:24:02 -04:00
Arkoprabho Chakraborti
b7526d537d DBZ-1228 MySQL connection with client authentication does not work
The SSL properties were being reset, and thus the authentication was failing on the second time.
When debezium connects to the database the first time in order to test the connections, the required parameters are all set. And thus the test passes.
After that the shutdown method is called that clears these properties, and the consecutive connection fails.

DBZ-1228: MySQL connection with client authentication does not work

Create and pass a socket factory that provides they keystore config

DBZ-1228: MySQL connection with client authentication does not work

Prevent forcing of SSL. Use SSL only if the required properties are set.

DBZ-1228: MySQL connection with client authentication does not work

Added better exception messages
2019-05-17 10:24:02 -04:00
Jenkins user
7748be6056 [maven-release-plugin] prepare for next development iteration 2019-05-02 16:04:56 +00:00
Jenkins user
5af083b86e [maven-release-plugin] prepare release v0.9.5.Final 2019-05-02 16:04:55 +00:00
Chris Cranford
9404eff794 DBZ-1226 Cleaned up tests 2019-05-01 18:37:09 -04:00
Gunnar Morling
2cd0eb17db DBZ-739 Removing obsolete method 2019-05-01 23:17:00 +02:00
Chris Cranford
46111505ed DBZ-1226 Fix test to validate enum/set options directly from antlr parsing. 2019-05-01 21:17:42 +02:00
Chris Cranford
a5fdfd9b24 DBZ-1226 Replace double single-quotes with a singular quote. 2019-05-01 21:17:42 +02:00
Chris Cranford
c6aa02f813 DBZ-1226 Add support for enum/set values that contain commas or escaped characters. 2019-05-01 21:17:42 +02:00
jchipmunk
72b06366fe Removing extra initialisation of "config" variable in PG config 2019-04-30 09:57:11 +02:00
jchipmunk
9fe033ce24 DBZ-1247 Specifying default snapshot fetch size for each connector config 2019-04-30 09:57:11 +02:00
Chris Cranford
83bf0f861a DBZ-1243 Fix handling of default value for datetime(0) 2019-04-25 17:31:22 +02:00
Jiri Pechanec
79afafcb0d DBZ-1249 Fix default value conversion for larger bits 2019-04-23 13:02:31 +02:00
krizhan
70c564b4c2 DBZ-212 Moved SERVER_NAME to RelationalDatabaseConnectorConfig 2019-04-23 12:29:44 +02:00
Gunnar Morling
5339dfc289 DBZ-1233 Formatting 2019-04-23 12:18:53 +02:00
Mathieu Rozieres
df79dfe751 DBZ-1233 MODE and others as MySQL column names
Add MODE to keywordsCanBeId to fix parse exception on so named columns
2019-04-23 12:18:40 +02:00
Jenkins user
cefc5ccfb9 [maven-release-plugin] prepare for next development iteration 2019-04-11 12:07:16 +00:00
Jenkins user
fc3026adc3 [maven-release-plugin] prepare release v0.9.4.Final 2019-04-11 12:07:15 +00:00
Gunnar Morling
f04147d67d DBZ-1208 Misc. clean-up;
* Adding reference to source of logic for setting up SSL socket factory
* Making method side-effect free
* Adding Jordon to COPYRIGHT.txt
2019-04-10 11:41:51 +02:00
jbragg
9ae2ebe329 DBZ-1208 Support for TLSv1.2;
Using accepted TLS protocol version  to set for BinaryLogClient
2019-04-10 11:41:13 +02:00
Jiri Pechanec
50fbe32113 DBZ-1220 Integration test for schema metadata 2019-04-10 11:20:09 +02:00