Commit Graph

1052 Commits

Author SHA1 Message Date
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Sergei Morozov
5bccf7ad1d DBZ-2688: DropViewParserListener should respect the skipViews flag 2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359 DBZ-2670 Modify testing approach 2020-10-21 17:41:22 +02:00
karamel
4898d18184 DBZ-2670 Allow non-Ascii characters in MySQL ids 2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
John Martin
4fe4aed24f DBZ-2643 Only set filter info in offsets when snapshot.new.tables = parallel 2020-10-14 16:53:04 +02:00
Jiri Pechanec
2270d23adb DBZ-2641 BLOB type has dimension 2020-10-08 09:01:23 +02:00
Jiri Pechanec
dd6e10b92b DBZ-2604 Query charset name in lowercase 2020-10-06 11:41:06 +02:00
Jiri Pechanec
cc09f164b9 DBZ-2604 Use default db charset as default table charset 2020-10-06 11:41:06 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Peter Junos
ab7db1ddca DBZ-2583 MySQL connector - ignore statement-based logs
Current mysql debezium connector fails once it sees an event generated
with statement or mixed based replication.

As users and programs can call SET SESSION binlog_format='STATEMENT'; as
they wish, they are able to break debezium connector. Only MySQL 8.0.14
is fixing this, but not everyone is on that version.

To prevent connector crashing in such cases, there should be an option
to log these issues and continue. That would be similar to processing
inconsistent schema (on the setting level).
2020-09-29 15:55:15 +02:00
Gunnar Morling
3d12616627 DBZ-2563 Avoiding dependency from MySqlValueConverters to BinlogReader 2020-09-29 10:36:33 +02:00
Gunnar Morling
87d70cb96d DBZ-2563 Simplifying MySqlValueConverters constructors 2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058 DBZ-2563 JSON processing can ignore deserialization errors 2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792 DBZ-2588 Introducing dedicated functional interface for key/value generators;
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Aaron Brady
9468b1f074 DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it 2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78 DBZ-2466 Address Backup Lock review feedback 2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89 DBZ-2466 Percona Backup Locks option for snapshots 2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c DBZ-2466 Add Percona Server profile to assembly 2020-09-15 11:43:49 +02:00
rkerner
011c3be948 DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields 2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04 DBZ-1962 Doc fix 2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7 DBZ-1962 Introduce column.whitelist for the MySql connector 2020-09-08 17:06:29 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
Chris Cranford
00463e10c0 DBZ-2332 Fix test failures with Kafka 1.x CI
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Chris Cranford
856fd5ee34 DBZ-2173 Upgrade MySQL binlog client 0.23.1 2020-08-04 10:40:06 +02:00
Gunnar Morling
e70708a6ad DBZ-1939 Removing unused methods; reducing visbility 2020-07-30 17:53:22 +02:00
Gunnar Morling
5cb82bb7c7 DBZ-1939 Simplifying boolean logic 2020-07-30 17:53:22 +02:00
Arik Cohen
e111bd585c DBZ-1939 graceful handling of "phantom" tables 2020-07-30 17:53:22 +02:00
Gunnar Morling
c1a1f381e9 DBZ-2387 Formatting 2020-07-30 09:04:51 +02:00
Moira Tagle
bee8d30f39 DBZ-2387 fix NPE in ParallelHaltingPredicate 2020-07-30 09:04:51 +02:00
Jiri Pechanec
6e1eb61e72 DBZ-2365 LONG types have separate grammar rules 2020-07-24 08:30:40 +02:00
Jiri Pechanec
18d0143d64 DBZ-2365 Support for crss-db datatypes 2020-07-24 08:30:40 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Kewei Shang
9811b67e9a DBZ-2330 Fix null default value when NOT NULL is after DEFAULT 2020-07-15 09:14:46 +02:00
Michael Wang
d7ae30a8d1 DBZ-2305 Allow single dimension DECIMAL in CAST 2020-07-13 20:52:12 +02:00
Chris Cranford
e3abc020c9 DBZ-2238 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeAsSchemaParameter 2020-07-10 08:14:28 +02:00
Chris Cranford
a286de7d97 DBZ-2269 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeByDatatype 2020-07-09 08:23:59 +02:00
Chris Cranford
1aae3cd262 DBZ-2243 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDatabaseUsingBinlogAndNoSnapshot 2020-07-09 06:30:56 +02:00
Chris Cranford
6a8eb416a1 DBZ-2270 Fix test failure - MySqlConnectorIT#shouldNotParseQueryIfServerOptionDisabled 2020-07-09 06:29:41 +02:00
rkerner
7b2e9be0d5 DBZ-730 add MySqlDecimalIT integration test for all decimal.handling.mode/s 2020-07-09 06:26:52 +02:00
Chris Cranford
f5ab12c346 DBZ-2229 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDecimalTableInDatabaseUsingBinlogAndNoSnapshot 2020-07-08 21:56:10 +02:00
Jiri Pechanec
15c49f3fb6 DBZ-2301 Hide internal config fields 2020-07-01 15:46:17 +02:00
Jiri Pechanec
3c6f3eb75c DBZ-2278 Resolve concurrent access to the thread map 2020-06-26 08:38:59 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Jiri Pechanec
87d93d44fd DBZ-2221 Wait for keepalive thread initialization 2020-06-24 09:14:42 +02:00
Jiri Pechanec
50943f59f7 DBZ-2267 Optionality ignored while converting default value 2020-06-23 18:36:36 +02:00
Jiri Pechanec
e9355c3589 DBZ-2261 Take the full filter count into assert 2020-06-22 20:54:44 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Jiri Pechanec
dc3d251f16 DBZ-2207 Intermittnet test failure 2020-06-16 16:55:34 +02:00
Chris Cranford
d4cefaa1c2 DBZ-2177 Fix inconsistent test failure 2020-06-16 00:06:34 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Jiri Pechanec
752bed1a6f DBZ-2169 Fix test failure 2020-06-10 17:38:08 -04:00
Emmanuel
c7ef4128db
DBZ-1989 Avoid returning distorted (Milli)SecondsBehindSource values 2020-06-09 17:21:08 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
c54e377dd2 DBZ-1814 Exporting Hex and Base64 representations as string 2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific 2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21 DBZ-1814 added new binary handling mode option 2020-06-05 12:13:29 +02:00
Gunnar Morling
79a64179c1 DBZ-2140 Typo fix 2020-06-03 11:34:58 +02:00
Jiri Pechanec
71c9607944 DBZ-2140 Handle drop default value 2020-06-03 11:34:58 +02:00
Jiri Pechanec
2b67e26407 DBZ-2130 Avoid ambiguity between type and charset keyword 2020-06-03 11:04:49 +02:00
Jiri Pechanec
06f8023a54 DBZ-2130 CHARACTER keyword used also as a type 2020-06-02 15:11:53 +02:00
Jiri Pechanec
20b45f84f3 DBZ-1657 Remove duplicate option definitions 2020-05-22 12:07:29 +02:00
Debezium Builder
dc25c379e5 [maven-release-plugin] prepare for next development iteration 2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9 [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:40:25 -04:00
Jiri Pechanec
e676d715c3 DBZ-2085 Apply custom converters to default values 2020-05-18 17:27:59 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Fándly Gergő
9cea694510 DBZ-2067 Add support for ALGORITHM=INSTANT on alter table statements 2020-05-14 12:31:14 +02:00
Max Kaplan
1b89b89301 DBZ-2062 allowing compression keyword to contain backticks in create table 2020-05-14 11:21:25 +02:00
Jiri Pechanec
c4f975bd0a DBZ-2061 Handle change of default value 2020-05-14 08:31:27 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
11c8e9df3d DBZ-1953 Rework configuration files 2020-04-29 12:27:38 +02:00
Chris Cranford
230ddaebdc DBZ-1953 Generalized SkipWhenDatabaseVersion functionality 2020-04-29 12:27:38 +02:00
Chris Cranford
bcae276234 DBZ-1953 MySQL 5.5 and 5.6 added to test matrix 2020-04-29 12:27:38 +02:00
Gunnar Morling
3d0606b348 DBZ-2027 Small speed-up of PG test execution;
* Using Awaitility so we can use 100ms looping intervals; also it's more concise
* Avoiding creation of one temporary connection
2020-04-29 09:56:59 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Jiri Pechanec
0d8d6a41c5 DBZ-1750 Validate Kafka params only for Kafka history 2020-04-24 15:35:28 +02:00
Gunnar Morling
0998fc533a DBZ-1895 Completing implementation;
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Hossein Torabi
9ddd893074 DBZ-1895 Implement SKIPPED_OPERATIONS for mysql 2020-04-22 15:04:36 +02:00
Ivan Klass
75f19239d1 DBZ-1886 Introduce separate storageExists() method to support manual topic creation 2020-04-20 17:46:03 +02:00
Jos Huiting
a0f65830de DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig 2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef DBZ-1962 Introduce column.whitelist for the Postgres connector 2020-04-17 15:24:42 +02:00
Chris Cranford
e7d7456a3f DBZ-1947 Remove obsolete MySQL metrics 2020-04-16 09:31:29 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00
Jiri Pechanec
318d1d3cc7 DBZ-1905 Make thread-naming params internal and optional 2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1 DBZ-1905 Validate database history topic 2020-04-08 12:18:32 +02:00
Chris Cranford
35eaf9828f DBZ-1950 Make validation of binlog_row_image compatible with MySQL 5.5 2020-04-08 10:28:12 +02:00
Chris Cranford
44bdf429c5 DBZ-1926 Properly log failed SQL during snapshot failure 2020-04-07 08:36:22 +02:00
Jiri Pechanec
242f50b2f3 DBZ-1932 Snapshot events calculated from table stats 2020-04-06 08:52:30 +02:00
Gunnar Morling
3d58d6cf32 DBZ-1911 Formatting; adding Nayana Hettiarachchi to authors list 2020-03-31 13:37:54 +02:00
Nayana Hettiarachchi
2c6e33ac76 DBZ-1911 - improve error messaging for binlog configuration validation 2020-03-31 13:34:06 +02:00
Gunnar Morling
89bb6eba6c DBZ-1531 Misc. clean-up;
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Gunnar Morling
aaffae2964 DBZ-1531 Typo fix 2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f [maven-release-plugin] prepare for next development iteration 2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:23:05 -04:00
Debezium Builder
86c1ed90ed [maven-release-plugin] prepare for next development iteration 2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 09:54:44 -04:00
Gunnar Morling
c156d30048 DBZ-1723 Centralizing stopping() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597 DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Jiri Pechanec
082761effc DBZ-1856 Deprecation process is not necessary 2020-03-11 12:02:07 +01:00
Fabio Cantarini
62b46ae596 DBZ-1830 Enhancement to datatype.propagate.source.type connector property
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32 DBZ-1830 Add support for new connector property datatype.propagate.source.type 2020-03-10 14:58:16 +01:00
Chris Cranford
01b4137a13 DBZ-1664 Fix metrics test failures 2020-03-09 23:30:24 +01:00
Chris Cranford
5506fadd2d DBZ-1664 Verify correctness of JMX metrics 2020-03-09 23:30:24 +01:00
Ruslan Gibaiev
4e45347f8e DBZ-1833 - CREATE TABLE [IF NOT EXISTS] shouldn't update state for existing table 2020-03-03 13:11:03 +01:00
Jiri Pechanec
504648d367 DBZ-1801 Fix typo
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2020-03-03 12:14:16 +01:00
Jiri Pechanec
51b9a732b9 DBZ-1801 TinyInt1 to boolean converter 2020-03-03 12:14:16 +01:00
Jiri Pechanec
e4b4aa818a DBZ-1834 Support for escaping 2020-03-03 10:56:19 +01:00
Jiri Pechanec
0f11f7e6de DBZ-1834 Support separately quoted schema and table 2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29 DBZ-1834 Support dots in table names 2020-03-03 10:56:19 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
1b77cf21b6 DBZ-1826 Avoid default false warning with default value 2020-02-26 16:55:19 +01:00
Gunnar Morling
c7c7183b11 DBZ-1826 Formatting 2020-02-26 15:49:26 +01:00
Jiri Pechanec
06049a5e9d DBZ-1826 Rename error handling config field 2020-02-26 15:49:26 +01:00
Jiri Pechanec
e3ce802c36 DBZ-1705 Switch new GTID process to earliest 2020-02-25 16:19:22 +01:00
Jiri Pechanec
f0cc055833 DBZ-1773 Change test for null value 2020-02-17 16:40:52 +01:00
Jiri Pechanec
a4d3c1e89a DBZ-1773 Process TINYINT(1) as number 2020-02-17 16:40:52 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Aykut Farsak
26cdc58efc
Fixing missing whitespace in exception message 2020-02-06 17:23:29 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00