Commit Graph

1036 Commits

Author SHA1 Message Date
Gunnar Morling
87d70cb96d DBZ-2563 Simplifying MySqlValueConverters constructors 2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058 DBZ-2563 JSON processing can ignore deserialization errors 2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792 DBZ-2588 Introducing dedicated functional interface for key/value generators;
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Aaron Brady
9468b1f074 DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it 2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78 DBZ-2466 Address Backup Lock review feedback 2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89 DBZ-2466 Percona Backup Locks option for snapshots 2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c DBZ-2466 Add Percona Server profile to assembly 2020-09-15 11:43:49 +02:00
rkerner
011c3be948 DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields 2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04 DBZ-1962 Doc fix 2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7 DBZ-1962 Introduce column.whitelist for the MySql connector 2020-09-08 17:06:29 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
Chris Cranford
00463e10c0 DBZ-2332 Fix test failures with Kafka 1.x CI
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Chris Cranford
856fd5ee34 DBZ-2173 Upgrade MySQL binlog client 0.23.1 2020-08-04 10:40:06 +02:00
Gunnar Morling
e70708a6ad DBZ-1939 Removing unused methods; reducing visbility 2020-07-30 17:53:22 +02:00
Gunnar Morling
5cb82bb7c7 DBZ-1939 Simplifying boolean logic 2020-07-30 17:53:22 +02:00
Arik Cohen
e111bd585c DBZ-1939 graceful handling of "phantom" tables 2020-07-30 17:53:22 +02:00
Gunnar Morling
c1a1f381e9 DBZ-2387 Formatting 2020-07-30 09:04:51 +02:00
Moira Tagle
bee8d30f39 DBZ-2387 fix NPE in ParallelHaltingPredicate 2020-07-30 09:04:51 +02:00
Jiri Pechanec
6e1eb61e72 DBZ-2365 LONG types have separate grammar rules 2020-07-24 08:30:40 +02:00
Jiri Pechanec
18d0143d64 DBZ-2365 Support for crss-db datatypes 2020-07-24 08:30:40 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Kewei Shang
9811b67e9a DBZ-2330 Fix null default value when NOT NULL is after DEFAULT 2020-07-15 09:14:46 +02:00
Michael Wang
d7ae30a8d1 DBZ-2305 Allow single dimension DECIMAL in CAST 2020-07-13 20:52:12 +02:00
Chris Cranford
e3abc020c9 DBZ-2238 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeAsSchemaParameter 2020-07-10 08:14:28 +02:00
Chris Cranford
a286de7d97 DBZ-2269 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeByDatatype 2020-07-09 08:23:59 +02:00
Chris Cranford
1aae3cd262 DBZ-2243 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDatabaseUsingBinlogAndNoSnapshot 2020-07-09 06:30:56 +02:00
Chris Cranford
6a8eb416a1 DBZ-2270 Fix test failure - MySqlConnectorIT#shouldNotParseQueryIfServerOptionDisabled 2020-07-09 06:29:41 +02:00
rkerner
7b2e9be0d5 DBZ-730 add MySqlDecimalIT integration test for all decimal.handling.mode/s 2020-07-09 06:26:52 +02:00
Chris Cranford
f5ab12c346 DBZ-2229 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDecimalTableInDatabaseUsingBinlogAndNoSnapshot 2020-07-08 21:56:10 +02:00
Jiri Pechanec
15c49f3fb6 DBZ-2301 Hide internal config fields 2020-07-01 15:46:17 +02:00
Jiri Pechanec
3c6f3eb75c DBZ-2278 Resolve concurrent access to the thread map 2020-06-26 08:38:59 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00
Debezium Builder
c0d30b87d9 [maven-release-plugin] prepare for next development iteration 2020-06-24 18:03:11 +02:00
Debezium Builder
0e2ac78301 [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:03:11 +02:00
Jiri Pechanec
87d93d44fd DBZ-2221 Wait for keepalive thread initialization 2020-06-24 09:14:42 +02:00
Jiri Pechanec
50943f59f7 DBZ-2267 Optionality ignored while converting default value 2020-06-23 18:36:36 +02:00
Jiri Pechanec
e9355c3589 DBZ-2261 Take the full filter count into assert 2020-06-22 20:54:44 +02:00
Debezium Builder
b03a4d0e50 [maven-release-plugin] prepare for next development iteration 2020-06-19 00:39:01 -04:00
Debezium Builder
93e60258d5 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:39:00 -04:00
Jiri Pechanec
dc3d251f16 DBZ-2207 Intermittnet test failure 2020-06-16 16:55:34 +02:00
Chris Cranford
d4cefaa1c2 DBZ-2177 Fix inconsistent test failure 2020-06-16 00:06:34 +02:00
Debezium Builder
65c39e9f11 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:00:20 -04:00
Debezium Builder
bce332c900 [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:00:19 -04:00
Jiri Pechanec
752bed1a6f DBZ-2169 Fix test failure 2020-06-10 17:38:08 -04:00
Emmanuel
c7ef4128db
DBZ-1989 Avoid returning distorted (Milli)SecondsBehindSource values 2020-06-09 17:21:08 +02:00
Balázs Németh
0853940f3d
DBZ-2169 Fix for misuse of ConfigurationDefaults.RETURN_CONTROL_INTERVAL;
* Implemented Temporals.min()
* Fixed pollInterval calculation based on the documentation
2020-06-09 10:24:50 +02:00
Gunnar Morling
c54e377dd2 DBZ-1814 Exporting Hex and Base64 representations as string 2020-06-05 12:13:29 +02:00
Gunnar Morling
023064eedb DBZ-1814 Renaming "raw" to "bytes"; also clarifying that this notion isn't Java-specific 2020-06-05 12:13:29 +02:00
Jeremy Finzel
5db614da21 DBZ-1814 added new binary handling mode option 2020-06-05 12:13:29 +02:00
Gunnar Morling
79a64179c1 DBZ-2140 Typo fix 2020-06-03 11:34:58 +02:00
Jiri Pechanec
71c9607944 DBZ-2140 Handle drop default value 2020-06-03 11:34:58 +02:00
Jiri Pechanec
2b67e26407 DBZ-2130 Avoid ambiguity between type and charset keyword 2020-06-03 11:04:49 +02:00
Jiri Pechanec
06f8023a54 DBZ-2130 CHARACTER keyword used also as a type 2020-06-02 15:11:53 +02:00
Jiri Pechanec
20b45f84f3 DBZ-1657 Remove duplicate option definitions 2020-05-22 12:07:29 +02:00
Debezium Builder
dc25c379e5 [maven-release-plugin] prepare for next development iteration 2020-05-19 03:40:25 -04:00
Debezium Builder
ad060181b9 [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:40:25 -04:00
Jiri Pechanec
e676d715c3 DBZ-2085 Apply custom converters to default values 2020-05-18 17:27:59 +02:00
Jiri Pechanec
97c3d3b6e9 DBZ-2088 Use POSIX tar 2020-05-18 14:29:38 +02:00
Fándly Gergő
9cea694510 DBZ-2067 Add support for ALGORITHM=INSTANT on alter table statements 2020-05-14 12:31:14 +02:00
Max Kaplan
1b89b89301 DBZ-2062 allowing compression keyword to contain backticks in create table 2020-05-14 11:21:25 +02:00
Jiri Pechanec
c4f975bd0a DBZ-2061 Handle change of default value 2020-05-14 08:31:27 +02:00
Chris Cranford
f449550b2d DBZ-2068 Skip tests incompatible with Kafka 1.x 2020-05-13 08:22:07 +02:00
Debezium Builder
8d4203279e [maven-release-plugin] prepare for next development iteration 2020-05-07 05:03:40 -04:00
Debezium Builder
a4e2c8f36c [maven-release-plugin] prepare release v1.2.0.Beta1 2020-05-07 05:03:40 -04:00
Jiri Pechanec
e350d74b17 DBZ-1904 Public facing schema history topic 2020-05-04 12:31:05 +02:00
Chris Cranford
11c8e9df3d DBZ-1953 Rework configuration files 2020-04-29 12:27:38 +02:00
Chris Cranford
230ddaebdc DBZ-1953 Generalized SkipWhenDatabaseVersion functionality 2020-04-29 12:27:38 +02:00
Chris Cranford
bcae276234 DBZ-1953 MySQL 5.5 and 5.6 added to test matrix 2020-04-29 12:27:38 +02:00
Gunnar Morling
3d0606b348 DBZ-2027 Small speed-up of PG test execution;
* Using Awaitility so we can use 100ms looping intervals; also it's more concise
* Avoiding creation of one temporary connection
2020-04-29 09:56:59 +02:00
JanHendrikDolling
33d83731af DBZ-1972 move static Filed methods as static Filed constant to RelationalDatabaseConnectorConfig instead. 2020-04-27 12:31:19 +02:00
Jiri Pechanec
0d8d6a41c5 DBZ-1750 Validate Kafka params only for Kafka history 2020-04-24 15:35:28 +02:00
Gunnar Morling
0998fc533a DBZ-1895 Completing implementation;
* Restoring original derserializers; excluding skipped events in event handlers
* Adding test
2020-04-22 15:04:36 +02:00
Hossein Torabi
9ddd893074 DBZ-1895 Implement SKIPPED_OPERATIONS for mysql 2020-04-22 15:04:36 +02:00
Ivan Klass
75f19239d1 DBZ-1886 Introduce separate storageExists() method to support manual topic creation 2020-04-20 17:46:03 +02:00
Jos Huiting
a0f65830de DBZ-1962 Remove TABLE_WHITELIST and TABLE_BLACKLIST in favor of definitions in RelationalDatabaseConnectorConfig 2020-04-17 15:24:42 +02:00
Jos Huiting
8ba21a98ef DBZ-1962 Introduce column.whitelist for the Postgres connector 2020-04-17 15:24:42 +02:00
Chris Cranford
e7d7456a3f DBZ-1947 Remove obsolete MySQL metrics 2020-04-16 09:31:29 +02:00
Debezium Builder
4ca9f92575 [maven-release-plugin] prepare for next development iteration 2020-04-16 02:22:00 -04:00
Debezium Builder
e704bccdaa [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:22:00 -04:00
JanHendrikDolling
1e19270981 DBZ-1692 Added support for hash based column masking mode for string values 2020-04-08 21:21:42 +02:00
Jiri Pechanec
318d1d3cc7 DBZ-1905 Make thread-naming params internal and optional 2020-04-08 12:18:32 +02:00
Jiri Pechanec
e81aec0ed1 DBZ-1905 Validate database history topic 2020-04-08 12:18:32 +02:00
Chris Cranford
35eaf9828f DBZ-1950 Make validation of binlog_row_image compatible with MySQL 5.5 2020-04-08 10:28:12 +02:00
Chris Cranford
44bdf429c5 DBZ-1926 Properly log failed SQL during snapshot failure 2020-04-07 08:36:22 +02:00
Jiri Pechanec
242f50b2f3 DBZ-1932 Snapshot events calculated from table stats 2020-04-06 08:52:30 +02:00
Gunnar Morling
3d58d6cf32 DBZ-1911 Formatting; adding Nayana Hettiarachchi to authors list 2020-03-31 13:37:54 +02:00
Nayana Hettiarachchi
2c6e33ac76 DBZ-1911 - improve error messaging for binlog configuration validation 2020-03-31 13:34:06 +02:00
Gunnar Morling
89bb6eba6c DBZ-1531 Misc. clean-up;
* Removing obsolete default impl
* Completing test
* Documention fixes
2020-03-25 12:33:38 +01:00
rk3rn3r
7f36b3c08f DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Gunnar Morling
aaffae2964 DBZ-1531 Typo fix 2020-03-25 12:33:38 +01:00
rk3rn3r
6310e00675 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
rk3rn3r
fbd8b94e94 DBZ-1531 added headers for primary key update events to reference the original key 2020-03-25 12:33:38 +01:00
Debezium Builder
ab54ce062f [maven-release-plugin] prepare for next development iteration 2020-03-24 01:23:05 -04:00
Debezium Builder
0b5a9117fb [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:23:05 -04:00
Debezium Builder
86c1ed90ed [maven-release-plugin] prepare for next development iteration 2020-03-11 09:54:44 -04:00
Debezium Builder
062c6abbe5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 09:54:44 -04:00
Gunnar Morling
c156d30048 DBZ-1723 Centralizing stopping() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Gunnar Morling
8ce69dc597 DBZ-1723 Encapsulating common poll() and stop() logic in BaseSourceTask 2020-03-11 13:57:23 +01:00
Jiri Pechanec
082761effc DBZ-1856 Deprecation process is not necessary 2020-03-11 12:02:07 +01:00
Fabio Cantarini
62b46ae596 DBZ-1830 Enhancement to datatype.propagate.source.type connector property
Add support for matching db and table name
Amend documentation accordingly
2020-03-10 14:58:16 +01:00
Fabio Cantarini
61cc791d32 DBZ-1830 Add support for new connector property datatype.propagate.source.type 2020-03-10 14:58:16 +01:00
Chris Cranford
01b4137a13 DBZ-1664 Fix metrics test failures 2020-03-09 23:30:24 +01:00
Chris Cranford
5506fadd2d DBZ-1664 Verify correctness of JMX metrics 2020-03-09 23:30:24 +01:00
Ruslan Gibaiev
4e45347f8e DBZ-1833 - CREATE TABLE [IF NOT EXISTS] shouldn't update state for existing table 2020-03-03 13:11:03 +01:00
Jiri Pechanec
504648d367 DBZ-1801 Fix typo
Co-Authored-By: Gunnar Morling <gunnar.morling@googlemail.com>
2020-03-03 12:14:16 +01:00
Jiri Pechanec
51b9a732b9 DBZ-1801 TinyInt1 to boolean converter 2020-03-03 12:14:16 +01:00
Jiri Pechanec
e4b4aa818a DBZ-1834 Support for escaping 2020-03-03 10:56:19 +01:00
Jiri Pechanec
0f11f7e6de DBZ-1834 Support separately quoted schema and table 2020-03-03 10:56:19 +01:00
Jiri Pechanec
c201578d29 DBZ-1834 Support dots in table names 2020-03-03 10:56:19 +01:00
Jiri Pechanec
06e1eca085 DBZ-1134 Support for user provided converters 2020-02-28 21:58:39 +01:00
Jiri Pechanec
1b77cf21b6 DBZ-1826 Avoid default false warning with default value 2020-02-26 16:55:19 +01:00
Gunnar Morling
c7c7183b11 DBZ-1826 Formatting 2020-02-26 15:49:26 +01:00
Jiri Pechanec
06049a5e9d DBZ-1826 Rename error handling config field 2020-02-26 15:49:26 +01:00
Jiri Pechanec
e3ce802c36 DBZ-1705 Switch new GTID process to earliest 2020-02-25 16:19:22 +01:00
Jiri Pechanec
f0cc055833 DBZ-1773 Change test for null value 2020-02-17 16:40:52 +01:00
Jiri Pechanec
a4d3c1e89a DBZ-1773 Process TINYINT(1) as number 2020-02-17 16:40:52 +01:00
Debezium Builder
f75746fb7b [maven-release-plugin] prepare for next development iteration 2020-02-13 03:18:20 -05:00
Debezium Builder
1d2df32743 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:18:20 -05:00
Gunnar Morling
dd5c2b8be9 DBZ-1766 Unifying handling of offset commits 2020-02-12 15:44:45 +01:00
Aykut Farsak
26cdc58efc
Fixing missing whitespace in exception message 2020-02-06 17:23:29 +01:00
Debezium Builder
9c424b2404 [maven-release-plugin] prepare for next development iteration 2020-02-05 08:54:52 -05:00
Debezium Builder
9f2caa3b7c [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 08:54:52 -05:00
Jiri Pechanec
ba10a229b6 DBZ-1052 CE support for tx metadata in data messages 2020-02-03 09:29:10 +01:00
Jiri Pechanec
60056b0a94 DBZ-1052 Transaction block moved to envelope 2020-02-03 09:29:10 +01:00
Jiri Pechanec
b0eb571f9f DBZ-1052 Transaction metadata for SQL Server 2020-02-03 09:29:10 +01:00
Debezium Builder
274bba9dc9 [maven-release-plugin] prepare for next development iteration 2020-01-16 05:40:24 -05:00
Debezium Builder
076df30108 [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:40:24 -05:00
Gunnar Morling
8c33a4e147 DBZ-1292 Catering for the differences in data schema;
* MongoDB doesn't have "before", but "patch"
* Also removing some redundancies and making RecordParser immutable
* Reducing log verbosity during tests
2020-01-16 08:01:56 +01:00
Gunnar Morling
7c18a6d8d5 DBZ-1292 Removing static state in CloudEventsConverterTest 2020-01-16 08:00:45 +01:00
GraySmog
d0e4b3c0af DBZ-1292 Delete data.schema.registry.url config option 2020-01-16 08:00:45 +01:00
GraySmog
915c8cafd9 DBZ-1292 CloudEvents converter for JSON and Avro format 2020-01-16 08:00:45 +01:00
Chris Cranford
1ec377224a DBZ-1712 MySQL connector use default port when database.port option not specified 2020-01-15 21:24:55 +01:00
Jiri Pechanec
88e280d89e DBZ-1693 Replace other instances of schema with catalog 2020-01-10 22:02:49 +01:00
Jiri Pechanec
6163f46585 DBZ-1693 Use corrent TableId component 2020-01-10 22:02:49 +01:00
Vasily Ulianko
8e342bea84 DBZ-1689 Allow setting boolean as default value for INT 2020-01-02 11:55:22 +01:00
Debezium Builder
9723c93db9 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:44:33 -05:00
Debezium Builder
09049516f2 [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:44:33 -05:00
Gunnar Morling
f5b563ff87 DBZ-1671 Propagating exception instead of message only 2019-12-17 07:25:51 +01:00
John Martin
fc24de8dde DBZ-1671 add innodb_lock_wait_timeout and update info log 2019-12-17 07:23:29 +01:00
John Martin
3f006f8c0e DBZ-1671 Adding configurable lock_wait_timeout for mysql connector SnapshotReader 2019-12-17 07:23:29 +01:00