Commit Graph

1044 Commits

Author SHA1 Message Date
Jiri Pechanec
e9ed4a0a2a DBZ-3086 Remove parallel snapshot reader offsets 2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e DBZ-3086 Separate legacy and new SourceInfo 2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f DBZ-3077 Unified record creation 2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
f63d08fc28 DBZ-3023 Handle default charsets for table 2021-02-05 05:44:14 +01:00
Jiri Pechanec
ed7a1c2486 DBZ-3047 Run the test after legacy package 2021-02-05 05:44:06 +01:00
Jiri Pechanec
c9fd39d04c DBZ-1865 Support for when_needed snapshot 2021-02-04 09:07:55 +01:00
Jiri Pechanec
f57343dc3b DBZ-1865 Use OptionaLong; add comments 2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
Jiri Pechanec
23c1546362 DBZ-1865 Modify metrics to conform to new classes 2021-02-04 09:07:55 +01:00
Jiri Pechanec
d333c9f005 DBZ-1865 Move legacy classes into separate package 2021-02-04 09:07:55 +01:00
Jiri Pechanec
5e887b2bfb DBZ-3020 Ignore expressions in default values 2021-02-03 10:12:09 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
rkerner
89cc1d7003 DBZ-3008 Fix that an invalid regex for database.inlcude.list and database.exlcude.list does not raise a validation error for MySQL connector and the connector only fails on start, also the config validated before
closes https://issues.redhat.com/browse/DBZ-3008
2021-02-01 18:38:54 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
Jiri Pechanec
5092f327d8 DBZ-2922 DatabaseLocales generates the DDL 2021-01-27 10:40:21 +01:00
Jiri Pechanec
8153404033 DBZ-2922 Support for cahrsets from collations 2021-01-27 10:40:21 +01:00
shuguang.xiang
363c794185 DBZ-2922 Resolve column type from collation name 2021-01-27 10:40:21 +01:00
Gunnar Morling
b5bb534429 DBZ-2921 Removing superfluous author tag 2021-01-14 15:52:18 +01:00
Jiri Pechanec
ff4fe78037 DBZ-2921 Record default database charset in history 2021-01-14 15:52:18 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
Jiri Pechanec
fbfba94027 DBZ-2167 Remove superfluous char
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-12-21 16:30:15 +01:00
Jiri Pechanec
58713599ba DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL 2020-12-21 16:30:15 +01:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Jiri Pechanec
a967afbd1a DBZ-2821 Support for CHAR VARYING use 2020-12-04 10:34:49 +01:00
Jiri Pechanec
b7fede7d53 DBZ-735 Verify Avro serialization 2020-11-27 17:33:23 +01:00
John Martin
f069cd6f3f DBZ-2775 add option for setting snapshot events as reads 2020-11-20 07:46:07 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
rkerner
9c5db0cd2f DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined 2020-11-12 07:42:48 +01:00
Kewei Shang
78c061a86d DBZ-2726 extend data separator and time separator 2020-11-10 10:01:33 +01:00
Kewei Shang
7e44a3068a DBZ-2726 Clean MySQL TIMESTAMP default value 2020-11-10 10:01:33 +01:00
Jiri Pechanec
b9a6bb35b8 DBZ-2673 Added comment; use defensive equals 2020-11-03 08:02:06 +01:00
Arik Cohen
e44b76fb9d DBZ-2673 Read the raw bytes of a character-type field 2020-11-03 08:02:06 +01:00
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Sergei Morozov
5bccf7ad1d DBZ-2688: DropViewParserListener should respect the skipViews flag 2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359 DBZ-2670 Modify testing approach 2020-10-21 17:41:22 +02:00
karamel
4898d18184 DBZ-2670 Allow non-Ascii characters in MySQL ids 2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
John Martin
4fe4aed24f DBZ-2643 Only set filter info in offsets when snapshot.new.tables = parallel 2020-10-14 16:53:04 +02:00
Jiri Pechanec
2270d23adb DBZ-2641 BLOB type has dimension 2020-10-08 09:01:23 +02:00
Jiri Pechanec
dd6e10b92b DBZ-2604 Query charset name in lowercase 2020-10-06 11:41:06 +02:00
Jiri Pechanec
cc09f164b9 DBZ-2604 Use default db charset as default table charset 2020-10-06 11:41:06 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Peter Junos
ab7db1ddca DBZ-2583 MySQL connector - ignore statement-based logs
Current mysql debezium connector fails once it sees an event generated
with statement or mixed based replication.

As users and programs can call SET SESSION binlog_format='STATEMENT'; as
they wish, they are able to break debezium connector. Only MySQL 8.0.14
is fixing this, but not everyone is on that version.

To prevent connector crashing in such cases, there should be an option
to log these issues and continue. That would be similar to processing
inconsistent schema (on the setting level).
2020-09-29 15:55:15 +02:00
Gunnar Morling
3d12616627 DBZ-2563 Avoiding dependency from MySqlValueConverters to BinlogReader 2020-09-29 10:36:33 +02:00
Gunnar Morling
87d70cb96d DBZ-2563 Simplifying MySqlValueConverters constructors 2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058 DBZ-2563 JSON processing can ignore deserialization errors 2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792 DBZ-2588 Introducing dedicated functional interface for key/value generators;
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Aaron Brady
9468b1f074 DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it 2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78 DBZ-2466 Address Backup Lock review feedback 2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89 DBZ-2466 Percona Backup Locks option for snapshots 2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c DBZ-2466 Add Percona Server profile to assembly 2020-09-15 11:43:49 +02:00
rkerner
011c3be948 DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields 2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04 DBZ-1962 Doc fix 2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7 DBZ-1962 Introduce column.whitelist for the MySql connector 2020-09-08 17:06:29 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00
Gunnar Morling
44efd1bc6b DBZ-2423 Propagating port default values 2020-08-12 13:50:42 +02:00
Debezium Builder
c4c50f5fc6 [maven-release-plugin] prepare for next development iteration 2020-08-06 00:46:18 -04:00
Debezium Builder
94cbeb95fa [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:46:17 -04:00
Chris Cranford
00463e10c0 DBZ-2332 Fix test failures with Kafka 1.x CI
MySqlDecimalIT#testPreciseDecimalHandlingMode
SqlServerConnectorIT#restartInTheMiddleOfTx
2020-08-04 23:21:23 +02:00
Chris Cranford
856fd5ee34 DBZ-2173 Upgrade MySQL binlog client 0.23.1 2020-08-04 10:40:06 +02:00
Gunnar Morling
e70708a6ad DBZ-1939 Removing unused methods; reducing visbility 2020-07-30 17:53:22 +02:00
Gunnar Morling
5cb82bb7c7 DBZ-1939 Simplifying boolean logic 2020-07-30 17:53:22 +02:00
Arik Cohen
e111bd585c DBZ-1939 graceful handling of "phantom" tables 2020-07-30 17:53:22 +02:00
Gunnar Morling
c1a1f381e9 DBZ-2387 Formatting 2020-07-30 09:04:51 +02:00
Moira Tagle
bee8d30f39 DBZ-2387 fix NPE in ParallelHaltingPredicate 2020-07-30 09:04:51 +02:00
Jiri Pechanec
6e1eb61e72 DBZ-2365 LONG types have separate grammar rules 2020-07-24 08:30:40 +02:00
Jiri Pechanec
18d0143d64 DBZ-2365 Support for crss-db datatypes 2020-07-24 08:30:40 +02:00
Debezium Builder
e1ab38de84 [maven-release-plugin] prepare for next development iteration 2020-07-16 04:40:04 -04:00
Debezium Builder
69cf375faa [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:40:04 -04:00
Kewei Shang
9811b67e9a DBZ-2330 Fix null default value when NOT NULL is after DEFAULT 2020-07-15 09:14:46 +02:00
Michael Wang
d7ae30a8d1 DBZ-2305 Allow single dimension DECIMAL in CAST 2020-07-13 20:52:12 +02:00
Chris Cranford
e3abc020c9 DBZ-2238 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeAsSchemaParameter 2020-07-10 08:14:28 +02:00
Chris Cranford
a286de7d97 DBZ-2269 Fix test failure - MySqlSourceTypeInSchemaIT#shouldPropagateSourceTypeByDatatype 2020-07-09 08:23:59 +02:00
Chris Cranford
1aae3cd262 DBZ-2243 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDatabaseUsingBinlogAndNoSnapshot 2020-07-09 06:30:56 +02:00
Chris Cranford
6a8eb416a1 DBZ-2270 Fix test failure - MySqlConnectorIT#shouldNotParseQueryIfServerOptionDisabled 2020-07-09 06:29:41 +02:00
rkerner
7b2e9be0d5 DBZ-730 add MySqlDecimalIT integration test for all decimal.handling.mode/s 2020-07-09 06:26:52 +02:00
Chris Cranford
f5ab12c346 DBZ-2229 Fix test failure - MySqlConnectorRegressionIT#shouldConsumeAllEventsFromDecimalTableInDatabaseUsingBinlogAndNoSnapshot 2020-07-08 21:56:10 +02:00
Jiri Pechanec
15c49f3fb6 DBZ-2301 Hide internal config fields 2020-07-01 15:46:17 +02:00
Jiri Pechanec
3c6f3eb75c DBZ-2278 Resolve concurrent access to the thread map 2020-06-26 08:38:59 +02:00
Randall Hauch
5860812a63
DBZ-2275 Updated default database history DML filter default to handle additional RDS statements;
* Added two more regular expressions to the default database history DML filter. These are intended to catch and filter out `INSERT into mysql.rds_monitor…` statements that RDS may write in the binlog
* Added a new unit test that checks that the regular expressions do catch some example statements
2020-06-25 20:57:49 +02:00