Commit Graph

1069 Commits

Author SHA1 Message Date
Nitin Agarwal
fd1ceeb02e DBZ-3114 Transaction metadata feature in MySQL connector 2021-02-18 12:41:34 +01:00
ani-sha
b6c61ac810 DBZ-2788 Replace MySQL connector option with SMT for mitigating wrong op flag 2021-02-18 12:35:03 +01:00
Gunnar Morling
184d1a2399 DBZ-3056 Misc. clean-up 2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a DBZ-3099 Doc fix 2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c DBZ-3099 Document non-volatile fields accessed by a single thread 2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d DBZ-3099 Address review comments; extract history comparator for testability 2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18 DBZ-3099 Address review comments 2021-02-16 10:02:17 +01:00
Gunnar Morling
5ca1d9fc4f DBZ-3099 Preferring explicit functional interface over Function 2021-02-16 10:02:17 +01:00
Jiri Pechanec
2af13af300 DBZ-3099 Streaming source test for new impl only 2021-02-16 10:02:17 +01:00
Jiri Pechanec
c53082f94f DBZ-3099 Fix typos 2021-02-16 10:02:17 +01:00
Jiri Pechanec
b0f906df35 DBZ-3099 Race condition in waiting for metrics 2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2 DBZ-3099 Snapshot buffering to handle config corner cases 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7394ecfd62 DBZ-3099 Make streaming MBean name configurable in tests 2021-02-16 10:02:17 +01:00
Jiri Pechanec
048530aeb8 DBZ-3099 Make metrics tests running with legacy 2021-02-16 10:02:17 +01:00
Jiri Pechanec
ea247b710d DBZ-3099 Rewritten reader tests to connector 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544 DBZ-3099 Fix schema recovery; Add table level locking 2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72 DBZ-3093 Unify snapshot and streaming parsing 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7bfbd5c7c5 DBZ-3093 Dispatch schema change events always 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13 DBZ-3093 Separate parsing and change applying phase in MySQL schema 2021-02-16 10:02:17 +01:00
Jiri Pechanec
5bf5e18d81 DBZ-3086 Legacy source info make for legacy tests 2021-02-16 10:02:16 +01:00
Jiri Pechanec
f01af4bec8 DBZ-3086 Source info formatting for legacy implementation 2021-02-16 10:02:16 +01:00
Jiri Pechanec
14a628ed60 DBZ-3086 Mark moved method as deprecated 2021-02-16 10:02:16 +01:00
Jiri Pechanec
a43bae7638 DBZ-3086 Separate offset and source info 2021-02-16 10:02:16 +01:00
Jiri Pechanec
e9ed4a0a2a DBZ-3086 Remove parallel snapshot reader offsets 2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e DBZ-3086 Separate legacy and new SourceInfo 2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f DBZ-3077 Unified record creation 2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Debezium Builder
e08df0a177 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:25:23 -05:00
Debezium Builder
da0411bf70 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:25:23 -05:00
Jiri Pechanec
f63d08fc28 DBZ-3023 Handle default charsets for table 2021-02-05 05:44:14 +01:00
Jiri Pechanec
ed7a1c2486 DBZ-3047 Run the test after legacy package 2021-02-05 05:44:06 +01:00
Jiri Pechanec
c9fd39d04c DBZ-1865 Support for when_needed snapshot 2021-02-04 09:07:55 +01:00
Jiri Pechanec
f57343dc3b DBZ-1865 Use OptionaLong; add comments 2021-02-04 09:07:55 +01:00
Jiri Pechanec
2374b6b045 DBZ-1865 First draft of MySQL rewrite 2021-02-04 09:07:55 +01:00
Jiri Pechanec
23c1546362 DBZ-1865 Modify metrics to conform to new classes 2021-02-04 09:07:55 +01:00
Jiri Pechanec
d333c9f005 DBZ-1865 Move legacy classes into separate package 2021-02-04 09:07:55 +01:00
Jiri Pechanec
5e887b2bfb DBZ-3020 Ignore expressions in default values 2021-02-03 10:12:09 +01:00
ani-sha
d4003c9172 DBZ-2420 Define database configs under RelationalDatabaseConnectorConfig 2021-02-03 08:05:42 +01:00
rkerner
89cc1d7003 DBZ-3008 Fix that an invalid regex for database.inlcude.list and database.exlcude.list does not raise a validation error for MySQL connector and the connector only fails on start, also the config validated before
closes https://issues.redhat.com/browse/DBZ-3008
2021-02-01 18:38:54 +01:00
Debezium Builder
237b4ac0f1 [maven-release-plugin] prepare for next development iteration 2021-01-28 07:38:55 -05:00
Debezium Builder
06b1d0cbad [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:38:55 -05:00
Jiri Pechanec
5092f327d8 DBZ-2922 DatabaseLocales generates the DDL 2021-01-27 10:40:21 +01:00
Jiri Pechanec
8153404033 DBZ-2922 Support for cahrsets from collations 2021-01-27 10:40:21 +01:00
shuguang.xiang
363c794185 DBZ-2922 Resolve column type from collation name 2021-01-27 10:40:21 +01:00
Gunnar Morling
b5bb534429 DBZ-2921 Removing superfluous author tag 2021-01-14 15:52:18 +01:00
Jiri Pechanec
ff4fe78037 DBZ-2921 Record default database charset in history 2021-01-14 15:52:18 +01:00
Debezium Builder
3010f99c32 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:38:13 -05:00
Debezium Builder
54534538d9 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:38:13 -05:00
Jiri Pechanec
fbfba94027 DBZ-2167 Remove superfluous char
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2020-12-21 16:30:15 +01:00
Jiri Pechanec
58713599ba DBZ-2167 Remove legacy parser completely; tests depending on parser move to MySQL 2020-12-21 16:30:15 +01:00
Debezium Builder
b1ab996c3e [maven-release-plugin] prepare for next development iteration 2020-12-16 14:11:31 -05:00
Debezium Builder
8fc864b278 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:11:31 -05:00
Debezium Builder
cf921f56b4 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:27:40 -05:00
Debezium Builder
c49a377487 [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:27:39 -05:00
Jiri Pechanec
a967afbd1a DBZ-2821 Support for CHAR VARYING use 2020-12-04 10:34:49 +01:00
Jiri Pechanec
b7fede7d53 DBZ-735 Verify Avro serialization 2020-11-27 17:33:23 +01:00
John Martin
f069cd6f3f DBZ-2775 add option for setting snapshot events as reads 2020-11-20 07:46:07 +01:00
Debezium Builder
4535549dcd [maven-release-plugin] prepare for next development iteration 2020-11-16 15:18:43 -05:00
Debezium Builder
3c70c5f7d5 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:18:43 -05:00
vanhoale
17a424d9ac DBZ-2662 Handle ChangeEventQueue by the size in bytes 2020-11-16 08:39:33 +01:00
rkerner
9c5db0cd2f DBZ-2580 Fix "The primary key cannot reference a non-existant column" error from MySQL DDL parser when CREATE TABLE statement starts with a primary key definition like "CREATE TABLE Products (PRIMARY KEY (id), ..." where the referenced primary key column is not yet defined 2020-11-12 07:42:48 +01:00
Kewei Shang
78c061a86d DBZ-2726 extend data separator and time separator 2020-11-10 10:01:33 +01:00
Kewei Shang
7e44a3068a DBZ-2726 Clean MySQL TIMESTAMP default value 2020-11-10 10:01:33 +01:00
Jiri Pechanec
b9a6bb35b8 DBZ-2673 Added comment; use defensive equals 2020-11-03 08:02:06 +01:00
Arik Cohen
e44b76fb9d DBZ-2673 Read the raw bytes of a character-type field 2020-11-03 08:02:06 +01:00
rkerner
c274c2b39b DBZ-2617 refactor to proper HeartbeatErrorHandler injection 2020-11-03 07:23:02 +01:00
Debezium Builder
26883dad92 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:45:59 -04:00
Debezium Builder
9adbc2d67e [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:45:59 -04:00
Sergei Morozov
5bccf7ad1d DBZ-2688: DropViewParserListener should respect the skipViews flag 2020-10-22 05:43:46 +02:00
Jiri Pechanec
b699e37359 DBZ-2670 Modify testing approach 2020-10-21 17:41:22 +02:00
karamel
4898d18184 DBZ-2670 Allow non-Ascii characters in MySQL ids 2020-10-21 17:41:22 +02:00
Kaushik Iyer
7d9e8fdc46 DBZ-2456 fixes after rebase 2020-10-16 10:13:48 +02:00
Kaushik Iyer
e2e6dc0932 DBZ-2456 selective snapshot implementation 2020-10-16 10:13:48 +02:00
John Martin
4fe4aed24f DBZ-2643 Only set filter info in offsets when snapshot.new.tables = parallel 2020-10-14 16:53:04 +02:00
Jiri Pechanec
2270d23adb DBZ-2641 BLOB type has dimension 2020-10-08 09:01:23 +02:00
Jiri Pechanec
dd6e10b92b DBZ-2604 Query charset name in lowercase 2020-10-06 11:41:06 +02:00
Jiri Pechanec
cc09f164b9 DBZ-2604 Use default db charset as default table charset 2020-10-06 11:41:06 +02:00
Debezium Builder
95b8ed3877 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:08:51 -04:00
Debezium Builder
19ad73beb2 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:08:50 -04:00
Peter Junos
ab7db1ddca DBZ-2583 MySQL connector - ignore statement-based logs
Current mysql debezium connector fails once it sees an event generated
with statement or mixed based replication.

As users and programs can call SET SESSION binlog_format='STATEMENT'; as
they wish, they are able to break debezium connector. Only MySQL 8.0.14
is fixing this, but not everyone is on that version.

To prevent connector crashing in such cases, there should be an option
to log these issues and continue. That would be similar to processing
inconsistent schema (on the setting level).
2020-09-29 15:55:15 +02:00
Gunnar Morling
3d12616627 DBZ-2563 Avoiding dependency from MySqlValueConverters to BinlogReader 2020-09-29 10:36:33 +02:00
Gunnar Morling
87d70cb96d DBZ-2563 Simplifying MySqlValueConverters constructors 2020-09-29 10:36:33 +02:00
Jiri Pechanec
5b2c14e058 DBZ-2563 JSON processing can ignore deserialization errors 2020-09-29 10:36:33 +02:00
Gunnar Morling
c1b057f792 DBZ-2588 Introducing dedicated functional interface for key/value generators;
Also keys are always KC Struct instead of generic j.l.Object.
2020-09-25 06:01:59 +02:00
Debezium Builder
b146b69154 [maven-release-plugin] prepare for next development iteration 2020-09-24 04:56:42 -04:00
Debezium Builder
c51cfe8eb9 [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 04:56:41 -04:00
Debezium Builder
837669890a [maven-release-plugin] prepare for next development iteration 2020-09-16 12:18:08 -04:00
Debezium Builder
086dbd960b [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:18:08 -04:00
Aaron Brady
9468b1f074 DBZ-2466 Start connector when using Oracle MySQL, so afterEach can stop it 2020-09-15 11:43:49 +02:00
Aaron Brady
a5b30ffa78 DBZ-2466 Address Backup Lock review feedback 2020-09-15 11:43:49 +02:00
Aaron Brady
9057896c89 DBZ-2466 Percona Backup Locks option for snapshots 2020-09-15 11:43:49 +02:00
Aaron Brady
304ad4998c DBZ-2466 Add Percona Server profile to assembly 2020-09-15 11:43:49 +02:00
rkerner
011c3be948 DBZ-2527 Add missing ListOfRegex validator to all regex list fields and fix dependent fields to not include @Deprecated whitelist/blacklist fields 2020-09-15 10:05:04 +02:00
Gunnar Morling
e91629cc04 DBZ-1962 Doc fix 2020-09-08 17:11:14 +02:00
Jos Huiting
29c6b2abc7 DBZ-1962 Introduce column.whitelist for the MySql connector 2020-09-08 17:06:29 +02:00
Debezium Builder
9979db648f [maven-release-plugin] prepare for next development iteration 2020-08-28 05:04:26 -04:00
Debezium Builder
5c58b23756 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:04:26 -04:00
rkerner
2c5c093587 DBZ-2171 avoid divisive language 2020-08-21 09:29:04 +02:00