Commit Graph

1780 Commits

Author SHA1 Message Date
jcechace
699a1612ae DBZ-6670 Replace error handler instead of recreate in order to keep retry counter 2023-07-25 13:46:56 +02:00
Debezium Builder
267dfda8a6 [maven-release-plugin] prepare for next development iteration 2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29 [maven-release-plugin] prepare release v2.4.0.Alpha1 2023-07-17 10:40:52 +00:00
jcechace
318c55cc74 DBZ-6659 Fixing junit dependencies 2023-07-14 09:11:10 +02:00
harveyyue
e3f684170e DBZ-6472 MySqlSnapshotChangeEventSource parallel execute createSchemaEventsForTables 2023-07-13 13:21:59 +02:00
harveyyue
5bc7fd1f7c DBZ-6603 Support for custom tags in the connector metrics 2023-07-13 09:52:33 +02:00
jcechace
5cb579bf12 DBZ-6525 Removing runtime dependency on core for testcontainers module in order to prevent logback.xml downstream conflicts 2023-07-11 12:07:04 +02:00
mfvitale
d5febcc054 DBZ-6417 Provide extensible signal action mechanism through SPI 2023-06-23 15:03:27 +02:00
mfvitale
9ed928a1c9 DBZ-6416 Improve tests stability 2023-06-22 13:22:34 +02:00
mfvitale
34e28ac52d DBZ-6416 Add initial snapshot notifications 2023-06-22 13:22:34 +02:00
Debezium Builder
60f730d383 [maven-release-plugin] prepare for next development iteration 2023-06-20 13:21:31 +00:00
Debezium Builder
150396e4c8 [maven-release-plugin] prepare release v2.3.0.Final 2023-06-20 13:21:31 +00:00
kate
a06db8d2e5 DBZ-6570 Fix ConcurrentModificationException in KafkaSignal 2023-06-20 08:55:48 +02:00
mfvitale
043e4da49a DBZ-6534 Adjust testNationalizedCharacterDataTypeMappings to be compatible with both MySQL 5.7 and 8.0 2023-06-19 07:50:17 +02:00
Jiri Pechanec
7e6c2ea75d DBZ-6533 Disable test in parallel setup 2023-06-15 17:33:19 +02:00
Jiri Pechanec
067683e56a DBZ-6076 Consistent config for all connectors 2023-06-15 11:55:28 +02:00
Anil Dasari
0431a8b9fc DBZ-6076: Add support for custom SourceInfoStructMaker for adding new fields to source field 2023-06-15 11:55:28 +02:00
Jiri Pechanec
08ed847095 DBZ-6533 Create a separate test db 2023-06-12 15:40:03 +02:00
Andrei Isac
fcc325845f DBZ-6533 add order_postfix table in ddl 2023-06-12 15:40:03 +02:00
Andrei Isac
573a91be07 DBZ-6533: fix table order on partial match when snapshotting 2023-06-12 15:40:03 +02:00
Debezium Builder
5d1b00588a [maven-release-plugin] prepare for next development iteration 2023-06-09 09:23:38 +00:00
Debezium Builder
d1e6107517 [maven-release-plugin] prepare release v2.3.0.CR1 2023-06-09 09:23:37 +00:00
mfvitale
ca92f9094e DBZ-6435 Add integration tests for TABLE statement 2023-06-07 16:37:15 +02:00
mfvitale
7338fde84e DBZ-6424 Emit JMX Notification when Debezium generate its own notification
DBZ-6424 Emit JMX Notification when Debezium generate its own notification

DBZ-6424 Emit JMX Notification when Debezium generate its own notification
2023-06-07 07:36:58 +02:00
mfvitale
ba8a3e5062 DBZ-6511 Expose reset method on SignalChannelReader to reset processed signals 2023-06-05 17:33:07 +02:00
mfvitale
862180cd0e DBZ-6511 Add test to ReadOnlyIncrementalSnapshotIT to signal through FileSignalChannel 2023-06-05 17:33:07 +02:00
mfvitale
4d56bbd15a DBZ-6511 Restore Kafka signal offset only when KafkaSignalChannel is enabled 2023-06-05 17:33:07 +02:00
Ronak Jain
3f3967c2bb DBZ-6366: Code Improvements for skip.messages.without.change
Addresses/Closes DBZ-6366
2023-06-05 14:50:25 +02:00
Debezium Builder
aa5b2131fc [maven-release-plugin] prepare for next development iteration 2023-05-26 10:35:20 +00:00
Debezium Builder
9cc9b3c29a [maven-release-plugin] prepare release v2.3.0.Beta1 2023-05-26 10:35:20 +00:00
mfvitale
dc00f64bbf DBZ-6447 Incremental snapshot notification ids are now equal to the id sent in the execute-snapshot signal. 2023-05-23 09:57:05 +02:00
Debezium Builder
a5b44767bc [maven-release-plugin] prepare for next development iteration 2023-05-11 11:05:24 +00:00
Debezium Builder
1b1a7531f2 [maven-release-plugin] prepare release v2.3.0.Alpha1 2023-05-11 11:05:24 +00:00
mfvitale
7429b4e6f1 DBZ-1973 Add incremental snapshot notifications 2023-05-10 12:22:02 +02:00
mfvitale
811b800f55 DBZ-1973 Add support for Notifications
DBZ-1973 Add more tests for other connectors

DBZ-1973 Add send method with offset parameter

DBZ-1973 Instantiate NotificationService in the task class

DBZ-1973 Instantiate NotificationService in the task class

DBZ-4027 Move specific sink channel configuration to SinkNotificationChannel

DBZ-4027 Remove not used SPI file

DBZ-1973 Moved SPI file definition to debezium-core

DBZ-1973 Rename KafkaNotificationChannel to more generic SinkNotificationChannel

DBZ-1973 Code refactor

DBZ-1973 Improve configuration property description

DBZ-1973 Improve test

DBZ-1973 Add close method to NotificationChannel

DBZ-1973 Implement KafkaNotificationChannel

DBZ-1973 Add NotificationService and LogNotificationChannel
2023-05-10 12:22:02 +02:00
kate
6c338754b3 DBZ-6440 Init Kafka signal channel 2023-05-09 06:48:39 +02:00
mfvitale
952340286e DBZ-4027 Make signalling channel configurable
DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Code style

DBZ-4027 Make SignalPayload more generic and extensible

DBZ-4027 Rename DatabaseSignalChannel to SourceSignalChannel

DBZ-4027 Improve logging

DBZ-4027 Moved SPI file definition to debezium-core

DBZ-4027 Move SignalProcessor synchronization point to be processed only when a signal cdc event arrives.

DBZ-4027 Add EventDispatcher constructor without signalProcessor for spanner connector

DBZ-4027 Fix NPE

DBZ-4027 Fix NPE

DBZ-4027 Formatting

DBZ-4027 Correctly manage signal on not supported connector

DBZ-4027 Use the correct MongoDbOffset

DBZ-4027 Correctly initialize offset for Oracle and SqlServer connectors

DBZ-4027 Register SPI implementations

DBZ-4027 Improve SignalProcessor instantiation

DBZ-4027 Pass source info in case of SchemaChanges action

DBZ-4027 Manage close event in a synchronous way

DBZ-4027 Correctly init offset context also in case of snapshot mode 'never'

DBZ-4027 Fix MySqlMetricsIT test

DBZ-4027 Move KafkaSignalChannel to core

DBZ-4027 Move KafkaSignalChannel to core

DBZ-4027 Set pass offset context after initial snapshot to SignalProcessor

DBZ-4027 Pass OffsetContext to signal processor

DBZ-4027 Pass CommonConnectorConfig to SignalChannelReader init method

DBZ-4027 Move Incremental snapshot window actions to dedicated package

DBZ-4027 Align SignalsIT test with new code

DBZ-4027 Fix SignalsIT test

DBZ-4027 Fix SignalProcessor scheduling

DBZ-4027 Moved DatabaseSignalChannel and SignalChannelReader to dedicated package

DBZ-4027 Start SignalProcessor from ChangeEventSourceCoordinator

DBZ-4027 Create SignalProcessor and renamed Signal to DatabaseSignalChannel

DBZ-4027 Initial refactoring of signal feature
2023-05-05 13:35:40 +02:00
Jiri Pechanec
58ef4f0b98 DBZ-6157 Disable potentially dangerous MySQL JDBC props 2023-05-04 11:54:04 +02:00
harveyyue
3860a4faca DBZ-6388 __source_ts_ms r (read) operation date is set to future for SQL Server 2023-05-02 08:11:02 -04:00
Nir Levy
f5555a894e DBZ-6357 Fix parsing of NATIONAL CHAR 2023-05-02 08:02:32 -04:00
ani-sha
a453c3ca19 DBZ-6259 Add missing description of various snapshot modes in the connector field definitions 2023-05-01 11:03:04 -04:00
Frederic Laurent
84b2e29698 DBZ-6340 Make preferred the new default SSL mode for the MySQL connector 2023-04-26 12:48:04 +02:00
Debezium Builder
bb1b79f3bd [maven-release-plugin] prepare for next development iteration 2023-04-20 09:09:43 +02:00
Debezium Builder
5483b4de99 [maven-release-plugin] prepare release v2.2.0.Final 2023-04-20 09:09:43 +02:00
hiscat
f07ec7ae5f DBZ-6361 Remove superfluous signal prefix 2023-04-19 13:08:18 +02:00
Jiri Pechanec
f4c200ac3e DBZ-2979 Fix tests 2023-04-19 09:04:29 +02:00
Ronak Jain
465b355dd0 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
* Add More Test Cases

Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Ronak Jain
762122ecf5 DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
* Add Mysql and SqlServer Connector Changes
* Change Docs
* Clean Test Case
* Formatting and Checkstyle

Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Debezium Builder
976a47a3a3 [maven-release-plugin] prepare for next development iteration 2023-04-14 08:46:06 +00:00
Debezium Builder
1ca8399e8b [maven-release-plugin] prepare release v2.2.0.CR1 2023-04-14 08:46:06 +00:00
Vojtech Juranek
44f2f40c56 DBZ-6216 Update testcontainers to use quay.io images
When needed update also version.
Update also leftovers in readme files.
2023-04-12 14:07:35 +02:00
harveyyue
c525f34cd0 DBZ-6070 DDL events not stored in schema history topic for excluded tables 2023-04-06 12:10:30 +02:00
Jiri Pechanec
063a65e4ac DBZ-6304 Upgrade MySQL driver and change Maven coordinates 2023-04-04 10:46:54 +02:00
Mark Bereznitsky
d4d116e45b DBZ-6271 add throwing of stack trace and a warn log 2023-04-04 06:57:57 +02:00
Mark Bereznitsky
ded4707108 DBZ-6271 allow for quiet failure of bin log retrieval 2023-04-04 06:57:57 +02:00
Mark Bereznitsky
4b41e0e649 DBZ-6271 allow binlog to be absent when doing a snapshot only 2023-04-04 06:57:57 +02:00
Debezium Builder
5c650fd054 [maven-release-plugin] prepare for next development iteration 2023-03-31 10:00:16 +00:00
Debezium Builder
68ffc4833b [maven-release-plugin] prepare release v2.2.0.Beta1 2023-03-31 10:00:16 +00:00
Chris Cranford
621ee17f81 DBZ-6225 DBZ-6226 DBZ-6231 Fix test failure 2023-03-29 08:27:03 +02:00
harveyyue
c9c1ce8a2f DBZ-6185 Zerofill property failed for different int types 2023-03-28 09:34:58 +02:00
Chris Cranford
1c5f14f7fd DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).

In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.

In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set.  By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
harveyyue
1877906dd8 DBZ-6197 Remove duplicated createDdlFilter method from historized connector config 2023-03-13 10:56:43 +01:00
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00
PlugaruT
472162e46e DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
Jiri Pechanec
d492ec892c DBZ-823 Use enum for enumeration 2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c DBZ-823 Restrict the type with generics 2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee DBZ-823 Add JavaDoc to new interfaces 2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211 DBZ-823 Don't use getter based name 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6 DBZ-823 Use better name for CF with main connection 2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
harveyyue
003bef0736 DBZ-5743 Introduce a new unicode topic naming strategy 2023-02-02 13:21:45 +01:00
Jiri Pechanec
c487d3aee2 DBZ-6059 Revert "DBZ-4663 Remove option for specifying driver class from MySQL Connector"
This reverts commit 115d7c2d81.
2023-01-31 13:14:01 +01:00
Liz Chatman
8a6fdab5d7 DBZ-2296 return false instead of true from isGtidModeEnabled for GTID_MODEs of OFF_PERMISSIVE and ON_PERMISSIVE 2023-01-26 07:43:13 +01:00
harveyyue
bd47d7396d DBZ-6003 Add more case to method to MySqlConnectorIT.shouldProcessCreateUniqueIndex 2023-01-26 07:39:28 +01:00
harveyyue
735b763075 DBZ-6003 Nullable columns marked with "optional: false" in DDL events 2023-01-26 07:39:28 +01:00
harveyyue
9ee39691bf DBZ-5798 Data type conversion failed for mysql bigint 2023-01-25 12:25:24 +01:00
harveyyue
0aed5d5fe9 DBZ-6040 Remove the redundancy "schema.history.internal" from MySqlConnectorConfig 2023-01-25 09:13:20 +01:00
Jiri Pechanec
acc9203c5c DBZ-6029 Use single regex 2023-01-25 06:10:18 +01:00
harveyyue
184e9725ab DBZ-6029 Unexpected format for TIME column: 8:00 2023-01-25 06:10:18 +01:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result 2023-01-19 09:24:02 +01:00
Jeremy Ford
8da86b78e8 DBZ-5879 Fix unit tests 2023-01-18 14:46:14 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
This reverts commit 6d8bcd42fd.
2023-01-17 10:40:20 +01:00
Jiri Pechanec
0c5e4f0051 DBZ-6002 Fix tests now requiring fractions 2023-01-13 12:00:00 +01:00
akshansh
66c9ab20c8 DBZ-5996 Removed * import 2023-01-11 12:09:26 +01:00
akshansh
444dab3ffa DBZ-5996 Handled case where fractionalWidth was -1 2023-01-11 12:09:26 +01:00
akshansh
b87d80f462 DBZ-5996 Implemented custom DateTimeFormatter to parse ZonedDateTime while preserving length of column. 2023-01-11 12:09:26 +01:00
harveyyue
5e56ad75f8 DBZ-5985 Disable to print invalid estimated row count when config "snapshot.select.statement.overrides" 2023-01-11 09:20:15 +01:00
Jochen Schalanda
44bcedaa72 DBZ-5993 Remove superfluous placeholder in log message (MySqlDatabaseSchema)
The warning message emitted when the Debezium Connector for MySQL
encounters an unparseable DDL statement contains a superfluous
placeholder.
2023-01-11 08:57:12 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
harveyyue
115d7c2d81 DBZ-4663 Remove option for specifying driver class from MySQL Connector 2023-01-06 09:23:34 -05:00
erdinc
0e8163daca DBZ-5976 Use as much as possible "replace" method rather than "replaceAll" 2023-01-05 07:30:49 +01:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
Raul Estrada
c1493c8e20 DBZ-3575 Comments review 2022-12-21 12:34:17 +01:00
Raul Estrada
282717fa55 DBZ-3575 Implement support for JSON_TABLE in MySQL parser 2022-12-21 12:34:17 +01:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
Raul Estrada
dd96ccc27d DBZ-5888 MariaDB-grammar 2022-12-14 14:42:29 +01:00
Vojtech Juranek
163ea307aa DBZ-5838 Skip Avro validation in tests which fail due to apicurio-registry #2980 2022-12-12 14:44:05 +01:00
mfvitale
4c941b63ed DBZ-5847: Add support for all connectors
Support for qualified table names
2022-12-12 14:40:56 +01:00
mfvitale
d12811e9aa DBZ-5847: Add documentation 2022-12-12 14:40:56 +01:00
mfvitale
bd680224da DBZ-5847: Add ComputePartition Transformation.
This new SMT permits to assign record to a specific partition based on configured table field name hash.
2022-12-12 14:40:56 +01:00
Marcelo Avancini
7754163c5d DBZ-2432: Fixing misuse of assertj
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
2022-12-08 13:10:26 +01:00
Nir Levy
39393299e4 DBZ-5904 Suppport INSERT INTO statements with dots in column names 2022-12-08 13:04:41 +01:00
Vojtech Juranek
e1b65cd6f7 DBZ-5889 Run integration tests in specified order
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
2022-12-08 13:00:41 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Erdinç Taşkın
681f2a7c43 [optimization] Simplify binlog validation conditions 2022-11-29 14:17:49 +01:00
Erdinç Taşkın
9f0224526a Remove nested if check
Simplify to flow. 
- Remove nested if check
- Postpone possible unused stamement which is connection.isBinlogRowImageFull()
2022-11-29 14:17:49 +01:00
Erdinç Taşkın
77e1cfc9a8 [optimization] Remove unnecessary null check
Remove Unnecessary null checks
2022-11-29 14:09:50 +01:00
Erdinç Taşkın
07d93497fe [optimization] Remove Unreachable if statement
if statement never will be true
2022-11-23 12:35:45 +01:00
Anisha Mohanty
5c2c0f54be DBZ-5836 COMMENT string for CREATE_USER & ALTER_USER clause 2022-11-23 08:46:12 +01:00
ggaborg
73691db6b1 DBZ-4720 fix mysql tls test 2022-11-22 14:46:55 +01:00
harveyyue
21fddc8515 DBZ-5843 Invalid Java object for schema with type FLOAT64: class java.lang.Float 2022-11-21 11:21:49 -05:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a [maven-release-plugin] prepare release v2.1.0.Alpha1 2022-11-10 13:29:05 +00:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
41d3d7d155 DBZ-2131 Run tests with Apicurio registry
When Apicurio profile is used and container with Apicurio started, use
Apicurio registry in the tests. Fall back to in-memory Confluent
registry otherwise.
2022-11-09 08:44:45 +01:00
Vojtech Juranek
e89c65ed98 DBZ-2131 Add Apicurion profile for Mysql 2022-11-09 08:44:45 +01:00
Vojtech Juranek
cfa56d3416 DBZ-2131 Use dedicated property for setting mysql test database
To be able to modify `docker.filter` property for Docker Maven plugin,
use dedicated property for selecting the test database. This will be
later used for creating `docker.filter` property.
2022-11-09 08:44:45 +01:00
Vojtech Juranek
95d9f4c34b DBZ-2131 Unify intendation in mysql pom.xml
Part of the file uses 2 space for intendation, part 4 spaces, which is
messy. Before touching the file, unify the intendation to 4 spaces in
all file.
2022-11-09 08:44:45 +01:00
Vojtech Juranek
0510102db5 DBZ-2131 Don't skip Avro validation
Original issue seems to be resolved, at least don't with with Avro
validation.
2022-11-09 08:44:45 +01:00
harveyyue
e6f0551451 DBZ-5801 The merge method of configuration is not work 2022-11-08 14:19:51 +01:00
harveyyue
6ba46b97cb DBZ-5790 Enhance the ability to sanitize topic name 2022-11-03 15:45:54 +01:00
jcechace
740715e2ee DBZ-5779 Migrated debezium-connector-mysql to AssertJ 2022-11-02 08:50:26 +01:00
Chris Cranford
dc5de5ae87 DBZ-5760 Only log full row data at TRACE level 2022-10-26 08:13:34 +02:00
harveyyue
a37d3332df DBZ-5610 MySQL Connector capture TRUNCATE command as message in table topic 2022-10-20 08:57:28 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
harveyyue
299f93afd7 DBZ-5709 The DDL_FILTER of SchemaHistory doesn't work for including break lines ddl statement 2022-10-14 09:21:40 +02:00
Jochen Schalanda
45ec33c17b DBZ-5724 Add PRIMARY as keyword to MySQL grammar to fix index hints
Index hints using the primary index (`USE INDEX(PRIMARY)`) are currently
failing because `PRIMARY` is missing from the list of keywords in the
ANTLR-based MySQL parser.

According to https://dev.mysql.com/doc/refman/8.0/en/keywords.html#keywords-8-0-detailed-P,
`PRIMARY` is a reserved keyword.

Index hints: https://dev.mysql.com/doc/refman/8.0/en/index-hints.html
2022-10-14 08:35:53 +02:00
harveyyue
0cbd14e67f DBZ-5728 MySqlSchemaMigrationIT runs failed 2022-10-14 07:20:24 +02:00
Vojtech Juranek
73f056df85 DBZ-5710 Remove whitelist/blacklist from log messages 2022-10-11 15:30:28 +02:00
Debezium Builder
884254aba1 [maven-release-plugin] prepare for next development iteration 2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6 [maven-release-plugin] prepare release v2.0.0.CR1 2022-10-07 09:27:51 +00:00
Jiri Pechanec
99dff302f1 DBZ-5612 Support for formatted messages 2022-10-04 13:45:43 +02:00
rajdangwal
58ab632ea3 DBZ-5612 log records only at trace level 2022-10-04 13:45:43 +02:00
rajdangwal
c03bcf8606 DBZ-5612 Remove records from being logged at all levels 2022-10-04 13:45:43 +02:00
harveyyue
f6b72f060c DBZ-5671 Remove logic name parameter from sub connector config 2022-10-03 11:40:17 -04:00
Sergei Morozov
e4d46c81b1 DBZ-5541: Default Debezium schema.name.adjustment.mode to "none" 2022-09-29 09:47:25 +02:00
Vojtech Juranek
97532042b3 DBZ-5657 Allow to use Docker maven plugin external properties
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.

[1] https://dmp.fabric8.io/#combining-property-config
2022-09-29 05:41:09 +02:00
harveyyue
d1153e8ad4 DBZ-5594 Clean up "logical name" config 2022-09-22 14:29:37 +02:00
Sergei Morozov
1a4cb1458a DBZ-5630: Unquote double quotes from default values on MySQL 2022-09-22 13:24:36 +02:00
harveyyue
f341724fa9 DBZ-5623 DDL Parsing Error 2022-09-20 17:18:57 -04:00
harveyyue
288c93434f DBZ-5585 Remove classloader parameter from JdbcConnection 2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552 [maven-release-plugin] prepare for next development iteration 2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b [maven-release-plugin] prepare release v2.0.0.Beta2 2022-09-16 06:36:39 +00:00
harveyyue
665edab844 DBZ-5589 Mysql connector can't handle the case sensitive of rename/change column statement 2022-09-13 09:36:25 +02:00
Vojtech Juranek
acc6be6df3 DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
2022-09-13 09:25:54 +02:00
Jiri Pechanec
c928f7a99e DBZ-5587 Formatting; add contributor 2022-09-08 13:31:04 +02:00
Hang Ruan
3477d53d47 DBZ-5587 fix default value parser when default value containing COLLATE 2022-09-08 13:31:04 +02:00
Anisha Mohanty
9fd204b383 DBZ-5044 Introduce respective SchemaFactory for all connectors 2022-09-08 10:35:20 +02:00
Anisha Mohanty
cfd0242e28 DBZ-5044 Sort imports & fix test failures 2022-09-08 10:35:20 +02:00
Anisha Mohanty
91ccb7578f DBZ-5044 Centralize datatype schemas 2022-09-08 10:35:20 +02:00
Vojtech Juranek
402df78381 DBZ-5043 Rename schema.history to schema.history.internal 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b797201263 DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5 DBZ-5043 Replace 'database history' with 'database schema history'
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79 DBZ-5043 Rename DatabaseHistory to SchemaHistory
Rename also all related classes and varibales.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
a7a293c5c8 DBZ-5043 Move driver pass-through parameters into dedicated namespace
Currently we mix database parameters like DB hostname, username or
password with other JDBC driver parameters which are passed to JDBC
driver as it is. Move these pass-through parameters into dedicated
namespace `driver.*` to separate them from common database parameters.
JDBC parameters which are defined on the connector level still stay
in `database` namespace.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
5d1b72e95f DBZ-5043 Simplify code after renaming database.history namespace
Filtering `database.history` namespace from pass-through parameters is now
not needed as it doesn't interfere with other `database.*` parameters.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
25aa6c4acc DBZ-5043 Change namespace to database.history to schema.history 2022-09-07 12:57:31 +02:00
harveyyue
58f4d3d912 DBZ-5480 Augment a uniqueness key filed/value in regex topic naming strategy 2022-09-06 14:58:57 +02:00
harveyyue
f4c7b52451 DBZ-5538 Unclear validation error when required field is missing 2022-09-05 10:35:55 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00
Jiri Pechanec
de53591dba DBZ-5244 Retry all communication exceptions by default 2022-08-31 09:45:09 -04:00
druud
06c254b98f [docs] Typos in MySqlUnsignedIntegerConverter.java
Just fixed some typos.
2022-08-31 09:05:46 +02:00
pkgonan
b031770300 DBZ-5544 Support BASE64_URL_SAFE in BinaryHandlingMode 2022-08-24 09:50:23 +02:00
tjwornjs
c09d26c5b4 DBZ-5489 fix test case 2022-08-24 09:46:01 +02:00
tjwornjs
cb4bbc0bec DBZ-5489 using value from MySqlConnectorConfig 2022-08-24 09:46:01 +02:00
tjwornjs
484a4390aa DBZ-5489 add test 2022-08-24 09:46:01 +02:00
harveyyue
0308a1cbb6 DBZ-5535 Disable preferring DDL before logical schema in history recovery 2022-08-23 14:16:35 +02:00
kate
88924d708e DBZ-2766 Fix GtidSet subtraction 2022-08-23 13:43:41 +02:00
kate
c52f2ffa6a DBZ-2766 Replace guava range with intervals 2022-08-23 13:43:41 +02:00
Sergei Morozov
1c99437890 DBZ-5470: Remove the dependency of JdbcConnection on DatabaseSchema 2022-08-19 11:06:59 +02:00
Chris Cranford
b7e2112603 DBZ-5497 Align test behavior 2022-08-19 11:05:29 +02:00
debjeetsarkar
b824c138db DBZ-2663 | Updated with checkstyle fixes.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
debjeetsarkar
f41474847d DBZ-2663 | Update mysql binlog connector library and add support for TRANSACTION PAYLOAD EVENT.
More Ref:
https://debezium.zulipchat.com/#narrow/stream/302533-dev/topic/Handling.20Transaction.20Payload.20Events.20for.20Mysql/near/289650440
https://github.com/osheroff/mysql-binlog-connector-java/pull/76#issuecomment-1185629635
2022-08-17 10:22:23 +02:00
Vivek Wassan
d89e71ebeb DBZ-5327 Smart Backfills 2022-08-17 10:05:55 +02:00
Chris Cranford
fcb845024f DBZ-5483 Fix testStopSnapshotKafkaSignal random failure 2022-08-08 15:55:56 -04:00
Chris Cranford
f8e67e3ff9 DBZ-5453 Add stop-snapshot MySQL read-only Kafka signal 2022-08-04 16:16:42 -04:00
Vojtech Juranek
2c505c08f5 DBZ-4727 Add Kafka based pause/resume signals
Add pause and resume snapshot signals. See previous commit for more
details. These signal do the same, but are used by read-only MySQL
where sending signals is done by sending Kafka messages.
2022-07-29 12:41:58 -04:00
Vojtech Juranek
3968b6b75f DBZ-4727 Intorduce KafkaSignal interface
In the follow-up commit signal for pause and resume snapshot will be
added. Intorduce `KafkaSignal` interface which would server as general
kafka-based signal.
2022-07-29 12:41:58 -04:00
Vojtech Juranek
c7d8353d7b DBZ-4727 Add snapshot paused JXM metrics
Add two JXM objects:
* `snapshotPaused` - detemines if the incremental snapshot is paused
  or not
* `snapshotPausedDurationInSeconds` - overall time when the incremental
  snapshot was paused. The time adds up - if the snapshot was paused
  e.g. two times, the `snapshotPausedDurationInSeconds` is the sum of
  these two paused times.
2022-07-29 12:41:58 -04:00
harveyyue
5f430f1a8e DBZ-5457 Deprecate legacy topic selector for all connectors 2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0 [maven-release-plugin] prepare for next development iteration 2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79 [maven-release-plugin] prepare release v2.0.0.Beta1 2022-07-26 18:13:09 +00:00
harveyyue
8d76ba217f DBZ-5333 Caused by: java.io.EOFException: Failed to read next byte from position 2005308603 2022-07-26 11:10:29 -04:00
harveyyue
9683b0fa77 DBZ-5424 Verify the unique index whether including function or arbitrary expression 2022-07-20 14:38:25 +02:00
harveyyue
7730610320 DBZ-5425 Remove the duplicated SimpleDdlParserListener from mysql connector 2022-07-20 14:35:34 +02:00
Chris Cranford
f412c2e6a4 DBZ-5396 Add support for connector-specific relational model attributes 2022-07-19 15:41:02 -04:00
Vojtech Juranek
5315dbd9cb DBZ-5047 Remove setting last snapshot event in MySQL connector
MySQL connector sets last snapshot event twice - the first time during
the streaming and the second time in
`MySqlSnapshotChangeEventSource.postSnapshot()` [1]. Remove setting the
last snapshot event during the streaming and keep it only in one place
in `postSnapshot()` method.

[1] https://github.com/debezium/debezium/blob/v2.0.0.Alpha3/debezium-connector-mysql/src/main/java/io/debezium/connector/mysql/MySqlSnapshotChangeEventSource.java#L563
2022-07-19 11:19:52 +02:00
Vojtech Juranek
109c3d1e0d DBZ-5047 Remove deprecated unused method from SourceInfo 2022-07-19 11:19:52 +02:00
harveyyue
77c7db163d DBZ-5414 Validate topic naming strategy relative topic name properties 2022-07-18 09:58:51 -04:00
harveyyue
6ea7abc8fc DBZ-4180 Pluggable topic selector 2022-07-13 14:45:25 +02:00
Jiri Pechanec
d8baac7c46 DBZ-5229 Reorganize code for inheritance use 2022-07-12 17:31:19 +02:00
Hossein Torabi
1ea02be9c2 DBZ-5229 define centralized and modular aproach for debezium storage 2022-07-12 17:31:19 +02:00
Jiri Pechanec
2a14e2fff7 DBZ-5343 Skip test for MySQL 8 2022-07-11 12:12:26 +02:00
harveyyue
35bd0107ce DBZ-5343 Unsigned tinyint conversion fails for MySQL 8.x 2022-07-11 12:12:26 +02:00
harveyyue
7ba7929d7e DBZ-5386 Missing "previousId" property with parsing the rename statement in kafka history topic 2022-07-11 07:44:14 +02:00
Debezium Builder
6fd1441af3 [maven-release-plugin] prepare for next development iteration 2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634 [maven-release-plugin] prepare release v2.0.0.Alpha3 2022-07-01 09:21:48 +00:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
Mike Kamornikov
cd84fb17ed DBZ-5291: Fix binlog filename comparison 2022-06-28 06:08:59 +02:00
harveyyue
20dc353262 DBZ-5170 Mysql Commit Timestamp 2022-06-27 15:50:52 +02:00
harveyyue
638076a899 DBZ-5267 Invalid date 'SEPTEMBER 31' 2022-06-24 16:27:46 +02:00
Chris Cranford
0bbf6e811c DBZ-5251 Align DefaultValueListener usage across enter/exit handlers 2022-06-24 11:31:08 +02:00
Chris Cranford
3fb5bf1339 DBZ-4451 Introduce SchemaChangeEvent factory methods 2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081 DBZ-4451 Store previous table id in alter schema change events
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5 DBZ-4834 Fix incremental snapshot of table added to include list 2022-06-16 08:39:16 +02:00
harveyyue
f6a04e2db8 DBZ-5236 Cannot convert field type tinyint(1) unsigned to boolean 2022-06-13 14:42:20 +02:00
Jiri Pechanec
db52977626 DBZ-5241 More specific pattern 2022-06-13 14:23:12 +02:00
Chris Cranford
93af38c189 DBZ-5241 Parse character set introducers on default values 2022-06-13 14:23:12 +02:00
Debezium Builder
6fff3a2876 [maven-release-plugin] prepare for next development iteration 2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df [maven-release-plugin] prepare release v2.0.0.Alpha2 2022-06-09 11:49:26 +00:00
Jiri Pechanec
48072682c6 DBZ-5201 Handle expression in DEFAULT as NULL 2022-06-08 13:33:10 +02:00
Vojtech Juranek
4a48eb33df DBZ-5045 Remove legacy V1 source info 2022-06-08 09:11:00 +02:00
Vojtech Juranek
ef8d7f7af7 DBZ-5045 Remove deprecated OBSOLETE_NAME_FOR_SKIP_FAILURE_HANDLING option value 2022-06-08 09:11:00 +02:00
Vojtech Juranek
1edab1d1a5 DBZ-5045 Remove deprecated MySQL GTID_NEW_CHANNEL_POSITION option 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b0b3066ed5 DBZ-5045 Remove deprecated COLUMN_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
b3a6131cee DBZ-5045 Remove deprecated DATABASE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
0cbb57f4bf DBZ-5045 Remove deprecated DATABASE_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4 DBZ-5045 Remove deprecated SCHEMA_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f DBZ-5045 Remove deprecated SCHEMA_WHITELIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3 DBZ-5045 Remove deprecated TABLE_BLACKLIST 2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc DBZ-5045 Remove deprecated TABLE_WHITELIST 2022-06-08 09:11:00 +02:00
harveyyue
acb743bd34 DBZ-5206 Remove the deprecated monitored tables metrics 2022-06-07 16:13:29 -04:00
Chris Cranford
9d71296b5c DBZ-4251 Support stopping incremental snapshots 2022-06-02 07:30:07 +02:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
01a81f8bc1 DBZ-5136: Refactored SnapshotContext setters 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Vojtech Juranek
a2110f7c02 DBZ-5042 Add DB name logging support into MySQL connector 2022-05-27 14:20:30 -04:00
Vojtech Juranek
f8d4307155 DBZ-5052 Send tombstones only when consumer is able to consume them
Change event consumer may specify if is able to consume tombstones or
not. If the it's not, don't send them. However, connector configuration
takes precence and thus cunsumer capability is taken into account only
when `tombstones.on.delete` is not explicitely configured for the
connector.

Also fix debezium server - setting notifier has to be done once embedded
config already exists, not before it.
2022-05-26 12:40:02 +02:00
harveyyue
3ada04b522 DBZ-3865 Debezium MySql connector does not capture floating point numbers with the right precision 2022-05-25 12:54:42 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Lee
2a8456d21b DBZ-5123 data-collection regex snapshot signal 2022-05-24 12:46:28 +02:00
harveyyue
52ba58ccc3 DBZ-5098 Introduce a new field "ts_ms" to identify the process time for schema change event 2022-05-18 14:21:39 +02:00
Vojtech Juranek
80aad894a2 DBZ-5131 Use fetch size only in tests which need it
Cuncurrent reading and modification of MySQL table can result into MySQL
JDBC driver ArrayIndexOutOfBoundsException when it tried to merge table
fields. This is result fo caching parepared statements while table
schema is modified. It seems that caching of prepared statements is
triggered by using fetch size. Use it only in test which needs this
option to work properly and which don't do any schema changes.
2022-05-17 05:56:42 +02:00
harveyyue
10632a3489 DBZ-5134 java.lang.NumberFormatException: For input string: \"0.000000000000000000\" 2022-05-16 10:53:32 +02:00
Jiabao Sun
6a2071acee DBZ-5126 Clear tableMapEventByTableId on rotate event 2022-05-16 09:19:47 +02:00
Vojtech Juranek
fd6be945b5 DBZ-5099 Allow zero-length dates
When date is zero and binary protocol use comperssion, date has zero
length [1]:

    type to store a DATE, DATETIME and TIMESTAMP fields in the binary protocol.

    to save space the packet can be compressed:
    if year, month, day, hour, minutes, seconds and micro_seconds are all 0, length is 0 and no other field is sent

Allow zero-lenght date and return null if column is optional, epoch date
otherwise (this conforms to MySqlDefaultValueConverter.convertToLocalDate()).

[1] https://dev.mysql.com/doc/internals/en/binary-protocol-value.html#packet-ProtocolBinary::MYSQL_TYPE_TIME
2022-05-09 13:57:04 +02:00
Chris Cranford
65017dc2d6 DBZ-5100 Do not default database.server.id 2022-05-09 08:52:24 +02:00
Vojtech Juranek
dfd8afab7b DBZ-4939 Fall back to JDBC driver if we fail to read timestamp or date
MySQL protocol can change during connection and as a result our custom
field reader may fail. In such case fall back to JDBC to read the value.
This is workaround until proper solution, which will require bigger
refactoring, is implemented, see DBZ-5084 for more details.
2022-05-06 07:55:58 +02:00
Sergei Morozov
194934b74a DBZ-5075: Clean up Javadocs 2022-05-03 13:46:23 +02:00
Sergei Morozov
f6546e4d87 DBZ-5075: Remove unused legacy MySQL code 2022-05-03 13:46:23 +02:00
Sergei Morozov
1e8181e5c4 DBZ-5075: Fix typo in a private property name 2022-05-03 13:46:23 +02:00
harveyyue
7fbc53df9d DBZ-5078 Rename "Mysql" to "MySql" in related MysqlFieldReader interface 2022-05-02 07:21:47 +02:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
Vojtech Juranek
391f36c52f DBZ-5054 Wait for the MySQL to be fully started before starting tests 2022-04-27 08:49:43 -04:00
harveyyue
7f60baa6e1 DBZ-4998 Should store event header timestamp in HistoryRecord 2022-04-19 13:50:09 +02:00
LarsWerkman
dbcb6e27c8 DBZ-4983 fix incorrect sorted import 2022-04-14 14:39:40 +02:00
LarsWerkman
6522809719 DBZ-4983 Move CharsetMappingWrapper to MysqlConnection class and expose using a static method 2022-04-14 14:39:40 +02:00
LarsWerkman
fec5aef1ec DBZ-4983 Use correct Java encoding Charset in AbstractMysqlFieldReader 2022-04-14 14:39:40 +02:00
Anisha Mohanty
b57b5e66dd DBZ-4965 Remove JDBC legacy date time properties 2022-04-08 08:31:30 +02:00
Anisha Mohanty
7d92a137e8 DBZ-4950 Remove MySQL legacy implementation 2022-04-08 08:31:30 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Nenad Stojanovikj
2d89f296de DBZ-4933 Fix NPE on null column data in MySQL
When doing a snapshot on a MySQL database which has char type columns
(VARCHAR, TEXT, CHAR) and they are null, and a custom converter is
present, the MySQL reader throws an NPE.

This fix addresses the problem by returning an object from the `null`
value.

https://issues.redhat.com/browse/DBZ-4933
2022-04-01 08:36:05 +02:00
Jiri Pechanec
586657f715 DBZ-3541 Test scientific as string 2022-03-29 09:12:17 +02:00
Sergei Morozov
a0533227cb DBZ-3541 Test case for scientific notation 2022-03-29 09:12:17 +02:00
Sergei Morozov
d766d806af DBZ-3541 Round decimal default values of integer columns 2022-03-29 09:12:17 +02:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Sergei Morozov
3a03ff0186 DBZ-3535: Remove unused EventDispatcher constructor parameter 2022-03-24 09:37:05 +01:00
Vojtěch Juránek
49d3a10f1e
DBZ-3949 Ignore DML records in binlog in MySQL connector;
In some cases (e.g. in some cases when MEMORY engine is used), DML
records can appear in binlog in spite of the fact it's set to ROW
format. Always ignore these records.


Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-03-23 08:12:02 +01:00
Vojtech Juranek
0163c07800 DBZ-4786 Avoid NPE when removing column which doesn't exists 2022-03-23 07:53:06 +01:00
harveyyue
e1706802a6
DBZ-4787 Improving MySQL SSL truststore/keystore property descriptions
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-03-18 09:11:23 +01:00
kate
4b2d5c29be DBZ-4878 Re-read incremental snapshot chunk on DDL event 2022-03-18 07:55:43 +01:00
harveyyue
044e454e0a DBZ-4832 Don't set truststore/keystore parameters to system variables 2022-03-15 11:25:28 +01:00
harveyyue
dac2e1350f DBZ-4841 Debezium Mysql connector can't handle CREATE INDEX IF NOT EXISTS (MariaDB) 2022-03-11 15:11:00 +01:00
harveyyue
ba3438c860 DBZ-4822 Mysql: Getting ERROR `Failed due to error: connect.errors.ConnectException: For input string: "false" 2022-03-11 10:22:43 +01:00
harveyyue
759e52c423 DBZ-4787 Skip some tests with SSL auth enabled 2022-03-11 10:10:18 +01:00
harveyyue
66d413c114 DBZ-4833 MySQL 5.7 - no viable alternative at input 'ALTER TABLE ORD_ALLOCATION_CONFIG CHANGE RANK' 2022-03-10 15:09:13 +01:00
Gunnar Morling
b46773e5e4 DBZ-4787 Making one more test pass with SSL auth enabled, removing another, now obsolete, one 2022-03-09 14:42:51 +01:00
Gunnar Morling
76b365e1cb DBZ-4787 Skipping one test when SSL authentication is enabled 2022-03-09 12:12:25 +01:00
Gunnar Morling
8896feb635 DBZ-4787 Adjusting several tests to run with SSL enabled 2022-03-09 11:24:49 +01:00
Gunnar Morling
7e987cd806 DBZ-4787 Simplifying the execution of tests with SSL authentication in the IDE;
When starting a MySQL test with -Ddatabase.ssl.mode=verify_ca, the right
defaults for truststore/keystore location and password are used, matching
the set-up created and executed by the Maven build.
2022-03-09 09:23:13 +01:00
Gunnar Morling
8125b7d8b8 DBZ-4787 Allowing to run entire MySQL test suite with SSL authentication 2022-03-09 09:23:13 +01:00
harveyyue
e7dc03fe6d DBZ-4787 Add mysql connector ssl it and build the relation mysql docker container 2022-03-09 09:23:13 +01:00
harveyyue
49963a5688 DBZ-4787 Not reading the keystore/truststore when enable mysql ssl configurations 2022-03-09 09:23:13 +01:00
harveyyue
da67ba332e DBZ-4823 Add event type for filtering trace message 2022-03-08 09:43:01 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00