Chris Cranford
8ca62c961c
DBZ-1482 Fix read-only incremental snapshot failures
2023-11-23 13:54:53 +01:00
Chris Cranford
e722845717
DBZ-1482 Don't initiate a transaction for every MariaDB GTID event.
...
There are use cases where MariaDB will send a GTID event to start a
transaction but that event will not conclude with a COMMIT and in
those cases, don't start a buffer transaction boundary.
2023-11-23 13:54:53 +01:00
Chris Cranford
25a68ba3ef
DBZ-1482 Fix MariaDB EventBuffer warnings
2023-11-23 13:54:53 +01:00
Chris Cranford
f5b0084216
DBZ-1482 Initial MariaDB GTID support
2023-11-23 13:54:53 +01:00
Chris Cranford
ebf940b1ad
DBZ-1482 Add MariaDB gtid replica bits
2023-11-23 13:54:53 +01:00
Chris Cranford
1deb01fd33
DBZ-7083 Relax REST extension validation
2023-11-23 13:54:53 +01:00
Chris Cranford
1d6a1ec6c1
DBZ-7083 Introduce strategy for MySQL and MariaDB
2023-11-23 13:54:53 +01:00
rkerner
aeaba3ae70
DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions
...
closes to https://issues.redhat.com/browse/DBZ-6762
2023-11-22 06:10:40 +01:00
Jiri Pechanec
31c343d00b
DBZ-7093 Code formatting
2023-11-15 12:59:54 +01:00
nicholas-fwang
7051f35bdf
DBZ-7093 fix checkstyle
2023-11-15 12:59:54 +01:00
nicholas-fwang
892dec2240
DBZ-7093 Check schema length to find missed DDL by SQL_BIN_LOG=OFF
2023-11-15 12:59:54 +01:00
Chris Cranford
74878523c7
DBZ-7135 Run MySQL CI configurations concurrently on GitHub
2023-11-13 19:16:57 -05:00
Debezium Builder
1521445908
[maven-release-plugin] prepare for next development iteration
2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138
[maven-release-plugin] prepare release v2.5.0.Alpha2
2023-11-10 10:26:05 +00:00
Chris Cranford
da9c2bfeb4
DBZ-7085 Fix default value handling in tests
2023-11-09 10:00:33 +01:00
Chris Cranford
2bff852174
DBZ-7085 Fix temporal reader MariaDB implementation
2023-11-09 10:00:33 +01:00
Chris Cranford
8ff03447e4
DBZ-7085 Implement simple MariaDB protocol field reader
2023-11-09 10:00:33 +01:00
Chris Cranford
35a536aefc
DBZ-7085 Apply MariaDB unique fetchSize requirements
...
Per https://jira.mariadb.org/browse/CONJ-977 , the MariaDB team does not
believe that the Integer.MIN_VALUE solution for triggering streaming is
spec compliant and as of MariaDB 3.x+ drivers, they explicitly will not
allow this.
This change explicitly sets the fetchSize to 1 to mimic the same style
of behavior that the default fetchSize uses when using MySQL. If a user
provides a custom fetchSize, that will take precedences.
2023-11-09 10:00:33 +01:00
Chris Cranford
b849effaf9
DBZ-7085 Add MariaDB and use it with MariaDB profile
2023-11-09 10:00:33 +01:00
Chris Cranford
0f4d2f2b1a
DBZ-7085 Fix test suite to protocol-based factory URL
2023-11-09 10:00:33 +01:00
ani-sha
700942b258
DBZ-6874 Drop MySQL 5.7, test MySQL 8.0 & adjust documentation
2023-11-09 09:26:26 +01:00
ani-sha
16ab761bed
DBZ-6873 Deprecate expire_logs_days, use binlog_expire_logs_seconds
2023-11-08 07:06:27 +01:00
ani-sha
e7a9430de3
DBZ-6873 Support MySQL 8.2
2023-11-08 07:06:27 +01:00
ani-sha
54be3bb663
DBZ-6873 Use percona server version 8.0
2023-11-08 07:06:27 +01:00
ani-sha
519c382153
DBZ-6873 Support MySQL 8.1
2023-11-08 07:06:27 +01:00
Debezium Builder
78c5204444
[maven-release-plugin] prepare for next development iteration
2023-10-26 15:39:35 +00:00
Debezium Builder
356e488e83
[maven-release-plugin] prepare release v2.5.0.Alpha1
2023-10-26 15:39:35 +00:00
Chris Cranford
b9e4abdf06
DBZ-2913 Rearrange logging rules
2023-10-26 13:03:03 +02:00
Chris Cranford
0ab2d8d93c
DBZ-2913 Add mariadb-ssl
profile, fix init script execution order
2023-10-26 13:03:03 +02:00
Chris Cranford
a7989379c1
DBZ-2913 Add mariadb
profile and GitHub check for MariaDB
2023-10-26 13:03:03 +02:00
Chris Cranford
cec5b67c5a
DBZ-2913 Cleanup test suite connection leak
2023-10-26 13:03:03 +02:00
Chris Cranford
dcce6f61f5
DBZ-2913 Use new configurable MariaDB capabilities API
2023-10-26 13:03:03 +02:00
Chris Cranford
ef2e7b3c8f
DBZ-2913 Disable JSON test, MariaDB handles JSON differnetly
2023-10-26 13:03:03 +02:00
Chris Cranford
af78ff3fb2
DBZ-2913 MariaDB image has SSL out of the box
2023-10-26 13:03:03 +02:00
Chris Cranford
42c9290038
DBZ-2913 Introduce SkipWhenDatabaseIs annotation
2023-10-26 13:03:03 +02:00
Chris Cranford
e3c98c47f7
DBZ-2913 Revert Align binlog client behavior to streaming source
...
The changes in this test were meant to remain local under the binlog
client new version was made available by the author.
2023-10-26 13:03:03 +02:00
Chris Cranford
e97f221bd3
DBZ-2913 Align binlog client behavior to streaming source
2023-10-26 13:03:03 +02:00
Chris Cranford
54f8f4636b
DBZ-2913 Fix failure due to log verbosity change
2023-10-26 13:03:03 +02:00
Chris Cranford
1ed77cd2ed
DBZ-2913 Reduce MySQL log verbosity
2023-10-26 13:03:03 +02:00
Chris Cranford
15ca23bff8
DBZ-2913 Fix GTID-based tests with no GTID enabled for MariaDB
2023-10-26 13:03:03 +02:00
Chris Cranford
ffe1824772
DBZ-2913 Fix binlog compression for MariaDB
2023-10-26 13:03:03 +02:00
Chris Cranford
f5313cd525
DBZ-2913 More various test fixes for MariaDB
2023-10-26 13:03:03 +02:00
Chris Cranford
498409dcb6
DBZ-2913 Fix more precision test failures
2023-10-26 13:03:03 +02:00
Chris Cranford
5069d78a02
DBZ-2913 Fix more precision test failures
2023-10-26 13:03:03 +02:00
Chris Cranford
3aeb84ace8
DBZ-2913 Fix some time precision failures
...
MySQL rounds precision up to match a column's precision when the precision is
smaller than the time value whereas MariaDB truncates by default. This can be
influenced on the MariaDB side by using `TIME_ROUND_FRACTIONAL` to avoid the
truncation.
In this commit, I've aligned the tests to MariaDB's default behavior.
2023-10-26 13:03:03 +02:00
Chris Cranford
b43a591419
DBZ-2913 Support MySQL and MariaDB image log init patterns
2023-10-26 13:03:03 +02:00
Chris Cranford
2a153cca62
DBZ-2913 Support binlog_annotate_row_events
...
MySQL supports an option called binlog_rows_query_log_events; however, MariaDB
supports a different option called binlog_annotate_row_events. This feature is
to add MariaDB's equivalent so that it acts the same as the original MySQL
option.
2023-10-26 13:03:03 +02:00
sean
6f04e9ce52
DBZ-7037 code-formatter
2023-10-25 10:48:10 +02:00
sean
a23f41a1b2
DBZ-7037 Fake Rotates Event skip tableMapEventByTableId clear
...
Fake Rotate Event
2023-10-25 10:48:10 +02:00
Roman Kudryashov
215f3098b7
DBZ-7016 Refactoring
2023-10-19 11:35:18 +02:00
Roman Kudryashov
ee64c70546
DBZ-7016 id
and type
of a CloudEvent can be retrieved from headers
2023-10-19 11:35:18 +02:00
Jiri Pechanec
cb093057c2
DBZ-7042 Use 8.0 in docs
2023-10-17 13:09:52 +02:00
ani-sha
07c1c0b0ad
DBZ-7042 Use mysql server image tag for docker/oracle hub
2023-10-17 13:09:52 +02:00
ani-sha
a72a15fef6
DBZ-7042 Use oracle container registry for MySQL images
2023-10-17 13:09:52 +02:00
mfvitale
db4babbdb4
DBZ-7035 Remove wrong test log configuration
2023-10-17 11:28:53 +02:00
mfvitale
24f1c5322b
DBZ-7035 MySqlStreamingChangeEventSource will effectively stop during blocking snapshot
2023-10-17 11:28:53 +02:00
Roman Kudryashov
01485aceb3
DBZ-6982 Provide configuration option to exclude extension attributes from a CloudEvent
2023-10-04 13:58:53 +02:00
Debezium Builder
40a8f4026d
[maven-release-plugin] prepare for next development iteration
2023-10-03 14:18:54 +00:00
Debezium Builder
412c6f7979
[maven-release-plugin] prepare release v2.4.0.Final
2023-10-03 14:18:54 +00:00
Roman Kudryashov
98c426dec4
DBZ-3642 CloudEventsConverter can retrieve metadata info from headers
2023-09-26 13:06:09 +02:00
Debezium Builder
cc1de0aa51
[maven-release-plugin] prepare for next development iteration
2023-09-22 09:00:45 +00:00
Debezium Builder
6809978083
[maven-release-plugin] prepare release v2.4.0.CR1
2023-09-22 09:00:45 +00:00
mfvitale
b4661881c9
DBZ-6945 Remove Table object for DROP schema event
2023-09-21 13:32:38 +02:00
rkerner
6d3528d4fb
DBZ-4395 Add connector specific Debezium Connect REST Extension/s and move logic from UI backend to the Debezium Connect REST Extension (part 2 of the re-architecturing/re-factoring)
...
DBZ-6761 Add "validate connection" endpoints in connector specific Connect REST extensions
closes to https://issues.redhat.com/browse/DBZ-4395
closes to https://issues.redhat.com/browse/DBZ-6761
2023-09-21 13:29:59 +02:00
mfvitale
68eb4b2df2
DBZ-6828 Process drop table events during blocking snapshot
2023-09-20 08:18:33 +02:00
mfvitale
ae199d2053
DBZ-6828 Blocking snapshot will generate schema events only for signaled tables
2023-09-20 08:18:33 +02:00
mfvitale
19ee1070f5
DBZ-6937 Incremental snapshot context is initialized in processSchemaChange method to avoid NPE when no context from initial snapshot exists
2023-09-20 08:14:36 +02:00
Debezium Builder
65169a9315
[maven-release-plugin] prepare for next development iteration
2023-09-13 09:41:46 +00:00
Debezium Builder
845e3e9d09
[maven-release-plugin] prepare release v2.4.0.Beta2
2023-09-13 09:41:46 +00:00
harveyyue
fe300784b0
DBZ-6865 Avoid getting NPE when executing the arrived method in ExecuteSnapshot
2023-09-04 08:59:31 +02:00
Debezium Builder
d97a18e8dc
[maven-release-plugin] prepare for next development iteration
2023-08-29 11:41:08 +00:00
Debezium Builder
5ce25f2cfe
[maven-release-plugin] prepare release v2.4.0.Beta1
2023-08-29 11:41:08 +00:00
Hang Ruan
43a86b2a46
DBZ-6824 fix review and enrich tests
2023-08-24 16:09:22 -04:00
Hang Ruan
99e9a1f880
DBZ-6824 trim default value for the BIGINT and SMALLINT types when parsing MySQL DDL
2023-08-24 16:09:22 -04:00
mfvitale
542b3619fa
DBZ-6731 Blocking snapshot takes configuration from signal payload
2023-08-15 12:43:43 +02:00
Jiri Novotny
b0be5b4808
DBZ-6791 Set ssl mode to disabled in pom.xml
2023-08-15 06:20:32 +02:00
Jiri Novotny
ef404bd1cd
DBZ-6791 Disable default ssl in tests
2023-08-15 06:20:32 +02:00
Stein Rolevink
80b1518057
DBZ-6786 Add checks to TransactionPayloadIT
2023-08-14 17:24:38 +02:00
Stein Rolevink
5e2f115959
DBZ-6786 Use custom row deserializers in case of binlog compression
2023-08-14 17:24:38 +02:00
Debezium Builder
3c72f071b0
[maven-release-plugin] prepare for next development iteration
2023-08-09 10:33:06 +00:00
Debezium Builder
915c465440
[maven-release-plugin] prepare release v2.4.0.Alpha2
2023-08-09 10:33:06 +00:00
Jiri Pechanec
9f3d401926
DBZ-6783 Reformat code
2023-08-09 10:44:39 +02:00
Ryan van Huuksloot
4f49d2f6fe
DBZ-6783 Upgrade MySQL Binlog Client to v0.28.1
2023-08-09 10:44:39 +02:00
Gurps Bassi
f4c029f5d1
DBZ-6727 use correct config for driver
2023-08-03 11:53:50 +02:00
mfvitale
61651a94b5
DBZ-6566 Force blocking snapshot even if a snapshot has already executed
2023-08-03 09:22:24 +02:00
mfvitale
def7379a0d
DBZ-6566 Support Blocking snapshot for MySQL
2023-08-03 09:22:24 +02:00
Jiri Pechanec
3212f3e919
DBZ-6714 Tested field is mandatory
2023-07-25 17:51:44 +02:00
Nikhil Benesch
8ba637f3be
DBZ-6714 Set precision of MySQL unsigned bigints in output decimal type
...
When using the "precise" configuration for
`bigint.unsigned.handling.mode`, the output decimal types were not
specifying a precision. Adjust the code to generate an Avro schema with
a decimal precision of 20, which is sufficient to represent all possible
unsigned bigints.
2023-07-25 17:51:44 +02:00
jcechace
699a1612ae
DBZ-6670 Replace error handler instead of recreate in order to keep retry counter
2023-07-25 13:46:56 +02:00
Debezium Builder
267dfda8a6
[maven-release-plugin] prepare for next development iteration
2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29
[maven-release-plugin] prepare release v2.4.0.Alpha1
2023-07-17 10:40:52 +00:00
jcechace
318c55cc74
DBZ-6659 Fixing junit dependencies
2023-07-14 09:11:10 +02:00
harveyyue
e3f684170e
DBZ-6472 MySqlSnapshotChangeEventSource parallel execute createSchemaEventsForTables
2023-07-13 13:21:59 +02:00
harveyyue
5bc7fd1f7c
DBZ-6603 Support for custom tags in the connector metrics
2023-07-13 09:52:33 +02:00
jcechace
5cb579bf12
DBZ-6525 Removing runtime dependency on core for testcontainers module in order to prevent logback.xml downstream conflicts
2023-07-11 12:07:04 +02:00
mfvitale
d5febcc054
DBZ-6417 Provide extensible signal action mechanism through SPI
2023-06-23 15:03:27 +02:00
mfvitale
9ed928a1c9
DBZ-6416 Improve tests stability
2023-06-22 13:22:34 +02:00
mfvitale
34e28ac52d
DBZ-6416 Add initial snapshot notifications
2023-06-22 13:22:34 +02:00
Debezium Builder
60f730d383
[maven-release-plugin] prepare for next development iteration
2023-06-20 13:21:31 +00:00
Debezium Builder
150396e4c8
[maven-release-plugin] prepare release v2.3.0.Final
2023-06-20 13:21:31 +00:00
kate
a06db8d2e5
DBZ-6570 Fix ConcurrentModificationException in KafkaSignal
2023-06-20 08:55:48 +02:00
mfvitale
043e4da49a
DBZ-6534 Adjust testNationalizedCharacterDataTypeMappings to be compatible with both MySQL 5.7 and 8.0
2023-06-19 07:50:17 +02:00
Jiri Pechanec
7e6c2ea75d
DBZ-6533 Disable test in parallel setup
2023-06-15 17:33:19 +02:00
Jiri Pechanec
067683e56a
DBZ-6076 Consistent config for all connectors
2023-06-15 11:55:28 +02:00
Anil Dasari
0431a8b9fc
DBZ-6076: Add support for custom SourceInfoStructMaker for adding new fields to source field
2023-06-15 11:55:28 +02:00
Jiri Pechanec
08ed847095
DBZ-6533 Create a separate test db
2023-06-12 15:40:03 +02:00
Andrei Isac
fcc325845f
DBZ-6533 add order_postfix table in ddl
2023-06-12 15:40:03 +02:00
Andrei Isac
573a91be07
DBZ-6533: fix table order on partial match when snapshotting
2023-06-12 15:40:03 +02:00
Debezium Builder
5d1b00588a
[maven-release-plugin] prepare for next development iteration
2023-06-09 09:23:38 +00:00
Debezium Builder
d1e6107517
[maven-release-plugin] prepare release v2.3.0.CR1
2023-06-09 09:23:37 +00:00
mfvitale
ca92f9094e
DBZ-6435 Add integration tests for TABLE
statement
2023-06-07 16:37:15 +02:00
mfvitale
7338fde84e
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
...
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
2023-06-07 07:36:58 +02:00
mfvitale
ba8a3e5062
DBZ-6511 Expose reset method on SignalChannelReader to reset processed signals
2023-06-05 17:33:07 +02:00
mfvitale
862180cd0e
DBZ-6511 Add test to ReadOnlyIncrementalSnapshotIT to signal through FileSignalChannel
2023-06-05 17:33:07 +02:00
mfvitale
4d56bbd15a
DBZ-6511 Restore Kafka signal offset only when KafkaSignalChannel is enabled
2023-06-05 17:33:07 +02:00
Ronak Jain
3f3967c2bb
DBZ-6366: Code Improvements for skip.messages.without.change
...
Addresses/Closes DBZ-6366
2023-06-05 14:50:25 +02:00
Debezium Builder
aa5b2131fc
[maven-release-plugin] prepare for next development iteration
2023-05-26 10:35:20 +00:00
Debezium Builder
9cc9b3c29a
[maven-release-plugin] prepare release v2.3.0.Beta1
2023-05-26 10:35:20 +00:00
mfvitale
dc00f64bbf
DBZ-6447 Incremental snapshot notification ids are now equal to the id sent in the execute-snapshot
signal.
2023-05-23 09:57:05 +02:00
Debezium Builder
a5b44767bc
[maven-release-plugin] prepare for next development iteration
2023-05-11 11:05:24 +00:00
Debezium Builder
1b1a7531f2
[maven-release-plugin] prepare release v2.3.0.Alpha1
2023-05-11 11:05:24 +00:00
mfvitale
7429b4e6f1
DBZ-1973 Add incremental snapshot notifications
2023-05-10 12:22:02 +02:00
mfvitale
811b800f55
DBZ-1973 Add support for Notifications
...
DBZ-1973 Add more tests for other connectors
DBZ-1973 Add send method with offset parameter
DBZ-1973 Instantiate NotificationService in the task class
DBZ-1973 Instantiate NotificationService in the task class
DBZ-4027 Move specific sink channel configuration to SinkNotificationChannel
DBZ-4027 Remove not used SPI file
DBZ-1973 Moved SPI file definition to debezium-core
DBZ-1973 Rename KafkaNotificationChannel to more generic SinkNotificationChannel
DBZ-1973 Code refactor
DBZ-1973 Improve configuration property description
DBZ-1973 Improve test
DBZ-1973 Add close method to NotificationChannel
DBZ-1973 Implement KafkaNotificationChannel
DBZ-1973 Add NotificationService and LogNotificationChannel
2023-05-10 12:22:02 +02:00
kate
6c338754b3
DBZ-6440 Init Kafka signal channel
2023-05-09 06:48:39 +02:00
mfvitale
952340286e
DBZ-4027 Make signalling channel configurable
...
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Code style
DBZ-4027 Make SignalPayload more generic and extensible
DBZ-4027 Rename DatabaseSignalChannel to SourceSignalChannel
DBZ-4027 Improve logging
DBZ-4027 Moved SPI file definition to debezium-core
DBZ-4027 Move SignalProcessor synchronization point to be processed only when a signal cdc event arrives.
DBZ-4027 Add EventDispatcher constructor without signalProcessor for spanner connector
DBZ-4027 Fix NPE
DBZ-4027 Fix NPE
DBZ-4027 Formatting
DBZ-4027 Correctly manage signal on not supported connector
DBZ-4027 Use the correct MongoDbOffset
DBZ-4027 Correctly initialize offset for Oracle and SqlServer connectors
DBZ-4027 Register SPI implementations
DBZ-4027 Improve SignalProcessor instantiation
DBZ-4027 Pass source info in case of SchemaChanges action
DBZ-4027 Manage close event in a synchronous way
DBZ-4027 Correctly init offset context also in case of snapshot mode 'never'
DBZ-4027 Fix MySqlMetricsIT test
DBZ-4027 Move KafkaSignalChannel to core
DBZ-4027 Move KafkaSignalChannel to core
DBZ-4027 Set pass offset context after initial snapshot to SignalProcessor
DBZ-4027 Pass OffsetContext to signal processor
DBZ-4027 Pass CommonConnectorConfig to SignalChannelReader init method
DBZ-4027 Move Incremental snapshot window actions to dedicated package
DBZ-4027 Align SignalsIT test with new code
DBZ-4027 Fix SignalsIT test
DBZ-4027 Fix SignalProcessor scheduling
DBZ-4027 Moved DatabaseSignalChannel and SignalChannelReader to dedicated package
DBZ-4027 Start SignalProcessor from ChangeEventSourceCoordinator
DBZ-4027 Create SignalProcessor and renamed Signal to DatabaseSignalChannel
DBZ-4027 Initial refactoring of signal feature
2023-05-05 13:35:40 +02:00
Jiri Pechanec
58ef4f0b98
DBZ-6157 Disable potentially dangerous MySQL JDBC props
2023-05-04 11:54:04 +02:00
harveyyue
3860a4faca
DBZ-6388 __source_ts_ms r (read) operation date is set to future for SQL Server
2023-05-02 08:11:02 -04:00
Nir Levy
f5555a894e
DBZ-6357 Fix parsing of NATIONAL CHAR
2023-05-02 08:02:32 -04:00
ani-sha
a453c3ca19
DBZ-6259 Add missing description of various snapshot modes in the connector field definitions
2023-05-01 11:03:04 -04:00
Frederic Laurent
84b2e29698
DBZ-6340 Make preferred the new default SSL mode for the MySQL connector
2023-04-26 12:48:04 +02:00
Debezium Builder
bb1b79f3bd
[maven-release-plugin] prepare for next development iteration
2023-04-20 09:09:43 +02:00
Debezium Builder
5483b4de99
[maven-release-plugin] prepare release v2.2.0.Final
2023-04-20 09:09:43 +02:00
hiscat
f07ec7ae5f
DBZ-6361 Remove superfluous signal prefix
2023-04-19 13:08:18 +02:00
Jiri Pechanec
f4c200ac3e
DBZ-2979 Fix tests
2023-04-19 09:04:29 +02:00
Ronak Jain
465b355dd0
DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
...
* Add More Test Cases
Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Ronak Jain
762122ecf5
DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
...
* Add Mysql and SqlServer Connector Changes
* Change Docs
* Clean Test Case
* Formatting and Checkstyle
Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Debezium Builder
976a47a3a3
[maven-release-plugin] prepare for next development iteration
2023-04-14 08:46:06 +00:00
Debezium Builder
1ca8399e8b
[maven-release-plugin] prepare release v2.2.0.CR1
2023-04-14 08:46:06 +00:00
Vojtech Juranek
44f2f40c56
DBZ-6216 Update testcontainers to use quay.io images
...
When needed update also version.
Update also leftovers in readme files.
2023-04-12 14:07:35 +02:00
harveyyue
c525f34cd0
DBZ-6070 DDL events not stored in schema history topic for excluded tables
2023-04-06 12:10:30 +02:00
Jiri Pechanec
063a65e4ac
DBZ-6304 Upgrade MySQL driver and change Maven coordinates
2023-04-04 10:46:54 +02:00
Mark Bereznitsky
d4d116e45b
DBZ-6271 add throwing of stack trace and a warn log
2023-04-04 06:57:57 +02:00
Mark Bereznitsky
ded4707108
DBZ-6271 allow for quiet failure of bin log retrieval
2023-04-04 06:57:57 +02:00
Mark Bereznitsky
4b41e0e649
DBZ-6271 allow binlog to be absent when doing a snapshot only
2023-04-04 06:57:57 +02:00
Debezium Builder
5c650fd054
[maven-release-plugin] prepare for next development iteration
2023-03-31 10:00:16 +00:00
Debezium Builder
68ffc4833b
[maven-release-plugin] prepare release v2.2.0.Beta1
2023-03-31 10:00:16 +00:00
Chris Cranford
621ee17f81
DBZ-6225 DBZ-6226 DBZ-6231 Fix test failure
2023-03-29 08:27:03 +02:00
harveyyue
c9c1ce8a2f
DBZ-6185 Zerofill property failed for different int types
2023-03-28 09:34:58 +02:00
Chris Cranford
1c5f14f7fd
DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
...
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).
In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.
In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set. By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
harveyyue
1877906dd8
DBZ-6197 Remove duplicated createDdlFilter method from historized connector config
2023-03-13 10:56:43 +01:00
Debezium Builder
55d65e9618
[maven-release-plugin] prepare for next development iteration
2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1
[maven-release-plugin] prepare release v2.2.0.Alpha3
2023-03-08 11:38:16 +00:00
PlugaruT
472162e46e
DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
...
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
Jiri Pechanec
d492ec892c
DBZ-823 Use enum for enumeration
2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c
DBZ-823 Restrict the type with generics
2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee
DBZ-823 Add JavaDoc to new interfaces
2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211
DBZ-823 Don't use getter based name
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6
DBZ-823 Use better name for CF with main connection
2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0
DBZ-823 CR changes
2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9
DBZ-823 Optionally parallelize initial snapshots
2023-03-03 12:47:15 +01:00
Debezium Builder
2245ceda44
[maven-release-plugin] prepare for next development iteration
2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a
[maven-release-plugin] prepare release v2.2.0.Alpha2
2023-02-16 11:28:25 +00:00
harveyyue
57b902ff8c
DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector
2023-02-02 13:21:45 +01:00
harveyyue
003bef0736
DBZ-5743 Introduce a new unicode topic naming strategy
2023-02-02 13:21:45 +01:00
Jiri Pechanec
c487d3aee2
DBZ-6059 Revert "DBZ-4663 Remove option for specifying driver class from MySQL Connector"
...
This reverts commit 115d7c2d81
.
2023-01-31 13:14:01 +01:00
Liz Chatman
8a6fdab5d7
DBZ-2296 return false instead of true from isGtidModeEnabled for GTID_MODEs of OFF_PERMISSIVE and ON_PERMISSIVE
2023-01-26 07:43:13 +01:00
harveyyue
bd47d7396d
DBZ-6003 Add more case to method to MySqlConnectorIT.shouldProcessCreateUniqueIndex
2023-01-26 07:39:28 +01:00
harveyyue
735b763075
DBZ-6003 Nullable columns marked with "optional: false" in DDL events
2023-01-26 07:39:28 +01:00
harveyyue
9ee39691bf
DBZ-5798 Data type conversion failed for mysql bigint
2023-01-25 12:25:24 +01:00
harveyyue
0aed5d5fe9
DBZ-6040 Remove the redundancy "schema.history.internal" from MySqlConnectorConfig
2023-01-25 09:13:20 +01:00
Jiri Pechanec
acc9203c5c
DBZ-6029 Use single regex
2023-01-25 06:10:18 +01:00
harveyyue
184e9725ab
DBZ-6029 Unexpected format for TIME column: 8:00
2023-01-25 06:10:18 +01:00
Debezium Builder
04f5291a2d
[maven-release-plugin] prepare for next development iteration
2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e
[maven-release-plugin] prepare release v2.2.0.Alpha1
2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb
DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result
2023-01-19 09:24:02 +01:00
Jeremy Ford
8da86b78e8
DBZ-5879 Fix unit tests
2023-01-18 14:46:14 +01:00
Jiri Pechanec
bcd6787cdc
DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
...
This reverts commit 6d8bcd42fd
.
2023-01-17 10:40:20 +01:00
Jiri Pechanec
0c5e4f0051
DBZ-6002 Fix tests now requiring fractions
2023-01-13 12:00:00 +01:00
akshansh
66c9ab20c8
DBZ-5996 Removed * import
2023-01-11 12:09:26 +01:00
akshansh
444dab3ffa
DBZ-5996 Handled case where fractionalWidth was -1
2023-01-11 12:09:26 +01:00
akshansh
b87d80f462
DBZ-5996 Implemented custom DateTimeFormatter to parse ZonedDateTime while preserving length of column.
2023-01-11 12:09:26 +01:00
harveyyue
5e56ad75f8
DBZ-5985 Disable to print invalid estimated row count when config "snapshot.select.statement.overrides"
2023-01-11 09:20:15 +01:00
Jochen Schalanda
44bcedaa72
DBZ-5993 Remove superfluous placeholder in log message (MySqlDatabaseSchema)
...
The warning message emitted when the Debezium Connector for MySQL
encounters an unparseable DDL statement contains a superfluous
placeholder.
2023-01-11 08:57:12 +01:00
govi20
6d8bcd42fd
DBZ-3653 Introduce incremental.snapshot.isolation.mode config
2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5
DBZ-4669 Reformat after plugin version consolidation
2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6
DBZ-2439 Remove redundant modifiers
2023-01-11 06:44:53 +01:00
harveyyue
115d7c2d81
DBZ-4663 Remove option for specifying driver class from MySQL Connector
2023-01-06 09:23:34 -05:00
erdinc
0e8163daca
DBZ-5976 Use as much as possible "replace" method rather than "replaceAll"
2023-01-05 07:30:49 +01:00
Debezium Builder
cf1720e4cb
[maven-release-plugin] prepare for next development iteration
2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd
[maven-release-plugin] prepare release v2.1.0.Final
2022-12-22 10:11:53 +00:00
Raul Estrada
c1493c8e20
DBZ-3575 Comments review
2022-12-21 12:34:17 +01:00
Raul Estrada
282717fa55
DBZ-3575 Implement support for JSON_TABLE in MySQL parser
2022-12-21 12:34:17 +01:00
Debezium Builder
177a60a9d3
[maven-release-plugin] prepare for next development iteration
2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c
[maven-release-plugin] prepare release v2.1.0.Beta1
2022-12-16 09:33:38 +00:00
Raul Estrada
dd96ccc27d
DBZ-5888 MariaDB-grammar
2022-12-14 14:42:29 +01:00
Vojtech Juranek
163ea307aa
DBZ-5838 Skip Avro validation in tests which fail due to apicurio-registry #2980
2022-12-12 14:44:05 +01:00
mfvitale
4c941b63ed
DBZ-5847: Add support for all connectors
...
Support for qualified table names
2022-12-12 14:40:56 +01:00
mfvitale
d12811e9aa
DBZ-5847: Add documentation
2022-12-12 14:40:56 +01:00
mfvitale
bd680224da
DBZ-5847: Add ComputePartition Transformation.
...
This new SMT permits to assign record to a specific partition based on configured table field name hash.
2022-12-12 14:40:56 +01:00
Marcelo Avancini
7754163c5d
DBZ-2432: Fixing misuse of assertj
...
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
2022-12-08 13:10:26 +01:00