Vojtech Juranek
4452e3d095
DBZ-7024 Move EmbeddedConfig into separate class
...
`EmbeddedConfig` needs to be shared with other implmentations of
`DebeziumEngine` as long as Debezium embedded depends on the Kafka
model.
2024-02-12 13:43:21 +01:00
mfvitale
3ff775ea6c
DBZ-7301 Add test for a custom Snapshotter and SnapshotQuery
2024-02-06 07:12:42 +01:00
mfvitale
a8a07e35f1
DBZ-7301 Implement SnapshotLock for MySQL connector
2024-02-06 07:12:42 +01:00
mfvitale
6cb01f67d1
DBZ-7301 Implement SnapshotQuery for MySQL connector
2024-02-06 07:12:42 +01:00
mfvitale
0e68bc642d
DBZ-7301 Support Snapshotter for MariaDB
2024-02-06 07:12:42 +01:00
mfvitale
1cdf2836dd
DBZ-7301 Implement Snapshotter for MySQL connector
2024-02-06 07:12:42 +01:00
mfvitale
f78d0cbd19
DBZ-7301 Add SnapshotterService to ChangeEventSourceFactory and SnapshotChangeEventSource
2024-02-06 07:12:42 +01:00
mfvitale
d0e4ad7e14
DBZ-7441 Postpone SignalProcessor start after streaming is initialized
...
This will avoid that channels that not depends on the event streaming like the 'source' channel, will start processing signals before the IncrementalSnapshotChangeEventSource is initialized.
2024-02-05 14:06:40 +01:00
nicholas-fwang
4b62ee44f7
DBZ-7143 Fix test code for database replica environment
2024-01-29 13:48:19 +01:00
nicholas-fwang
1f8c957d18
DBZ-7143 Use log with trace record
2024-01-29 13:48:19 +01:00
nicholas-fwang
be35033d6b
DBZ-7143 fix format
2024-01-29 13:48:19 +01:00
nicholas-fwang
fcee5e7bdc
DBZ-7143 Add constructor for testing in MysqlValueConverters
2024-01-29 13:48:19 +01:00
nicholas-fwang
d710ee6b9f
DBZ-7143 Rollback ValueConverter and handle when parse default value
2024-01-29 13:48:19 +01:00
nicholas-fwang
5aae5f51f4
DBZ-7143 Move event converting failure handler to ValueConverter interface.
2024-01-29 13:48:19 +01:00
nicholas-fwang
a36caea1de
DBZ-7143 Add table DATE_TIME_TABLE_CONNECT_MODE to avoid consume error when connect mode
2024-01-29 13:48:19 +01:00
nicholas-fwang
7d99605886
DBZ-7143 Add case when EventConvertingFailureHandlingMode is null
2024-01-29 13:48:19 +01:00
nicholas-fwang
4f2bbb023a
DBZ-7143 fix checkstyle format
2024-01-29 13:48:19 +01:00
nicholas-fwang
57a46943af
DBZ-7143 throw exception in JdbcValueConverters
2024-01-29 13:48:19 +01:00
nicholas-fwang
eeea0f1e70
DBZ-7143 Add event.converting.failure.handling.mode option
2024-01-29 13:48:19 +01:00
Animesh Kumar
986303babc
DBZ-7376 Fix logging for schema only recovery in mysql
2024-01-23 15:01:28 +01:00
Debezium Builder
65d63ed42d
[maven-release-plugin] prepare for next development iteration
2024-01-21 10:12:45 +00:00
Debezium Builder
485fa82a8f
[maven-release-plugin] prepare release v2.6.0.Alpha1
2024-01-21 10:12:44 +00:00
Vojtech Juranek
33c8430a84
DBZ-7356 Update comment to include relevant DBZ issue
2024-01-17 09:45:43 +01:00
Vojtech Juranek
5ca719d1d0
DBZ-7355 Skip Avro serialization validation
...
Test fails due to bug in Apicurio
https://github.com/Apicurio/apicurio-registry/issues/2980
2024-01-17 09:45:43 +01:00
Peter Hamer
e2c0a59ec3
DBZ-7347 Update notification tests.
2024-01-17 09:42:27 +01:00
Jakub Cechacek
5dbe073d3b
DBZ-7260 Offset value conversion extracted into common util class
2024-01-11 09:58:24 +01:00
mfvitale
20fbe73bc8
DBZ-7311 Use a more meaningful name for identify an on demand blocking snapshot
2024-01-08 12:52:03 +01:00
mfvitale
47cbdee526
DBZ-7311 Permits to execute a blocking snapshot even if snapshot.mode=never
2024-01-08 12:52:03 +01:00
Mickael Maison
70e7186868
DBZ-7298 Add service loader manifests for all Connect plugins
...
Add manifests for source/sink connectors, converters and transformations.
2024-01-04 09:22:29 +01:00
Debezium Builder
3853d20f44
[maven-release-plugin] prepare for next development iteration
2023-12-21 06:52:01 +00:00
Debezium Builder
5d35e9caaa
[maven-release-plugin] prepare release v2.5.0.Final
2023-12-21 06:52:01 +00:00
ani-sha
4b36ed9975
DBZ-7177 DBZ-6764 Use correct context name and add suggestions for code review
2023-12-20 08:56:56 +01:00
ani-sha
5a27d42257
DBZ-7177 Add isStreaming check for all tests, remove unused files
2023-12-20 08:56:56 +01:00
rkerner
e06f96f339
DBZ-6764 Fix waitForStreamingRunning/isStreamingRunning
2023-12-20 08:56:56 +01:00
ani-sha
a12b1a9872
DBZ-6764 Connector metrics implementation for REST extension
2023-12-20 08:56:56 +01:00
ani-sha
5841eacb79
DBZ-7177 Wait for streaming, adjust test cases
2023-12-20 08:56:56 +01:00
ani-sha
e535e5b78d
DBZ-7177 Add suggestions from code review, adjust code style changes
2023-12-20 08:56:56 +01:00
ani-sha
2555a1cee2
DBZ-6764 DBZ-7178 DBZ-7177 Use MBeanServer to query metrics for REST endpoint and create new metrics descriptor
2023-12-20 08:56:56 +01:00
ani-sha
2165d9bed1
DBZ-6764 Connector metrics implementation for REST extension
2023-12-20 08:56:56 +01:00
Roman Kudryashov
516aa87fad
DBZ-7235 Add option to customize CloudEvents schema name
2023-12-20 06:53:37 +01:00
Jiri Pechanec
7354f7aa38
DBZ-7251 Enable fitering of MySQL connector
2023-12-19 17:29:37 +01:00
“vsantonastaso”
9dac11e1cd
DBZ-7164 Support offset commit for the signal topic
2023-12-19 15:51:10 +01:00
harveyyue
225277c5c0
DBZ-7251 Return generic DataCollectionId instead of REST response DataCollection in getMatchingCollections method
2023-12-19 12:53:57 +01:00
harveyyue
4719396ffc
DBZ-7145 Introduce a common parent connect for all Debezium source connectors
2023-12-19 12:53:57 +01:00
harveyyue
5553059fb8
DBZ-7167 Provide a public API from the connector implementations to retrieve the list of matching collections or tables based on the different include-/exclude lists
2023-12-19 12:53:57 +01:00
Vojtech Juranek
37ebb8ecae
DBZ-7275 Close connection registerd with bean registry
...
New connection created for bean registry is never closed. Close it
during when stopping the task.
2023-12-19 10:22:02 +01:00
Debezium Builder
2c1def7241
[maven-release-plugin] prepare for next development iteration
2023-12-14 09:43:13 +00:00
Debezium Builder
ef8260f802
[maven-release-plugin] prepare release v2.5.0.CR1
2023-12-14 09:43:12 +00:00
Chris Cranford
2b02b3982e
DBZ-4321 Rework configuration options
2023-12-13 11:27:40 -05:00
Chris Cranford
22a22d65d1
DBZ-4321 Pull getQualifiedTableName up to AbstractConnectorConnection
2023-12-13 11:27:40 -05:00
Chris Cranford
ada157d117
DBZ-4321 Introduce BeanRegistry
and ServiceRegistry
...
As a part of this work to handle injection in a cleaner way, this commit
adds two new broad concepts called `BeanRegistry` and `ServiceRegistry`.
A BeanRegistry is a glorified registry of different objects that are not
necessarily services but may be desired by a service. This contract will
allow Debezium to integrate in the future with other CDI providers.
A ServiceRegistry is more of an internal concept, where various systems
can be started based on their dependency order and provides a universal
way to split larger parts of the code into smaller, focused modules that
can be accessed using the Service Locator pattern.
2023-12-13 11:27:40 -05:00
Chris Cranford
26b3881941
DBZ-4321 Add MongoDB hook & polish injection handler
2023-12-13 11:27:40 -05:00
Chris Cranford
59027ed5ed
DBZ-4321 New PostProcessor
contract and Column Reselection
2023-12-13 11:27:40 -05:00
harveyyue
c5ce1cf945
DBZ-7251 Length value is not removed when changing a column's type
2023-12-12 10:18:21 +01:00
gongzhongqiang
018ecfe9f6
[polish] remove redundant Geometry type checking code
2023-12-08 10:16:46 +01:00
mfvitale
f275b1172c
DBZ-6834 Disable signal based watermarking tests on ReadOnlyIncrementalSnapshotIT
2023-12-06 14:10:26 +01:00
mfvitale
ee0a55a19c
DBZ-6834 Disable signal based watermarking tests on ReadOnlyIncrementalSnapshotIT
2023-12-06 14:10:26 +01:00
Jiabao Sun
d740bf52dd
DBZ-7230 MySQL BIT Type should have a default length 1
2023-12-06 07:15:26 +01:00
Debezium Builder
0fd1c0dc9a
[maven-release-plugin] prepare for next development iteration
2023-12-04 13:55:35 +00:00
Debezium Builder
3e2d75f0da
[maven-release-plugin] prepare release v2.5.0.Beta1
2023-12-04 13:55:35 +00:00
Lourens Naude
ae25b3a11a
DBZ-7183 Support MySQL 8 high resolution replication timestamps from GTID events
2023-11-30 20:30:12 -05:00
Lourens Naude
baa2ea1e0f
DBZ-7183 Remove dead code: setBinlogTimestampSeconds and getBinlogTimestampSeconds
2023-11-30 20:30:12 -05:00
“vsantonastaso”
8c1c369449
DBZ-6878 add table specific notification in initial snapshot
2023-11-29 08:32:21 +01:00
rkerner
fe0b83e7fb
DBZ-7179 Fix DebeziumMySqlConnectorResource not using the new MySQL adatper structure to support different MySQL flavors
...
closes to https://issues.redhat.com/browse/DBZ-7179
2023-11-24 07:15:08 +01:00
Chris Cranford
1ce4ebd668
DBZ-1482 Fix for mismatch source query during incremental snapshots
2023-11-23 13:54:53 +01:00
Chris Cranford
3c3bd504c8
DBZ-1482 Add some logging for test failure
2023-11-23 13:54:53 +01:00
Chris Cranford
b4790b36f3
DBZ-1482 Disable purged GTID tests for MariaDB - not applicable
2023-11-23 13:54:53 +01:00
Chris Cranford
8ca62c961c
DBZ-1482 Fix read-only incremental snapshot failures
2023-11-23 13:54:53 +01:00
Chris Cranford
e722845717
DBZ-1482 Don't initiate a transaction for every MariaDB GTID event.
...
There are use cases where MariaDB will send a GTID event to start a
transaction but that event will not conclude with a COMMIT and in
those cases, don't start a buffer transaction boundary.
2023-11-23 13:54:53 +01:00
Chris Cranford
25a68ba3ef
DBZ-1482 Fix MariaDB EventBuffer warnings
2023-11-23 13:54:53 +01:00
Chris Cranford
f5b0084216
DBZ-1482 Initial MariaDB GTID support
2023-11-23 13:54:53 +01:00
Chris Cranford
ebf940b1ad
DBZ-1482 Add MariaDB gtid replica bits
2023-11-23 13:54:53 +01:00
Chris Cranford
1deb01fd33
DBZ-7083 Relax REST extension validation
2023-11-23 13:54:53 +01:00
Chris Cranford
1d6a1ec6c1
DBZ-7083 Introduce strategy for MySQL and MariaDB
2023-11-23 13:54:53 +01:00
rkerner
aeaba3ae70
DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions
...
closes to https://issues.redhat.com/browse/DBZ-6762
2023-11-22 06:10:40 +01:00
Jiri Pechanec
31c343d00b
DBZ-7093 Code formatting
2023-11-15 12:59:54 +01:00
nicholas-fwang
7051f35bdf
DBZ-7093 fix checkstyle
2023-11-15 12:59:54 +01:00
nicholas-fwang
892dec2240
DBZ-7093 Check schema length to find missed DDL by SQL_BIN_LOG=OFF
2023-11-15 12:59:54 +01:00
Chris Cranford
74878523c7
DBZ-7135 Run MySQL CI configurations concurrently on GitHub
2023-11-13 19:16:57 -05:00
Debezium Builder
1521445908
[maven-release-plugin] prepare for next development iteration
2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138
[maven-release-plugin] prepare release v2.5.0.Alpha2
2023-11-10 10:26:05 +00:00
Chris Cranford
da9c2bfeb4
DBZ-7085 Fix default value handling in tests
2023-11-09 10:00:33 +01:00
Chris Cranford
2bff852174
DBZ-7085 Fix temporal reader MariaDB implementation
2023-11-09 10:00:33 +01:00
Chris Cranford
8ff03447e4
DBZ-7085 Implement simple MariaDB protocol field reader
2023-11-09 10:00:33 +01:00
Chris Cranford
35a536aefc
DBZ-7085 Apply MariaDB unique fetchSize requirements
...
Per https://jira.mariadb.org/browse/CONJ-977 , the MariaDB team does not
believe that the Integer.MIN_VALUE solution for triggering streaming is
spec compliant and as of MariaDB 3.x+ drivers, they explicitly will not
allow this.
This change explicitly sets the fetchSize to 1 to mimic the same style
of behavior that the default fetchSize uses when using MySQL. If a user
provides a custom fetchSize, that will take precedences.
2023-11-09 10:00:33 +01:00
Chris Cranford
b849effaf9
DBZ-7085 Add MariaDB and use it with MariaDB profile
2023-11-09 10:00:33 +01:00
Chris Cranford
0f4d2f2b1a
DBZ-7085 Fix test suite to protocol-based factory URL
2023-11-09 10:00:33 +01:00
ani-sha
700942b258
DBZ-6874 Drop MySQL 5.7, test MySQL 8.0 & adjust documentation
2023-11-09 09:26:26 +01:00
ani-sha
16ab761bed
DBZ-6873 Deprecate expire_logs_days, use binlog_expire_logs_seconds
2023-11-08 07:06:27 +01:00
ani-sha
e7a9430de3
DBZ-6873 Support MySQL 8.2
2023-11-08 07:06:27 +01:00
ani-sha
54be3bb663
DBZ-6873 Use percona server version 8.0
2023-11-08 07:06:27 +01:00
ani-sha
519c382153
DBZ-6873 Support MySQL 8.1
2023-11-08 07:06:27 +01:00
Debezium Builder
78c5204444
[maven-release-plugin] prepare for next development iteration
2023-10-26 15:39:35 +00:00
Debezium Builder
356e488e83
[maven-release-plugin] prepare release v2.5.0.Alpha1
2023-10-26 15:39:35 +00:00
Chris Cranford
b9e4abdf06
DBZ-2913 Rearrange logging rules
2023-10-26 13:03:03 +02:00
Chris Cranford
0ab2d8d93c
DBZ-2913 Add mariadb-ssl
profile, fix init script execution order
2023-10-26 13:03:03 +02:00
Chris Cranford
a7989379c1
DBZ-2913 Add mariadb
profile and GitHub check for MariaDB
2023-10-26 13:03:03 +02:00
Chris Cranford
cec5b67c5a
DBZ-2913 Cleanup test suite connection leak
2023-10-26 13:03:03 +02:00
Chris Cranford
dcce6f61f5
DBZ-2913 Use new configurable MariaDB capabilities API
2023-10-26 13:03:03 +02:00
Chris Cranford
ef2e7b3c8f
DBZ-2913 Disable JSON test, MariaDB handles JSON differnetly
2023-10-26 13:03:03 +02:00