Commit Graph

8365 Commits

Author SHA1 Message Date
Chris Cranford
30eb53c764 DBZ-6254 Add LogMiner Query and Username Include Filtering
* Add `log.mining.query.filter.mode` configuration option
* Add `log.mining.username.include.list` configuration option
2023-05-09 11:31:08 +02:00
kate
6c338754b3 DBZ-6440 Init Kafka signal channel 2023-05-09 06:48:39 +02:00
Kanthi Subramanian
f70b215b51 DBZ-6433 Include column names in default insert for JDBC schema history. 2023-05-05 13:41:44 +02:00
Kanthi Subramanian
e97e54352f DBZ-6433 Make insert configurable for JDBC Schema history. 2023-05-05 13:41:44 +02:00
Kanthi Subramanian
7b146b094d DBZ-6433 Make insert and delete queries configurable for JDBC offset storage. 2023-05-05 13:41:44 +02:00
mfvitale
0ca87d8031 DBZ-4027 During event dispatch process only signal from source channel 2023-05-05 13:35:40 +02:00
mfvitale
952340286e DBZ-4027 Make signalling channel configurable
DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Add an Incremental snapshot test with kafka signaling

DBZ-4027 Code style

DBZ-4027 Make SignalPayload more generic and extensible

DBZ-4027 Rename DatabaseSignalChannel to SourceSignalChannel

DBZ-4027 Improve logging

DBZ-4027 Moved SPI file definition to debezium-core

DBZ-4027 Move SignalProcessor synchronization point to be processed only when a signal cdc event arrives.

DBZ-4027 Add EventDispatcher constructor without signalProcessor for spanner connector

DBZ-4027 Fix NPE

DBZ-4027 Fix NPE

DBZ-4027 Formatting

DBZ-4027 Correctly manage signal on not supported connector

DBZ-4027 Use the correct MongoDbOffset

DBZ-4027 Correctly initialize offset for Oracle and SqlServer connectors

DBZ-4027 Register SPI implementations

DBZ-4027 Improve SignalProcessor instantiation

DBZ-4027 Pass source info in case of SchemaChanges action

DBZ-4027 Manage close event in a synchronous way

DBZ-4027 Correctly init offset context also in case of snapshot mode 'never'

DBZ-4027 Fix MySqlMetricsIT test

DBZ-4027 Move KafkaSignalChannel to core

DBZ-4027 Move KafkaSignalChannel to core

DBZ-4027 Set pass offset context after initial snapshot to SignalProcessor

DBZ-4027 Pass OffsetContext to signal processor

DBZ-4027 Pass CommonConnectorConfig to SignalChannelReader init method

DBZ-4027 Move Incremental snapshot window actions to dedicated package

DBZ-4027 Align SignalsIT test with new code

DBZ-4027 Fix SignalsIT test

DBZ-4027 Fix SignalProcessor scheduling

DBZ-4027 Moved DatabaseSignalChannel and SignalChannelReader to dedicated package

DBZ-4027 Start SignalProcessor from ChangeEventSourceCoordinator

DBZ-4027 Create SignalProcessor and renamed Signal to DatabaseSignalChannel

DBZ-4027 Initial refactoring of signal feature
2023-05-05 13:35:40 +02:00
Jiri Pechanec
58ef4f0b98 DBZ-6157 Disable potentially dangerous MySQL JDBC props 2023-05-04 11:54:04 +02:00
Stephen Clarkson
4be4f5c874 [docs] resolve grammatical error with note
Property `skip.messages.without.change` in Postgresql Connector documentation has a note with a grammatical error.
2023-05-04 06:11:05 +02:00
Martin Medek
1347fca0af DBZ-1661 added mysql replication example images to release-pipeline job 2023-05-03 12:22:21 +02:00
Martin Medek
08ff44874c DBZ-1661 mysql replication tests refactor 2023-05-03 12:22:21 +02:00
Martin Medek
6919486175 DBZ-1661 moved the mysql replication test to its own class, fixed namespace preparation validation 2023-05-03 12:22:21 +02:00
Martin Medek
e7f38e9f27 DBZ-1661 refactor mysql init in ocp, mysql replication test is skipped in docker tests 2023-05-03 12:22:21 +02:00
Martin Medek
c7db4aee92 DBZ-1661 Added mysql replica instance and integration test for reading from mysql slave 2023-05-03 12:22:21 +02:00
Jiri Pechanec
ab5d643aa8 DBZ-6353 Use correct SQL codes for other cases 2023-05-03 12:15:18 +02:00
umachi
6ced91fe53 DBZ-6353 Add a conditions of 'OBJECT_IN_USE', 'NOT_IMPLEMENTED'. 2023-05-03 12:15:18 +02:00
Bob Roldan
b0bae55f4b DBZ-6046 Minor edits 2023-05-03 07:26:18 +02:00
Bob Roldan
954623183c DBZ-6046 Adds documentation about upgrading PG DB used by Debezium 2023-05-03 07:26:18 +02:00
Jiri Pechanec
6b1455666a DBZ-6411 Message content logged only at TRACE 2023-05-03 06:51:28 +02:00
mfvitale
e5d4332835 DBZ-6411 Fix HeaderToValue schema update cache.
When the connector starts for the first time with initial snapshot record with read operation will be created. In this phase the ExtractChangedRecordState will produce no headers and since HeaderToValue was not skipping record without headers the cache of the new schema will be created only with the old fields.
2023-05-03 06:51:28 +02:00
roldanbob
789f44043b
[docs] Fix typo
Insert missing character (on -> one)
2023-05-02 09:08:36 -04:00
miguelbirdie
63cc36e9a2 DBZ-6112 Set Replica Identity for PostgreSQL tables
Introduces a new PostgreSQL configuration parameter called `replica.autoset.type`. With this parameter, you can easily specify the Replica Identity value for each table that is captured by the connector
2023-05-02 14:33:46 +02:00
Jiri Pechanec
bd097117b9 DBZ-3621 Make Replace underscores with dots in param names 2023-05-02 14:15:19 +02:00
Jiri Pechanec
d1ee10af05 DBZ-3621 Make SELECT to check table presence configurable 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
6f72efa5eb DBZ-3621 Added option to set Create DDL and Select customizable for JDBC Schema history. 2023-05-02 14:15:19 +02:00
Jiri Pechanec
3372e5c450 DBZ-3621 Clean deps; add logging for tests; extrenalize config options 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
ba41b603eb DBZ-3621 Make select and insert queries configurable for JDBC offset storage. 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
d33472eeb8 DBZ-3621 Changed references to JDBC URI to JDBC URL 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
3f8b2a8d49 DBZ-3621 Changed references to JDBC URI to JDBC URL 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
646c77f117 DBZ-3621 Organize imports 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
9bedafdbf2 DBZ-3621 Address PR review comments and added javadocs. 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
4a36af6129 DBZ-3621 Address PR review comments and added javadocs. 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
3b22d6d457 DBZ-3621 Fixed JDBC offset store integration test. 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
dc67324da5 DBZ-3621 Added name to Aliases.txt 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
aca0da75e1 DBZ-3621 Added debezium jdbc storage module 2023-05-02 14:15:19 +02:00
Kanthi Subramanian
8be3806525 DBZ-3621 Added debezium-storage module to pom.xml 2023-05-02 14:15:19 +02:00
harveyyue
3860a4faca DBZ-6388 __source_ts_ms r (read) operation date is set to future for SQL Server 2023-05-02 08:11:02 -04:00
Nir Levy
f5555a894e DBZ-6357 Fix parsing of NATIONAL CHAR 2023-05-02 08:02:32 -04:00
dependabot[bot]
78c446b2d5 [ci] Bump tj-actions/changed-files from 35.9.0 to 35.9.2
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.9.0 to 35.9.2.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.9.0...v35.9.2)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-05-02 06:24:31 +02:00
roldanbob
d39db1a567
[docs] (main) Update link in description of the HoursToKeepTransactionInBuffer property
Updates the link in the description of the `HoursToKeepTransactionInBuffer` property so that it points to the entry for the `log.mining.transaction.retention.ms` property,  which supersedes `log.mining.transaction.retention.hours`, the original link target, which was removed in 2.2.
2023-05-01 17:17:45 -04:00
jcechace
21e3c14491 DBZ-6363 Support for MongoDB tests in UI build with Debezium 2.2 2023-05-01 11:35:47 -04:00
ani-sha
a453c3ca19 DBZ-6259 Add missing description of various snapshot modes in the connector field definitions 2023-05-01 11:03:04 -04:00
Chris Cranford
1e10253c5e DBZ-6256 Documentation updates 2023-05-01 10:41:05 -04:00
Chris Cranford
3f554645b6 DBZ-6256 Add log.mining.flush.table.name Oracle config option
There is the potential when using multiple connector deployments on Oracle that
there could be some level of lock contention with all connectors using the same
table. This allows users to configure the flush table name themselves, reducing
the lock contention across multiple connector deployments.
2023-05-01 10:41:05 -04:00
caicancai
473925c0a5 DBZ-6401 MySql in debezium-parser-ddl :The inserted sql statement reports an error 2023-05-01 10:27:28 -04:00
RJ Nowling
6c11e4d4ab DBZ-6348 Add documentation for HTTP Client JWT authentication 2023-05-01 10:09:38 -04:00
Ronak Jain
4fcf7ec056 DBZ-6321: chore(Postgres-Document) Document Requirements for multiple connectors on same db host
Addresses/Closes DBZ-6321
2023-05-01 10:06:43 -04:00
jcechace
d3d194f34d DBZ-6402 Using MongoCommandException to detect invalid change stream resume token in order to perform snapshot properly 2023-04-29 14:06:55 -04:00
Nir Levy
34aa5ed8b9 DBZ-6396 Honor slot.max.retries when committing LSN before starting replication 2023-04-28 15:01:26 +02:00
Chris Cranford
4664dd6df6 DBZ-6355 Add log.mining.transaction.retention.ms; deprecate log.mining.transaction.retention.hours 2023-04-27 09:28:29 -04:00