Commit Graph

9125 Commits

Author SHA1 Message Date
Vojtech Juranek
60939c8965 DBZ-7099 Provide default value for PeriodicCommitOffsetPolicy
In 7b4cf1901 deprecated `io.debezium.embedded.spi.OffsetCommitPolicy`,
which provided also constructor for `Configuration`, was removed.
This constructor was actually used for creating `OffsetCommitPolicy`.
`Configuration` provides default values for options which are not
explicitly set, while `Properties` based constructor cannot do that
and therefore with this switch the default value for
`offset.flush.interval.ms` is now missing.

As debezium-api package has no knowledge about `Configuration`
interface, which is part of debezium-core, and thus about the default
values, specify default value direcly in the `PeriodicCommitOffsetPolicy`
class.
2023-11-14 06:58:11 +01:00
dependabot[bot]
893d8eb29f [ci] Bump actions/github-script from 6 to 7
Bumps [actions/github-script](https://github.com/actions/github-script) from 6 to 7.
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](https://github.com/actions/github-script/compare/v6...v7)

---
updated-dependencies:
- dependency-name: actions/github-script
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 19:18:01 -05:00
dependabot[bot]
033f4628a7 [ci] Bump tj-actions/changed-files from 40.1.0 to 40.1.1
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 40.1.0 to 40.1.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v40.1.0...v40.1.1)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 19:17:51 -05:00
Chris Cranford
74878523c7 DBZ-7135 Run MySQL CI configurations concurrently on GitHub 2023-11-13 19:16:57 -05:00
Vojtech Juranek
d46abde144 [docs] Mention SQL server instance name is ignored when port is specified 2023-11-13 12:21:55 +01:00
Jiri Pechanec
ef69dbe91c DBZ-6809 Fix imports 2023-11-10 16:06:43 +01:00
Jakub Cechacek
e88d00badb DBZ-6809 Added test for ExtractNewDocumentState with avro enabled on connector and transformation levels 2023-11-10 16:06:43 +01:00
Jiri Pechanec
acab36bd02 [docs] Expose Informix docs 2023-11-10 14:44:19 +01:00
mfvitale
013671b245 DBZ-6317 Document batch.size property for JDBC Sink Connector 2023-11-10 14:22:31 +01:00
Jiri Pechanec
3e64bd87bc DBZ-4999 [docs] Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-11-10 14:07:17 +01:00
Lars M Johansson
56bc1286c5 DBZ-4999 [docs] Update documentation/modules/ROOT/pages/connectors/informix.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-11-10 14:07:17 +01:00
Lars M Johansson
1455c971bf DBZ-4999 [docs] typo in Informix documentation (cdc.batchsize -> cdc.buffersize) 2023-11-10 14:07:17 +01:00
Lars M Johansson
69dec4881f DBZ-4999 [docs] Updated documentation of Informix connector 2023-11-10 14:07:17 +01:00
Lars M Johansson
921f2ef91d DBZ-4999 [docs] Documentation of Informix connector 2023-11-10 14:07:17 +01:00
Vojtech Juranek
105cd22dff [docs] Remove deprecated embedded engine documentation 2023-11-10 13:46:59 +01:00
Debezium Builder
5b6bc75293 [release] Development version for testing module deps 2023-11-10 10:35:27 +00:00
Debezium Builder
1521445908 [maven-release-plugin] prepare for next development iteration 2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138 [maven-release-plugin] prepare release v2.5.0.Alpha2 2023-11-10 10:26:05 +00:00
Debezium Builder
119aadead3 [release] Stable 2.5.0.Alpha2 for testing module deps 2023-11-10 10:24:05 +00:00
Jiri Pechanec
4eb3e665bf [release] Changelog for 2.5.0.Alpha2 2023-11-10 11:21:26 +01:00
Jiri Pechanec
f3eb643822 DBZ-7043 Use code idiom 2023-11-10 10:53:00 +01:00
Vadzim Ramanenka
a46069a8f7 DBZ-7043: Emit a notification when completed reading from a capture instance
Let the database know when the connector has finished reading
from a capture instance by calling a stored procedure.
2023-11-10 10:53:00 +01:00
Chris Cranford
34df6ade4d DBZ-6942 Verify no log sequence gaps on log switch
There is a corner case where it's possible the Oracle connector may query
the Oracle metadata tables quicker than the ARC process can generate an
archive log history record in V$ARCHIVED_LOG, and this can lead to a race
condition where we may incorrectly advance the connector forward to start
mining a group of logs when a log sequence gap exists in the log ranges.

For users who use the online_catalog strategy, there are some checks that
LogMiner does automatically which it skips, and one is with log sequence
gaps. This fix enforces that check by Debezium even for users who may use
the faster online_catalog mode so that no logs are omitted and events
could be missed.
2023-11-10 09:49:10 +01:00
mfvitale
33dc8e0ec6 DBZ-6317 Document tombstone behaviour 2023-11-10 06:43:18 +01:00
Jiri Pechanec
4f485caca3 DBZ-7119 Allow empty column list in INSERT 2023-11-09 14:25:14 +01:00
Chris Cranford
b834a3a66a DBZ-6963 Test should only apply to LogMiner 2023-11-09 10:58:01 +01:00
Chris Cranford
81d30a1224 DBZ-6963 Fix test failure 2023-11-09 10:58:01 +01:00
Chris Cranford
a4346222a7 DBZ-6963 Checkstyle fixes 2023-11-09 10:58:01 +01:00
Chris Cranford
b69dbd53e6 DBZ-6963 Do not merge events if table has no LOB columns
There was a possible situation where if a long transaction consisted of
updating and inserting into the same table with identical keys with a
given sequence that the commit handler would merge several events for a
table without LOB columns, resulting in a difference in expected events
in the Kafka topic vs what was seen in LogMiner.
2023-11-09 10:58:01 +01:00
Jakub Cechacek
468b6e431e DBZ-6726 Documenting split handling mode for oversized change events 2023-11-09 10:55:40 +01:00
Chris Cranford
da9c2bfeb4 DBZ-7085 Fix default value handling in tests 2023-11-09 10:00:33 +01:00
Chris Cranford
2bff852174 DBZ-7085 Fix temporal reader MariaDB implementation 2023-11-09 10:00:33 +01:00
Chris Cranford
8ff03447e4 DBZ-7085 Implement simple MariaDB protocol field reader 2023-11-09 10:00:33 +01:00
Chris Cranford
35a536aefc DBZ-7085 Apply MariaDB unique fetchSize requirements
Per https://jira.mariadb.org/browse/CONJ-977, the MariaDB team does not
believe that the Integer.MIN_VALUE solution for triggering streaming is
spec compliant and as of MariaDB 3.x+ drivers, they explicitly will not
allow this.

This change explicitly sets the fetchSize to 1 to mimic the same style
of behavior that the default fetchSize uses when using MySQL. If a user
provides a custom fetchSize, that will take precedences.
2023-11-09 10:00:33 +01:00
Chris Cranford
47df821c6d DBZ-7085 Don't use MySQL test artifacts in JDBC storage tests 2023-11-09 10:00:33 +01:00
Chris Cranford
b849effaf9 DBZ-7085 Add MariaDB and use it with MariaDB profile 2023-11-09 10:00:33 +01:00
Chris Cranford
0f4d2f2b1a DBZ-7085 Fix test suite to protocol-based factory URL 2023-11-09 10:00:33 +01:00
ani-sha
700942b258 DBZ-6874 Drop MySQL 5.7, test MySQL 8.0 & adjust documentation 2023-11-09 09:26:26 +01:00
Chris Cranford
7532e52228 DBZ-7120 Add a connection max retry limit to Redis schema history 2023-11-09 07:59:58 +01:00
Jiri Pechanec
9d84d01f64 DBZ-6726 Switch to ArrayList for repeated iteration 2023-11-09 07:57:12 +01:00
Jakub Cechacek
89b07a013e DBZ-6726 support for $changeStreamSplitLargeEvent aggregation in MongoDB connector 2023-11-09 07:57:12 +01:00
dependabot[bot]
7b23b31408 [ci] Bump tj-actions/changed-files from 39.2.4 to 40.1.0
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 39.2.4 to 40.1.0.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v39.2.4...v40.1.0)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-08 17:39:57 -05:00
Jiri Pechanec
be2ec95aa8 [docs] Fix param names 2023-11-08 13:27:34 +01:00
Jakub Cechacek
2f70c30962 DBZ-6875 Ensuring root user is created when using authenticated mongo rs 2023-11-08 13:13:43 +01:00
Rafael Câmara
83e6f28e41 [docs] Add commas to SQL Server connector configuration example. 2023-11-08 12:54:35 +01:00
ani-sha
16ab761bed DBZ-6873 Deprecate expire_logs_days, use binlog_expire_logs_seconds 2023-11-08 07:06:27 +01:00
ani-sha
e7a9430de3 DBZ-6873 Support MySQL 8.2 2023-11-08 07:06:27 +01:00
ani-sha
54be3bb663 DBZ-6873 Use percona server version 8.0 2023-11-08 07:06:27 +01:00
ani-sha
519c382153 DBZ-6873 Support MySQL 8.1 2023-11-08 07:06:27 +01:00
Bob Roldan
f9c321024b DBZ-7108 Minor edit to description of mongodb.connection.mode property 2023-11-08 05:59:39 +01:00