Commit Graph

9191 Commits

Author SHA1 Message Date
Kosta Kostelnik
3508913a3d DBZ-7153 - using an in-mem cache to process faster 2023-11-18 09:11:31 -05:00
ruslan
daf7f57d77 DBZ-7142 Improved Outbox Event Router SMT to handle whitespaces inside of fields.additional.placement setting 2023-11-16 11:57:34 +01:00
Roman Kudryashov
f429536a75 DBZ-7065 Docs for ConvertCloudEventToSaveableForm 2023-11-16 11:55:02 +01:00
Vojtech Juranek
d1c08f154d DBZ-7132 Document MySQL database.ssl.* options 2023-11-15 13:02:03 +01:00
Jiri Pechanec
31c343d00b DBZ-7093 Code formatting 2023-11-15 12:59:54 +01:00
nicholas-fwang
7051f35bdf DBZ-7093 fix checkstyle 2023-11-15 12:59:54 +01:00
nicholas-fwang
892dec2240 DBZ-7093 Check schema length to find missed DDL by SQL_BIN_LOG=OFF 2023-11-15 12:59:54 +01:00
mfvitale
a049ea92fa DBZ-7141 Remove ComputePartition SMT related code 2023-11-15 12:57:11 +01:00
harveyyue
2422df2fd0 DBZ-7140 Debezium-ddl-parser crashes on parsing MySQL DDL statement (specific UNION) 2023-11-14 20:32:27 -05:00
Jiri Pechanec
e654dc228f DBZ-7066 Code reorganization 2023-11-14 11:56:16 +01:00
harveyyue
41f9423caf DBZ-7066 Add test cases synchronously from "DBZ-6809" 2023-11-14 11:56:16 +01:00
harveyyue
223b6e4335 DBZ-7066 Extract common creating transformation methods to ConnectRecordUtil 2023-11-14 11:56:16 +01:00
harveyyue
4c3b5540ec DBZ-7066 Add NewExtractNewDocumentStateTest and NewExtractNewDocumentStateTestIT for new option "delete.tombstone.handling.mode" 2023-11-14 11:56:16 +01:00
harveyyue
d21d5838fc DBZ-7066 Add NewExtractNewRecordStateTest for new option "delete.tombstone.handling.mode" 2023-11-14 11:56:16 +01:00
harveyyue
5e8287eb40 DBZ-7066 The DefaultDeleteHandlingStrategy couldn't add the rewrite "__deleted" field to a non-struct value 2023-11-14 11:56:16 +01:00
Jiri Pechanec
0f86db81b3 DBZ-7099 Refactor to named constant 2023-11-14 06:58:11 +01:00
Vojtech Juranek
60939c8965 DBZ-7099 Provide default value for PeriodicCommitOffsetPolicy
In 7b4cf1901 deprecated `io.debezium.embedded.spi.OffsetCommitPolicy`,
which provided also constructor for `Configuration`, was removed.
This constructor was actually used for creating `OffsetCommitPolicy`.
`Configuration` provides default values for options which are not
explicitly set, while `Properties` based constructor cannot do that
and therefore with this switch the default value for
`offset.flush.interval.ms` is now missing.

As debezium-api package has no knowledge about `Configuration`
interface, which is part of debezium-core, and thus about the default
values, specify default value direcly in the `PeriodicCommitOffsetPolicy`
class.
2023-11-14 06:58:11 +01:00
dependabot[bot]
893d8eb29f [ci] Bump actions/github-script from 6 to 7
Bumps [actions/github-script](https://github.com/actions/github-script) from 6 to 7.
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](https://github.com/actions/github-script/compare/v6...v7)

---
updated-dependencies:
- dependency-name: actions/github-script
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 19:18:01 -05:00
dependabot[bot]
033f4628a7 [ci] Bump tj-actions/changed-files from 40.1.0 to 40.1.1
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 40.1.0 to 40.1.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v40.1.0...v40.1.1)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-13 19:17:51 -05:00
Chris Cranford
74878523c7 DBZ-7135 Run MySQL CI configurations concurrently on GitHub 2023-11-13 19:16:57 -05:00
Vojtech Juranek
d46abde144 [docs] Mention SQL server instance name is ignored when port is specified 2023-11-13 12:21:55 +01:00
Jiri Pechanec
ef69dbe91c DBZ-6809 Fix imports 2023-11-10 16:06:43 +01:00
Jakub Cechacek
e88d00badb DBZ-6809 Added test for ExtractNewDocumentState with avro enabled on connector and transformation levels 2023-11-10 16:06:43 +01:00
Jiri Pechanec
acab36bd02 [docs] Expose Informix docs 2023-11-10 14:44:19 +01:00
mfvitale
013671b245 DBZ-6317 Document batch.size property for JDBC Sink Connector 2023-11-10 14:22:31 +01:00
Jiri Pechanec
3e64bd87bc DBZ-4999 [docs] Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2023-11-10 14:07:17 +01:00
Lars M Johansson
56bc1286c5 DBZ-4999 [docs] Update documentation/modules/ROOT/pages/connectors/informix.adoc
Co-authored-by: roldanbob <broldan@redhat.com>
2023-11-10 14:07:17 +01:00
Lars M Johansson
1455c971bf DBZ-4999 [docs] typo in Informix documentation (cdc.batchsize -> cdc.buffersize) 2023-11-10 14:07:17 +01:00
Lars M Johansson
69dec4881f DBZ-4999 [docs] Updated documentation of Informix connector 2023-11-10 14:07:17 +01:00
Lars M Johansson
921f2ef91d DBZ-4999 [docs] Documentation of Informix connector 2023-11-10 14:07:17 +01:00
Vojtech Juranek
105cd22dff [docs] Remove deprecated embedded engine documentation 2023-11-10 13:46:59 +01:00
Debezium Builder
5b6bc75293 [release] Development version for testing module deps 2023-11-10 10:35:27 +00:00
Debezium Builder
1521445908 [maven-release-plugin] prepare for next development iteration 2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138 [maven-release-plugin] prepare release v2.5.0.Alpha2 2023-11-10 10:26:05 +00:00
Debezium Builder
119aadead3 [release] Stable 2.5.0.Alpha2 for testing module deps 2023-11-10 10:24:05 +00:00
Jiri Pechanec
4eb3e665bf [release] Changelog for 2.5.0.Alpha2 2023-11-10 11:21:26 +01:00
Jiri Pechanec
f3eb643822 DBZ-7043 Use code idiom 2023-11-10 10:53:00 +01:00
Vadzim Ramanenka
a46069a8f7 DBZ-7043: Emit a notification when completed reading from a capture instance
Let the database know when the connector has finished reading
from a capture instance by calling a stored procedure.
2023-11-10 10:53:00 +01:00
Chris Cranford
34df6ade4d DBZ-6942 Verify no log sequence gaps on log switch
There is a corner case where it's possible the Oracle connector may query
the Oracle metadata tables quicker than the ARC process can generate an
archive log history record in V$ARCHIVED_LOG, and this can lead to a race
condition where we may incorrectly advance the connector forward to start
mining a group of logs when a log sequence gap exists in the log ranges.

For users who use the online_catalog strategy, there are some checks that
LogMiner does automatically which it skips, and one is with log sequence
gaps. This fix enforces that check by Debezium even for users who may use
the faster online_catalog mode so that no logs are omitted and events
could be missed.
2023-11-10 09:49:10 +01:00
mfvitale
33dc8e0ec6 DBZ-6317 Document tombstone behaviour 2023-11-10 06:43:18 +01:00
Jiri Pechanec
4f485caca3 DBZ-7119 Allow empty column list in INSERT 2023-11-09 14:25:14 +01:00
Chris Cranford
b834a3a66a DBZ-6963 Test should only apply to LogMiner 2023-11-09 10:58:01 +01:00
Chris Cranford
81d30a1224 DBZ-6963 Fix test failure 2023-11-09 10:58:01 +01:00
Chris Cranford
a4346222a7 DBZ-6963 Checkstyle fixes 2023-11-09 10:58:01 +01:00
Chris Cranford
b69dbd53e6 DBZ-6963 Do not merge events if table has no LOB columns
There was a possible situation where if a long transaction consisted of
updating and inserting into the same table with identical keys with a
given sequence that the commit handler would merge several events for a
table without LOB columns, resulting in a difference in expected events
in the Kafka topic vs what was seen in LogMiner.
2023-11-09 10:58:01 +01:00
Jakub Cechacek
468b6e431e DBZ-6726 Documenting split handling mode for oversized change events 2023-11-09 10:55:40 +01:00
Chris Cranford
da9c2bfeb4 DBZ-7085 Fix default value handling in tests 2023-11-09 10:00:33 +01:00
Chris Cranford
2bff852174 DBZ-7085 Fix temporal reader MariaDB implementation 2023-11-09 10:00:33 +01:00
Chris Cranford
8ff03447e4 DBZ-7085 Implement simple MariaDB protocol field reader 2023-11-09 10:00:33 +01:00
Chris Cranford
35a536aefc DBZ-7085 Apply MariaDB unique fetchSize requirements
Per https://jira.mariadb.org/browse/CONJ-977, the MariaDB team does not
believe that the Integer.MIN_VALUE solution for triggering streaming is
spec compliant and as of MariaDB 3.x+ drivers, they explicitly will not
allow this.

This change explicitly sets the fetchSize to 1 to mimic the same style
of behavior that the default fetchSize uses when using MySQL. If a user
provides a custom fetchSize, that will take precedences.
2023-11-09 10:00:33 +01:00