Commit Graph

8188 Commits

Author SHA1 Message Date
jcechace
04dbae17ad DBZ-5987 Cleaning up and updating its test coverage 2023-03-16 13:20:19 +01:00
jcechace
a39c084259 DBZ-5987 Replacing remaining usages of oplog with resume tokens retrieved from either change stream even or cursor 2023-03-16 13:20:19 +01:00
jcechace
bfdba1fb25 DBZ-5987 Removing obsolete ReplicaSetChangeStreamsContext from MongoDbStreamingChangeEventSource in order to simplify the implementation 2023-03-16 13:20:19 +01:00
Jiri Pechanec
d4c3e23767 DBZ-6092 Simplify the code; change logging 2023-03-16 12:58:03 +01:00
Anatolii Popov
cbb785d67a DBZ-6092 Fallback to restart_lsn in Postgres connector if confirmed_flush_lsn is NULL and no long-running transactions were committed during timeout 2023-03-16 12:58:03 +01:00
Vojtěch Juránek
42b374613a DBZ-6204 Fix typo
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2023-03-16 11:32:52 +01:00
Vojtech Juranek
3b5740f1a8 DBZ-6204 Avoid skipping record when determining resume LSN
When the last operation before connector stop is tx BEGIN, subsequent
INSERT done after connector stop can have same LSN as BEGIN and thus it
was possible to skip this INSERT when we search for the resume LSN. This
issue was described and fixed in DBZ-5915. However, the same LSN can
have also previous tx COMMIT, so the WAL can look like this:

    LSN | operation
    ------------------
    123 | COMMIT
    123 | BEGIN
    123 | INSERT
    124 | COMMIT

When the last stored LSN is 123 for COMMIT operation, we skip also BEGIN
and INSERT operations with LSN 123 and resume from COMMIT with LSN 124.

Adjust condition introduced in DBZ-5915 to consider also the case when
the last processed operation is COMMIT.
2023-03-16 11:32:52 +01:00
ani-sha
7f5b45a890 DBZ-6124 Add alterByAlterCheckTableConstraint rule for ALTER TABLE 2023-03-16 11:30:39 +01:00
Chris Cranford
88c6419dae DBZ-6124 Restore old rule, rearranged dataType rules 2023-03-16 11:30:39 +01:00
Anisha Mohanty
3b1a43edf9 DBZ-6124 Modify CREATE and ALTER TABLE rules 2023-03-16 11:30:39 +01:00
ani-sha
3874160834 DBZ-6115 Use correct conditional clause for build step 2023-03-16 08:51:12 +01:00
ani-sha
d34891e1e9 DBZ-6194 Use CHARSET for alterByConvertCharset clause 2023-03-16 08:01:12 +01:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
ani-sha
1847c9b116 DBZ-6188 Allow optional uidList for partitionFunctionKey rule 2023-03-16 07:56:38 +01:00
dependabot[bot]
075954f359 [ci] Bump tj-actions/changed-files from 35.6.1 to 35.7.0
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.6.1 to 35.7.0.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.6.1...v35.7.0)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-14 08:37:27 +01:00
Jiri Pechanec
59ba820c28 DBZ-6180 Correct dependency management 2023-03-13 18:02:10 +01:00
Hossein Torabi
d4ab16f011 DBZ-6180: debezium-storage-azure-blob 2023-03-13 18:02:10 +01:00
Jiri Pechanec
9e7591641a [docs] Fix spelling of RocketMQ 2023-03-13 17:57:01 +01:00
Jiri Pechanec
ee3904dbef [jenkins-jobs] Support server for pre-2.2; Debezium Server in core repo 2023-03-13 11:01:50 +01:00
harveyyue
1877906dd8 DBZ-6197 Remove duplicated createDdlFilter method from historized connector config 2023-03-13 10:56:43 +01:00
PlugaruT
2f7c60931b DBZ-6023 [doc] Fix missing example of signal with surrogate-key 2023-03-10 10:40:17 -05:00
PlugaruT
5a758fb229 DBZ-6023 [doc] Rephrase a bit the description to be more consistent with others. 2023-03-10 10:40:17 -05:00
PlugaruT
5d1bb1aa80 DBZ-6023 [doc] Documentation for surrogate-key field from execute-snapshot signal record. 2023-03-10 10:40:17 -05:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
mfvitale
77d9c88ac3 [docs] Add missing Partition Routing to navbar 2023-03-09 15:47:37 +01:00
Nir Levy
16f460d2d7 DBZ-6190: Fix support for ddl filter 2023-03-09 08:48:43 +01:00
Jiri Pechanec
97ce3fa09e DBZ-6186 Mark as MariaDB only 2023-03-09 08:38:31 +01:00
Nir Levy
c6ca9125d9 DBZ-6186: Add support for GRANT DELETE HISTORY in mariadb 2023-03-09 08:38:31 +01:00
tony joseph
5adf2150d2 [release] Add contributors 2023-03-09 08:35:09 +01:00
Debezium Builder
c8d4dcc007 [release] Development version for testing module deps 2023-03-08 11:46:24 +00:00
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00
Debezium Builder
7225f61374 [release] Stable 2.2.0.Alpha3 for testing module deps 2023-03-08 11:36:15 +00:00
Jiri Pechanec
a18dd39c87 [release] Changelog for 2.2.0.Alpha3 2023-03-08 12:31:48 +01:00
Jiri Pechanec
b19b743583 [jenkins-jobs] Execute script to obtain dependencies 2023-03-08 12:31:48 +01:00
Jiri Pechanec
f62caf9c83 DBZ-6143 Make tests running with xstream 2023-03-08 09:15:48 +01:00
dependabot[bot]
be6ffdf7fd [ci] Bump actions/checkout from 2 to 3
Bumps [actions/checkout](https://github.com/actions/checkout) from 2 to 3.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v2...v3)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-07 14:49:47 +01:00
dependabot[bot]
45380e4b44 [ci] Bump tj-actions/changed-files from 35.5.6 to 35.6.1
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.5.6 to 35.6.1.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.5.6...v35.6.1)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-07 12:57:40 +01:00
subodh
b781960019 DBZ-6179 Fix swallowing of exception cause of finally block in RelationalSnapshotChangeEventSource 2023-03-06 10:28:57 +01:00
PlugaruT
6ad3df4d19 DBZ-6023 Change surrogate key provided in integration tests 2023-03-06 10:25:59 +01:00
Jiri Pechanec
98dcdb8f55 DBZ-6023 Remove nnecessary code 2023-03-06 10:25:59 +01:00
PlugaruT
3e05965d24 DBZ-6023 Add integration tests 2023-03-06 10:25:59 +01:00
PlugaruT
7d0492fee5 DBZ-6023 Unit tests for buildChunkQuery and buildMaxPrimaryKeyQuery methods 2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
Jiri Pechanec
0585c6beb8 DBZ-823 Add NULL instance for the class 2023-03-03 12:47:15 +01:00
Jiri Pechanec
fef5fa26f3 DBZ-823 Mark parallel snapshotting as incubating in documentation 2023-03-03 12:47:15 +01:00
Jiri Pechanec
d492ec892c DBZ-823 Use enum for enumeration 2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c DBZ-823 Restrict the type with generics 2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee DBZ-823 Add JavaDoc to new interfaces 2023-03-03 12:47:15 +01:00