Commit Graph

8205 Commits

Author SHA1 Message Date
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Russell Mora
bf3acaa872 [docs] Fix SQL JSON
JSON has an extra closing brace
2023-03-22 10:17:17 +01:00
Jiri Pechanec
a88dcd4488 DBZ-6211 Corrected formatting 2023-03-22 10:07:15 +01:00
ani-sha
1fb8cfcb7a DBZ-6211 Add missing privileges as per MySQL 8.x 2023-03-22 10:07:15 +01:00
harveyyue
cd7da5723d DBZ-6235 Remove incubation notice from Debezium Server page 2023-03-22 09:45:26 +01:00
Chris Cranford
1c5f14f7fd DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).

In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.

In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set.  By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
ani-sha
66ee2dd4eb DBZ-6239 Use pull_request instead of pull_request_target 2023-03-21 14:51:58 +01:00
dependabot[bot]
440e441a90 [ci] Bump tj-actions/changed-files from 35.7.0 to 35.7.2
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.7.0 to 35.7.2.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.7.0...v35.7.2)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-21 06:14:00 +01:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
jcechace
a393930de9 DBZ-5987 Removing unnecessary getOffset() call during streaming 2023-03-16 13:20:19 +01:00
jcechace
a536952779 DBZ-5987 Code cleanup in MongoDb SourceInfo 2023-03-16 13:20:19 +01:00
jcechace
0f10c71642 DBZ-5987 Using consistent approach when extracting change event timestampt acroos different event types 2023-03-16 13:20:19 +01:00
jcechace
6d7b655273 DBZ-5987 cleanup of connection management in *ChangeEventSource classes 2023-03-16 13:20:19 +01:00
jcechace
04dbae17ad DBZ-5987 Cleaning up and updating its test coverage 2023-03-16 13:20:19 +01:00
jcechace
a39c084259 DBZ-5987 Replacing remaining usages of oplog with resume tokens retrieved from either change stream even or cursor 2023-03-16 13:20:19 +01:00
jcechace
bfdba1fb25 DBZ-5987 Removing obsolete ReplicaSetChangeStreamsContext from MongoDbStreamingChangeEventSource in order to simplify the implementation 2023-03-16 13:20:19 +01:00
Jiri Pechanec
d4c3e23767 DBZ-6092 Simplify the code; change logging 2023-03-16 12:58:03 +01:00
Anatolii Popov
cbb785d67a DBZ-6092 Fallback to restart_lsn in Postgres connector if confirmed_flush_lsn is NULL and no long-running transactions were committed during timeout 2023-03-16 12:58:03 +01:00
Vojtěch Juránek
42b374613a DBZ-6204 Fix typo
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2023-03-16 11:32:52 +01:00
Vojtech Juranek
3b5740f1a8 DBZ-6204 Avoid skipping record when determining resume LSN
When the last operation before connector stop is tx BEGIN, subsequent
INSERT done after connector stop can have same LSN as BEGIN and thus it
was possible to skip this INSERT when we search for the resume LSN. This
issue was described and fixed in DBZ-5915. However, the same LSN can
have also previous tx COMMIT, so the WAL can look like this:

    LSN | operation
    ------------------
    123 | COMMIT
    123 | BEGIN
    123 | INSERT
    124 | COMMIT

When the last stored LSN is 123 for COMMIT operation, we skip also BEGIN
and INSERT operations with LSN 123 and resume from COMMIT with LSN 124.

Adjust condition introduced in DBZ-5915 to consider also the case when
the last processed operation is COMMIT.
2023-03-16 11:32:52 +01:00
ani-sha
7f5b45a890 DBZ-6124 Add alterByAlterCheckTableConstraint rule for ALTER TABLE 2023-03-16 11:30:39 +01:00
Chris Cranford
88c6419dae DBZ-6124 Restore old rule, rearranged dataType rules 2023-03-16 11:30:39 +01:00
Anisha Mohanty
3b1a43edf9 DBZ-6124 Modify CREATE and ALTER TABLE rules 2023-03-16 11:30:39 +01:00
ani-sha
3874160834 DBZ-6115 Use correct conditional clause for build step 2023-03-16 08:51:12 +01:00
ani-sha
d34891e1e9 DBZ-6194 Use CHARSET for alterByConvertCharset clause 2023-03-16 08:01:12 +01:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
ani-sha
1847c9b116 DBZ-6188 Allow optional uidList for partitionFunctionKey rule 2023-03-16 07:56:38 +01:00
dependabot[bot]
075954f359 [ci] Bump tj-actions/changed-files from 35.6.1 to 35.7.0
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.6.1 to 35.7.0.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.6.1...v35.7.0)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-14 08:37:27 +01:00
Jiri Pechanec
59ba820c28 DBZ-6180 Correct dependency management 2023-03-13 18:02:10 +01:00
Hossein Torabi
d4ab16f011 DBZ-6180: debezium-storage-azure-blob 2023-03-13 18:02:10 +01:00
Jiri Pechanec
9e7591641a [docs] Fix spelling of RocketMQ 2023-03-13 17:57:01 +01:00
Jiri Pechanec
ee3904dbef [jenkins-jobs] Support server for pre-2.2; Debezium Server in core repo 2023-03-13 11:01:50 +01:00
harveyyue
1877906dd8 DBZ-6197 Remove duplicated createDdlFilter method from historized connector config 2023-03-13 10:56:43 +01:00
PlugaruT
2f7c60931b DBZ-6023 [doc] Fix missing example of signal with surrogate-key 2023-03-10 10:40:17 -05:00
PlugaruT
5a758fb229 DBZ-6023 [doc] Rephrase a bit the description to be more consistent with others. 2023-03-10 10:40:17 -05:00
PlugaruT
5d1bb1aa80 DBZ-6023 [doc] Documentation for surrogate-key field from execute-snapshot signal record. 2023-03-10 10:40:17 -05:00
Bob Roldan
405be98721 DBZ-6153 Refactor Streams deployment content to fix errors 2023-03-10 11:47:21 +01:00
PlugaruT
6d32e22549 DBZ-5490 Document the case when message.key.columns is set and REPLICA IDENTITY of the tables is not FULL.
It breaks tombstone events to have the proper key created because non-primary key columns will be null, and their values in the key will also be null.
2023-03-10 07:46:40 +01:00
mfvitale
77d9c88ac3 [docs] Add missing Partition Routing to navbar 2023-03-09 15:47:37 +01:00
Nir Levy
16f460d2d7 DBZ-6190: Fix support for ddl filter 2023-03-09 08:48:43 +01:00
Jiri Pechanec
97ce3fa09e DBZ-6186 Mark as MariaDB only 2023-03-09 08:38:31 +01:00
Nir Levy
c6ca9125d9 DBZ-6186: Add support for GRANT DELETE HISTORY in mariadb 2023-03-09 08:38:31 +01:00
tony joseph
5adf2150d2 [release] Add contributors 2023-03-09 08:35:09 +01:00
Debezium Builder
c8d4dcc007 [release] Development version for testing module deps 2023-03-08 11:46:24 +00:00
Debezium Builder
55d65e9618 [maven-release-plugin] prepare for next development iteration 2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1 [maven-release-plugin] prepare release v2.2.0.Alpha3 2023-03-08 11:38:16 +00:00