Commit Graph

8122 Commits

Author SHA1 Message Date
jcechace
1a2a040859 DBZ-6246 Bumping minimal MongoDB version to 4.2 in GH actions 2023-03-23 14:03:56 +01:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Vojtech Juranek
d38f9444c4 DBZ-6216 Remove Docker credential
Remove docker credentials and login to docker hub from scripts and jobs.
As this is in separate commit, it can be easily reverted in case we
want to publish to docker hub again in the future.
2023-03-23 13:29:19 +01:00
Vojtech Juranek
f17721dc1e DBZ-6216 Adjust release scripts to push images only to quay.io 2023-03-23 13:29:19 +01:00
Vojtech Juranek
7376bca551 DBZ-6216 Update documentation to refer to quay.io images 2023-03-23 13:29:19 +01:00
Vojtech Juranek
7c9ccb561b DBZ-6216 Use quay.io images in e2e benchmark 2023-03-23 13:29:19 +01:00
Vojtech Juranek
cfca3e41a3 DBZ-6216 Update postgres notes to use quay.io images
Also update postgres version currently being used
2023-03-23 13:29:19 +01:00
Vojtech Juranek
f32bf343c7 DBZ-6216 Remove obsolete Mongo notes
Mongo tests were migrated to testcontainers and Mongo is not run via
Maven plugin or manually any more.
2023-03-23 13:29:19 +01:00
mfvitale
4980f94a31 DBZ-6243: Fix MySql parser to permit alias in single delete statements 2023-03-23 08:26:54 +01:00
Chris Cranford
9307019441 DBZ-6244 Support ImageFromDockerfile syntax with testcontainers 2023-03-22 19:58:48 +01:00
Jiri Pechanec
e3fdd873e1 DBZ-6201 Skip expensive logging 2023-03-22 14:02:44 +01:00
mfvitale
2d70f47c40 DBZ-6201: Add more fail test scenarios 2023-03-22 14:02:44 +01:00
mfvitale
16191a5a35 DBZ-6201: Add logs 2023-03-22 14:02:44 +01:00
mfvitale
039a3f04e8 DBZ-6201: Add support for move and nested fields for HeaderToValue SMT 2023-03-22 14:02:44 +01:00
mfvitale
c45bf39eb0 DBZ-6201: Add new HeaderToValue SMT to copy headers to value 2023-03-22 14:02:44 +01:00
mfvitale
4e544debdc DBZ-6201: Fix validation message that reports null as value 2023-03-22 14:02:44 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Russell Mora
bf3acaa872 [docs] Fix SQL JSON
JSON has an extra closing brace
2023-03-22 10:17:17 +01:00
Jiri Pechanec
a88dcd4488 DBZ-6211 Corrected formatting 2023-03-22 10:07:15 +01:00
ani-sha
1fb8cfcb7a DBZ-6211 Add missing privileges as per MySQL 8.x 2023-03-22 10:07:15 +01:00
harveyyue
cd7da5723d DBZ-6235 Remove incubation notice from Debezium Server page 2023-03-22 09:45:26 +01:00
Chris Cranford
1c5f14f7fd DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).

In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.

In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set.  By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
ani-sha
66ee2dd4eb DBZ-6239 Use pull_request instead of pull_request_target 2023-03-21 14:51:58 +01:00
dependabot[bot]
440e441a90 [ci] Bump tj-actions/changed-files from 35.7.0 to 35.7.2
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.7.0 to 35.7.2.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.7.0...v35.7.2)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-21 06:14:00 +01:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
jcechace
a393930de9 DBZ-5987 Removing unnecessary getOffset() call during streaming 2023-03-16 13:20:19 +01:00
jcechace
a536952779 DBZ-5987 Code cleanup in MongoDb SourceInfo 2023-03-16 13:20:19 +01:00
jcechace
0f10c71642 DBZ-5987 Using consistent approach when extracting change event timestampt acroos different event types 2023-03-16 13:20:19 +01:00
jcechace
6d7b655273 DBZ-5987 cleanup of connection management in *ChangeEventSource classes 2023-03-16 13:20:19 +01:00
jcechace
04dbae17ad DBZ-5987 Cleaning up and updating its test coverage 2023-03-16 13:20:19 +01:00
jcechace
a39c084259 DBZ-5987 Replacing remaining usages of oplog with resume tokens retrieved from either change stream even or cursor 2023-03-16 13:20:19 +01:00
jcechace
bfdba1fb25 DBZ-5987 Removing obsolete ReplicaSetChangeStreamsContext from MongoDbStreamingChangeEventSource in order to simplify the implementation 2023-03-16 13:20:19 +01:00
Jiri Pechanec
d4c3e23767 DBZ-6092 Simplify the code; change logging 2023-03-16 12:58:03 +01:00
Anatolii Popov
cbb785d67a DBZ-6092 Fallback to restart_lsn in Postgres connector if confirmed_flush_lsn is NULL and no long-running transactions were committed during timeout 2023-03-16 12:58:03 +01:00
Vojtěch Juránek
42b374613a DBZ-6204 Fix typo
Co-authored-by: Jiri Pechanec <jpechane@redhat.com>
2023-03-16 11:32:52 +01:00
Vojtech Juranek
3b5740f1a8 DBZ-6204 Avoid skipping record when determining resume LSN
When the last operation before connector stop is tx BEGIN, subsequent
INSERT done after connector stop can have same LSN as BEGIN and thus it
was possible to skip this INSERT when we search for the resume LSN. This
issue was described and fixed in DBZ-5915. However, the same LSN can
have also previous tx COMMIT, so the WAL can look like this:

    LSN | operation
    ------------------
    123 | COMMIT
    123 | BEGIN
    123 | INSERT
    124 | COMMIT

When the last stored LSN is 123 for COMMIT operation, we skip also BEGIN
and INSERT operations with LSN 123 and resume from COMMIT with LSN 124.

Adjust condition introduced in DBZ-5915 to consider also the case when
the last processed operation is COMMIT.
2023-03-16 11:32:52 +01:00
ani-sha
7f5b45a890 DBZ-6124 Add alterByAlterCheckTableConstraint rule for ALTER TABLE 2023-03-16 11:30:39 +01:00
Chris Cranford
88c6419dae DBZ-6124 Restore old rule, rearranged dataType rules 2023-03-16 11:30:39 +01:00
Anisha Mohanty
3b1a43edf9 DBZ-6124 Modify CREATE and ALTER TABLE rules 2023-03-16 11:30:39 +01:00
ani-sha
3874160834 DBZ-6115 Use correct conditional clause for build step 2023-03-16 08:51:12 +01:00
ani-sha
d34891e1e9 DBZ-6194 Use CHARSET for alterByConvertCharset clause 2023-03-16 08:01:12 +01:00
Bob Roldan
4138a9898a DBZ-6215 Adds missing annotation comments for Oracle connector FAQ topic 2023-03-16 07:58:55 +01:00
ani-sha
1847c9b116 DBZ-6188 Allow optional uidList for partitionFunctionKey rule 2023-03-16 07:56:38 +01:00
dependabot[bot]
075954f359 [ci] Bump tj-actions/changed-files from 35.6.1 to 35.7.0
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.6.1 to 35.7.0.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.6.1...v35.7.0)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-14 08:37:27 +01:00
Jiri Pechanec
59ba820c28 DBZ-6180 Correct dependency management 2023-03-13 18:02:10 +01:00