Commit Graph

8437 Commits

Author SHA1 Message Date
Chris Cranford
f9bb5eb82f DBZ-6221 Correctly interpret CHARACTER/CHARACTER VARYING data types while streaming 2023-03-28 14:45:12 +02:00
harveyyue
c9c1ce8a2f DBZ-6185 Zerofill property failed for different int types 2023-03-28 09:34:58 +02:00
dependabot[bot]
1db806d3d1 [ci] Bump tj-actions/changed-files from 35.7.2 to 35.7.6
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.7.2 to 35.7.6.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.7.2...v35.7.6)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-28 09:33:40 +02:00
mfvitale
673a42b541 DBZ-6232 Support 'binary.handling.mode' also on bytea array 2023-03-27 15:55:38 +02:00
mfvitale
ed67ff6eb9 DBZ-6232 Manage BYTEA_ARRAY in PostgresValueConverter 2023-03-27 15:55:38 +02:00
Anatolii Popov
930d9b0971 DBZ-6251 Ignore Debezium internal transactions during fallback to restart_lsn in Postgres connector if confirmed_flush_lsn is NULL 2023-03-27 15:55:13 +02:00
Nir Levy
735933ce6b DBZ-6248 Expose EmbeddedEngine configuration fields 2023-03-27 11:04:56 +02:00
Nir Levy
c7e00d3881 DBZ-6249 Fix error thrown when snapshot.custom_class=custom and no snapshot.custom.class 2023-03-27 10:53:39 +02:00
Fiore Mario Vitale
84ab0dc3d2
DBZ-6201: Add docs for HeaderToValue SMT (#4389)
* DBZ-6201: Add docs for HeaderToValue SMT
---------

Co-authored-by: roldanbob <broldan@redhat.com>
2023-03-27 10:44:11 +02:00
sondn
7a70eddf48 DBZ-6250 Missing a keyword which can be used as column name 2023-03-27 10:36:54 +02:00
jcechace
2fdd3fbc86 DBZ-6170 Added basic test scenario for running mongodb connector with sharded mongodb cluster 2023-03-27 10:31:47 +02:00
jcechace
033396bf80 DBZ-6170 Support for connecting to mongodb sharded clusters either with single connection to mongos or to each shard individually 2023-03-27 10:31:47 +02:00
Gunnar Morling
d5963f1601 [docs] Adding missing comma 2023-03-24 13:45:39 +01:00
jcechace
99b9349587 DBZ-6247 More resilient image version handling for MongoDbContainer and related tests 2023-03-23 16:15:03 +01:00
jcechace
6763e3c317 DBZ-6246: Removing MongoDB 4.0 and adding 4.2 to Jenkins job 2023-03-23 14:19:22 +01:00
jcechace
1a2a040859 DBZ-6246 Bumping minimal MongoDB version to 4.2 in GH actions 2023-03-23 14:03:56 +01:00
roldanbob
4eabec4ad5 DBZ-6090 Apply edits from documentation review 2023-03-23 13:30:47 +01:00
jcechace
0dbdbcf119 DBZ-6090 Updated connection information in MongoDB documentation 2023-03-23 13:30:47 +01:00
Vojtech Juranek
d38f9444c4 DBZ-6216 Remove Docker credential
Remove docker credentials and login to docker hub from scripts and jobs.
As this is in separate commit, it can be easily reverted in case we
want to publish to docker hub again in the future.
2023-03-23 13:29:19 +01:00
Vojtech Juranek
f17721dc1e DBZ-6216 Adjust release scripts to push images only to quay.io 2023-03-23 13:29:19 +01:00
Vojtech Juranek
7376bca551 DBZ-6216 Update documentation to refer to quay.io images 2023-03-23 13:29:19 +01:00
Vojtech Juranek
7c9ccb561b DBZ-6216 Use quay.io images in e2e benchmark 2023-03-23 13:29:19 +01:00
Vojtech Juranek
cfca3e41a3 DBZ-6216 Update postgres notes to use quay.io images
Also update postgres version currently being used
2023-03-23 13:29:19 +01:00
Vojtech Juranek
f32bf343c7 DBZ-6216 Remove obsolete Mongo notes
Mongo tests were migrated to testcontainers and Mongo is not run via
Maven plugin or manually any more.
2023-03-23 13:29:19 +01:00
mfvitale
4980f94a31 DBZ-6243: Fix MySql parser to permit alias in single delete statements 2023-03-23 08:26:54 +01:00
Chris Cranford
9307019441 DBZ-6244 Support ImageFromDockerfile syntax with testcontainers 2023-03-22 19:58:48 +01:00
Jiri Pechanec
e3fdd873e1 DBZ-6201 Skip expensive logging 2023-03-22 14:02:44 +01:00
mfvitale
2d70f47c40 DBZ-6201: Add more fail test scenarios 2023-03-22 14:02:44 +01:00
mfvitale
16191a5a35 DBZ-6201: Add logs 2023-03-22 14:02:44 +01:00
mfvitale
039a3f04e8 DBZ-6201: Add support for move and nested fields for HeaderToValue SMT 2023-03-22 14:02:44 +01:00
mfvitale
c45bf39eb0 DBZ-6201: Add new HeaderToValue SMT to copy headers to value 2023-03-22 14:02:44 +01:00
mfvitale
4e544debdc DBZ-6201: Fix validation message that reports null as value 2023-03-22 14:02:44 +01:00
Bob Roldan
df8eb9780b DBZ-6223 Adds upstream anchor 2023-03-22 12:17:30 +01:00
Bob Roldan
76d38e41b4 DBZ-6233 Add metadata; additional edits 2023-03-22 12:17:30 +01:00
Bob Roldan
13b2e7ac1a DBZ-823 Edit description of snapshot.tables.order.by.row.count 2023-03-22 10:18:18 +01:00
Bob Roldan
12a9aa9517 DBZ-823 Update Db2 doc for consistency 2023-03-22 10:18:18 +01:00
Bob Roldan
20b368760b DBZ-823 Conditionally designates parallel snapshots as incubating or TP 2023-03-22 10:18:18 +01:00
Russell Mora
bf3acaa872 [docs] Fix SQL JSON
JSON has an extra closing brace
2023-03-22 10:17:17 +01:00
Jiri Pechanec
a88dcd4488 DBZ-6211 Corrected formatting 2023-03-22 10:07:15 +01:00
ani-sha
1fb8cfcb7a DBZ-6211 Add missing privileges as per MySQL 8.x 2023-03-22 10:07:15 +01:00
harveyyue
cd7da5723d DBZ-6235 Remove incubation notice from Debezium Server page 2023-03-22 09:45:26 +01:00
Chris Cranford
1c5f14f7fd DBZ-6225 DBZ-6226 DBZ-6231 Introduce CustomConverter for JDBC sink consistency
In DBZ-6225, it was identified that the schema type associated with TINYINT(1)
and BOOLEAN data types wasn't consistent. This converter implementation will
always emit BOOLEAN data types as INT16, similar to TINYINT(1).

In DBZ-6226, it was identified that the schema type associated with REAL data
types wasn't consistent, emitted as FLOAT64 during snapshot and FLOAT32 in
the streaming phase. This converter implementation will always emit such types
as FLOAT64 for consistency.

In DBZ-6231, during streaming the DDL parser will get the column type as the
literal type supplied by the user's DDL, i.e. NCHAR or NVARCHAR but when the
DDL is sourced from SHOW CREATE TABLE, MySQL returns these columns as types
of CHAR/VARCHAR but with a character set.  By passing the character_set in
the schema consistency, we can deduce nationalized vs non-nationalized.
2023-03-21 14:53:56 +01:00
ani-sha
66ee2dd4eb DBZ-6239 Use pull_request instead of pull_request_target 2023-03-21 14:51:58 +01:00
dependabot[bot]
440e441a90 [ci] Bump tj-actions/changed-files from 35.7.0 to 35.7.2
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.7.0 to 35.7.2.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.7.0...v35.7.2)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-21 06:14:00 +01:00
roldanbob
4c18c0340b
[docs] add missing table block terminator
Addresses local antora build warning:

WARN (asciidoctor): unterminated table block
    file: /home/broldan/git/debezium/documentation/modules/ROOT/pages/transformations/event-changes.adoc:137
2023-03-16 17:06:21 -04:00
jcechace
a393930de9 DBZ-5987 Removing unnecessary getOffset() call during streaming 2023-03-16 13:20:19 +01:00
jcechace
a536952779 DBZ-5987 Code cleanup in MongoDb SourceInfo 2023-03-16 13:20:19 +01:00
jcechace
0f10c71642 DBZ-5987 Using consistent approach when extracting change event timestampt acroos different event types 2023-03-16 13:20:19 +01:00
jcechace
6d7b655273 DBZ-5987 cleanup of connection management in *ChangeEventSource classes 2023-03-16 13:20:19 +01:00
jcechace
04dbae17ad DBZ-5987 Cleaning up and updating its test coverage 2023-03-16 13:20:19 +01:00