Commit Graph

7970 Commits

Author SHA1 Message Date
Chris Cranford
375be6d61d DBZ-5283 Updated documentation 2023-02-10 13:53:05 +01:00
Chris Cranford
a7d1bb0f86 DBZ-5283 Decoupled changed SMT vs new state SMT, updated docs 2023-02-10 13:53:05 +01:00
Chris Cranford
bf46b298a2 DBZ-5283 Event Changes documentation updates 2023-02-10 13:53:05 +01:00
Chris Cranford
3d5c4328db DBZ-5283 Document unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
297225d141 DBZ-5283 Add unchanged field support to ExtractNewRecordState 2023-02-10 13:53:05 +01:00
Chris Cranford
a330c39f8b DBZ-5283 Document ExtractChangedRecordState SMT 2023-02-10 13:53:05 +01:00
Chris Cranford
f8eb32cf6f DBZ-5283 Move ExtractChangedRecordState tests to own class 2023-02-10 13:53:05 +01:00
harveyyue
4cb6e7c5b3 DBZ-5283 Introduce a new SMT ExtractChangedRecordState to capture the names of changed/unchanged field within headers 2023-02-10 13:53:05 +01:00
Théophile Helleboid - chtitux
f3417f383f [docs] Fix link to PG mailing List
https://www.postgresql.org/message-id/CAJ3gD9fE%3D0w50sRagcs%2BjrktBXuJAWGZQdSTMa57CCY%2BDh-xbg%40mail.gmail.com is encoded and works.

The link is currently broken because `@` generate a `mailto:` link.
2023-02-08 12:37:08 +01:00
Martin Medek
2add1f4c20 DBZ-3832 refactor, added test parameter to skip namespace and strimzi preparation
DBZ-3832 refactor

DBZ-3832 Removing redundant jenkins jobs

DBZ-3832 Refactor, moved operator deployment to standalone fixtures

DBZ-3832 Removed isRunningFromOcp hooks from kafka/kafkaConnect deployment, removed operator and namaespace preparation from system_pipeline

DBZ-3832 Modified OCP system tests to not create namespaces and operators

DBZ-3832 Moved namespace cleanup to NamespaceCleanupListener to be executed after all test classes, refactor

DBZ-3832 added strimzi, apicurio operators creation to testsuite.
Added maven property to set strimzi/apic subscription channel
Added namespace and clusterRoleBinding preparation into testsuite
2023-02-08 11:47:57 +01:00
Yang Wu
d7ab7146f0 DBZ-6089 Expose sequence in postgres parser 2023-02-08 10:13:19 +01:00
Jeremy Ford
517b43b870 DBZ-5827 ActivateTracingSpan wrong timestamps reported
Change txLogSpan to use processingTimestamp for span finish.
2023-02-07 13:25:44 +01:00
Jacob Gminder
6beea85425 DBZ-6084: Retrieve the database names from the configuration instead of re-parsing them from scratch. 2023-02-07 13:11:23 +01:00
Jacob Gminder
0a1862a5cf DBZ-6084: Validate that database.names is not empty in the SQL server connector configuration. 2023-02-07 13:11:23 +01:00
Jacob Gminder
4acb9304d1 DBZ-6084: Set the number of tasks to the minimum of maxTasks or the number of databases. 2023-02-07 13:11:23 +01:00
dependabot[bot]
8fc3495890 [ci] Bump tj-actions/changed-files from 35.4.4 to 35.5.0
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.4.4 to 35.5.0.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.4.4...v35.5.0)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-07 07:26:25 +01:00
Ismail Simsek
3548daf8b9 DBZ-6075 Use Instantiator to load ClassLoader 2023-02-07 07:24:03 +01:00
Bob Roldan
c853770c86 DBZ-6069 Remove problematic links 2023-02-03 08:49:30 +01:00
harveyyue
0dcf9922f6 DBZ-5743 update the "field.name.adjustment.mode" property to all connector docs 2023-02-02 13:21:45 +01:00
Jiri Pechanec
3a646519de DBZ-5743 Modify Javadoc 2023-02-02 13:21:45 +01:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
harveyyue
f093d7a6c9 DBZ-5743 Introduce alternative AVRO_UNICODE mode for schema adjuster 2023-02-02 13:21:45 +01:00
harveyyue
003bef0736 DBZ-5743 Introduce a new unicode topic naming strategy 2023-02-02 13:21:45 +01:00
jcechace
e982033961 DBZ-6064 masking sensitive information in connection string on close 2023-02-01 11:05:16 +01:00
jcechace
0918c34b38 DBZ-5973 Support for more types as key in mongodb incremental snapshot implementation 2023-02-01 08:47:14 +01:00
Jiri Pechanec
e7a4e820b9 [release] Add contributor 2023-02-01 06:28:10 +01:00
TimLoes
c8bfc6562b [docs] Variable name clarified
It is necessary to query for server_id instead of server-id, which is being used on the config file.
2023-02-01 06:27:16 +01:00
Jiri Pechanec
c487d3aee2 DBZ-6059 Revert "DBZ-4663 Remove option for specifying driver class from MySQL Connector"
This reverts commit 115d7c2d81.
2023-01-31 13:14:01 +01:00
Jiri Pechanec
37e18a240e [ci] Non-core connectors not required for Server 2023-01-31 13:13:31 +01:00
Vojtech Juranek
a372521956 [ci] Configure depenecy bot to use [ci] prefix for PRs 2023-01-31 12:58:07 +01:00
Jiri Pechanec
768682a71f DBZ-6054 Upgrade to Kafka 3.3.2 2023-01-31 11:51:50 +01:00
Jiri Pechanec
f705ecbf30 DBZ-6057 Add dependency comment 2023-01-31 09:17:06 +01:00
Jiri Pechanec
11580aec1c DBZ-4038 Add missing connectors to BOM 2023-01-31 08:47:21 +01:00
Jiri Pechanec
7d5179b5f6 DBZ-6049 Move debezium-server to https://github.com/debezium/debezium-server/ 2023-01-31 08:47:21 +01:00
Henry Cai
a2f15abafd DBZ-6043: Vitess: Support Mapping unsigned bigint mysql column type to long
Add doc for the new `bigint.unsigned.handling.mode`
2023-01-31 07:17:33 +01:00
dependabot[bot]
8136c6a3e1 [ci] Bump actions
Signed-off-by: dependabot[bot] <support@github.com>
2023-01-31 06:57:23 +01:00
Vojtech Juranek
c52ffe2fcd DBZ-6035 Await transactions also in IncrementalSnapshotWithRecompileIT
Override no-op waitForCdcTransactionPropagation() also in
IncrementalSnapshotWithRecompileIT which also fails very often.
2023-01-31 06:55:40 +01:00
Vojtech Juranek
775c96971a DBZ-5997 Add missing comment 2023-01-30 22:20:56 +01:00
sunxiaojian
64558ea56a DBZ-5997 Debezium Storage add support for Apache RocketMQ 2023-01-30 23:07:45 +08:00
Vojtech Juranek
b34121c128 [ci] Setup dependency bot github actions 2023-01-30 11:51:33 +01:00
Vojtech Juranek
6aebb0b07f [ci] Update to recent changed-files action 2023-01-30 11:51:33 +01:00
Jiri Pechanec
65dedf0a58 [ci] Add job for Spanner compat build 2023-01-27 09:09:08 +01:00
Byron Ruth
8c518ce57e [docs] Note support for NATS JetStream in description 2023-01-26 14:53:32 +01:00
Jiri Pechanec
795014e040 DBZ-6037 Data no longer logged on error 2023-01-26 13:30:20 +01:00
Liz Chatman
8a6fdab5d7 DBZ-2296 return false instead of true from isGtidModeEnabled for GTID_MODEs of OFF_PERMISSIVE and ON_PERMISSIVE 2023-01-26 07:43:13 +01:00
harveyyue
bd47d7396d DBZ-6003 Add more case to method to MySqlConnectorIT.shouldProcessCreateUniqueIndex 2023-01-26 07:39:28 +01:00
harveyyue
735b763075 DBZ-6003 Nullable columns marked with "optional: false" in DDL events 2023-01-26 07:39:28 +01:00
Anisha Mohanty
232579a236 DBZ-6016 Add CLUSTERING KEY constraint for TOKUDB 2023-01-26 07:36:17 +01:00
Vojtech Juranek
f53237c249 DBZ-6035 Await for transactions to be propagated to CDC table
Lowering polling interval intorduced in previous commit doesn't fully
fix the issue and there is still small race condition. To fully fix it
add function for awaiting transaction to be propagate to CDC table and
await transaction in tests which randomly fails.
2023-01-26 07:33:10 +01:00
Vojtech Juranek
895fd0b99f DBZ-6035 Add function for adjusting SQL server polling interval
Some tests fail randomly as they insert some records at the begging
of the test, start Debezium and asserts that there are no records.
However, as SQL server poll for the changes and copies them into
CDC table not immediately but in specified interval (by default 5
secods), there can be a race condition when the entries inserted
at the beginning of the test are copied into CDC table after starting
Debezium and it resutls into the test failure as there are unexpected
records.

Add function for adjusting the polling interval and decrease polling
interval in `IncrementalSnapshotIT` which fails very often.

This doesn't fully fix the race condition, but decreases the changes
the issue is hit.
2023-01-26 07:33:10 +01:00