Commit Graph

7070 Commits

Author SHA1 Message Date
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
01a81f8bc1 DBZ-5136: Refactored SnapshotContext setters 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Chris Cranford
15e9231c30 DBZ-5179 Use LRUCacheMap to avoid high memory usage 2022-06-01 15:53:55 +02:00
Vojtech Juranek
21e093250e DBZ-5154 Add documentation how to enable server scripting 2022-06-01 10:22:50 +02:00
Chris Cranford
28cd36edff DBZ-5011 Set task metrics attribute when using only 1 task 2022-06-01 09:41:36 +02:00
Chris Cranford
9fa5a48274 DBZ-5011 Register MongoDB metrics with task id when more than one task 2022-06-01 09:41:36 +02:00
harveyyue
9a3afac243 DBZ-5180 Put the MysqlPartition values to MDC getting NPE in logging context phase 2022-06-01 09:17:04 +02:00
Vojtech Juranek
7ac91c4450 DBZ-5154 Support scripting in Debezium Server
Add Debezium scripting and it's optional JSR 223 dependencies into
server distribution in `lib_opt` directory.

Add these jars into classpath when `ENABLE_DEBEZIUM_SCRIPTING` env.
variable is set to `true`. Otherwise scripting jars are not loaded.
2022-05-31 18:02:47 +02:00
Vojtech Juranek
e463d53449 DBZ-5154 Split off Debezium optional scripting dependencies
Optional dependencies don't play well with maven assembly pluing and
I didn't find a way how to include optional dependencies into archive
built by assembly plugin.

Split off Debezium optional scripting dependencies into separate module.
Scripting module will have optional dependency on this new module, while
other modules (e.g. server dist module) can use it as a regular
dependency.
2022-05-31 18:02:47 +02:00
jcechace
a8fddcef2e DBZ-5162 Fixed DB2 connector tests 2022-05-28 17:03:02 +02:00
Chris Cranford
a900ababcd DBZ-5042 Use PDB name when set in Oracle configuration 2022-05-27 14:20:30 -04:00
Vojtech Juranek
fa07f67cdb DBZ-5042 Add DB name logging support into Oracle connector 2022-05-27 14:20:30 -04:00
Vojtech Juranek
0757c966d0 DBZ-5042 Add DB name logging support into Postgres connector 2022-05-27 14:20:30 -04:00
Vojtech Juranek
a2110f7c02 DBZ-5042 Add DB name logging support into MySQL connector 2022-05-27 14:20:30 -04:00
Vojtech Juranek
5550057034 DBZ-5042 Add abstract partition with DB name
DB names is used by logging facilities. As the DB name is required only
for relational DBs, also this abstract class is provided only for
relational DB connectors.

Use this abstract class for SQL server connector, where DB name logging
is already implemented.
2022-05-27 14:20:30 -04:00
jcechace
c067e20fbe DBZ-5162 Fixed missing persistence type for ApicurioRegistry resources 2022-05-27 13:40:05 +02:00
connorszczepaniak-wk
125fddaa01 DBZ-5089: update docs to reflect new additional field placement option 2022-05-27 12:46:39 +02:00
Jiri Pechanec
b85cb275b1 DBZ-5089 Use atomic reference 2022-05-27 12:46:39 +02:00
connorszczepaniak-wk
8693b4f008 DBZ-5089: add partition to the outbox event router in additional fields
DBZ-5089: undo format change

DBZ-5089: add tests for the partition routing

DBZ-5089: remove nonsensical comment

DBZ-5089: partition fieldname is a string; test properly

DBZ-5089: fix one of the failing tests

DBZ-5089: pass args through

DBZ-5089: fix oracle implementation; add configs for mongo connector

DBZ-5089: put partition in additional placement

DBZ-5089: restore formatting
2022-05-27 12:46:39 +02:00
harveyyue
e45e8bd43b DBZ-5172 Expose more useful exception info with building the field default value schema 2022-05-27 12:41:12 +02:00
Jiri Pechanec
3198ef77a8 DBZ-5166 Add contributor 2022-05-27 12:33:23 +02:00
Rotem Adhoh
8ef7224543 DBZ-5166 Fixed ExtractNewRecordState SMT to pass all columns' data as is, i.e: without potential unwanted values manipulation.
Prior to this fix, when inserting an explicit NULL value to a nullable column which has a default value, resulted in a record which contains the corresponding field with the default value (instead of NULL) after applying ExtractNewRecordState transformation.
A new unit test was added as well.
2022-05-27 12:33:23 +02:00
Anisha Mohanty
51e4d9ee6f DBZ-4947 Setup Maven with 3.8.4 2022-05-27 06:41:07 +02:00
Jiri Pechanec
6623bc6f5f DBZ-4947 Use correct work directory 2022-05-27 06:41:07 +02:00
Anisha Mohanty
7938310467 DBZ-4947 Build Debezium UI upon any changes in debezium-core 2022-05-27 06:41:07 +02:00
Chris Cranford
1ae7bec46e DBZ-5146 Remove log.mining.view.fetch.size, use query.fetch.size instead. 2022-05-26 19:26:14 -04:00
Chris Cranford
60b1b3cc1d DBZ-5147 Fix test failures 2022-05-26 18:37:24 -04:00
Chris Cranford
2978898641 DBZ-5147 Adjust log levels, apply test rules 2022-05-26 18:37:24 -04:00
Chris Cranford
7ab0cea8f1 DBZ-5147 Add event.processing.failure.handling.mode for Oracle 2022-05-26 18:37:24 -04:00
Anisha Mohanty
3d5134dca3 DBZ-5168 Run jdk workflow on push/pull request 2022-05-26 11:49:21 -04:00
Anisha Mohanty
da6af6b498 DBZ-5168 Add debezium-server-bom dependency to jdk workflow 2022-05-26 11:49:21 -04:00
Vojtech Juranek
f8d4307155 DBZ-5052 Send tombstones only when consumer is able to consume them
Change event consumer may specify if is able to consume tombstones or
not. If the it's not, don't send them. However, connector configuration
takes precence and thus cunsumer capability is taken into account only
when `tombstones.on.delete` is not explicitely configured for the
connector.

Also fix debezium server - setting notifier has to be done once embedded
config already exists, not before it.
2022-05-26 12:40:02 +02:00
Vojtech Juranek
d6447a91c9 DBZ-5052 Add option to start embedded engine with custom change handler
Also make `consumedLines` instance variable available to subclasses to
they can use it in the change handler.
2022-05-26 12:40:02 +02:00
Vojtech Juranek
d6efe20826 DBZ-5052 Move test event consumer to dedicated method.
This makes code more readable and allows subclasses to override
the consumer when needed.
2022-05-26 12:40:02 +02:00
Chris Cranford
fc2da7a28b DBZ-5167 Upgrade PostgreSQL driver to 42.3.6 2022-05-26 09:20:29 +02:00
harveyyue
3ada04b522 DBZ-3865 Debezium MySql connector does not capture floating point numbers with the right precision 2022-05-25 12:54:42 -04:00
jcechace
a0d74f653b DBZ-5162 Added request.retry.backoff.limit to OCP client 2022-05-25 12:47:14 -04:00
jcechace
6109e5c7dc DBZ-5164 Updated oracle instnat client in oracle connector pipeline 2022-05-25 09:40:28 -04:00
Gunnar Morling
28da038cae DBZ-4409 Removing Gson from BOM 2022-05-25 13:50:05 +02:00
jcechace
b7ae5a8376 DBZ-5162 Fixed incorrect inheritance in connector system ITs 2022-05-25 05:49:56 -04:00
jcechace
94e1a0b0c1 DBZ-5162 DockerKafka now correctly provides assertions 2022-05-25 05:21:14 -04:00
jcechace
b040888285 DBZ-5162 Fixed default kafka version in ConfigProperties 2022-05-25 05:21:14 -04:00
jcechace
19189b12c1 DBZ-5162 Improved Artifact Server readiness detection 2022-05-25 05:21:14 -04:00
jcechace
b1d94d4e19 DBZ-5162 ability to specify version of startup scripts for kafka rhel image 2022-05-25 05:21:14 -04:00
jcechace
ec6266673d DBZ-5162 add netcat to Kafka RHEL image 2022-05-25 05:21:14 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Cranford
15eb7807c4 DBZ-5119 Add heartbeat.action.query support for Oracle 2022-05-24 12:54:40 +02:00