Commit Graph

9713 Commits

Author SHA1 Message Date
roldanbob
7498ffe197 DBZ-7418 Reformats .connect-log4j.properties callout list as table 2024-02-13 15:46:40 -05:00
roldanbob
4063695afc DBZ-7418 Reformats PG inventory-connector callout legend as table 2024-02-13 15:46:40 -05:00
roldanbob
6c5b02b0bd DBZ-7418 Reformat callouts for pg_hba.conf example as table 2024-02-13 15:46:40 -05:00
roldanbob
228517786e DBZ-7418 Formats callout list for inventory-connector.yaml example as table 2024-02-13 15:46:40 -05:00
roldanbob
9a7e140187 DBZ-7418 Formats callout list in jdbc.adoc as table 2024-02-13 15:46:40 -05:00
Debezium Builder
8c73b756e1 [release] Development version for testing module deps 2024-02-13 09:29:50 +00:00
Debezium Builder
10e327602c [maven-release-plugin] prepare for next development iteration 2024-02-13 09:20:04 +00:00
Debezium Builder
0c5b05738c [maven-release-plugin] prepare release v2.6.0.Alpha2 2024-02-13 09:20:04 +00:00
Debezium Builder
ca39695ad7 [release] Stable 2.6.0.Alpha2 for testing module deps 2024-02-13 09:17:55 +00:00
Jiri Pechanec
2924bf8d82 [release] Add contributor 2024-02-13 10:15:22 +01:00
Jiri Pechanec
a412fdef83 [release] Changelog for 2.6.0.Alpha2 2024-02-13 10:13:26 +01:00
Jiri Novotny
7eb0e8b4af DBZ-7002 Use working OCP connection check 2024-02-13 08:49:16 +01:00
Jiri Novotny
8907d88f49 DBZ-7002 Remove the need for OCP cluster in non-OCP system tests 2024-02-13 08:49:16 +01:00
mfvitale
cb5a4d7a1a DBZ-7481 SnapshotterServiceProvider will check if snapshot mode class is related to the running connector. 2024-02-13 08:42:34 +01:00
roldanbob
af92291b48 DBZ-7440 Change link target for JMX options to Streams API reference 2024-02-12 11:35:57 -05:00
roldanbob
c7dee74081 DBZ-7440 Fixes errors in revised cross-references 2024-02-12 11:35:57 -05:00
roldanbob
2cde1700f3 DBZ-7440 Fix links in deployment prereqs to Streams Deploy/Manage guide 2024-02-12 11:35:57 -05:00
roldanbob
f13b9b50e7 DBZ-7440 Corrects internal xref and link to Streams Deploy/Manage guide 2024-02-12 11:35:57 -05:00
roldanbob
71c3ddcf03 DBZ-7440 Removes closing square bracket after attribute reference 2024-02-12 11:35:57 -05:00
roldanbob
c8ce003391 DBZ-7440 Point links to Streams Deploy/Manage vs Deploy guide (MongoDB) 2024-02-12 11:35:57 -05:00
roldanbob
7927f45f40 DBZ-7440 Retarget Streams Deployment guide links to Deploy/Manage guide 2024-02-12 11:35:57 -05:00
roldanbob
87c66e2bbf DBZ-7440 Update link target for Streams monitoring docs 2024-02-12 11:35:57 -05:00
roldanbob
52d93143a9 DBZ-7440 Fix link/link text in shared deployment file Addl resource list 2024-02-12 11:35:57 -05:00
Vojtech Juranek
7789d995e5 DBZ-7024 Add possibility to specify engine builder factory
Also add converting builder factory for async engine into SPI service.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
dbdb052535 DBZ-7024 Add converting builder for async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
004ebeff16 DBZ-7024 Move creation of converters into dedicated class 2024-02-12 13:43:21 +01:00
Vojtech Juranek
b74a0eb2c2 DBZ-7024 Move RecordProcessors into separate classes 2024-02-12 13:43:21 +01:00
Vojtech Juranek
eef8ee4cea DBZ-7024 Move async engine into separate package 2024-02-12 13:43:21 +01:00
Vojtech Juranek
425407331c DBZ-7024 Add TODO item for improving ConnectorCallback API 2024-02-12 13:43:21 +01:00
Vojtech Juranek
3edc61e443 DBZ-7024 Improve processor instantiation 2024-02-12 13:43:21 +01:00
Vojtech Juranek
cdf5e0255a DBZ-7024 Improve log level and log messges 2024-02-12 13:43:21 +01:00
Vojtech Juranek
a04dc84b3e DBZ-7024 Embedde state comparions into State enum methods
It's more safe to have the comparions directly in the enum and also make
obvisou that the ordering of enum is important.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
5c21d19815 DBZ-7024 Use enum for record processing order option 2024-02-12 13:43:21 +01:00
Vojtech Juranek
ee1f33fe33 DBZ-7024 Limit size of records processing thread pool
If the number of threads is provided as a number, limit it to 16 threads
to avoid possible overhead with context switching on a beefy machines
where the default value using all available cores may result in many
threads, which would be waiting most of the time anyway, as such machine
may run probably many other tasks, not only Debezium.

If the user really wants to use all available cores, it can be specified
using `AVAILABLE-CORES` placeholder.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
e2d2cff7fd DBZ-7024 Interrupt polling if needed
Some polling tasks may be stuck and we need to interrupt polling during
the shutdown not have to wait for TASK_MANAGEMENT_TIMEOUT_MS to timeout.

Also, when we start to interrput polling, we have to remove interruption
of the main thread in the `catch` part. It was a bug anyway as it
interrputed the main thread what we definitelly don't want to happen in
any case.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
40131c0531 DBZ-7024 Increase task management timeout to 2min
Increase task management timeout to two minutes and make this option
internal. This timeout will be hopefully sufficient for most of the
deployments. If not, we will increase the timeout it make this option
public.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
fc7381ad91 DBZ-7024 Improve javadoc and comments 2024-02-12 13:43:21 +01:00
Vojtech Juranek
8bb1a122b1 DBZ-7024 Add missing condition 2024-02-12 13:43:21 +01:00
Vojtech Juranek
0f7d3100b4 DBZ-7024 Add option for creating default ChangeConsumer
This option effective allowes the user to request serial processing of
the records byt the provided Consumer.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
cc5f7aedd1 DBZ-7024 Don't provide default ChangeConsumer
To allow user to use different processors, don't provide the default
ChangeHandler.
2024-02-12 13:43:21 +01:00
Vojtech Juranek
de2e4aba9f DBZ-7024 Add debug logging when selecting the processor 2024-02-12 13:43:21 +01:00
Vojtech Juranek
001cb2a640 DBZ-7024 Improve javadocs and comments, fix typos 2024-02-12 13:43:21 +01:00
Vojtech Juranek
78f7c40410 DBZ-7024 Don't stop engine before tasks are fully running 2024-02-12 13:43:21 +01:00
Vojtech Juranek
834b522739 DBZ-7024 Fix ReadOnlyIncrementalSnapshotIT after switch to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
6c71cb7f88 DBZ-7024 Fix StreamingSourceIT after switch to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
ec58dd6a1c DBZ-7024 Fix MySqlRestartIT after switch to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
3a902ff1d6 DBZ-7024 Fix MySqlConnectorSchemaValidateIT after switch to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
4689db90c0 DBZ-7024 Switch abstract embedded tests to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
0137d5f15e DBZ-7024 Switch MySQL tests inheriting from AbstractConnectorTest to async engine 2024-02-12 13:43:21 +01:00
Vojtech Juranek
dfdeab7ab8 DBZ-7024 Add method to await engine shutdown 2024-02-12 13:43:21 +01:00