Commit Graph

682 Commits

Author SHA1 Message Date
mfvitale
08c50fb619 DBZ-8137 Fix JMX signal and notification channel for multiple tasks connectors 2024-08-28 10:04:06 +02:00
Debezium Builder
cf11d07ea8 [maven-release-plugin] prepare for next development iteration 2024-08-22 03:23:47 -04:00
Debezium Builder
2145f752ec [maven-release-plugin] prepare release v3.0.0.Beta1 2024-08-22 03:23:47 -04:00
mfvitale
110d3f38c1 DBZ-8035 Stabilize OracleMetricsIT tests 2024-08-20 13:23:34 +02:00
mfvitale
1f0a61fb30 DBZ-7601 Stabilize SqlServerMetricsIT tests 2024-08-20 13:23:34 +02:00
mfvitale
f3d43a8755 DBZ-8035 Uniform metrics tests 2024-08-20 13:23:34 +02:00
Jakub Cechacek
8277961085 DBZ-8135 Caching task channels in AsyncEngineSignaler 2024-08-20 13:03:22 +02:00
Jakub Cechacek
9965835e15 DBZ-8135 Basic Signaler tests for PG 2024-08-20 13:03:22 +02:00
Jakub Cechacek
dd5e6e1a16 DBZ-8135 Added Signaler support to async engine 2024-08-20 13:03:22 +02:00
Ryan van Huuksloot
8617f474c5 DBZ-8082: Pass Headers to Key/Value Converters 2024-08-15 08:44:31 +02:00
rkerner
42fbde8268 DBZ-8138 Re-add check if assembly profile is active as JUnit annotation
closes https://issues.redhat.com/browse/DBZ-8138
2024-08-15 08:15:43 +02:00
Lars M Johansson
ba39a27b89 DBZ-8114: waitForAvailableRecords with records.waittime 2024-08-15 08:04:26 +02:00
Lars M Johansson
da143ef8b2 DBZ-8114: start connector after altering schema to avoid having to stop and start it again for Informix 2024-08-15 08:04:26 +02:00
Debezium Builder
17aca64cec [maven-release-plugin] prepare for next development iteration 2024-08-02 06:20:37 -04:00
Debezium Builder
5d54d75362 [maven-release-plugin] prepare release v3.0.0.Alpha2 2024-08-02 06:20:36 -04:00
Vojtech Juranek
e583599d22 DBZ-8100 Wait for streaming instead of starting connector
If we stop the connector short after its start, we need to wait for
streaming phase, i.e. wait for starting all connector tasks.
Waiting for connector start return `true` when connector begins to start
its tasks, but to prevent leaking of the resources, async engine doesn't
allow stopping the connector until all its tasks are started. Therefore
when using async. engine, we have to wait for tasks to be started before
stopping the connector, otherwise exception is thrown.
2024-08-02 05:31:22 +02:00
Vojtech Juranek
fb94614419 DBZ-8106 Close transfomations upon embedded engine stop 2024-07-31 11:19:07 +02:00
Vojtech Juranek
63377d9d6a DBZ-8106 Stop header converter after stopping connector and its tasks 2024-07-31 11:19:07 +02:00
Ryan van Huuksloot
681db3ee03 DBZ-8040: Formatting 2024-07-16 17:26:51 -04:00
Ryan van Huuksloot
479a41af28 DBZ-8040: Custom Converter Support 2024-07-16 17:26:51 -04:00
mfvitale
3499f9e80d DBZ-8050 Skip data collection names that fails to be parsed as TableId 2024-07-16 16:56:30 -04:00
Debezium Builder
53b14371e5 [maven-release-plugin] prepare for next development iteration 2024-07-11 03:24:06 -04:00
Debezium Builder
61fb58f24f [maven-release-plugin] prepare release v3.0.0.Alpha1 2024-07-11 03:24:06 -04:00
Ryan van Huuksloot
ad1ae7a124 [typo] Typo in AsyncDebeziumEngine 2024-07-10 06:22:39 +02:00
Debezium Builder
ee2c192ae0 [maven-release-plugin] prepare for next development iteration 2024-06-28 04:36:37 -04:00
Debezium Builder
d47ba9bcb0 [maven-release-plugin] prepare release v2.7.0.Final 2024-06-28 04:36:37 -04:00
Vojtech Juranek
ee0045d962 DBZ-7976 Mark EmbeddedEngine as deprecated 2024-06-25 13:37:22 -04:00
Debezium Builder
db691fd16f [maven-release-plugin] prepare for next development iteration 2024-06-13 09:04:36 +00:00
Debezium Builder
73ce5c5058 [maven-release-plugin] prepare release v2.7.0.Beta2 2024-06-13 09:04:36 +00:00
mfvitale
05a04451ec DBZ-7917 Fix ReadOnlyIncrementalSnapshotIT.java test 2024-06-13 08:41:49 +02:00
mfvitale
9704f0c3e0 DBZ-7917 Add ReadOnlyIncrementalSnapshotIT.java test 2024-06-13 08:41:49 +02:00
Vojtech Juranek
8662f7ddd8 DBZ-7937 Add exception stack trace when engine fails to commit offset 2024-06-10 14:18:38 +02:00
Lars M Johansson
a7bfa8d11f DBZ-7813: waitForAvailableRecords using Awaitility 2024-06-10 07:20:20 +02:00
Lars M Johansson
145c42e700 DBZ-7813: waitForAvailableRecords using Awaitility 2024-06-06 13:36:36 +02:00
Debezium Builder
5273bb1601 [maven-release-plugin] prepare for next development iteration 2024-06-06 05:44:28 +00:00
Debezium Builder
a79c9ef799 [maven-release-plugin] prepare release v2.7.0.Beta1 2024-06-06 05:44:27 +00:00
mfvitale
730eabc1f9 DBZ-7858 Initial snapshot completed/aborted notification will the correct offset 2024-05-14 12:14:53 +02:00
Michal Augustýn
5b14097a94 DBZ-7870 default value of -1 for connection error retries interpreted as no limit 2024-05-14 11:43:16 +02:00
Debezium Builder
34a7c11de6 [maven-release-plugin] prepare for next development iteration 2024-05-13 06:42:03 +00:00
Debezium Builder
ebf74a8933 [maven-release-plugin] prepare release v2.7.0.Alpha2 2024-05-13 06:42:03 +00:00
mfvitale
70c526eb16 DBZ-7806 Skip search for WAl position when offset exist and is just after the initial snapshot. 2024-05-10 09:34:45 +02:00
Debezium Builder
bcac0c5c7a [maven-release-plugin] prepare for next development iteration 2024-04-25 09:21:27 +00:00
Debezium Builder
0be6e6b8fd [maven-release-plugin] prepare release v2.7.0.Alpha1 2024-04-25 09:21:26 +00:00
Vojtech Juranek
294fdb9d3f DBZ-7777 Use explicit list iterator in for cycle 2024-04-19 15:11:48 +02:00
Vojtech Juranek
c4a54962ad DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt   Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       88.006           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       90.226           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       83.129           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       81.417           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       90.936           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       83.645           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       77.527           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       88.495           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       79.590           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       90.246           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss        0.125           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.514           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.391           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.467           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.393           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.462           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.431           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.460           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.419           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.448           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.230           s/op
2024-04-19 15:11:48 +02:00
Vojtech Juranek
17d537c67f DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.738           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.404           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.524           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.505           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.428           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.685           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.400           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.357           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.508           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.857           s/op
2024-04-19 15:11:48 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
mfvitale
72b3b4c3c0 DBZ-7732 Fix test wait condition 2024-04-11 07:53:48 +02:00
mfvitale
64454cc378 DBZ-7716 Correct IncrementalSnapshotContext dataCollectionsToSnapshot cache update 2024-04-11 07:53:48 +02:00
Vojtech Juranek
a2eaddffcf DBZ-7764 Use cache thread pool as the default for async. engine 2024-04-11 07:46:01 +02:00