Commit Graph

664 Commits

Author SHA1 Message Date
Ryan van Huuksloot
681db3ee03 DBZ-8040: Formatting 2024-07-16 17:26:51 -04:00
Ryan van Huuksloot
479a41af28 DBZ-8040: Custom Converter Support 2024-07-16 17:26:51 -04:00
mfvitale
3499f9e80d DBZ-8050 Skip data collection names that fails to be parsed as TableId 2024-07-16 16:56:30 -04:00
Debezium Builder
53b14371e5 [maven-release-plugin] prepare for next development iteration 2024-07-11 03:24:06 -04:00
Debezium Builder
61fb58f24f [maven-release-plugin] prepare release v3.0.0.Alpha1 2024-07-11 03:24:06 -04:00
Ryan van Huuksloot
ad1ae7a124 [typo] Typo in AsyncDebeziumEngine 2024-07-10 06:22:39 +02:00
Debezium Builder
ee2c192ae0 [maven-release-plugin] prepare for next development iteration 2024-06-28 04:36:37 -04:00
Debezium Builder
d47ba9bcb0 [maven-release-plugin] prepare release v2.7.0.Final 2024-06-28 04:36:37 -04:00
Vojtech Juranek
ee0045d962 DBZ-7976 Mark EmbeddedEngine as deprecated 2024-06-25 13:37:22 -04:00
Debezium Builder
db691fd16f [maven-release-plugin] prepare for next development iteration 2024-06-13 09:04:36 +00:00
Debezium Builder
73ce5c5058 [maven-release-plugin] prepare release v2.7.0.Beta2 2024-06-13 09:04:36 +00:00
mfvitale
05a04451ec DBZ-7917 Fix ReadOnlyIncrementalSnapshotIT.java test 2024-06-13 08:41:49 +02:00
mfvitale
9704f0c3e0 DBZ-7917 Add ReadOnlyIncrementalSnapshotIT.java test 2024-06-13 08:41:49 +02:00
Vojtech Juranek
8662f7ddd8 DBZ-7937 Add exception stack trace when engine fails to commit offset 2024-06-10 14:18:38 +02:00
Lars M Johansson
a7bfa8d11f DBZ-7813: waitForAvailableRecords using Awaitility 2024-06-10 07:20:20 +02:00
Lars M Johansson
145c42e700 DBZ-7813: waitForAvailableRecords using Awaitility 2024-06-06 13:36:36 +02:00
Debezium Builder
5273bb1601 [maven-release-plugin] prepare for next development iteration 2024-06-06 05:44:28 +00:00
Debezium Builder
a79c9ef799 [maven-release-plugin] prepare release v2.7.0.Beta1 2024-06-06 05:44:27 +00:00
mfvitale
730eabc1f9 DBZ-7858 Initial snapshot completed/aborted notification will the correct offset 2024-05-14 12:14:53 +02:00
Michal Augustýn
5b14097a94 DBZ-7870 default value of -1 for connection error retries interpreted as no limit 2024-05-14 11:43:16 +02:00
Debezium Builder
34a7c11de6 [maven-release-plugin] prepare for next development iteration 2024-05-13 06:42:03 +00:00
Debezium Builder
ebf74a8933 [maven-release-plugin] prepare release v2.7.0.Alpha2 2024-05-13 06:42:03 +00:00
mfvitale
70c526eb16 DBZ-7806 Skip search for WAl position when offset exist and is just after the initial snapshot. 2024-05-10 09:34:45 +02:00
Debezium Builder
bcac0c5c7a [maven-release-plugin] prepare for next development iteration 2024-04-25 09:21:27 +00:00
Debezium Builder
0be6e6b8fd [maven-release-plugin] prepare release v2.7.0.Alpha1 2024-04-25 09:21:26 +00:00
Vojtech Juranek
294fdb9d3f DBZ-7777 Use explicit list iterator in for cycle 2024-04-19 15:11:48 +02:00
Vojtech Juranek
c4a54962ad DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt   Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       88.006           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       90.226           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       83.129           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       81.417           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       90.936           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       83.645           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       77.527           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       88.495           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       79.590           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       90.246           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss        0.125           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.514           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.391           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.467           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.393           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.462           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.431           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.460           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.419           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.448           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.230           s/op
2024-04-19 15:11:48 +02:00
Vojtech Juranek
17d537c67f DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
Before the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt    Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       295.353           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       310.652           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       305.956           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       334.755           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       306.477           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       257.661           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss        78.385           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss        75.899           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss        81.068           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss        94.506           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss         0.857           s/op

After the change:

    Benchmark                                        (processingOrder)  (recordCount)  (threadCount)  Mode  Cnt  Score   Error  Units
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              1    ss       0.738           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              2    ss       0.404           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              4    ss       0.524           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000              8    ss       0.505           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine               ORDERED         100000             16    ss       0.428           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              1    ss       0.685           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              2    ss       0.400           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              4    ss       0.357           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000              8    ss       0.508           s/op
    DebeziumEnginePerf.processRecordsAsyncEngine             UNORDERED         100000             16    ss       0.410           s/op
    DebeziumEnginePerf.processRecordsEmbeddedEngine                N/A         100000            N/A    ss       0.857           s/op
2024-04-19 15:11:48 +02:00
twthorn
ea8dddade3 DBZ-7698 Add ordered transaction metadata 2024-04-19 10:23:30 +02:00
mfvitale
72b3b4c3c0 DBZ-7732 Fix test wait condition 2024-04-11 07:53:48 +02:00
mfvitale
64454cc378 DBZ-7716 Correct IncrementalSnapshotContext dataCollectionsToSnapshot cache update 2024-04-11 07:53:48 +02:00
Vojtech Juranek
a2eaddffcf DBZ-7764 Use cache thread pool as the default for async. engine 2024-04-11 07:46:01 +02:00
Vojtech Juranek
230076205f DBZ-7763 Remove async engine records processing thread cap 2024-04-11 07:46:01 +02:00
mfvitale
1190389edc DBZ-7718 Support table name escaping in BlockingSnapshotIT 2024-04-04 14:58:24 +02:00
mfvitale
ba2f893168 DBZ-7718 Support table name escaping in data collection to be snapshotted 2024-04-04 14:58:24 +02:00
Vojtěch Juránek
b281b3bede DBZ-7632 Apply suggestions from code review
Co-authored-by: roldanbob <broldan@redhat.com>
2024-04-04 13:25:29 +02:00
Vojtech Juranek
44fb5d2788 DBZ-7632 Link embedded engine documentation in readme
Use the link to the documentation instead of duplicating the
documentation here, which is also obsolete. Keep the documentation
on a single place and up-to-date.
2024-04-04 13:25:29 +02:00
Debezium Builder
ea182d83f3 [maven-release-plugin] prepare for next development iteration 2024-04-02 07:38:53 +00:00
Debezium Builder
7dcd94d19e [maven-release-plugin] prepare release v2.6.0.Final 2024-04-02 07:38:53 +00:00
Vojtech Juranek
d88fd9e2e7 DBZ-7710 Remove unneded copying from RecordProcessors 2024-03-27 14:05:11 +01:00
Vojtech Juranek
6b35efc00a DBZ-7661 Don't propagate cancelation exption when polling is stopped
`CancellationException` should be thrown mostly in the test when we want
to stop as soon as possible and may not wait for polling task to finish.
2024-03-25 17:48:31 +01:00
Vojtech Juranek
8e0c6ad88e DBZ-7661 Close properly offset backing store 2024-03-25 17:48:31 +01:00
Vojtech Juranek
16a089abb6 DBZ-7661 Always shut down record processing thread pool 2024-03-25 17:48:31 +01:00
Debezium Builder
4df18d9f43 [maven-release-plugin] prepare for next development iteration 2024-03-25 09:57:05 +00:00
Debezium Builder
9656da1fad [maven-release-plugin] prepare release v2.6.0.CR1 2024-03-25 09:57:04 +00:00
Chris Cranford
200f9ed28e DBZ-7596 Improved tests for reselect post processor 2024-03-18 13:44:14 +01:00
Chris Cranford
0e267d8ef6 DBZ-7596 Support reselection of PostgreSQL hstore values 2024-03-18 13:44:14 +01:00
Andreas Martens
adabb899f8 DBZ-7614: expand scope of catch furing Engine validation 2024-03-11 15:41:30 +01:00
Andreas Martens
c74c6d6188 DBZ-7614: indent changes in EmbeddedEngine 2024-03-11 15:41:30 +01:00
Andreas Martens
85aea68c9a DBZ-7614: catch exception during validation 2024-03-11 15:41:30 +01:00