Vojtech Juranek
e583599d22
DBZ-8100 Wait for streaming instead of starting connector
...
If we stop the connector short after its start, we need to wait for
streaming phase, i.e. wait for starting all connector tasks.
Waiting for connector start return `true` when connector begins to start
its tasks, but to prevent leaking of the resources, async engine doesn't
allow stopping the connector until all its tasks are started. Therefore
when using async. engine, we have to wait for tasks to be started before
stopping the connector, otherwise exception is thrown.
2024-08-02 05:31:22 +02:00
Vojtech Juranek
fb94614419
DBZ-8106 Close transfomations upon embedded engine stop
2024-07-31 11:19:07 +02:00
Vojtech Juranek
63377d9d6a
DBZ-8106 Stop header converter after stopping connector and its tasks
2024-07-31 11:19:07 +02:00
Ryan van Huuksloot
681db3ee03
DBZ-8040: Formatting
2024-07-16 17:26:51 -04:00
Ryan van Huuksloot
479a41af28
DBZ-8040: Custom Converter Support
2024-07-16 17:26:51 -04:00
mfvitale
3499f9e80d
DBZ-8050 Skip data collection names that fails to be parsed as TableId
2024-07-16 16:56:30 -04:00
Debezium Builder
53b14371e5
[maven-release-plugin] prepare for next development iteration
2024-07-11 03:24:06 -04:00
Debezium Builder
61fb58f24f
[maven-release-plugin] prepare release v3.0.0.Alpha1
2024-07-11 03:24:06 -04:00
Ryan van Huuksloot
ad1ae7a124
[typo] Typo in AsyncDebeziumEngine
2024-07-10 06:22:39 +02:00
Debezium Builder
ee2c192ae0
[maven-release-plugin] prepare for next development iteration
2024-06-28 04:36:37 -04:00
Debezium Builder
d47ba9bcb0
[maven-release-plugin] prepare release v2.7.0.Final
2024-06-28 04:36:37 -04:00
Vojtech Juranek
ee0045d962
DBZ-7976 Mark EmbeddedEngine as deprecated
2024-06-25 13:37:22 -04:00
Debezium Builder
db691fd16f
[maven-release-plugin] prepare for next development iteration
2024-06-13 09:04:36 +00:00
Debezium Builder
73ce5c5058
[maven-release-plugin] prepare release v2.7.0.Beta2
2024-06-13 09:04:36 +00:00
mfvitale
05a04451ec
DBZ-7917 Fix ReadOnlyIncrementalSnapshotIT.java test
2024-06-13 08:41:49 +02:00
mfvitale
9704f0c3e0
DBZ-7917 Add ReadOnlyIncrementalSnapshotIT.java test
2024-06-13 08:41:49 +02:00
Vojtech Juranek
8662f7ddd8
DBZ-7937 Add exception stack trace when engine fails to commit offset
2024-06-10 14:18:38 +02:00
Lars M Johansson
a7bfa8d11f
DBZ-7813: waitForAvailableRecords using Awaitility
2024-06-10 07:20:20 +02:00
Lars M Johansson
145c42e700
DBZ-7813: waitForAvailableRecords using Awaitility
2024-06-06 13:36:36 +02:00
Debezium Builder
5273bb1601
[maven-release-plugin] prepare for next development iteration
2024-06-06 05:44:28 +00:00
Debezium Builder
a79c9ef799
[maven-release-plugin] prepare release v2.7.0.Beta1
2024-06-06 05:44:27 +00:00
mfvitale
730eabc1f9
DBZ-7858 Initial snapshot completed/aborted notification will the correct offset
2024-05-14 12:14:53 +02:00
Michal Augustýn
5b14097a94
DBZ-7870 default value of -1 for connection error retries interpreted as no limit
2024-05-14 11:43:16 +02:00
Debezium Builder
34a7c11de6
[maven-release-plugin] prepare for next development iteration
2024-05-13 06:42:03 +00:00
Debezium Builder
ebf74a8933
[maven-release-plugin] prepare release v2.7.0.Alpha2
2024-05-13 06:42:03 +00:00
mfvitale
70c526eb16
DBZ-7806 Skip search for WAl position when offset exist and is just after the initial snapshot.
2024-05-10 09:34:45 +02:00
Debezium Builder
bcac0c5c7a
[maven-release-plugin] prepare for next development iteration
2024-04-25 09:21:27 +00:00
Debezium Builder
0be6e6b8fd
[maven-release-plugin] prepare release v2.7.0.Alpha1
2024-04-25 09:21:26 +00:00
Vojtech Juranek
294fdb9d3f
DBZ-7777 Use explicit list iterator in for cycle
2024-04-19 15:11:48 +02:00
Vojtech Juranek
c4a54962ad
DBZ-7777 Avoid using List#get() in ParallelSmtConsumerProcessor
...
Before the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 88.006 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 90.226 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 83.129 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 81.417 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 90.936 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 83.645 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 77.527 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 88.495 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 79.590 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 90.246 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.125 s/op
After the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 0.514 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 0.391 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 0.467 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 0.393 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 0.462 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 0.410 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 0.431 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 0.460 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 0.419 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 0.448 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.230 s/op
2024-04-19 15:11:48 +02:00
Vojtech Juranek
17d537c67f
DBZ-7777 Avoid using List#get() in ParallelSmtAndConvertConsumerProcessor
...
Before the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 295.353 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 310.652 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 305.956 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 334.755 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 306.477 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 257.661 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 78.385 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 75.899 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 81.068 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 94.506 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.857 s/op
After the change:
Benchmark (processingOrder) (recordCount) (threadCount) Mode Cnt Score Error Units
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 1 ss 0.738 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 2 ss 0.404 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 4 ss 0.524 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 8 ss 0.505 s/op
DebeziumEnginePerf.processRecordsAsyncEngine ORDERED 100000 16 ss 0.428 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 1 ss 0.685 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 2 ss 0.400 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 4 ss 0.357 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 8 ss 0.508 s/op
DebeziumEnginePerf.processRecordsAsyncEngine UNORDERED 100000 16 ss 0.410 s/op
DebeziumEnginePerf.processRecordsEmbeddedEngine N/A 100000 N/A ss 0.857 s/op
2024-04-19 15:11:48 +02:00
twthorn
ea8dddade3
DBZ-7698 Add ordered transaction metadata
2024-04-19 10:23:30 +02:00
mfvitale
72b3b4c3c0
DBZ-7732 Fix test wait condition
2024-04-11 07:53:48 +02:00
mfvitale
64454cc378
DBZ-7716 Correct IncrementalSnapshotContext dataCollectionsToSnapshot cache update
2024-04-11 07:53:48 +02:00
Vojtech Juranek
a2eaddffcf
DBZ-7764 Use cache thread pool as the default for async. engine
2024-04-11 07:46:01 +02:00
Vojtech Juranek
230076205f
DBZ-7763 Remove async engine records processing thread cap
2024-04-11 07:46:01 +02:00
mfvitale
1190389edc
DBZ-7718 Support table name escaping in BlockingSnapshotIT
2024-04-04 14:58:24 +02:00
mfvitale
ba2f893168
DBZ-7718 Support table name escaping in data collection to be snapshotted
2024-04-04 14:58:24 +02:00
Vojtěch Juránek
b281b3bede
DBZ-7632 Apply suggestions from code review
...
Co-authored-by: roldanbob <broldan@redhat.com>
2024-04-04 13:25:29 +02:00
Vojtech Juranek
44fb5d2788
DBZ-7632 Link embedded engine documentation in readme
...
Use the link to the documentation instead of duplicating the
documentation here, which is also obsolete. Keep the documentation
on a single place and up-to-date.
2024-04-04 13:25:29 +02:00
Debezium Builder
ea182d83f3
[maven-release-plugin] prepare for next development iteration
2024-04-02 07:38:53 +00:00
Debezium Builder
7dcd94d19e
[maven-release-plugin] prepare release v2.6.0.Final
2024-04-02 07:38:53 +00:00
Vojtech Juranek
d88fd9e2e7
DBZ-7710 Remove unneded copying from RecordProcessors
2024-03-27 14:05:11 +01:00
Vojtech Juranek
6b35efc00a
DBZ-7661 Don't propagate cancelation exption when polling is stopped
...
`CancellationException` should be thrown mostly in the test when we want
to stop as soon as possible and may not wait for polling task to finish.
2024-03-25 17:48:31 +01:00
Vojtech Juranek
8e0c6ad88e
DBZ-7661 Close properly offset backing store
2024-03-25 17:48:31 +01:00
Vojtech Juranek
16a089abb6
DBZ-7661 Always shut down record processing thread pool
2024-03-25 17:48:31 +01:00
Debezium Builder
4df18d9f43
[maven-release-plugin] prepare for next development iteration
2024-03-25 09:57:05 +00:00
Debezium Builder
9656da1fad
[maven-release-plugin] prepare release v2.6.0.CR1
2024-03-25 09:57:04 +00:00
Chris Cranford
200f9ed28e
DBZ-7596 Improved tests for reselect post processor
2024-03-18 13:44:14 +01:00
Chris Cranford
0e267d8ef6
DBZ-7596 Support reselection of PostgreSQL hstore values
2024-03-18 13:44:14 +01:00