Vojtech Juranek
fdab2cd61b
DBZ-7007 Remove engine.isRunning() from testsuite
2023-11-06 10:50:21 +01:00
Vojtech Juranek
89277591dd
DBZ-7007 Replace engine.await() with Awaitility condition
...
In the second case replace infinite loop by one minute wait. If this is
not sufficient for any case, we can increase the timeout in the future.
2023-11-06 10:50:21 +01:00
Vojtech Juranek
9b1d5172ff
DBZ-6213 Remove unneeded code from the testsuite
...
After fixing start method to really start the connector, this wait loop
is not needed any more.
2023-11-06 10:50:21 +01:00
Vojtech Juranek
1a58845507
DBZ-7007 Use close() instead of EmbeddedEngine#stop() method
2023-11-06 10:50:21 +01:00
Vojtech Juranek
953f1c77aa
DBZ-7007 Switch to DebeziuEngine in ConnectorOutputTest
2023-11-06 10:50:21 +01:00
Vojtech Juranek
d0c2658c43
DBZ-7007 Switch to DebeziuEngine in EmbeddedEngineTest
2023-11-06 10:50:21 +01:00
Vojtech Juranek
3295844cc3
DBZ-7007 Use property based configuration in the emebdded tests
2023-11-06 10:50:21 +01:00
Vojtech Juranek
9d26dd4cf4
DBZ-7007 Move embedded engine config into separate interface
...
This config will be re-used by possible other implementations of
DebeiumEngine API in the embedded package. As DebeziumEngine API
can have completely different implementations and thus also config,
the class is called `EmbeddedEngineConfig` as it's assumed to be used
only by embedded engine "family" of implementations.
To keep backward compatibility, the config options are extracted into
an interface and `EmbeddedEngine` implements this interface, thus
allowing to use these options in custom classes without any need for the
code changes.
2023-11-06 10:50:21 +01:00
Roman Kudryashov
b0d7d60b5d
DBZ-7016 Optimize retrieval of id and type
2023-10-19 11:35:18 +02:00
Roman Kudryashov
22f6b083b1
DBZ-7016 Change metadata.location property syntax
2023-10-19 11:35:18 +02:00
Roman Kudryashov
ee64c70546
DBZ-7016 id
and type
of a CloudEvent can be retrieved from headers
2023-10-19 11:35:18 +02:00
Vojtech Juranek
7b4cf1901c
DBZ-7013 Remove deprecated and unused code from embedded package
2023-10-10 06:36:05 +02:00
Roman Kudryashov
01485aceb3
DBZ-6982 Provide configuration option to exclude extension attributes from a CloudEvent
2023-10-04 13:58:53 +02:00
mfvitale
993413955c
DBZ-6793 Add timestamp for notifications
2023-09-28 14:20:17 -04:00
Roman Kudryashov
98c426dec4
DBZ-3642 CloudEventsConverter can retrieve metadata info from headers
2023-09-26 13:06:09 +02:00
Animesh Kumar
fcbff074f4
DBZ-6787 Dedupe table list while incremental snapshot
2023-09-26 10:50:32 +02:00
mfvitale
5d7ba3e951
DBZ-6957 Remove spaces in Signal and Notification JMX ObjectName
2023-09-21 12:04:33 -04:00
mfvitale
68eb4b2df2
DBZ-6828 Process drop table events during blocking snapshot
2023-09-20 08:18:33 +02:00
mfvitale
ae199d2053
DBZ-6828 Blocking snapshot will generate schema events only for signaled tables
2023-09-20 08:18:33 +02:00
Nir Levy
c748fc494b
DBZ-6866 Fix behaviour when errors.max.retries = 0
2023-09-05 15:03:01 -04:00
Jiri Pechanec
5515fb67f1
DBZ-6853 Use topic admin
2023-08-31 18:06:34 +02:00
“vsantonastaso”
43adc59292
DBZ-6742 use JSON format for JMX Notitication userData
2023-08-22 06:42:51 +02:00
mfvitale
542b3619fa
DBZ-6731 Blocking snapshot takes configuration from signal payload
2023-08-15 12:43:43 +02:00
Vojtech Juranek
230c056577
DBZ-6715 Refactor polling of the records
2023-08-04 15:00:11 +02:00
Vojtech Juranek
9483b5ac76
DBZ-6715 Speed-up embedded engine test
...
This speeds up embedded engine test by 5 minutes.
2023-08-04 15:00:11 +02:00
Vojtech Juranek
226cd99e07
DBZ-6715 Use better method name
2023-08-04 15:00:11 +02:00
Vojtech Juranek
e4b34e771c
DBZ-6715 Make variables final
2023-08-04 15:00:11 +02:00
Vojtech Juranek
23adf86379
DBZ-6715 Refactor running connector and task and error handling
2023-08-04 15:00:11 +02:00
Vojtech Juranek
fae7b9b18d
DBZ-6715 Refactor initialization of the connector
...
Exiting from `run()` method is now done by throwing new runtime
exception.
2023-08-04 15:00:11 +02:00
mfvitale
61651a94b5
DBZ-6566 Force blocking snapshot even if a snapshot has already executed
2023-08-03 09:22:24 +02:00
mfvitale
85d725fde8
DBZ-6566 Support Blocking snapshot for Oracle
2023-08-03 09:22:24 +02:00
mfvitale
f883a5c9a3
DBZ-6566 Support Blocking snapshot for SQLServer
2023-08-03 09:22:24 +02:00
mfvitale
def7379a0d
DBZ-6566 Support Blocking snapshot for MySQL
2023-08-03 09:22:24 +02:00
mfvitale
70f16af7c4
DBZ-6566 Support Blocking snapshot for PostgreSQL
2023-08-03 09:22:24 +02:00
Chris Cranford
58792c4a7c
DBZ-6730 Exit consumption loop if engine has stopped
2023-07-31 13:43:49 +02:00
mfvitale
a06ba84153
DBZ-6672 Improve NotificationIt stability
2023-07-18 09:42:21 +02:00
Jiri Pechanec
aca46f6bd1
DBZ-6047 Use updated Kafka offset stores
2023-07-13 11:26:21 +02:00
Jiri Pechanec
764427081b
DBZ-6517 DBZ-6654 Make CE converter compatible with Kafka 3.5
2023-07-13 11:26:21 +02:00
harveyyue
58d3e150b9
DBZ-6603 Add integration test for custom metric tags
2023-07-13 09:52:33 +02:00
mfvitale
9ed928a1c9
DBZ-6416 Improve tests stability
2023-06-22 13:22:34 +02:00
mfvitale
34e28ac52d
DBZ-6416 Add initial snapshot notifications
2023-06-22 13:22:34 +02:00
mfvitale
7338fde84e
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
...
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
DBZ-6424 Emit JMX Notification when Debezium generate its own notification
2023-06-07 07:36:58 +02:00
mfvitale
769d9361e7
DBZ-6424 Add JMX Notification channel
...
This channel permits to send Debezium notification to JMX bean
DBZ-6424 Add JMX Signal channel
This channel permits to send signal to Debezium through the JMX operation
2023-06-07 07:36:58 +02:00
Jiri Pechanec
2fea067cca
DBZ-5252 Allow skipping records in test consumer
2023-05-26 05:48:34 +02:00
mfvitale
e0659f1a0e
DBZ-6496 Fix performance issue on testNotification
test with Oracle and MS SQL Server connectors
2023-05-24 18:51:49 +02:00
mfvitale
dc00f64bbf
DBZ-6447 Incremental snapshot notification ids are now equal to the id sent in the execute-snapshot
signal.
2023-05-23 09:57:05 +02:00
mfvitale
7429b4e6f1
DBZ-1973 Add incremental snapshot notifications
2023-05-10 12:22:02 +02:00
mfvitale
811b800f55
DBZ-1973 Add support for Notifications
...
DBZ-1973 Add more tests for other connectors
DBZ-1973 Add send method with offset parameter
DBZ-1973 Instantiate NotificationService in the task class
DBZ-1973 Instantiate NotificationService in the task class
DBZ-4027 Move specific sink channel configuration to SinkNotificationChannel
DBZ-4027 Remove not used SPI file
DBZ-1973 Moved SPI file definition to debezium-core
DBZ-1973 Rename KafkaNotificationChannel to more generic SinkNotificationChannel
DBZ-1973 Code refactor
DBZ-1973 Improve configuration property description
DBZ-1973 Improve test
DBZ-1973 Add close method to NotificationChannel
DBZ-1973 Implement KafkaNotificationChannel
DBZ-1973 Add NotificationService and LogNotificationChannel
2023-05-10 12:22:02 +02:00
mfvitale
952340286e
DBZ-4027 Make signalling channel configurable
...
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Add an Incremental snapshot test with kafka signaling
DBZ-4027 Code style
DBZ-4027 Make SignalPayload more generic and extensible
DBZ-4027 Rename DatabaseSignalChannel to SourceSignalChannel
DBZ-4027 Improve logging
DBZ-4027 Moved SPI file definition to debezium-core
DBZ-4027 Move SignalProcessor synchronization point to be processed only when a signal cdc event arrives.
DBZ-4027 Add EventDispatcher constructor without signalProcessor for spanner connector
DBZ-4027 Fix NPE
DBZ-4027 Fix NPE
DBZ-4027 Formatting
DBZ-4027 Correctly manage signal on not supported connector
DBZ-4027 Use the correct MongoDbOffset
DBZ-4027 Correctly initialize offset for Oracle and SqlServer connectors
DBZ-4027 Register SPI implementations
DBZ-4027 Improve SignalProcessor instantiation
DBZ-4027 Pass source info in case of SchemaChanges action
DBZ-4027 Manage close event in a synchronous way
DBZ-4027 Correctly init offset context also in case of snapshot mode 'never'
DBZ-4027 Fix MySqlMetricsIT test
DBZ-4027 Move KafkaSignalChannel to core
DBZ-4027 Move KafkaSignalChannel to core
DBZ-4027 Set pass offset context after initial snapshot to SignalProcessor
DBZ-4027 Pass OffsetContext to signal processor
DBZ-4027 Pass CommonConnectorConfig to SignalChannelReader init method
DBZ-4027 Move Incremental snapshot window actions to dedicated package
DBZ-4027 Align SignalsIT test with new code
DBZ-4027 Fix SignalsIT test
DBZ-4027 Fix SignalProcessor scheduling
DBZ-4027 Moved DatabaseSignalChannel and SignalChannelReader to dedicated package
DBZ-4027 Start SignalProcessor from ChangeEventSourceCoordinator
DBZ-4027 Create SignalProcessor and renamed Signal to DatabaseSignalChannel
DBZ-4027 Initial refactoring of signal feature
2023-05-05 13:35:40 +02:00
Jiri Pechanec
3372e5c450
DBZ-3621 Clean deps; add logging for tests; extrenalize config options
2023-05-02 14:15:19 +02:00
Kanthi Subramanian
ba41b603eb
DBZ-3621 Make select and insert queries configurable for JDBC offset storage.
2023-05-02 14:15:19 +02:00
Kanthi Subramanian
3f8b2a8d49
DBZ-3621 Changed references to JDBC URI to JDBC URL
2023-05-02 14:15:19 +02:00
Kanthi Subramanian
8be3806525
DBZ-3621 Added debezium-storage module to pom.xml
2023-05-02 14:15:19 +02:00
Nir Levy
735933ce6b
DBZ-6248 Expose EmbeddedEngine configuration fields
2023-03-27 11:04:56 +02:00
PlugaruT
6ad3df4d19
DBZ-6023 Change surrogate key provided in integration tests
2023-03-06 10:25:59 +01:00
PlugaruT
3e05965d24
DBZ-6023 Add integration tests
2023-03-06 10:25:59 +01:00
Ismail Simsek
3548daf8b9
DBZ-6075 Use Instantiator to load ClassLoader
2023-02-07 07:24:03 +01:00
Vojtech Juranek
f53237c249
DBZ-6035 Await for transactions to be propagated to CDC table
...
Lowering polling interval intorduced in previous commit doesn't fully
fix the issue and there is still small race condition. To fully fix it
add function for awaiting transaction to be propagate to CDC table and
await transaction in tests which randomly fails.
2023-01-26 07:33:10 +01:00
Jiri Pechanec
1ec41fa120
DBZ-5879 Added logging; removed commented out code
2023-01-18 14:46:14 +01:00
Jeremy Ford
553cb9b1dd
DBZ-5879 Add wait to tests in order to maintain expectations of existing integration tests
2023-01-18 14:46:14 +01:00
Jeremy Ford
d775104331
DBZ-5926 Add support for Connect Headers to Debezium Server
...
Add headers support to ChangeEvent
Add SerializationFormat support headers
2023-01-18 10:28:22 +01:00
Jiri Pechanec
8ca5e0a9b5
DBZ-4669 Reformat after plugin version consolidation
2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6
DBZ-2439 Remove redundant modifiers
2023-01-11 06:44:53 +01:00
Marcelo Avancini
7754163c5d
DBZ-2432: Fixing misuse of assertj
...
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
2022-12-08 13:10:26 +01:00
poonam-meghnani
a8f149237b
DBZ-5661 Disabling retries and stop connector if failed with Retriable errors, when errors.max.retires is less than -1
2022-11-23 12:29:51 +01:00
ggaborg
a6b2f0db3c
DBZ-4720 Validate Debezium Server configuration properties
2022-11-22 14:46:55 +01:00
Vojtech Juranek
0510102db5
DBZ-2131 Don't skip Avro validation
...
Original issue seems to be resolved, at least don't with with Avro
validation.
2022-11-09 08:44:45 +01:00
Ondrej Babec
a7e005da25
DBZ-5805 Fix TransformationTest for Kafka 2.X
2022-11-08 14:49:35 +01:00
jcechace
ee6d3ea6d6
DBZ-5779 Migrated debezium-embedded to AssertJ
2022-11-02 08:50:26 +01:00
Jiri Pechanec
c6babedbdf
DBZ-5530 Improve test cases
2022-10-20 08:27:27 +02:00
Jeremy Ford
9072ea404f
DBZ-5530 Add support for predicates in debezium embedded engine.
2022-10-20 08:27:27 +02:00
Vojtech Juranek
820b9d10d5
DBZ-5329 Add LSN to Postgres transation ID
...
Add `EventDispatcher` constructor which accepts `TransactionMonior`
instance as a parameter and in case of Postgres pass into
`EventDispatcher` custom `PostgresTransactionMonitor` which adjusts
transactions IDs by adding LSN, i.e. Postgres transaction is now of
form `txId:LSN`.
2022-10-11 15:38:33 +02:00
ggaborg
001371e976
DBZ-4629 infinite retries
2022-10-06 13:11:53 +02:00
ggaborg
11c588fb03
DBZ-4629 Debezium server crashes when no connection to the source db
2022-10-06 13:11:53 +02:00
Sergei Morozov
e4d46c81b1
DBZ-5541: Default Debezium schema.name.adjustment.mode to "none"
2022-09-29 09:47:25 +02:00
harveyyue
20d56734d4
DBZ-5585 Modify the Instantiator to not require classloader
2022-09-19 17:15:29 +02:00
Jeremy Ford
6ba801adc1
DBZ-5583 Wrap offset policy instantiation in try/catch
2022-09-19 14:31:12 +02:00
Jeremy Ford
fc2fa9debf
DBZ-4213 Use UTF-8 encoding when creating new Strings
2022-09-19 14:19:41 +02:00
harveyyue
09b99840d8
DBZ-4617 Deprecate internal key/value converter options
2022-09-14 12:49:30 +02:00
Vojtech Juranek
b797201263
DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH
2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5
DBZ-5043 Replace 'database history' with 'database schema history'
...
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79
DBZ-5043 Rename DatabaseHistory to SchemaHistory
...
Rename also all related classes and varibales.
2022-09-07 12:57:31 +02:00
Jeremy Ford
539d9a3958
DBZ-5534 EmbeddedEngine should initialize Connector using SourceConnectorContext
...
Use SourceConnectorContext instead of ConnectorContext
2022-08-22 14:13:03 -04:00
Chris Cranford
14c9f8855b
DBZ-5327 Fix Oracle/Db2 test failures
2022-08-19 11:33:01 -04:00
jcechace
fc9de10a0e
DBZ-4733 adjusting poll interval in mongodb tests
2022-08-19 12:55:58 +02:00
Vivek Wassan
d89e71ebeb
DBZ-5327 Smart Backfills
2022-08-17 10:05:55 +02:00
Chris Cranford
0ee30e2115
DBZ-4727 Adjust chunk size for pause test
2022-08-01 10:04:42 -04:00
Vojtech Juranek
ed504173e1
DBZ-4727 Implement incremental snaphost pause/resume
...
Intorduce two new signals:
* `pause-snapshot` - pauses running incremental snapshot
* `resume-snapshot` - resumes paused incremental snapshot
If the incremental snapshot is running and pause signal is sent,
currently processed chunk is finished and then no other chunk is read.
Snapshot state is kept in running state. Once snapshot is resume,
chunk is reverted to position which was last sent to the broker and
process of reading chunks and emitting `read` events continues until
all tables are read and sent.
This patch handles only table-based signals. MySQL Kafka-based signals
will be addressed later.
2022-07-29 12:41:58 -04:00
Vojtech Juranek
65bfeeccea
DBZ-4727 Make wait for snapshot event generic
2022-07-29 12:41:58 -04:00
Jan Doms
b5adede223
DBZ-5433 stop OffsetStore if it fails to fully start
2022-07-22 09:29:13 -04:00
Chris Cranford
b6549670c8
DBZ-4451 Allow test to be extended by connectors
2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5
DBZ-4834 Fix incremental snapshot of table added to include list
2022-06-16 08:39:16 +02:00
Chris Cranford
6cf9da004e
DBZ-4251 Make several test methods abstract
2022-06-02 07:30:07 +02:00
Chris Cranford
9d71296b5c
DBZ-4251 Support stopping incremental snapshots
2022-06-02 07:30:07 +02:00
Vojtech Juranek
f8d4307155
DBZ-5052 Send tombstones only when consumer is able to consume them
...
Change event consumer may specify if is able to consume tombstones or
not. If the it's not, don't send them. However, connector configuration
takes precence and thus cunsumer capability is taken into account only
when `tombstones.on.delete` is not explicitely configured for the
connector.
Also fix debezium server - setting notifier has to be done once embedded
config already exists, not before it.
2022-05-26 12:40:02 +02:00
Vojtech Juranek
d6447a91c9
DBZ-5052 Add option to start embedded engine with custom change handler
...
Also make `consumedLines` instance variable available to subclasses to
they can use it in the change handler.
2022-05-26 12:40:02 +02:00
Vojtech Juranek
d6efe20826
DBZ-5052 Move test event consumer to dedicated method.
...
This makes code more readable and allows subclasses to override
the consumer when needed.
2022-05-26 12:40:02 +02:00
Chris Lee
2a8456d21b
DBZ-5123 data-collection regex snapshot signal
2022-05-24 12:46:28 +02:00
zalmane
e679b37849
DBZ-4742 change connect config to use WorkerConfig values for interpolation
2022-03-31 08:54:46 +02:00
Jiri Pechanec
d13a1635d7
DBZ-3952 Store schema for tables not in schema collection list
2022-02-17 07:41:00 +01:00
Chris Cranford
dcd8607108
DBZ-4584 Support case-sensitive Oracle incremental snapshots
2022-01-31 09:14:46 +01:00
Chris Cranford
35ef67852c
DBZ-4562 Reduce log verbosity
2022-01-25 18:41:06 +01:00
Jiri Pechanec
55894e57c2
DBZ-4610 Upgrade to Kafka 3.1.0
2022-01-25 15:26:42 +01:00
Jiri Pechanec
9509e5976a
DBZ-4566 Used topic names for Debezium Engine converters
2022-01-19 11:32:45 +01:00
Jiri Pechanec
8fd3243a86
DBZ-2224 Test logging based on logback
2022-01-18 11:24:21 +01:00
Kate
5d81466ec1
DBZ-4501 Null out incremental snapshot event's query field
2022-01-03 14:38:36 +01:00
Jiri Pechanec
d13e6f546c
DBZ-4467 Skip unsupported test for Db2
2021-12-20 11:29:30 +01:00
Chris Cranford
63731a2a09
DBZ-3940 Unify EventRouter tests for connectors
2021-12-13 13:52:31 +01:00
Jiri Pechanec
b1dcfcb0b8
DBZ-3342 Incremental snapshot support for MongoDB
2021-12-09 10:03:41 +01:00
Jiri Pechanec
5e40e1cdf5
DBZ-4272 Skip connector test using annotations
2021-11-30 09:28:44 +01:00
Jiri Pechanec
358eb0379b
DBZ-4272 Disable tests for SQL Server
2021-11-30 09:28:44 +01:00
Chris Cranford
652f41f7fb
DBZ-4272 Add drop column schema change to test
2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838
DBZ-4272 Incrementally snapshot after schema change without NPE
2021-11-30 09:28:44 +01:00
Kate
44073cf7d8
DBZ-4196 Support schema changes during incremental snapshot
2021-11-16 14:56:06 +01:00
Chris Cranford
3569cb4602
DBZ-4291 Reducing log verbosity
...
* Reduce Incremental Snapshot Test verbosity
* Reduce excessive SnapshotReader logging
2021-11-16 14:46:27 +01:00
harveyyue
aa3ae05e22
DBZ-4107 Incremental snapshot doesn't work without primary key
2021-11-05 13:31:26 +01:00
Jiri Pechanec
955afddd56
DBZ-435 Converting FieldBlacklistIT and MongoMetricsIT tests
2021-10-26 18:13:16 +02:00
Jiri Pechanec
2140ff51be
DBZ-435 Aligned MongoDbConnectorIT test
2021-10-26 18:13:16 +02:00
Jiri Pechanec
0ccc83db21
DBZ-3860 Provide correct boundaries for multi PK tables
2021-10-14 17:26:50 +02:00
Chris Cranford
43cf567f0f
DBZ-4040 Fix IncrementalSnapshotIT test failure for Oracle connector
2021-09-24 18:24:29 -04:00
Jiri Pechanec
26d0e78023
DBZ-4013 Skip invalid table
2021-09-17 14:20:42 +02:00
rkerner
52333596de
DBZ-3364 add additional metadata to fields for API spec generator for the Debezium UI
...
part of https://issues.redhat.com/browse/DBZ-3364
DBZ-2653 User rollback from parent class
2021-08-23 17:57:38 +02:00
Chris Cranford
393a44a55f
DBZ-3692 Oracle incremental snapshot support
2021-07-29 13:51:42 +02:00
Kate
c6e530cc27
DBZ-3577 Skip read-only test when gtid mode is off
2021-07-29 07:10:46 +02:00
Kate
9b66ab374a
DBZ-3577 Support read-only MySQL incremental snapshots
2021-07-29 07:10:46 +02:00
Anisha Mohanty
58fbf88a4a
DBZ-400 Add a system property for number of allowed runs when no records are consumed
2021-05-31 10:05:44 +02:00
Jiri Pechanec
cbaf13841f
DBZ-3500 Incremental snapshots for Db2
2021-05-20 08:06:37 +02:00
Jiri Pechanec
90738f53a6
DBZ-3500 Incremental snapshots for SQL Server
2021-05-20 08:06:37 +02:00
Jiri Pechanec
a626dc149f
DBZ-3500 Provide common test for incremental snapshot testing
2021-05-20 08:06:37 +02:00
Jiri Pechanec
260c32cf0e
DBZ-3473 Resume parallel snapshot after connector restart
2021-05-06 05:37:36 +02:00
Anisha Mohanty
0006a443cb
DBZ-2388 Use Apicurio converters with Debezium Server
2021-03-31 15:23:15 +02:00
Jiri Pechanec
86cb71ad8b
DBZ-3251 Call stop even in case of start failure
2021-03-09 17:32:01 +01:00
Thomas Thornton
72f8c06bb6
DBZ-2897 Make Offsets interface non-static, refactor test for updating offsets
2021-02-17 08:41:01 +01:00
Thomas Thornton
dcb6b04835
DBZ-2897 Define and implement Offsets contract for updating offsets of records.
...
Added Offsets contract in DebeziumEngine and implemented it as SourceRecordOffsets in EmbeddedEngine.
Added additional method buildOffsets in RecordCommitter for retrieving an Offsets object, implemented
in ConvertingEngineBuilder and EmbeddedEngine. Modified markProcessed method to use Offsets contract.
Updated tests and documentation.
2021-02-17 08:41:01 +01:00
Thomas Thornton
bcea293df7
DBZ-2897 Use assertThat in EmbeddedEngineTest.shouldRunEngineWithConsumerSettingOffsets
2021-02-17 08:41:01 +01:00
Thomas Thornton
8d87f5feae
DBZ-2897 Extended RecordCommitter interface to handle updated source offsets.
...
Extended the DebeziumEngine interface to include a new method for marking a
record processed with updated source offsets. Implemented the new interface
method in both ConvertingEngineBuilder and EmbeddedEngine. EmbeddedEngine
creates a new SourceRecord with the updated sourceOffsets and passes this
to the original markProcessed method. Added a unit test in EmbeddedEngineTest
that verifies that the file offset storage contains the updated source offset’s
partition. Added a revapi ignore case to prevent failure from a method added
to an interface without a default method. Updated docs for Debezium Engine
that describe the new functionality.
2021-02-17 08:41:01 +01:00
Jiri Pechanec
7394ecfd62
DBZ-3099 Make streaming MBean name configurable in tests
2021-02-16 10:02:17 +01:00
ani-sha
5f8a22a5df
DBZ-2858 Make field descriptions consistent for time values
2021-02-16 09:55:35 +01:00
Gunnar Morling
aa674842a3
DBZ-2923 Improving test stability
2021-01-14 17:02:04 +01:00
Jeremy Ford
6752a2cd04
DBZ-2830 EmbeddedEngine does not shutdown when commitOffsets is interrupted
...
Modified commitOffsets to propagate InterruptedException
2020-12-08 12:08:31 +01:00
Jiri Pechanec
b7fede7d53
DBZ-735 Verify Avro serialization
2020-11-27 17:33:23 +01:00
rkerner
aff1df7573
DBZ-2637 fix unit test timeouts
2020-11-16 07:47:25 +01:00
rkerner
f291b07b6b
DBZ-2724 cleanup code and apply PR feedback
2020-11-10 10:44:41 +01:00
rkerner
0015d628d5
DBZ-2724 Add integration tests for DBZ-2617 (fix Postgres was not able to shutdown with shutdown mode "fast")
...
DBZ-2602 Migrate Testcontainers related changes on DebeziumContainer from UI PoC backend to Debezium main repo
2020-11-10 10:44:41 +01:00
Chris Cranford
6c34a6e3f2
DBZ-2704 Suggested fixes
2020-11-04 06:15:16 +01:00
Chris Cranford
4e6b3b1268
DBZ-2704 Fix test failure - PostgresConnectorIT#shouldRegularlyFlushLsnWithTxMonitoring
2020-11-04 06:15:16 +01:00
Gunnar Morling
b792ac3274
DBZ-2495 Misc. fixes
2020-09-30 12:13:45 +02:00
rkerner
2c5c093587
DBZ-2171 avoid divisive language
2020-08-21 09:29:04 +02:00
victorxiang30
2d6301591c
DBZ-2381 ProtoBuf support for Debezium Server
2020-07-29 12:18:26 +02:00
Jiri Pechanec
8b0b252eb9
DBZ-2288 Events in exported snapshot no longer filtered by LSN
2020-07-16 09:51:00 +02:00