Commit Graph

3959 Commits

Author SHA1 Message Date
Thomas Thornton
dcb6b04835 DBZ-2897 Define and implement Offsets contract for updating offsets of records.
Added Offsets contract in DebeziumEngine and implemented it as SourceRecordOffsets in EmbeddedEngine.
Added additional method buildOffsets in RecordCommitter for retrieving an Offsets object, implemented
in ConvertingEngineBuilder and EmbeddedEngine. Modified markProcessed method to use Offsets contract.
Updated tests and documentation.
2021-02-17 08:41:01 +01:00
Thomas Thornton
bcea293df7 DBZ-2897 Use assertThat in EmbeddedEngineTest.shouldRunEngineWithConsumerSettingOffsets 2021-02-17 08:41:01 +01:00
Thomas Thornton
8d87f5feae DBZ-2897 Extended RecordCommitter interface to handle updated source offsets.
Extended the DebeziumEngine interface to include a new method for marking a
record processed with updated source offsets. Implemented the new interface
method in both ConvertingEngineBuilder and EmbeddedEngine. EmbeddedEngine
creates a new SourceRecord with the updated sourceOffsets and passes this
to the original markProcessed method. Added a unit test in EmbeddedEngineTest
that verifies that the file offset storage contains the updated source offset’s
partition. Added a revapi ignore case to prevent failure from a method added
to an interface without a default method. Updated docs for Debezium Engine
that describe the new functionality.
2021-02-17 08:41:01 +01:00
Kewei Shang
673a1657a7 Add io.debezium.data.Json sematic type for JSON column 2021-02-16 14:52:58 +01:00
Kewei Shang
a484240330 DBZ-3115 Add support for JSON column to Vitess 9.0.0 2021-02-16 14:52:58 +01:00
Gunnar Morling
440364e781 DBZ-2984 Removing unused field 2021-02-16 14:49:35 +01:00
Jiri Pechanec
8c0b87c667 DBZ-2984 Guess struct name only when unavailable 2021-02-16 14:49:35 +01:00
Gunnar Morling
ad34b64485 DBZ-3116 Quarkus version update 2021-02-16 14:34:18 +01:00
Gunnar Morling
184d1a2399 DBZ-3056 Misc. clean-up 2021-02-16 12:45:09 +01:00
Yilong Chang
a0b3704832 DBZ-3056 Validate all fields in subclasses. 2021-02-16 12:34:06 +01:00
Yilong Chang
76c7e0d426 DBZ-3056 Extract basic valdiation in parent class. 2021-02-16 12:34:06 +01:00
Yilong Chang
938aa48ac2 DBZ-3056 Change log level to debug for validation success/error. 2021-02-16 12:34:06 +01:00
Yilong Chang
c004663418 DBZ-3056 Fix format. 2021-02-16 12:34:06 +01:00
Yilong Chang
d98488b376 DBZ-3056 Add validation for SQL Server connector. 2021-02-16 12:34:06 +01:00
Gunnar Morling
cb2b2fc07a DBZ-3099 Doc fix 2021-02-16 10:11:23 +01:00
Jiri Pechanec
1c9f7a1c1c DBZ-3099 Document non-volatile fields accessed by a single thread 2021-02-16 10:02:17 +01:00
Jiri Pechanec
745bb6c11d DBZ-3099 Address review comments; extract history comparator for testability 2021-02-16 10:02:17 +01:00
Jiri Pechanec
cb1476ce18 DBZ-3099 Address review comments 2021-02-16 10:02:17 +01:00
Gunnar Morling
5ca1d9fc4f DBZ-3099 Preferring explicit functional interface over Function 2021-02-16 10:02:17 +01:00
Jiri Pechanec
2af13af300 DBZ-3099 Streaming source test for new impl only 2021-02-16 10:02:17 +01:00
Jiri Pechanec
c53082f94f DBZ-3099 Fix typos 2021-02-16 10:02:17 +01:00
Jiri Pechanec
b0f906df35 DBZ-3099 Race condition in waiting for metrics 2021-02-16 10:02:17 +01:00
Jiri Pechanec
21b15facb2 DBZ-3099 Snapshot buffering to handle config corner cases 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7394ecfd62 DBZ-3099 Make streaming MBean name configurable in tests 2021-02-16 10:02:17 +01:00
Jiri Pechanec
048530aeb8 DBZ-3099 Make metrics tests running with legacy 2021-02-16 10:02:17 +01:00
Jiri Pechanec
b3c9395a1f DBZ-3099 Add CI job for legacy MySQL 2021-02-16 10:02:17 +01:00
Jiri Pechanec
ea247b710d DBZ-3099 Rewritten reader tests to connector 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6a9ca7d544 DBZ-3099 Fix schema recovery; Add table level locking 2021-02-16 10:02:17 +01:00
Jiri Pechanec
08e4988c72 DBZ-3093 Unify snapshot and streaming parsing 2021-02-16 10:02:17 +01:00
Jiri Pechanec
7bfbd5c7c5 DBZ-3093 Dispatch schema change events always 2021-02-16 10:02:17 +01:00
Jiri Pechanec
6607310f13 DBZ-3093 Separate parsing and change applying phase in MySQL schema 2021-02-16 10:02:17 +01:00
Jiri Pechanec
5bf5e18d81 DBZ-3086 Legacy source info make for legacy tests 2021-02-16 10:02:16 +01:00
Jiri Pechanec
f01af4bec8 DBZ-3086 Source info formatting for legacy implementation 2021-02-16 10:02:16 +01:00
Jiri Pechanec
14a628ed60 DBZ-3086 Mark moved method as deprecated 2021-02-16 10:02:16 +01:00
Jiri Pechanec
a43bae7638 DBZ-3086 Separate offset and source info 2021-02-16 10:02:16 +01:00
Jiri Pechanec
e9ed4a0a2a DBZ-3086 Remove parallel snapshot reader offsets 2021-02-16 10:02:16 +01:00
Jiri Pechanec
488464419e DBZ-3086 Separate legacy and new SourceInfo 2021-02-16 10:02:16 +01:00
Jiri Pechanec
1d86d7068f DBZ-3077 Unified record creation 2021-02-16 10:02:16 +01:00
ani-sha
5f8a22a5df DBZ-2858 Make field descriptions consistent for time values 2021-02-16 09:55:35 +01:00
Bob Roldan
567e3d7ae9 DBZ-3111 Remove dup anchors introduced into props tables in DBZ-2918. 2021-02-16 09:44:11 +01:00
Gunnar Morling
b5b73b4409 DBZ-3057 Formatting fix 2021-02-16 09:40:13 +01:00
Chris Cranford
09de77cf7d DBZ-3057 Add some TableId helper methods 2021-02-16 09:40:13 +01:00
Jiri Pechanec
dadaaa4212 DBZ-3069 New Maven infra for release 2021-02-15 18:05:04 +01:00
Kewei Shang
c7850e8614 DBZ-3100 Vitess Connector supports Vitess 9.0.0 2021-02-15 17:16:33 +01:00
jcechace
77719ad8b8 DBZ-2265 by default tests are run without Apicurio Registry 2021-02-15 11:09:59 +01:00
jcechace
fe8319ea0a DBZ-2265 Allowing connector tests to run with Avro 2021-02-15 11:09:59 +01:00
jcechace
b208337f9c DBZ-2265 Apicurio Registry deployment descriptors 2021-02-15 11:09:59 +01:00
jcechace
04401295a0 DBZ-2265 Apicurio Registry deployment infrastracture 2021-02-15 11:09:59 +01:00
jcechace
802b088868 DBZ-2235 Job for upstream db2 connector tests 2021-02-15 10:51:10 +01:00
Bob Roldan
43ad0a0b2a DBZ-3097 Remove parenthetical ref to Db2 connector being Incubating 2021-02-12 13:48:45 -05:00