Commit Graph

4694 Commits

Author SHA1 Message Date
Gunnar Morling
f7bf6eedf4 DBZ-3116 Quarkus 1.12.0.Final 2021-02-22 10:10:24 +01:00
Gunnar Morling
62ad3969c1 DBZ-3107 Typo fixes 2021-02-22 09:08:47 +01:00
Jiri Pechanec
a97b86db43 DBZ-3107 Workaround for DBZ-3158 2021-02-22 09:08:47 +01:00
Chris Cranford
738b365bc5 DBZ-3109 Account for multiple log group types 2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd DBZ-3078 Use max.queue.size for fetch size 2021-02-19 21:39:27 +01:00
Chris Cranford
5ed242a674 DBZ-3078 Use longer column values 2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776 DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61 DBZ-3078 Connector adjustments for new DML parser 2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218 DBZ-3078 Initial implementation of FastDmlParser 2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start 2021-02-19 19:03:45 +01:00
Chris Cranford
c1bad8fa98 DBZ-2795 Document CDB vs non-CDB configuration nuances 2021-02-19 18:53:18 +01:00
Chris Cranford
88b2f73842 DBZ-3001 Do not resolve database version lazily 2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05 DBZ-3001 Control MAX Scn for LogMiner based on Oracle version 2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7 DBZ-3110 Introduce RequireDatabaseOption test annotation 2021-02-19 17:01:25 +01:00
Kewei Shang
b1d2f2203a DBZ-3124 Add ENUM support to Vitess documentation 2021-02-19 15:06:32 +01:00
Kewei Shang
e07564e532 DBZ-3124 Use one-line per thought/sentence style
It is easier with the diff

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-02-19 12:26:44 +01:00
Kewei Shang
92659d6a27 DBZ-3124 Overload builder() and schema() to take multiple values 2021-02-19 12:26:44 +01:00
Kewei Shang
f7fe4bf118 DBZ-3124 Update Vitess documentation of ENUM limitation for Vitess 8.0.0 2021-02-19 12:26:44 +01:00
Jiri Pechanec
1edad510ff DBZ-2614 Support for infinite timestamps 2021-02-19 10:44:06 +01:00
Jiri Pechanec
1f79c15a48 DBZ-2616 Fix negative years conversion 2021-02-19 10:44:06 +01:00
Jiri Pechanec
a17e7cee44 DBZ-2865 Regression in warning message cleanup 2021-02-19 10:40:15 +01:00
Gunnar Morling
e024fc60ab DBZ-3095 Propagating socket exceptions 2021-02-19 10:30:41 +01:00
Michael Cizmar
a78843a683
DBZ-3149 Clarified the initial snapshot mode literal 2021-02-19 10:30:00 +01:00
Gunnar Morling
edcc3a041f DBZ-3147 Renaming test connection class 2021-02-19 09:16:31 +01:00
Nitin Agarwal
62f51e8b29 DBZ-3114: addressing review comments 2021-02-18 12:41:34 +01:00
Nitin Agarwal
eff55ed4e8 DBZ-3114: adding documentation for transaction metadata support in MySQL 2021-02-18 12:41:34 +01:00
Jiri Pechanec
737d2353a6 DBZ-3114 Test more resilient for repeted runs and testsuite execution 2021-02-18 12:41:34 +01:00
Jiri Pechanec
decb4ec3da DBZ-3114 Tests only for new implementation 2021-02-18 12:41:34 +01:00
Nitin Agarwal
fd1ceeb02e DBZ-3114 Transaction metadata feature in MySQL connector 2021-02-18 12:41:34 +01:00
Gunnar Morling
ae29bc9a57 DBZ-2788 Re-arranging documentation update 2021-02-18 12:39:44 +01:00
ani-sha
b6c61ac810 DBZ-2788 Replace MySQL connector option with SMT for mitigating wrong op flag 2021-02-18 12:35:03 +01:00
Chris Cranford
304f38e15a DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler 2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c DBZ-3090 Commit events in same thread that processes results for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad DBZ-3090 Fix emitting transaction end event for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2 DBZ-2754 Fix test failures 2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799 DBZ-2754 Fix test compilation failures 2021-02-17 20:11:01 -05:00
Jiri Pechanec
34de76b3b2 DBZ-3027 Add UI for release 2021-02-17 13:05:30 +01:00
Gunnar Morling
28f7231136 DBZ-2754 Wording fix 2021-02-17 12:18:15 +01:00
Gunnar Morling
0980492bb0 DBZ-2754 Using Duration instead of long for durations 2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487 DBZ-2754 Add log.mining.transaction.retention.hours config option 2021-02-17 12:13:16 +01:00
Chris Cranford
4108375788 DBZ-2754 Add link to Jira issue follow-up 2021-02-17 09:20:10 +01:00
Chris Cranford
7f4bbc4725 DBZ-2754 Document log.mining.transaction.retention.hours option 2021-02-17 09:20:10 +01:00
Bob Roldan
e2625fd560 DBZ-3087 Missed one leading + in literal monospace encoding. 2021-02-17 09:16:37 +01:00
Bob Roldan
e27f837b47 DBZ-3087 Remove zero-width spaces from prop names subject to copying 2021-02-17 09:16:37 +01:00
Thomas Prelle
15887077ff DBZ-2680 Sanitize field name do not santize sub struct field
Their are an issue during the sanitisation to avro on mongodb connector.
The sanitization failed on sub struct like
{​
"_id": "222",
"metrics": {​
"metric::fct":

{​"min": 0, "max": 1 }
​
}
2021-02-17 09:09:00 +01:00
Thomas Thornton
72f8c06bb6 DBZ-2897 Make Offsets interface non-static, refactor test for updating offsets 2021-02-17 08:41:01 +01:00
Thomas Thornton
dcb6b04835 DBZ-2897 Define and implement Offsets contract for updating offsets of records.
Added Offsets contract in DebeziumEngine and implemented it as SourceRecordOffsets in EmbeddedEngine.
Added additional method buildOffsets in RecordCommitter for retrieving an Offsets object, implemented
in ConvertingEngineBuilder and EmbeddedEngine. Modified markProcessed method to use Offsets contract.
Updated tests and documentation.
2021-02-17 08:41:01 +01:00
Thomas Thornton
bcea293df7 DBZ-2897 Use assertThat in EmbeddedEngineTest.shouldRunEngineWithConsumerSettingOffsets 2021-02-17 08:41:01 +01:00
Thomas Thornton
8d87f5feae DBZ-2897 Extended RecordCommitter interface to handle updated source offsets.
Extended the DebeziumEngine interface to include a new method for marking a
record processed with updated source offsets. Implemented the new interface
method in both ConvertingEngineBuilder and EmbeddedEngine. EmbeddedEngine
creates a new SourceRecord with the updated sourceOffsets and passes this
to the original markProcessed method. Added a unit test in EmbeddedEngineTest
that verifies that the file offset storage contains the updated source offset’s
partition. Added a revapi ignore case to prevent failure from a method added
to an interface without a default method. Updated docs for Debezium Engine
that describe the new functionality.
2021-02-17 08:41:01 +01:00
Kewei Shang
673a1657a7 Add io.debezium.data.Json sematic type for JSON column 2021-02-16 14:52:58 +01:00