Commit Graph

708 Commits

Author SHA1 Message Date
Chris Cranford
343318b5d4 DBZ-3710 Support Oracle column default values 2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb DBZ-4255 Reduce verbosity of logging Oracle memory metrics 2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a DBZ-4222 Correctly assign min metrics values when unset 2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0 DBZ-4222 Initialize log names/status in metrics when streaming starts 2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89 DBZ-4222 Correctly update last and total batch duration metrics 2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64 DBZ-4222 Do not recalculate fetch query metrics twice 2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef DBZ-4230 Gracefully handle ORA-00310 during streaming 2021-11-08 15:23:12 +01:00
Chris Cranford
64f030da14 DBZ-4252 Remove unused code 2021-11-06 10:30:39 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Chris Cranford
b650a5cfa9 DBZ-4240 Resolve asterisk precision as default number precision 2021-11-05 08:24:17 +01:00
Chris Cranford
403ddb54c9 DBZ-4204 Allow ORA-04030 exceptions to be retried 2021-11-05 08:13:16 +01:00
Chris Cranford
84aa46fb27 DBZ-4159 Make Oracle Infinispan trx cache layout forward compatible 2021-11-05 08:10:45 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Chris Cranford
ce28e939d6 DBZ-4159 Javadoc updates 2021-11-03 18:17:49 +01:00
Chris Cranford
954b81a75f DBZ-4159 Cache LogMinerEvent instances in separate cache 2021-11-03 18:17:49 +01:00
Chris Cranford
4f69443ad8 DBZ-4233 CHAR / NCHAR precision not derived from DDL 2021-11-03 07:11:00 +01:00
Chris Cranford
d0c96f440b DBZ-4077 Fix NPE with Oracle test suite 2021-11-03 07:08:35 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Chris Cranford
833791ffa4 DBZ-4194 Extend alias support for DELETE statements 2021-10-28 01:33:50 -04:00
harveyyue
a9cbb8f2ae DBZ-4194 DML statement couldn't be parsed 2021-10-28 01:33:50 -04:00
Chris Cranford
c25963fbd7 DBZ-4206 Parse Oracle DDL using SDO_GEOMETRY data types 2021-10-28 07:28:20 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Chris Cranford
acfd5123c7 DBZ-4161 Restrict test to LogMiner only 2021-10-26 16:00:44 -04:00
Chris Cranford
2a6df35dbb DBZ-3978 Restrict test to LogMiner only 2021-10-26 16:00:18 -04:00
Chris Cranford
9f27cddbc5 DBZ-4186 Fix OracleSchemaMigrationIT test failures for Xstream 2021-10-22 09:01:56 +02:00
Chris Cranford
2db345d1ed DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE 2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab DBZ-4036 Only pass one SCN to the timestamp function 2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3 DBZ-4036 move scn_to_timestamp to a seperate function. 2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7 DBZ-4036 extract configuration 2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d DBZ-4036 handle SCN gap. 2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc DBZ-4188 Skip LogMiner tests while using XStream 2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438 DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable 2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection;
Also delaying event parsing until after duplication check.

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea DBZ-4161 Merge logging and object name length checks 2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b DBZ-4161 Log warning on long table/column names 2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867 DBZ-4140 scn -> SCN in messages 2021-10-18 12:12:30 +02:00
Chris Cranford
0ae985e5f8 DBZ-4140 Avoid NPE with getMaxArchiveLogScn by using query retries 2021-10-18 12:12:30 +02:00
Chris Cranford
c86a7cba60 DBZ-4064 Fix test failures 2021-10-15 09:17:43 +02:00
Chris Cranford
38fc16c869 DBZ-4064 Fix NullPointerException with LogMinerEventRow initialization 2021-10-15 09:17:43 +02:00
Chris Cranford
7494a1cd29 DBZ-4151 Prevent possible OutOfMemoryError with tracking schema changes 2021-10-14 16:47:22 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Zongwen Li
636c09e040 DBZ-3986 [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode 2021-10-12 15:03:01 +02:00
Chris Cranford
e3294146b5 DBZ-4118 Do not write multiple rows to flush table 2021-10-12 10:29:10 +02:00
Chris Cranford
150f45354a DBZ-4135 Fix handling of alter table MODIFY column DDL 2021-10-12 10:11:08 +02:00
Chris Cranford
abc3bb42d6 DBZ-4106 Don't continuously reconfigure DatabaseHistory 2021-10-05 20:15:58 +02:00
Gunnar Morling
477efc4033 DBZ-4078 Making sure base lifecycle hook is called 2021-10-04 10:09:51 +02:00
Chris Cranford
6482733915 DBZ-3978 Fix formatting 2021-10-01 14:14:39 -04:00
Willie Zhu
33def4cb48 DBZ-3978 only skip dispatching event for excluded user name 2021-10-01 14:14:39 -04:00
Chris Cranford
d94951ea62 DBZ-3978 Move integration test 2021-10-01 14:14:39 -04:00
Chris Cranford
806246edb0 DBZ-3978 Change loglevel to trace 2021-10-01 14:14:39 -04:00
Chris Cranford
16267cee23 DBZ-3978 Make fields final 2021-10-01 14:14:39 -04:00
Willie Zhu
0a9fced8bb DBZ-3978 add userName as a constructor argument.Add integration test. 2021-10-01 14:14:39 -04:00
Willie Zhu
0fa6f9f464 DBZ-3978 Exclude usernames at transaction level 2021-10-01 14:14:39 -04:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Chris Cranford
582a169f92 DBZ-4067 Correctly calculate mining session boundaries
It is not guaranteed that the flush strategy will force all LGWR buffer entries
to be written to the redo logs in which case the mining boundaries must then be
calculated based on the lastProcessedScn rather than the current batch endScn.
This prevents event loss between mining sessions when this timing scenario
occurs.
2021-10-01 09:15:04 +02:00
Chris Cranford
5d05fadf04 DBZ-3712 Add poll interval configuration option 2021-09-29 11:52:27 -04:00
Chris Cranford
e85b6e1780 DBZ-3712 Support start/change archive.log.only.mode gracefully 2021-09-28 17:52:35 +02:00
Chris Cranford
7cca4aaa75
DBZ-4037 Gracefully handle unsupported RAW data types 2021-09-28 11:57:23 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Chris Cranford
a14e13ff01 DBZ-4010 Allow ORA-01327 exceptions to be retried 2021-09-21 13:44:26 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Chris Cranford
093408bba8 DBZ-3954 Restrict capturing change events to configured PDB 2021-09-02 09:06:28 +02:00
Chris Cranford
47c3273985 DBZ-3892 Reuse precompiled pattern instance 2021-09-01 13:10:00 -04:00
Chris Cranford
8dc4a08c70 DBZ-3892 Correctly parse concatenated UNISTR values 2021-09-01 13:10:00 -04:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Chris Cranford
0f07b43012 DBZ-3898 Skip excluded schema DDL events 2021-08-26 09:20:33 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Chris Cranford
5263bbe2ec DBZ-3911 Fix SQLException due to column name typo 2021-08-24 21:41:02 +02:00
Chris Cranford
7e588c6173 DBZ-3896 Support multi-statement table DDLs 2021-08-23 22:48:52 +02:00
Chris Cranford
973fa248ed DBZ-3902 Fix test failure shouldNotEmitDdlEventsForNonTableObjects 2021-08-23 11:44:14 -04:00
Chris Cranford
b6244591d7 DBZ-3893 Make allocation more explicit 2021-08-23 10:00:20 -04:00
Chris Cranford
26b70316b9 DBZ-3893 Treat EMPTY_XLOB() as an empty LOB value instead of NULL 2021-08-23 10:00:20 -04:00
李宗文
b0c0d879e5 DBZ-3876 Improve the SCN update method in MemoryLogMinerEventProcessor 2021-08-23 09:29:31 -04:00
Chris Cranford
82e09ecd60 DBZ-3813 Change error message 2021-08-18 10:00:06 +02:00
Chris Cranford
b898c6031f DBZ-3813 Fix method name typo 2021-08-18 10:00:06 +02:00
Chris Cranford
f695bacf6f DBZ-3813 Add recommended tests 2021-08-18 10:00:06 +02:00
Chris Cranford
7242284b1e DBZ-3813 Add rac.nodes port validation 2021-08-18 10:00:06 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Chris Cranford
e2c0c1d3c0 DBZ-3692 Fix NullPointerException
This NPE check effectively only enables Incremental Snapshot behavior for Oracle
if a signal data collection id is provided; otherwise its disabled
2021-07-30 06:12:10 +02:00
Chris Cranford
e1b003c4f4 DBZ-3752 Formatting fix 2021-07-30 06:12:10 +02:00
Chris Cranford
492008d771 DBZ-3752 Fix test mocks after rebase 2021-07-30 06:12:10 +02:00
Chris Cranford
709a50a652 DBZ-3752 More suggested changes
* Added `infinispan-buffer` profile for testing with infinispan
* Made `online_catalog` the default for testing
* Added protostream-processor back to the POM
2021-07-30 06:12:10 +02:00
Chris Cranford
1c0b4fd5af DBZ-3752 Suggested changes 2021-07-30 06:12:10 +02:00
Chris Cranford
0cbce95a0c DBZ-3752 Memory & Infinispan Buffering implementations 2021-07-30 06:12:10 +02:00
Chris Cranford
26461bc07d DBZ-3692 Introduce completion callback for incremental snapshots 2021-07-29 13:51:42 +02:00
Chris Cranford
393a44a55f DBZ-3692 Oracle incremental snapshot support 2021-07-29 13:51:42 +02:00