alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
7,951 Commits 3 Branches 0 Tags 51 MiB
3a646519de
Commit Graph

1015 Commits

Author SHA1 Message Date
Dominique Chanet
fe523359f9 DBZ-4737 fix SqlUtils test 2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac DBZ-4737 fix log file discovery 2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599 DBZ-4715 Use ZoneOffset rather than long for database offset seconds 2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30 DBZ-4715 Fix stream event's source timestamp tz resolution 2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22 DBZ-4737 Fix error when rewinding to oldest archive log SCN 
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
 2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size". 2022-02-09 03:03:26 -05:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Chris Cranford
7ec2abd89e DBZ-4305 Skip test when using Oracle 21 2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90 DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics 2022-02-08 13:19:50 -05:00
René Kerner
8b47bf2d8f
DBZ-4665 Extend Debezium Schema Generator; 
* finish renaming of API/APIFormat occurences to use Schema instead
* add creation of directory structure per connector when creating descriptors: `postgres.json` --> `postgres/postgres.json`
* add configuration to add a schema filename prefix (`postgres.json` --> `debezium-postgres.json`)
* add configuration to add a schema filename suffix (`postgres.json` --> `postgres-1.9.0-SNAPSHOT.json`)
* add some minor logging (available schema formats, selected format, processed connectors) and throw errors on failed state (no schema formats found, no connectors found)
* remove Oracle connector schema generation as it is not annotated yet
* automatically resolving all dependencies required by the schema generator

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2022-02-07 16:19:50 +01:00
Chris Cranford
57934a0838 DBZ-4367 Fix test failure due to auto-commit state 2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN 
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
 2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package 
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
 2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920 DBZ-732 Execute Oracle ITs on CI 2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change 2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode 2022-01-06 11:29:41 -05:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a DBZ-4446 Option to disable Infinispan in Oracle 2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f DBZ-3940 Add connector-driven EventRouter configuration 2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf DBZ-4426 Log message when Oracle schema locks are disabled by configuration 2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212 DBZ-4425 Fix Oracle Infinispan unavailable value serialization 2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2 DBZ-4422 Fix inconsistencies with XStream LOB handling 2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20 DBZ-4385 Javadoc fixes 2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8 DBZ-4385 Don't specify mining strategy in tests 2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a DBZ-4385 Truncate support for Oracle 2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2 DBZ-4388 Don't set default value if resolution fails 2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c DBZ-3635 Made option internal & undocumented 2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3 DBZ-3635 Allow fetching of transaction logs to be retried. 2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32 DBZ-4400 Fix not-null CLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564 DBZ-4400 Fix not-null BLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117 DBZ-4400 Support binary.handling.mode for Oracle 2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase 2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25 DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected 2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838 DBZ-4272 Incrementally snapshot after schema change without NPE 2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c DBZ-4360 Correctly parse default values with trailing spaces 2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82 DBZ-1539 Remove field group 2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11 DBZ-1539 Cleanup tests 2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2 DBZ-1539 Add interval.handling.mode to oracle connector 2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0 DBZ-4276 Extend LOB tests when LOB is disabled 2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe DBZ-4236 Unify Oracle LogMiner event processors 2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb DBZ-4169 Consolidate rollback and recently committed trx caches 2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0 DBZ-4169 Suggested changes 2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669 DBZ-4169 Enforce existence of Hotrod client server list option when necessary 2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038 DBZ-4169 Extract strings to constants 2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3 DBZ-4169 Raise error when using log.mining.buffer.location option 2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead DBZ-4169 Cleanup Oracle POM 2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137 DBZ-4169 Consolidate CacheProvider impls into Processor impls 2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120 DBZ-4169 Flush out configuration options; fix ConfigDef test 2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56 DBZ-4169 Cleanup cache creation 2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18 DBZ-4169 Cleanup TestHelper 2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b DBZ-4169 Support remote Infinispan caches 2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3 DBZ-4308 Avoid NPE during table/column length checks 2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954 DBZ-4276 Improve map initialization 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling 
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
 2021-11-16 20:29:59 +01:00
Chris Cranford
0fbfd88f6c DBZ-4276 Add unavailable.value.placeholder support for Oracle 2021-11-16 20:29:59 +01:00
Chris Cranford
7720c653e5 DBZ-4279 For test compatibility with Xstream 2021-11-14 16:47:51 -05:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Gunnar Morling
a03de4e9d0 DBZ-3611 Clarifying purpose of test 2021-11-11 09:24:05 +01:00
Chris Cranford
85101f0ad7 DBZ-3611 Avoid NPE with database include/exclude lists 2021-11-11 09:24:05 +01:00
Chris Cranford
d77098c3f0 DBZ-3710 Emit SYSDATE as 1970-01-01T00:00:00Z for zone-based temporal values 2021-11-10 09:43:25 +01:00
Chris Cranford
5c2523cd73 DBZ-3710 Suggested changes 2021-11-10 09:43:25 +01:00
Chris Cranford
5afda302ec DBZ-3710 Javadoc updates 2021-11-10 09:43:25 +01:00
Chris Cranford
78f79afff3 DBZ-3710 Change mapper methods to static scope 2021-11-10 09:43:25 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Chris Cranford
3fd784c51d DBZ-4208 Add test case for sequence-based defaults 2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4 DBZ-3710 Support Oracle column default values 2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb DBZ-4255 Reduce verbosity of logging Oracle memory metrics 2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a DBZ-4222 Correctly assign min metrics values when unset 2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0 DBZ-4222 Initialize log names/status in metrics when streaming starts 2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89 DBZ-4222 Correctly update last and total batch duration metrics 2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64 DBZ-4222 Do not recalculate fetch query metrics twice 2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef DBZ-4230 Gracefully handle ORA-00310 during streaming 2021-11-08 15:23:12 +01:00
Chris Cranford
64f030da14 DBZ-4252 Remove unused code 2021-11-06 10:30:39 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Chris Cranford
b650a5cfa9 DBZ-4240 Resolve asterisk precision as default number precision 2021-11-05 08:24:17 +01:00
Chris Cranford
403ddb54c9 DBZ-4204 Allow ORA-04030 exceptions to be retried 2021-11-05 08:13:16 +01:00
Chris Cranford
84aa46fb27 DBZ-4159 Make Oracle Infinispan trx cache layout forward compatible 2021-11-05 08:10:45 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Chris Cranford
ce28e939d6 DBZ-4159 Javadoc updates 2021-11-03 18:17:49 +01:00
Chris Cranford
954b81a75f DBZ-4159 Cache LogMinerEvent instances in separate cache 2021-11-03 18:17:49 +01:00
Chris Cranford
4f69443ad8 DBZ-4233 CHAR / NCHAR precision not derived from DDL 2021-11-03 07:11:00 +01:00
Chris Cranford
d0c96f440b DBZ-4077 Fix NPE with Oracle test suite 2021-11-03 07:08:35 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract; 
Keeping legacy method until the legacy MySQL connector implementation has been removed.
 2021-11-01 10:17:49 +01:00
Chris Cranford
833791ffa4 DBZ-4194 Extend alias support for DELETE statements 2021-10-28 01:33:50 -04:00
harveyyue
a9cbb8f2ae DBZ-4194 DML statement couldn't be parsed 2021-10-28 01:33:50 -04:00
Chris Cranford
c25963fbd7 DBZ-4206 Parse Oracle DDL using SDO_GEOMETRY data types 2021-10-28 07:28:20 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Chris Cranford
acfd5123c7 DBZ-4161 Restrict test to LogMiner only 2021-10-26 16:00:44 -04:00
Chris Cranford
2a6df35dbb DBZ-3978 Restrict test to LogMiner only 2021-10-26 16:00:18 -04:00
Chris Cranford
9f27cddbc5 DBZ-4186 Fix OracleSchemaMigrationIT test failures for Xstream 2021-10-22 09:01:56 +02:00
Chris Cranford
2db345d1ed DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE 2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab DBZ-4036 Only pass one SCN to the timestamp function 2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3 DBZ-4036 move scn_to_timestamp to a seperate function. 2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7 DBZ-4036 extract configuration 2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d DBZ-4036 handle SCN gap. 2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc DBZ-4188 Skip LogMiner tests while using XStream 2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438 DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable 2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection; 
Also delaying event parsing until after duplication check.

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea DBZ-4161 Merge logging and object name length checks 2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b DBZ-4161 Log warning on long table/column names 2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867 DBZ-4140 scn -> SCN in messages 2021-10-18 12:12:30 +02:00
Chris Cranford
0ae985e5f8 DBZ-4140 Avoid NPE with getMaxArchiveLogScn by using query retries 2021-10-18 12:12:30 +02:00
Chris Cranford
c86a7cba60 DBZ-4064 Fix test failures 2021-10-15 09:17:43 +02:00
Chris Cranford
38fc16c869 DBZ-4064 Fix NullPointerException with LogMinerEventRow initialization 2021-10-15 09:17:43 +02:00
Chris Cranford
7494a1cd29 DBZ-4151 Prevent possible OutOfMemoryError with tracking schema changes 2021-10-14 16:47:22 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-10-12 15:40:02 +02:00
Zongwen Li
636c09e040 DBZ-3986 [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode 2021-10-12 15:03:01 +02:00
Chris Cranford
e3294146b5 DBZ-4118 Do not write multiple rows to flush table 2021-10-12 10:29:10 +02:00
Chris Cranford
150f45354a DBZ-4135 Fix handling of alter table MODIFY column DDL 2021-10-12 10:11:08 +02:00
Chris Cranford
abc3bb42d6 DBZ-4106 Don't continuously reconfigure DatabaseHistory 2021-10-05 20:15:58 +02:00
Gunnar Morling
477efc4033 DBZ-4078 Making sure base lifecycle hook is called 2021-10-04 10:09:51 +02:00
Chris Cranford
6482733915 DBZ-3978 Fix formatting 2021-10-01 14:14:39 -04:00
Willie Zhu
33def4cb48 DBZ-3978 only skip dispatching event for excluded user name 2021-10-01 14:14:39 -04:00
Chris Cranford
d94951ea62 DBZ-3978 Move integration test 2021-10-01 14:14:39 -04:00
Chris Cranford
806246edb0 DBZ-3978 Change loglevel to trace 2021-10-01 14:14:39 -04:00
Chris Cranford
16267cee23 DBZ-3978 Make fields final 2021-10-01 14:14:39 -04:00
Willie Zhu
0a9fced8bb DBZ-3978 add userName as a constructor argument.Add integration test. 2021-10-01 14:14:39 -04:00
Willie Zhu
0fa6f9f464 DBZ-3978 Exclude usernames at transaction level 2021-10-01 14:14:39 -04:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00
Chris Cranford
582a169f92 DBZ-4067 Correctly calculate mining session boundaries 
It is not guaranteed that the flush strategy will force all LGWR buffer entries
to be written to the redo logs in which case the mining boundaries must then be
calculated based on the lastProcessedScn rather than the current batch endScn.
This prevents event loss between mining sessions when this timing scenario
occurs.
 2021-10-01 09:15:04 +02:00
Chris Cranford
5d05fadf04 DBZ-3712 Add poll interval configuration option 2021-09-29 11:52:27 -04:00
Chris Cranford
e85b6e1780 DBZ-3712 Support start/change archive.log.only.mode gracefully 2021-09-28 17:52:35 +02:00
Chris Cranford
7cca4aaa75
DBZ-4037 Gracefully handle unsupported RAW data types 2021-09-28 11:57:23 +02:00
Debezium Builder
bec0b6b67e [maven-release-plugin] prepare for next development iteration 2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725 [maven-release-plugin] prepare release v1.7.0.CR2 2021-09-23 06:31:25 +00:00
Chris Cranford
a14e13ff01 DBZ-4010 Allow ORA-01327 exceptions to be retried 2021-09-21 13:44:26 +02:00
Debezium Builder
c15e0b303b [maven-release-plugin] prepare for next development iteration 2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121 [maven-release-plugin] prepare release v1.7.0.CR1 2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set; 
Also adding missing descriptions.
 2021-09-09 13:35:41 +02:00
Chris Cranford
093408bba8 DBZ-3954 Restrict capturing change events to configured PDB 2021-09-02 09:06:28 +02:00
Chris Cranford
47c3273985 DBZ-3892 Reuse precompiled pattern instance 2021-09-01 13:10:00 -04:00
Chris Cranford
8dc4a08c70 DBZ-3892 Correctly parse concatenated UNISTR values 2021-09-01 13:10:00 -04:00
Anisha Mohanty
153e0920e1 DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors; 
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
 2021-08-30 12:20:56 +02:00
Chris Cranford
0f07b43012 DBZ-3898 Skip excluded schema DDL events 2021-08-26 09:20:33 +02:00
Debezium Builder
2ce6bcb2ab [maven-release-plugin] prepare for next development iteration 2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423 [maven-release-plugin] prepare release v1.7.0.Beta1 2021-08-25 05:20:56 -04:00
Chris Cranford
5263bbe2ec DBZ-3911 Fix SQLException due to column name typo 2021-08-24 21:41:02 +02:00
Chris Cranford
7e588c6173 DBZ-3896 Support multi-statement table DDLs 2021-08-23 22:48:52 +02:00
Chris Cranford
973fa248ed DBZ-3902 Fix test failure shouldNotEmitDdlEventsForNonTableObjects 2021-08-23 11:44:14 -04:00
Chris Cranford
b6244591d7 DBZ-3893 Make allocation more explicit 2021-08-23 10:00:20 -04:00
Chris Cranford
26b70316b9 DBZ-3893 Treat EMPTY_XLOB() as an empty LOB value instead of NULL 2021-08-23 10:00:20 -04:00
李宗文
b0c0d879e5 DBZ-3876 Improve the SCN update method in MemoryLogMinerEventProcessor 2021-08-23 09:29:31 -04:00
Chris Cranford
82e09ecd60 DBZ-3813 Change error message 2021-08-18 10:00:06 +02:00
Chris Cranford
b898c6031f DBZ-3813 Fix method name typo 2021-08-18 10:00:06 +02:00
Chris Cranford
f695bacf6f DBZ-3813 Add recommended tests 2021-08-18 10:00:06 +02:00
Chris Cranford
7242284b1e DBZ-3813 Add rac.nodes port validation 2021-08-18 10:00:06 +02:00
Sergei Morozov
a40ad7132d DBZ-2975: Remove partition from offset context 2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12 DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets 2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52 DBZ-2975: Move Partition to io.debezium.pipeline.spi 2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06 [maven-release-plugin] prepare for next development iteration 2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426 [maven-release-plugin] prepare release v1.7.0.Alpha1 2021-07-30 02:39:08 -04:00
Chris Cranford
e2c0c1d3c0 DBZ-3692 Fix NullPointerException 
This NPE check effectively only enables Incremental Snapshot behavior for Oracle
if a signal data collection id is provided; otherwise its disabled
 2021-07-30 06:12:10 +02:00
Chris Cranford
e1b003c4f4 DBZ-3752 Formatting fix 2021-07-30 06:12:10 +02:00
Chris Cranford
492008d771 DBZ-3752 Fix test mocks after rebase 2021-07-30 06:12:10 +02:00
Chris Cranford
709a50a652 DBZ-3752 More suggested changes 
* Added `infinispan-buffer` profile for testing with infinispan
* Made `online_catalog` the default for testing
* Added protostream-processor back to the POM
 2021-07-30 06:12:10 +02:00
Chris Cranford
1c0b4fd5af DBZ-3752 Suggested changes 2021-07-30 06:12:10 +02:00
Chris Cranford
0cbce95a0c DBZ-3752 Memory & Infinispan Buffering implementations 2021-07-30 06:12:10 +02:00
Chris Cranford
26461bc07d DBZ-3692 Introduce completion callback for incremental snapshots 2021-07-29 13:51:42 +02:00
Chris Cranford
393a44a55f DBZ-3692 Oracle incremental snapshot support 2021-07-29 13:51:42 +02:00
Chris Cranford
10ab20a157 DBZ-2552 Refactor & introduce LogWriterFlushStrategy 2021-07-28 13:25:03 +02:00
Chris Cranford
1fd68e6fa9 DBZ-2552 Refactored several methods to connection class 2021-07-28 13:25:03 +02:00
Chris Cranford
6a1267b26c DBZ-2552 Refactored constants usage 2021-07-28 13:25:03 +02:00
Chris Cranford
a7498ca340 DBZ-2552 Remove non-runtime code 2021-07-28 13:25:03 +02:00
Chris Cranford
0fa869388e DBZ-2552 Minor code cleanup 2021-07-28 13:25:03 +02:00
Chris Cranford
bd0dd5ec9c DBZ-2552 Refactored database state capture logic 2021-07-28 13:25:03 +02:00
Chris Cranford
48b01dd837 DBZ-2552 Refactored supplemental logging logic 2021-07-28 13:25:03 +02:00
Chris Cranford
e49e3f9211 DBZ-2552 Refactored getting current redo log filenames 2021-07-28 13:25:03 +02:00
Chris Cranford
60a90851c6 DBZ-2552 Refactored mining session ending SCN logic 2021-07-28 13:25:03 +02:00
Chris Cranford
5898dc4b0a DBZ-2552 Refactored start/end mining session logic 2021-07-28 13:25:03 +02:00
Chris Cranford
e02c2eb912 DBZ-2552 Remove unused or irrelevant code 2021-07-28 13:25:03 +02:00
Chris Cranford
8eed85037f DBZ-2552 Refactored SCN queries 2021-07-28 13:25:03 +02:00
Chris Cranford
b8c2d6e64a DBZ-2552 Refactored getting database system time 2021-07-28 13:25:03 +02:00
Chris Cranford
4ca93c6ff8 DBZ-2552 Refactored setting NLS parameters for mining session 2021-07-28 13:25:03 +02:00
Chris Cranford
a0e1acdf3e DBZ-2552 Refactored create flush table logic 2021-07-28 13:25:03 +02:00
Chris Cranford
9a1e181ed7 DBZ-2552 Refactored build data dictionary logic 2021-07-28 13:25:03 +02:00
Chris Cranford
fe499bf3d2 DBZ-2552 Refactored Oracle LGWR flush logic 2021-07-28 13:25:03 +02:00
Chris Cranford
d450f58b37 DBZ-3756 Add UGA/PGA memory statistics to JMX metrics 2021-07-16 11:07:48 -04:00
Chris Cranford
52e198e3b5 DBZ-3683 Relax restrictions on connector user 2021-07-16 16:28:31 +02:00
Gunnar Morling
cbb5a78a6d DBZ-3671 More concise variable name 2021-07-05 12:27:04 +02:00
Gunnar Morling
bc21c14489 DBZ-3671 Apply suggestions from code review 2021-07-05 12:26:59 +02:00
Chris Cranford
4e0c54d782 DBZ-3671 Add test for user exclusion SQL condition 2021-07-05 12:26:59 +02:00
Chris Cranford
ddf25b144c DBZ-3671 Remove trailing space in query 2021-07-05 12:26:59 +02:00
Patrick Chu
77f268abe6 DBZ-3671 Add property to exclude users in logminer query 2021-07-05 12:26:59 +02:00
Chris Cranford
ed31ea9ffb DBZ-3668 Adjust ServiceLoader for SPI change 2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d DBZ-3668 Extracting SPI package 2021-07-03 16:31:52 +07:00
Chris Cranford
77f57ee703 DBZ-3668 Fix formatting 2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Chris Cranford
3f759a8daa DBZ-3668 Add CloudEventsConverter support for Oracle connector 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71 DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig 2021-07-01 15:11:01 +02:00
Gunnar Morling
e8af7176e9 DBZ-3155 Removing JSqlParser from POM files 2021-07-01 10:57:45 +02:00
Chris Cranford
b625124e09 DBZ-3155 Move LogMinerDmlEntry & impl 2021-07-01 10:57:45 +02:00
Chris Cranford
c7622cbc18 DBZ-3155 Remove legacy DDL JSqlParser implementation 2021-07-01 10:57:45 +02:00
Chris Cranford
d804f41775 DBZ-3581 Remove deprecated log.mining.history.xxx features 2021-07-01 09:31:18 +02:00
Chris Cranford
237a71ea3c DBZ-3684 OracleSchemaMigrationIT - Fix possible false positive test failure 2021-07-01 09:10:42 +02:00
Chris Cranford
51825b0b47 DBZ-3677 Change connection validation failure message log level 2021-07-01 09:08:08 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Chris Cranford
db8475be42 DBZ-1211 Add extra test assertions 2021-06-29 11:14:19 +02:00
Chris Cranford
bcf5441284 DBZ-1211 Add test case 2021-06-29 11:14:19 +02:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Chris Cranford
01e87c11ed DBZ-3676 When LOB support is disabled, use adaptive SCN mining windows 2021-06-29 09:46:49 +02:00
Chris Cranford
09fa730d98 DBZ-3661 Introduce Oracle log.mining.archive.destination.name option 2021-06-29 09:25:57 +02:00
Gunnar Morling
ab3cf09165 DBZ-3665 Formatting 2021-06-28 15:53:36 +02:00
Chris Cranford
b9a79dcdd0 DBZ-3665 Provide better error description when enabling archive log only mode 2021-06-28 15:53:36 +02:00
Chris Cranford
d5d1ca8db2 DBZ-3664 Fix formatting 2021-06-28 02:57:33 -04:00
Gunnar Morling
3d30b7371f DBZ-3664 Wording fix 2021-06-28 08:25:34 +02:00
Chris Cranford
4a844aa36b DBZ-3664 Adjust log level for max batch reached message 2021-06-28 08:25:34 +02:00
Chris Cranford
4db80f86f0 DBZ-3672 Remove unused code 2021-06-26 22:03:14 +02:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Chris Cranford
185e598d91 DBZ-3645 Fix test failures for Oracle Xstream 2021-06-23 08:00:43 -04:00
Chris Cranford
61b22d9574 DBZ-3645 Adjust metrics calculations & logging levels 2021-06-23 09:55:29 +02:00
Chris Cranford
16eb60d8f1 DBZ-3645 Adjust SCN end point calculation w/sanity checks 2021-06-23 09:55:29 +02:00
Chris Cranford
c9e62a6806 DBZ-3645 Make Oracle LOB support opt-in 2021-06-23 09:55:29 +02:00
Chris Cranford
f6edfdc49a DBZ-3365 Revert "Remove unused imports", commit 080d701 2021-06-23 00:54:18 -04:00
Chris Cranford
080d7014db DBZ-3365 Remove unused imports 2021-06-22 11:45:28 -04:00
Chris Cranford
8b90786b35 DBZ-3634 Enable DDL events to be filtered by include/exclude lists 2021-06-22 11:26:57 +02:00
Chris Cranford
3113cb9175 DBZ-3639 Send heartbeat events during periods of low activity. 2021-06-21 11:03:01 +02:00
Chris Cranford
537437e6fa DBZ-3631 Suggested changes & formatting fixes 2021-06-21 09:28:03 +02:00
Chris Cranford
bb40bd9d67 DBZ-3631 Introduce ChunkColumnValues wrapper optimization 2021-06-21 09:28:03 +02:00
Chris Cranford
19d7ad401a DBZ-3631 Use traditional loop instead of stream 2021-06-18 08:42:31 +02:00
Chris Cranford
2310e45f3c DBZ-3631 Align Xstream to emit null when BLOB/CLOB fields are set to null. 
While LogMiner already did this, the Xstream implementation was not checking for
this use case and was instead emitting empty strings or empty byte buffer values
rather than explicit nulls if there was no data.
 2021-06-18 08:42:31 +02:00
Chris Cranford
29b7f1fa44 DBZ-3631 Fix Oracle trx reconciliation not finding PK columns 2021-06-17 09:10:33 +02:00
Chris Cranford
b4ac2f9c1c DBZ-3616 Avoid logging processed trx warnings & emit DDL changes once 2021-06-16 10:17:41 +02:00
Chris Cranford
aedb6118da DBZ-3612 Do not parse Oracle ALTER TABLE ddl for unknown tables 2021-06-16 10:07:32 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Chris Cranford
8783eae098 DBZ-3599 Fix Oracle RAC url variable substitution 2021-06-09 16:03:31 +02:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places; 
Also parameterizing offset loader contract, so to avoid casts later on.
 2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Chris Cranford
473eb2c02c DBZ-3561 Introduce archive log only mode for Oracle 2021-06-09 10:18:17 +02:00
Chris Cranford
9cc6239bc0 DBZ-3591 Fix SelectLobParser throwing NPE for unknown tables 2021-06-07 15:15:21 +02:00
Chris Cranford
4d3c1f7e72 DBZ-3062 Use captured instead of monitored 2021-06-07 11:19:54 +02:00
Chris Cranford
a2fc19f409 DBZ-3062 Oracle connector support snapshot.include.collection.list 2021-06-07 11:19:54 +02:00
Chris Cranford
de2fe7149b DBZ-3563 Deduplicate logs based on sequence number and not scn ranges 2021-06-07 11:17:11 +02:00
jackey.zhang
c32e290fac DBZ-3587 fix NPE when builder is null 2021-06-04 07:19:15 +02:00
Chris Cranford
fa3b7fd758 DBZ-3557 Fix test failures 2021-06-02 15:58:23 +02:00
Chris Cranford
078b8f7270 DBZ-3557 Remove exclusive from SnapshotLockingMode, use shared as default 2021-06-02 15:58:23 +02:00
Chris Cranford
d9d2706a17 DBZ-3557 Fix typo 2021-06-02 15:58:23 +02:00
Chris Cranford
047c505bc1 DBZ-3557 Add snapshot.locking.mode option for Oracle 2021-06-02 15:58:23 +02:00
Gunnar Morling
c4f5cbca6c DBZ-3328 Removing unused field 2021-06-02 12:18:48 +02:00
Chris Cranford
0af3959c2d DBZ-3328 Use object arrays to write column values 
Previously we used a wrapper class, LogMinerColumnValueImpl, to store
both the column name and value; however this introduced some overhead
in object allocation.  This change mostly focused on the removal of
that implementation and its interface in favor of creating object
arrays up-front and writing the column values directly.

Included as well as the following changes:

* Deprecated LogMinerColumnValue, impl, and wrapper
* Removed SEQUENCE# from LogMiner query, no longer needed
* Adapted tests to runtime changes with object arrays
 2021-06-02 12:18:48 +02:00
Chris Cranford
f178a6e235 DBZ-3328 Remove superfluous state from LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
7dd980e505 DBZ-3328 Fix test failures 2021-06-02 12:18:48 +02:00
Gunnar Morling
4dcda868b5 DBZ-3328 Adding factory methods for LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
19e650dc25 DBZ-3328 Updated comment 2021-06-02 12:18:48 +02:00
Chris Cranford
49f3ee6172 DBZ-3328 Performance cleanup 
* Use loop rather than streams
* Remove usage of Optional
* No need to add superfluous null-valued columns
 2021-06-02 12:18:48 +02:00
Chris Cranford
52906cf154 DBZ-3328 Avoid copying in Oracle LogMiner DML parser 2021-06-02 12:18:48 +02:00
Chris Cranford
ae9a32ab83 DBZ-3565 Make log.mining.history.xxx options internal 2021-06-02 10:47:54 +02:00
Chris Cranford
fd5afb04ea DBZ-3565 Fix formatting 2021-06-02 10:47:54 +02:00
Chris Cranford
eb22eaf85f DBZ-3565 Always use NeverHistoryRecorder if retention hours are 0 2021-06-02 10:47:54 +02:00