Commit Graph

801 Commits

Author SHA1 Message Date
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920 DBZ-732 Execute Oracle ITs on CI 2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change 2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode 2022-01-06 11:29:41 -05:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a DBZ-4446 Option to disable Infinispan in Oracle 2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f DBZ-3940 Add connector-driven EventRouter configuration 2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf DBZ-4426 Log message when Oracle schema locks are disabled by configuration 2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212 DBZ-4425 Fix Oracle Infinispan unavailable value serialization 2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2 DBZ-4422 Fix inconsistencies with XStream LOB handling 2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20 DBZ-4385 Javadoc fixes 2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8 DBZ-4385 Don't specify mining strategy in tests 2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a DBZ-4385 Truncate support for Oracle 2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2 DBZ-4388 Don't set default value if resolution fails 2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c DBZ-3635 Made option internal & undocumented 2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3 DBZ-3635 Allow fetching of transaction logs to be retried. 2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32 DBZ-4400 Fix not-null CLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564 DBZ-4400 Fix not-null BLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117 DBZ-4400 Support binary.handling.mode for Oracle 2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase 2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25 DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected 2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838 DBZ-4272 Incrementally snapshot after schema change without NPE 2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c DBZ-4360 Correctly parse default values with trailing spaces 2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82 DBZ-1539 Remove field group 2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11 DBZ-1539 Cleanup tests 2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2 DBZ-1539 Add interval.handling.mode to oracle connector 2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0 DBZ-4276 Extend LOB tests when LOB is disabled 2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe DBZ-4236 Unify Oracle LogMiner event processors 2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb DBZ-4169 Consolidate rollback and recently committed trx caches 2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0 DBZ-4169 Suggested changes 2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669 DBZ-4169 Enforce existence of Hotrod client server list option when necessary 2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038 DBZ-4169 Extract strings to constants 2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3 DBZ-4169 Raise error when using log.mining.buffer.location option 2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead DBZ-4169 Cleanup Oracle POM 2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137 DBZ-4169 Consolidate CacheProvider impls into Processor impls 2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120 DBZ-4169 Flush out configuration options; fix ConfigDef test 2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56 DBZ-4169 Cleanup cache creation 2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18 DBZ-4169 Cleanup TestHelper 2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b DBZ-4169 Support remote Infinispan caches 2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3 DBZ-4308 Avoid NPE during table/column length checks 2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954 DBZ-4276 Improve map initialization 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
Chris Cranford
0fbfd88f6c DBZ-4276 Add unavailable.value.placeholder support for Oracle 2021-11-16 20:29:59 +01:00
Chris Cranford
7720c653e5 DBZ-4279 For test compatibility with Xstream 2021-11-14 16:47:51 -05:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Gunnar Morling
a03de4e9d0 DBZ-3611 Clarifying purpose of test 2021-11-11 09:24:05 +01:00
Chris Cranford
85101f0ad7 DBZ-3611 Avoid NPE with database include/exclude lists 2021-11-11 09:24:05 +01:00
Chris Cranford
d77098c3f0 DBZ-3710 Emit SYSDATE as 1970-01-01T00:00:00Z for zone-based temporal values 2021-11-10 09:43:25 +01:00
Chris Cranford
5c2523cd73 DBZ-3710 Suggested changes 2021-11-10 09:43:25 +01:00
Chris Cranford
5afda302ec DBZ-3710 Javadoc updates 2021-11-10 09:43:25 +01:00
Chris Cranford
78f79afff3 DBZ-3710 Change mapper methods to static scope 2021-11-10 09:43:25 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Chris Cranford
3fd784c51d DBZ-4208 Add test case for sequence-based defaults 2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4 DBZ-3710 Support Oracle column default values 2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb DBZ-4255 Reduce verbosity of logging Oracle memory metrics 2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a DBZ-4222 Correctly assign min metrics values when unset 2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0 DBZ-4222 Initialize log names/status in metrics when streaming starts 2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89 DBZ-4222 Correctly update last and total batch duration metrics 2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64 DBZ-4222 Do not recalculate fetch query metrics twice 2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef DBZ-4230 Gracefully handle ORA-00310 during streaming 2021-11-08 15:23:12 +01:00