Commit Graph

708 Commits

Author SHA1 Message Date
Chris Cranford
a900ababcd DBZ-5042 Use PDB name when set in Oracle configuration 2022-05-27 14:20:30 -04:00
Vojtech Juranek
fa07f67cdb DBZ-5042 Add DB name logging support into Oracle connector 2022-05-27 14:20:30 -04:00
Chris Cranford
1ae7bec46e DBZ-5146 Remove log.mining.view.fetch.size, use query.fetch.size instead. 2022-05-26 19:26:14 -04:00
Chris Cranford
60b1b3cc1d DBZ-5147 Fix test failures 2022-05-26 18:37:24 -04:00
Chris Cranford
2978898641 DBZ-5147 Adjust log levels, apply test rules 2022-05-26 18:37:24 -04:00
Chris Cranford
7ab0cea8f1 DBZ-5147 Add event.processing.failure.handling.mode for Oracle 2022-05-26 18:37:24 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Cranford
15eb7807c4 DBZ-5119 Add heartbeat.action.query support for Oracle 2022-05-24 12:54:40 +02:00
Chris Cranford
2b78fca8ce DBZ-5148 Retry starting Oracle LogMiner after ORA-01291 2022-05-23 10:30:18 +02:00
Chris Cranford
7577500696 DBZ-5140 Do not log transaction warning when lob-enabled is true 2022-05-18 14:11:36 -04:00
Chris Cranford
9a81339b54 DBZ-4782 Rework if-branches 2022-05-13 12:51:38 +02:00
Chris Cranford
e1579f8738 DBZ-4782 Flush SCN values upon schema changes 2022-05-13 12:51:38 +02:00
Chris Cranford
d0c6b59527 DBZ-4973 Cleanup logging calls 2022-05-10 11:33:33 -04:00
Chris Cranford
db9a104ea4 DBZ-4973 Remove unused code 2022-05-10 11:33:33 -04:00
Chris Cranford
035d6b4c14 DBZ-5090 Improve test use case 2022-05-10 09:45:34 -04:00
Chris Cranford
0d595025fd DBZ-5090 Undo events across multiple mining sessions 2022-05-10 09:45:34 -04:00
Chris Cranford
43ae067ef8 DBZ-5006 Add suggested test coverage 2022-04-27 08:52:29 -04:00
Chris Cranford
7e845f83cb DBZ-3318 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
cea4b51a3b DBZ-4963 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
09e58c5a5c DBZ-5006 Allow "/" characters in Oracle table names 2022-04-27 08:52:29 -04:00
Jan Doms
f698a59481 DBZ-5005 adjust LogMiner batch size based on comparison with currently used batch size 2022-04-26 14:08:00 -04:00
Chris Cranford
9e08093900 DBZ-5029 Scope several OracleConnectorIT tests to LogMiner only
* shouldCaptureChangeForTableWithUnsupportedColumnType
* shouldContinueToUpdateOffsetsEvenWhenTableIsNotChanged
2022-04-21 16:10:39 +02:00
Chris Cranford
cee77e5b96 DBZ-5028 Scope OracleOffsetContextTest to the LogMiner adapter 2022-04-21 15:51:02 +02:00
Chris Cranford
5f9b2fa822 DBZ-4963 Use Optional & Stopwatch, disable lengthy test by default 2022-04-21 08:05:59 +02:00
Chris Cranford
c804509673 DBZ-4963 Introduce log.mining.session.max.ms config option for Oracle 2022-04-21 08:05:59 +02:00
Chris Cranford
f24be1f533 DBZ-4994 Fix LOB locator event parsing with escaped single quotes 2022-04-19 09:07:36 +02:00
Chris Cranford
f667402fe0 DBZ-4987 Propagate up all exceptions from LCR handler 2022-04-19 07:23:39 +02:00
Chris Cranford
89fb497602 DBZ-4976 Add unit test 2022-04-14 11:58:50 +02:00
Chris Cranford
0ffd2e2ec3 DBZ-4976 Rework null checks & add nullability comments 2022-04-14 11:58:50 +02:00
Anisha Mohanty
736a3b149b DBZ-4976 Handle NPEs for column definitions of Oracle DDL statements 2022-04-14 11:58:50 +02:00
Chris Cranford
1d68c8ed53 DBZ-4978 Avoid NPE during Oracle connector shutdown 2022-04-14 10:18:40 +02:00
Chris Cranford
7b95aa7bcb DBZ-4953 Correctly handle TRUNCATE when LOB is enabled 2022-04-11 07:45:12 +02:00
Chris Cranford
e984754c2a DBZ-4932 Use LCR v1 format with Oracle 12.0 and 12.1 2022-04-11 07:09:39 +02:00
Chris Cranford
a793d9e2ca DBZ-4936 Restrict test to only memory-based buffer 2022-04-08 14:21:17 -04:00
Chris Cranford
22d300731f DBZ-3318 Add integration test for database.url 2022-04-08 11:14:30 -04:00
Chris Cranford
c7e1006dd3 DBZ-4879 Correctly resolve archive-log-only SCN mining range 2022-04-08 12:05:57 +02:00
Chris Cranford
3740d27366 DBZ-4936 Don't re-emit transaction on restart with commit SCN equal to offset commit SCN 2022-04-08 09:21:38 +02:00
Chris Cranford
785623658c DBZ-4937 Correctly read/write snapshot_scn and snapshot_pending_trx offsets 2022-04-01 13:56:04 -04:00
Chris Cranford
13a96549bc DBZ-4907 Increment Commit SCN when any COMMIT is detected 2022-03-31 10:02:38 -04:00
Chris Cranford
36ad6f23db
DBZ-4891 Remove unused variable 2022-03-30 16:06:04 -04:00
Chris Cranford
6f7fa743ed
DBZ-4862 Correctly parse double single-quotes in SEL_LOB_LOCATOR events 2022-03-30 16:06:04 -04:00
asibanovs
1fe8dbb1cd
DBZ-4891 Fix Oracle Logminer's escaped single quotes parsing in DMLs, related unit test and fix for the old DBZ-3414 test. 2022-03-30 16:06:04 -04:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Jiri Pechanec
60b80f6365 DBZ-4869 Add hint to warn message 2022-03-23 10:50:03 +01:00
Chris Cranford
64f22e3498 DBZ-4869 Log warning rather than exception on incorrect table-level logging level 2022-03-23 10:50:03 +01:00
Jiri Pechanec
71ffde5eaa DBZ-4900 Use Duration instead of millis 2022-03-23 09:01:59 +01:00
Chris Cranford
2dd488effb DBZ-4900 Use exponential back-off for log availability check 2022-03-23 09:01:59 +01:00
Ethan Zou
efdb5d21fc DBZ-4850 Add several retriable SQL error codes 2022-03-22 11:52:27 -04:00
Chris Cranford
80cda74e63 DBZ-4897 Suggested edits 2022-03-22 16:47:21 +01:00
Chris Cranford
337305f0e6 DBZ-4897 Parse Oracle character-based column default values with parens 2022-03-22 16:47:21 +01:00
Chris Cranford
45648632f3 DBZ-4880 Correctly interpret NCLOB in Oracle DDL parser 2022-03-18 11:05:36 +01:00
Chris Cranford
c90993a652 DBZ-4852 DBZ-4853 DDL parser pass unsupported column types as OracleTypes.OTHER 2022-03-18 11:05:36 +01:00
Jiri Pechanec
341ec1260e DBZ-4878 Add partition to Oracle xstream 2022-03-18 07:55:43 +01:00
kate
d2899a276a DBZ-4878 Add partition to Oracle logminer 2022-03-18 07:55:43 +01:00
Chris Cranford
c8ecea8df9 DBZ-4842 Relax supplemental log check when table does not exist 2022-03-17 09:52:47 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Chris Cranford
fd38f771fa DBZ-4819 Correct timing concerns to get FlushStrategyIT stable 2022-03-04 11:28:27 -05:00
Chris Cranford
252549c674 DBZ-4287 Remove redundant getCurrentRedoLogSequences usage 2022-03-03 07:48:12 -05:00
Willie Zhu
66007df053 DBZ-4287 set the currentRedoLogSequences at the time when we update the redo log file list 2022-03-03 07:48:12 -05:00
Chris Cranford
7de14775ee DBZ-4635 Prevent NPE from offsets during Oracle connector upgrade 2022-02-28 21:55:23 +01:00
Chris Cranford
9103a220b7 DBZ-4744 Correctly parse signal table name when using domain name 2022-02-22 15:27:21 +01:00
Chris Cranford
0ed2defc93 DBZ-4718 Process transaction retention on each mining iteration 2022-02-22 14:50:23 +01:00
Dominique Chanet
10dfc3be87 DBZ-4737 rename hasNoLogFilesStartingBeforeOrAtScn to hasLogFilesStartingBeforeOrAtScn 2022-02-16 09:10:51 -05:00
Dominique Chanet
fe523359f9 DBZ-4737 fix SqlUtils test 2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac DBZ-4737 fix log file discovery 2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599 DBZ-4715 Use ZoneOffset rather than long for database offset seconds 2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30 DBZ-4715 Fix stream event's source timestamp tz resolution 2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22 DBZ-4737 Fix error when rewinding to oldest archive log SCN
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size". 2022-02-09 03:03:26 -05:00
Chris Cranford
7ec2abd89e DBZ-4305 Skip test when using Oracle 21 2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90 DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics 2022-02-08 13:19:50 -05:00
Chris Cranford
57934a0838 DBZ-4367 Fix test failure due to auto-commit state 2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00