Commit Graph

1048 Commits

Author SHA1 Message Date
Chris Cranford
f3671afaf7 DBZ-5139 Apply threshold to all processors, added tests 2022-06-01 17:52:44 -04:00
Ethan Zou
1ac6abf63e DBZ-5139 Abandon transaction who has too many events according to new configuration 'log.mining.buffer.memory.transaction.events.threshold' 2022-06-01 17:52:44 -04:00
Jiri Pechanec
88b7ae2050 DBZ-5136 Move sourceInfo to common class 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it 2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649 DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes 2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795 DBZ-5136 Move common class to common package 2022-06-01 16:56:29 +02:00
Andrew Walker
d23735c658 DBZ-5136: Fix missing reference 2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4 DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf DBZ-5136: Add first flag and refactor OffsetContext 2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6 DBZ-5136: Add last in table flag 2022-06-01 16:56:29 +02:00
Chris Cranford
15e9231c30 DBZ-5179 Use LRUCacheMap to avoid high memory usage 2022-06-01 15:53:55 +02:00
Chris Cranford
a900ababcd DBZ-5042 Use PDB name when set in Oracle configuration 2022-05-27 14:20:30 -04:00
Vojtech Juranek
fa07f67cdb DBZ-5042 Add DB name logging support into Oracle connector 2022-05-27 14:20:30 -04:00
Chris Cranford
1ae7bec46e DBZ-5146 Remove log.mining.view.fetch.size, use query.fetch.size instead. 2022-05-26 19:26:14 -04:00
Chris Cranford
60b1b3cc1d DBZ-5147 Fix test failures 2022-05-26 18:37:24 -04:00
Chris Cranford
2978898641 DBZ-5147 Adjust log levels, apply test rules 2022-05-26 18:37:24 -04:00
Chris Cranford
7ab0cea8f1 DBZ-5147 Add event.processing.failure.handling.mode for Oracle 2022-05-26 18:37:24 -04:00
Chris Cranford
7d8c9486d6 DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants 2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743 DBZ-5119 Pull heartbeat.action.query support into debezium-core 2022-05-24 12:54:40 +02:00
Chris Cranford
15eb7807c4 DBZ-5119 Add heartbeat.action.query support for Oracle 2022-05-24 12:54:40 +02:00
Chris Cranford
2b78fca8ce DBZ-5148 Retry starting Oracle LogMiner after ORA-01291 2022-05-23 10:30:18 +02:00
Chris Cranford
7577500696 DBZ-5140 Do not log transaction warning when lob-enabled is true 2022-05-18 14:11:36 -04:00
Chris Cranford
9a81339b54 DBZ-4782 Rework if-branches 2022-05-13 12:51:38 +02:00
Chris Cranford
e1579f8738 DBZ-4782 Flush SCN values upon schema changes 2022-05-13 12:51:38 +02:00
Chris Cranford
d0c6b59527 DBZ-4973 Cleanup logging calls 2022-05-10 11:33:33 -04:00
Chris Cranford
db9a104ea4 DBZ-4973 Remove unused code 2022-05-10 11:33:33 -04:00
Chris Cranford
035d6b4c14 DBZ-5090 Improve test use case 2022-05-10 09:45:34 -04:00
Chris Cranford
0d595025fd DBZ-5090 Undo events across multiple mining sessions 2022-05-10 09:45:34 -04:00
Debezium Builder
901825810a [maven-release-plugin] prepare for next development iteration 2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647 [maven-release-plugin] prepare release v2.0.0.Alpha1 2022-04-28 13:51:12 +00:00
Chris Cranford
43ae067ef8 DBZ-5006 Add suggested test coverage 2022-04-27 08:52:29 -04:00
Chris Cranford
7e845f83cb DBZ-3318 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
cea4b51a3b DBZ-4963 Scope tests to Oracle LogMiner adapter 2022-04-27 08:52:29 -04:00
Chris Cranford
09e58c5a5c DBZ-5006 Allow "/" characters in Oracle table names 2022-04-27 08:52:29 -04:00
Jan Doms
f698a59481 DBZ-5005 adjust LogMiner batch size based on comparison with currently used batch size 2022-04-26 14:08:00 -04:00
Chris Cranford
9e08093900 DBZ-5029 Scope several OracleConnectorIT tests to LogMiner only
* shouldCaptureChangeForTableWithUnsupportedColumnType
* shouldContinueToUpdateOffsetsEvenWhenTableIsNotChanged
2022-04-21 16:10:39 +02:00
Chris Cranford
cee77e5b96 DBZ-5028 Scope OracleOffsetContextTest to the LogMiner adapter 2022-04-21 15:51:02 +02:00
Chris Cranford
5f9b2fa822 DBZ-4963 Use Optional & Stopwatch, disable lengthy test by default 2022-04-21 08:05:59 +02:00
Chris Cranford
c804509673 DBZ-4963 Introduce log.mining.session.max.ms config option for Oracle 2022-04-21 08:05:59 +02:00
Chris Cranford
f24be1f533 DBZ-4994 Fix LOB locator event parsing with escaped single quotes 2022-04-19 09:07:36 +02:00
Chris Cranford
f667402fe0 DBZ-4987 Propagate up all exceptions from LCR handler 2022-04-19 07:23:39 +02:00
Chris Cranford
89fb497602 DBZ-4976 Add unit test 2022-04-14 11:58:50 +02:00
Chris Cranford
0ffd2e2ec3 DBZ-4976 Rework null checks & add nullability comments 2022-04-14 11:58:50 +02:00
Anisha Mohanty
736a3b149b DBZ-4976 Handle NPEs for column definitions of Oracle DDL statements 2022-04-14 11:58:50 +02:00
Chris Cranford
1d68c8ed53 DBZ-4978 Avoid NPE during Oracle connector shutdown 2022-04-14 10:18:40 +02:00
Chris Cranford
7b95aa7bcb DBZ-4953 Correctly handle TRUNCATE when LOB is enabled 2022-04-11 07:45:12 +02:00
Chris Cranford
e984754c2a DBZ-4932 Use LCR v1 format with Oracle 12.0 and 12.1 2022-04-11 07:09:39 +02:00
Chris Cranford
a793d9e2ca DBZ-4936 Restrict test to only memory-based buffer 2022-04-08 14:21:17 -04:00
Chris Cranford
22d300731f DBZ-3318 Add integration test for database.url 2022-04-08 11:14:30 -04:00
Chris Cranford
c7e1006dd3 DBZ-4879 Correctly resolve archive-log-only SCN mining range 2022-04-08 12:05:57 +02:00
Chris Cranford
3740d27366 DBZ-4936 Don't re-emit transaction on restart with commit SCN equal to offset commit SCN 2022-04-08 09:21:38 +02:00
Debezium Builder
4a6de64c25 [maven-release-plugin] prepare for next development iteration 2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90 [maven-release-plugin] prepare release v1.9.0.Final 2022-04-05 14:49:51 +00:00
Chris Cranford
785623658c DBZ-4937 Correctly read/write snapshot_scn and snapshot_pending_trx offsets 2022-04-01 13:56:04 -04:00
Chris Cranford
13a96549bc DBZ-4907 Increment Commit SCN when any COMMIT is detected 2022-03-31 10:02:38 -04:00
Chris Cranford
36ad6f23db
DBZ-4891 Remove unused variable 2022-03-30 16:06:04 -04:00
Chris Cranford
6f7fa743ed
DBZ-4862 Correctly parse double single-quotes in SEL_LOB_LOCATOR events 2022-03-30 16:06:04 -04:00
asibanovs
1fe8dbb1cd
DBZ-4891 Fix Oracle Logminer's escaped single quotes parsing in DMLs, related unit test and fix for the old DBZ-3414 test. 2022-03-30 16:06:04 -04:00
Debezium Builder
ab7fe3b96a [maven-release-plugin] prepare for next development iteration 2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee [maven-release-plugin] prepare release v1.9.0.CR1 2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782 DBZ-3535: Introduce schema.name.adjustment.mode 2022-03-24 09:37:05 +01:00
Jiri Pechanec
60b80f6365 DBZ-4869 Add hint to warn message 2022-03-23 10:50:03 +01:00
Chris Cranford
64f22e3498 DBZ-4869 Log warning rather than exception on incorrect table-level logging level 2022-03-23 10:50:03 +01:00
Jiri Pechanec
71ffde5eaa DBZ-4900 Use Duration instead of millis 2022-03-23 09:01:59 +01:00
Chris Cranford
2dd488effb DBZ-4900 Use exponential back-off for log availability check 2022-03-23 09:01:59 +01:00
Ethan Zou
efdb5d21fc DBZ-4850 Add several retriable SQL error codes 2022-03-22 11:52:27 -04:00
Chris Cranford
80cda74e63 DBZ-4897 Suggested edits 2022-03-22 16:47:21 +01:00
Chris Cranford
337305f0e6 DBZ-4897 Parse Oracle character-based column default values with parens 2022-03-22 16:47:21 +01:00
Chris Cranford
45648632f3 DBZ-4880 Correctly interpret NCLOB in Oracle DDL parser 2022-03-18 11:05:36 +01:00
Chris Cranford
c90993a652 DBZ-4852 DBZ-4853 DDL parser pass unsupported column types as OracleTypes.OTHER 2022-03-18 11:05:36 +01:00
Jiri Pechanec
341ec1260e DBZ-4878 Add partition to Oracle xstream 2022-03-18 07:55:43 +01:00
kate
d2899a276a DBZ-4878 Add partition to Oracle logminer 2022-03-18 07:55:43 +01:00
Chris Cranford
c8ecea8df9 DBZ-4842 Relax supplemental log check when table does not exist 2022-03-17 09:52:47 +01:00
Gunnar Morling
d20a6f00e7 DBZ-4801 Using JdbcConfiguration in JdbcConnection 2022-03-07 17:53:45 +01:00
Chris Cranford
fd38f771fa DBZ-4819 Correct timing concerns to get FlushStrategyIT stable 2022-03-04 11:28:27 -05:00
Debezium Builder
fece16039c [maven-release-plugin] prepare for next development iteration 2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809 [maven-release-plugin] prepare release v1.9.0.Beta1 2022-03-03 17:00:08 +00:00
Chris Cranford
252549c674 DBZ-4287 Remove redundant getCurrentRedoLogSequences usage 2022-03-03 07:48:12 -05:00
Willie Zhu
66007df053 DBZ-4287 set the currentRedoLogSequences at the time when we update the redo log file list 2022-03-03 07:48:12 -05:00
Chris Cranford
7de14775ee DBZ-4635 Prevent NPE from offsets during Oracle connector upgrade 2022-02-28 21:55:23 +01:00
Chris Cranford
9103a220b7 DBZ-4744 Correctly parse signal table name when using domain name 2022-02-22 15:27:21 +01:00
Chris Cranford
0ed2defc93 DBZ-4718 Process transaction retention on each mining iteration 2022-02-22 14:50:23 +01:00
Dominique Chanet
10dfc3be87 DBZ-4737 rename hasNoLogFilesStartingBeforeOrAtScn to hasLogFilesStartingBeforeOrAtScn 2022-02-16 09:10:51 -05:00
Dominique Chanet
fe523359f9 DBZ-4737 fix SqlUtils test 2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac DBZ-4737 fix log file discovery 2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599 DBZ-4715 Use ZoneOffset rather than long for database offset seconds 2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30 DBZ-4715 Fix stream event's source timestamp tz resolution 2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22 DBZ-4737 Fix error when rewinding to oldest archive log SCN
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size". 2022-02-09 03:03:26 -05:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Chris Cranford
7ec2abd89e DBZ-4305 Skip test when using Oracle 21 2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90 DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics 2022-02-08 13:19:50 -05:00
René Kerner
8b47bf2d8f
DBZ-4665 Extend Debezium Schema Generator;
* finish renaming of API/APIFormat occurences to use Schema instead
* add creation of directory structure per connector when creating descriptors: `postgres.json` --> `postgres/postgres.json`
* add configuration to add a schema filename prefix (`postgres.json` --> `debezium-postgres.json`)
* add configuration to add a schema filename suffix (`postgres.json` --> `postgres-1.9.0-SNAPSHOT.json`)
* add some minor logging (available schema formats, selected format, processed connectors) and throw errors on failed state (no schema formats found, no connectors found)
* remove Oracle connector schema generation as it is not annotated yet
* automatically resolving all dependencies required by the schema generator

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-07 16:19:50 +01:00
Chris Cranford
57934a0838 DBZ-4367 Fix test failure due to auto-commit state 2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920 DBZ-732 Execute Oracle ITs on CI 2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change 2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode 2022-01-06 11:29:41 -05:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a DBZ-4446 Option to disable Infinispan in Oracle 2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f DBZ-3940 Add connector-driven EventRouter configuration 2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf DBZ-4426 Log message when Oracle schema locks are disabled by configuration 2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212 DBZ-4425 Fix Oracle Infinispan unavailable value serialization 2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2 DBZ-4422 Fix inconsistencies with XStream LOB handling 2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20 DBZ-4385 Javadoc fixes 2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8 DBZ-4385 Don't specify mining strategy in tests 2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a DBZ-4385 Truncate support for Oracle 2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2 DBZ-4388 Don't set default value if resolution fails 2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c DBZ-3635 Made option internal & undocumented 2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3 DBZ-3635 Allow fetching of transaction logs to be retried. 2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32 DBZ-4400 Fix not-null CLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564 DBZ-4400 Fix not-null BLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117 DBZ-4400 Support binary.handling.mode for Oracle 2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase 2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25 DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected 2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838 DBZ-4272 Incrementally snapshot after schema change without NPE 2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c DBZ-4360 Correctly parse default values with trailing spaces 2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82 DBZ-1539 Remove field group 2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11 DBZ-1539 Cleanup tests 2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2 DBZ-1539 Add interval.handling.mode to oracle connector 2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0 DBZ-4276 Extend LOB tests when LOB is disabled 2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe DBZ-4236 Unify Oracle LogMiner event processors 2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb DBZ-4169 Consolidate rollback and recently committed trx caches 2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0 DBZ-4169 Suggested changes 2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669 DBZ-4169 Enforce existence of Hotrod client server list option when necessary 2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038 DBZ-4169 Extract strings to constants 2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3 DBZ-4169 Raise error when using log.mining.buffer.location option 2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead DBZ-4169 Cleanup Oracle POM 2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137 DBZ-4169 Consolidate CacheProvider impls into Processor impls 2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120 DBZ-4169 Flush out configuration options; fix ConfigDef test 2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56 DBZ-4169 Cleanup cache creation 2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18 DBZ-4169 Cleanup TestHelper 2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b DBZ-4169 Support remote Infinispan caches 2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3 DBZ-4308 Avoid NPE during table/column length checks 2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954 DBZ-4276 Improve map initialization 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
Chris Cranford
0fbfd88f6c DBZ-4276 Add unavailable.value.placeholder support for Oracle 2021-11-16 20:29:59 +01:00
Chris Cranford
7720c653e5 DBZ-4279 For test compatibility with Xstream 2021-11-14 16:47:51 -05:00
Debezium Builder
f93e901dce [maven-release-plugin] prepare for next development iteration 2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19 [maven-release-plugin] prepare release v1.8.0.Alpha2 2021-11-11 09:21:59 +00:00
Gunnar Morling
a03de4e9d0 DBZ-3611 Clarifying purpose of test 2021-11-11 09:24:05 +01:00
Chris Cranford
85101f0ad7 DBZ-3611 Avoid NPE with database include/exclude lists 2021-11-11 09:24:05 +01:00
Chris Cranford
d77098c3f0 DBZ-3710 Emit SYSDATE as 1970-01-01T00:00:00Z for zone-based temporal values 2021-11-10 09:43:25 +01:00
Chris Cranford
5c2523cd73 DBZ-3710 Suggested changes 2021-11-10 09:43:25 +01:00
Chris Cranford
5afda302ec DBZ-3710 Javadoc updates 2021-11-10 09:43:25 +01:00
Chris Cranford
78f79afff3 DBZ-3710 Change mapper methods to static scope 2021-11-10 09:43:25 +01:00
Chris Cranford
5ec9381702 DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL) 2021-11-10 09:43:25 +01:00
Chris Cranford
3fd784c51d DBZ-4208 Add test case for sequence-based defaults 2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4 DBZ-3710 Support Oracle column default values 2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb DBZ-4255 Reduce verbosity of logging Oracle memory metrics 2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a DBZ-4222 Correctly assign min metrics values when unset 2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0 DBZ-4222 Initialize log names/status in metrics when streaming starts 2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89 DBZ-4222 Correctly update last and total batch duration metrics 2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64 DBZ-4222 Do not recalculate fetch query metrics twice 2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef DBZ-4230 Gracefully handle ORA-00310 during streaming 2021-11-08 15:23:12 +01:00
Chris Cranford
64f030da14 DBZ-4252 Remove unused code 2021-11-06 10:30:39 +01:00
harveyyue
aa3ae05e22 DBZ-4107 Incremental snapshot doesn't work without primary key 2021-11-05 13:31:26 +01:00
Chris Cranford
b650a5cfa9 DBZ-4240 Resolve asterisk precision as default number precision 2021-11-05 08:24:17 +01:00
Chris Cranford
403ddb54c9 DBZ-4204 Allow ORA-04030 exceptions to be retried 2021-11-05 08:13:16 +01:00
Chris Cranford
84aa46fb27 DBZ-4159 Make Oracle Infinispan trx cache layout forward compatible 2021-11-05 08:10:45 +01:00
jiabao.sun
24ead16c24 DBZ-3966 Remove defaultValue and keep defaultValueExpression 2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697 DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues 2021-11-04 10:47:17 +01:00
Chris Cranford
ce28e939d6 DBZ-4159 Javadoc updates 2021-11-03 18:17:49 +01:00
Chris Cranford
954b81a75f DBZ-4159 Cache LogMinerEvent instances in separate cache 2021-11-03 18:17:49 +01:00
Chris Cranford
4f69443ad8 DBZ-4233 CHAR / NCHAR precision not derived from DDL 2021-11-03 07:11:00 +01:00
Chris Cranford
d0c96f440b DBZ-4077 Fix NPE with Oracle test suite 2021-11-03 07:08:35 +01:00
ahodavdekar
1d81b6db19 DBZ-4077 Exposing the transaction metadata topic name as a config option 2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4 DBZ-2975 Using Offsets in recover() contract;
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Chris Cranford
833791ffa4 DBZ-4194 Extend alias support for DELETE statements 2021-10-28 01:33:50 -04:00
harveyyue
a9cbb8f2ae DBZ-4194 DML statement couldn't be parsed 2021-10-28 01:33:50 -04:00
Chris Cranford
c25963fbd7 DBZ-4206 Parse Oracle DDL using SDO_GEOMETRY data types 2021-10-28 07:28:20 +02:00
Debezium Builder
2026a48302 [maven-release-plugin] prepare for next development iteration 2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9 [maven-release-plugin] prepare release v1.8.0.Alpha1 2021-10-27 06:47:26 +00:00
Chris Cranford
acfd5123c7 DBZ-4161 Restrict test to LogMiner only 2021-10-26 16:00:44 -04:00
Chris Cranford
2a6df35dbb DBZ-3978 Restrict test to LogMiner only 2021-10-26 16:00:18 -04:00
Chris Cranford
9f27cddbc5 DBZ-4186 Fix OracleSchemaMigrationIT test failures for Xstream 2021-10-22 09:01:56 +02:00
Chris Cranford
2db345d1ed DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE 2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab DBZ-4036 Only pass one SCN to the timestamp function 2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3 DBZ-4036 move scn_to_timestamp to a seperate function. 2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7 DBZ-4036 extract configuration 2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d DBZ-4036 handle SCN gap. 2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc DBZ-4188 Skip LogMiner tests while using XStream 2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f DBZ-4000 Support parse table and columns comment 2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438 DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable 2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection;
Also delaying event parsing until after duplication check.

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea DBZ-4161 Merge logging and object name length checks 2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b DBZ-4161 Log warning on long table/column names 2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867 DBZ-4140 scn -> SCN in messages 2021-10-18 12:12:30 +02:00
Chris Cranford
0ae985e5f8 DBZ-4140 Avoid NPE with getMaxArchiveLogScn by using query retries 2021-10-18 12:12:30 +02:00
Chris Cranford
c86a7cba60 DBZ-4064 Fix test failures 2021-10-15 09:17:43 +02:00
Chris Cranford
38fc16c869 DBZ-4064 Fix NullPointerException with LogMinerEventRow initialization 2021-10-15 09:17:43 +02:00
Chris Cranford
7494a1cd29 DBZ-4151 Prevent possible OutOfMemoryError with tracking schema changes 2021-10-14 16:47:22 +02:00
Sergei Morozov
4a03c5df17 DBZ-2975: Include database name into topic and schema names
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Zongwen Li
636c09e040 DBZ-3986 [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode 2021-10-12 15:03:01 +02:00
Chris Cranford
e3294146b5 DBZ-4118 Do not write multiple rows to flush table 2021-10-12 10:29:10 +02:00
Chris Cranford
150f45354a DBZ-4135 Fix handling of alter table MODIFY column DDL 2021-10-12 10:11:08 +02:00
Chris Cranford
abc3bb42d6 DBZ-4106 Don't continuously reconfigure DatabaseHistory 2021-10-05 20:15:58 +02:00
Gunnar Morling
477efc4033 DBZ-4078 Making sure base lifecycle hook is called 2021-10-04 10:09:51 +02:00
Chris Cranford
6482733915 DBZ-3978 Fix formatting 2021-10-01 14:14:39 -04:00
Willie Zhu
33def4cb48 DBZ-3978 only skip dispatching event for excluded user name 2021-10-01 14:14:39 -04:00
Chris Cranford
d94951ea62 DBZ-3978 Move integration test 2021-10-01 14:14:39 -04:00
Chris Cranford
806246edb0 DBZ-3978 Change loglevel to trace 2021-10-01 14:14:39 -04:00
Chris Cranford
16267cee23 DBZ-3978 Make fields final 2021-10-01 14:14:39 -04:00
Willie Zhu
0a9fced8bb DBZ-3978 add userName as a constructor argument.Add integration test. 2021-10-01 14:14:39 -04:00
Willie Zhu
0fa6f9f464 DBZ-3978 Exclude usernames at transaction level 2021-10-01 14:14:39 -04:00
Jiri Pechanec
f910fc930b [release] Switch to 1.8 snapshot 2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046 [maven-release-plugin] prepare for next development iteration 2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85 [maven-release-plugin] prepare release v1.7.0.Final 2021-10-01 13:26:33 +02:00