alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
6,688 Commits 3 Branches 0 Tags 51 MiB
840979a454
Commit Graph

820 Commits

Author SHA1 Message Date
Willie Zhu
66007df053 DBZ-4287 set the currentRedoLogSequences at the time when we update the redo log file list 2022-03-03 07:48:12 -05:00
Chris Cranford
7de14775ee DBZ-4635 Prevent NPE from offsets during Oracle connector upgrade 2022-02-28 21:55:23 +01:00
Chris Cranford
9103a220b7 DBZ-4744 Correctly parse signal table name when using domain name 2022-02-22 15:27:21 +01:00
Chris Cranford
0ed2defc93 DBZ-4718 Process transaction retention on each mining iteration 2022-02-22 14:50:23 +01:00
Dominique Chanet
10dfc3be87 DBZ-4737 rename hasNoLogFilesStartingBeforeOrAtScn to hasLogFilesStartingBeforeOrAtScn 2022-02-16 09:10:51 -05:00
Dominique Chanet
fe523359f9 DBZ-4737 fix SqlUtils test 2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac DBZ-4737 fix log file discovery 2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f DBZ-4478: Multi-partition metrics for SQL Server 2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces 2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599 DBZ-4715 Use ZoneOffset rather than long for database offset seconds 2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30 DBZ-4715 Fix stream event's source timestamp tz resolution 2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22 DBZ-4737 Fix error when rewinding to oldest archive log SCN 
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
 2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size". 2022-02-09 03:03:26 -05:00
Debezium Builder
7a47f478a4 [maven-release-plugin] prepare for next development iteration 2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e [maven-release-plugin] prepare release v1.9.0.Alpha2 2022-02-09 07:23:10 +00:00
Chris Cranford
7ec2abd89e DBZ-4305 Skip test when using Oracle 21 2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90 DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics 2022-02-08 13:19:50 -05:00
René Kerner
8b47bf2d8f
DBZ-4665 Extend Debezium Schema Generator; 
* finish renaming of API/APIFormat occurences to use Schema instead
* add creation of directory structure per connector when creating descriptors: `postgres.json` --> `postgres/postgres.json`
* add configuration to add a schema filename prefix (`postgres.json` --> `debezium-postgres.json`)
* add configuration to add a schema filename suffix (`postgres.json` --> `postgres-1.9.0-SNAPSHOT.json`)
* add some minor logging (available schema formats, selected format, processed connectors) and throw errors on failed state (no schema formats found, no connectors found)
* remove Oracle connector schema generation as it is not annotated yet
* automatically resolving all dependencies required by the schema generator

Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2022-02-07 16:19:50 +01:00
Chris Cranford
57934a0838 DBZ-4367 Fix test failure due to auto-commit state 2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15 DBZ-4367 Fix Xstream compilation problem 2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead DBZ-4367 process initial review comments 2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5 DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN 
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
 2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3 DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests 2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4 DBZ-4702 Document & fix test - XStream does not support ROWID data type 2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering (#3151) 2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d DBZ-4650 Mark incompatible Xstream tests as LogMiner-only 2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108 DBZ-4584 Support case-sensitive Oracle incremental snapshots 2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f [maven-release-plugin] prepare for next development iteration 2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e [maven-release-plugin] prepare release v1.9.0.Alpha1 2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369 DBZ-4595 Support Oracle ROWID data type 2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8 DBZ-4567 DDL and DML events exclude built-in schemas 2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d DBZ-4404 Added signal table support for Oracle 11G 2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5 DBZ-4520 Making static collections immutable 2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42 DBZ-4577 Provide custom error message handling 2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86 DBZ-2224 Test logging based on logback 2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972 DBZ-4536 Rework checks based on feedback 2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf DBZ-4536 Make OracleErrorHandler more flexible of retriable errors 2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values 2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package 
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).

There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.

The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
 2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b DBZ-4541: Promote failure to register metrics to exception 2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407 DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI 2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920 DBZ-732 Execute Oracle ITs on CI 2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda DBZ-4459: Introduce interfaces and default implementations for change event source metrics 2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46 DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs 2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872 DBZ-4408 Remove log.mining.log.file.query.max.retries 2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c DBZ-4460 Renaming all openapi occurrences to schema 2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f DBZ-4460 Set default values for format & output directory 2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691 DBZ-4460 Apply the plug-in to all connector modules 2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221 DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation 2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues 2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change 2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode 2022-01-06 11:29:41 -05:00
harveyyue
792187f669 DBZ-4472 Make connector task partition readability for log 2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98 [maven-release-plugin] prepare for next development iteration 2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f [maven-release-plugin] prepare release v1.8.0.Final 2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a DBZ-4446 Option to disable Infinispan in Oracle 2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09 DBZ-3940 Unify EventRouter tests for connectors 2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f DBZ-3940 Add connector-driven EventRouter configuration 2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf DBZ-4426 Log message when Oracle schema locks are disabled by configuration 2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df [maven-release-plugin] prepare for next development iteration 2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a [maven-release-plugin] prepare release v1.8.0.CR1 2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212 DBZ-4425 Fix Oracle Infinispan unavailable value serialization 2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2 DBZ-4422 Fix inconsistencies with XStream LOB handling 2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20 DBZ-4385 Javadoc fixes 2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8 DBZ-4385 Don't specify mining strategy in tests 2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a DBZ-4385 Truncate support for Oracle 2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2 DBZ-4388 Don't set default value if resolution fails 2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c DBZ-3635 Made option internal & undocumented 2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3 DBZ-3635 Allow fetching of transaction logs to be retried. 2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32 DBZ-4400 Fix not-null CLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564 DBZ-4400 Fix not-null BLOB column support when LOB disabled 2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117 DBZ-4400 Support binary.handling.mode for Oracle 2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase 2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25 DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected 2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf [maven-release-plugin] prepare for next development iteration 2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2 [maven-release-plugin] prepare release v1.8.0.Beta1 2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb DBZ-4272 Add drop column schema change to test 2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838 DBZ-4272 Incrementally snapshot after schema change without NPE 2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c DBZ-4360 Correctly parse default values with trailing spaces 2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82 DBZ-1539 Remove field group 2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11 DBZ-1539 Cleanup tests 2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2 DBZ-1539 Add interval.handling.mode to oracle connector 2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0 DBZ-4276 Extend LOB tests when LOB is disabled 2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe DBZ-4236 Unify Oracle LogMiner event processors 2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb DBZ-4169 Consolidate rollback and recently committed trx caches 2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0 DBZ-4169 Suggested changes 2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669 DBZ-4169 Enforce existence of Hotrod client server list option when necessary 2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038 DBZ-4169 Extract strings to constants 2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3 DBZ-4169 Raise error when using log.mining.buffer.location option 2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead DBZ-4169 Cleanup Oracle POM 2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137 DBZ-4169 Consolidate CacheProvider impls into Processor impls 2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120 DBZ-4169 Flush out configuration options; fix ConfigDef test 2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56 DBZ-4169 Cleanup cache creation 2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18 DBZ-4169 Cleanup TestHelper 2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b DBZ-4169 Support remote Infinispan caches 2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3 DBZ-4308 Avoid NPE during table/column length checks 2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303 DBZ-4276 Expose unavailable value placeholder for PG and Oracle only 2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954 DBZ-4276 Improve map initialization 2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221 DBZ-4276 Unify unavailable value placeholder handling 
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
 2021-11-16 20:29:59 +01:00