alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
5,431 Commits 3 Branches 0 Tags 51 MiB
5db43c853e
Commit Graph

581 Commits

Author SHA1 Message Date
Chris Cranford
7f7e23b110 DBZ-3668 Add ServiceLoader hook CloudEvents converter 2021-07-03 16:31:52 +07:00
Chris Cranford
3f759a8daa DBZ-3668 Add CloudEventsConverter support for Oracle connector 2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba DBZ-2975: Add partition awareness to source task components 
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
 2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71 DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig 2021-07-01 15:11:01 +02:00
Gunnar Morling
e8af7176e9 DBZ-3155 Removing JSqlParser from POM files 2021-07-01 10:57:45 +02:00
Chris Cranford
b625124e09 DBZ-3155 Move LogMinerDmlEntry & impl 2021-07-01 10:57:45 +02:00
Chris Cranford
c7622cbc18 DBZ-3155 Remove legacy DDL JSqlParser implementation 2021-07-01 10:57:45 +02:00
Chris Cranford
d804f41775 DBZ-3581 Remove deprecated log.mining.history.xxx features 2021-07-01 09:31:18 +02:00
Chris Cranford
237a71ea3c DBZ-3684 OracleSchemaMigrationIT - Fix possible false positive test failure 2021-07-01 09:10:42 +02:00
Chris Cranford
51825b0b47 DBZ-3677 Change connection validation failure message log level 2021-07-01 09:08:08 +02:00
Debezium Builder
9d3f6b2a86 [maven-release-plugin] prepare for next development iteration 2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56 [maven-release-plugin] prepare release v1.6.0.Final 2021-06-30 03:45:06 -04:00
Chris Cranford
db8475be42 DBZ-1211 Add extra test assertions 2021-06-29 11:14:19 +02:00
Chris Cranford
bcf5441284 DBZ-1211 Add test case 2021-06-29 11:14:19 +02:00
Jiri Pechanec
472b82abb7 DBZ-3622 Decouple database and schema history record writes 2021-06-29 10:36:41 +02:00
Chris Cranford
01e87c11ed DBZ-3676 When LOB support is disabled, use adaptive SCN mining windows 2021-06-29 09:46:49 +02:00
Chris Cranford
09fa730d98 DBZ-3661 Introduce Oracle log.mining.archive.destination.name option 2021-06-29 09:25:57 +02:00
Gunnar Morling
ab3cf09165 DBZ-3665 Formatting 2021-06-28 15:53:36 +02:00
Chris Cranford
b9a79dcdd0 DBZ-3665 Provide better error description when enabling archive log only mode 2021-06-28 15:53:36 +02:00
Chris Cranford
d5d1ca8db2 DBZ-3664 Fix formatting 2021-06-28 02:57:33 -04:00
Gunnar Morling
3d30b7371f DBZ-3664 Wording fix 2021-06-28 08:25:34 +02:00
Chris Cranford
4a844aa36b DBZ-3664 Adjust log level for max batch reached message 2021-06-28 08:25:34 +02:00
Chris Cranford
4db80f86f0 DBZ-3672 Remove unused code 2021-06-26 22:03:14 +02:00
Debezium Builder
ae053414ac [maven-release-plugin] prepare for next development iteration 2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74 [maven-release-plugin] prepare release v1.6.0.CR1 2021-06-24 01:50:07 -04:00
Chris Cranford
185e598d91 DBZ-3645 Fix test failures for Oracle Xstream 2021-06-23 08:00:43 -04:00
Chris Cranford
61b22d9574 DBZ-3645 Adjust metrics calculations & logging levels 2021-06-23 09:55:29 +02:00
Chris Cranford
16eb60d8f1 DBZ-3645 Adjust SCN end point calculation w/sanity checks 2021-06-23 09:55:29 +02:00
Chris Cranford
c9e62a6806 DBZ-3645 Make Oracle LOB support opt-in 2021-06-23 09:55:29 +02:00
Chris Cranford
f6edfdc49a DBZ-3365 Revert "Remove unused imports", commit 080d701 2021-06-23 00:54:18 -04:00
Chris Cranford
080d7014db DBZ-3365 Remove unused imports 2021-06-22 11:45:28 -04:00
Chris Cranford
8b90786b35 DBZ-3634 Enable DDL events to be filtered by include/exclude lists 2021-06-22 11:26:57 +02:00
Chris Cranford
3113cb9175 DBZ-3639 Send heartbeat events during periods of low activity. 2021-06-21 11:03:01 +02:00
Chris Cranford
537437e6fa DBZ-3631 Suggested changes & formatting fixes 2021-06-21 09:28:03 +02:00
Chris Cranford
bb40bd9d67 DBZ-3631 Introduce ChunkColumnValues wrapper optimization 2021-06-21 09:28:03 +02:00
Chris Cranford
19d7ad401a DBZ-3631 Use traditional loop instead of stream 2021-06-18 08:42:31 +02:00
Chris Cranford
2310e45f3c DBZ-3631 Align Xstream to emit null when BLOB/CLOB fields are set to null. 
While LogMiner already did this, the Xstream implementation was not checking for
this use case and was instead emitting empty strings or empty byte buffer values
rather than explicit nulls if there was no data.
 2021-06-18 08:42:31 +02:00
Chris Cranford
29b7f1fa44 DBZ-3631 Fix Oracle trx reconciliation not finding PK columns 2021-06-17 09:10:33 +02:00
Chris Cranford
b4ac2f9c1c DBZ-3616 Avoid logging processed trx warnings & emit DDL changes once 2021-06-16 10:17:41 +02:00
Chris Cranford
aedb6118da DBZ-3612 Do not parse Oracle ALTER TABLE ddl for unknown tables 2021-06-16 10:07:32 +02:00
Debezium Builder
48ca58a609 [maven-release-plugin] prepare for next development iteration 2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859 [maven-release-plugin] prepare release v1.6.0.Beta2 2021-06-10 06:03:12 -04:00
Chris Cranford
8783eae098 DBZ-3599 Fix Oracle RAC url variable substitution 2021-06-09 16:03:31 +02:00
Gunnar Morling
1ce65fa628 DBZ-2975 Avoiding raw types in some places; 
Also parameterizing offset loader contract, so to avoid casts later on.
 2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542 DBZ-2975: Extract offset context from object states to method signatures 2021-06-09 16:02:33 +02:00
Chris Cranford
473eb2c02c DBZ-3561 Introduce archive log only mode for Oracle 2021-06-09 10:18:17 +02:00
Chris Cranford
9cc6239bc0 DBZ-3591 Fix SelectLobParser throwing NPE for unknown tables 2021-06-07 15:15:21 +02:00
Chris Cranford
4d3c1f7e72 DBZ-3062 Use captured instead of monitored 2021-06-07 11:19:54 +02:00
Chris Cranford
a2fc19f409 DBZ-3062 Oracle connector support snapshot.include.collection.list 2021-06-07 11:19:54 +02:00
Chris Cranford
de2fe7149b DBZ-3563 Deduplicate logs based on sequence number and not scn ranges 2021-06-07 11:17:11 +02:00
jackey.zhang
c32e290fac DBZ-3587 fix NPE when builder is null 2021-06-04 07:19:15 +02:00
Chris Cranford
fa3b7fd758 DBZ-3557 Fix test failures 2021-06-02 15:58:23 +02:00
Chris Cranford
078b8f7270 DBZ-3557 Remove exclusive from SnapshotLockingMode, use shared as default 2021-06-02 15:58:23 +02:00
Chris Cranford
d9d2706a17 DBZ-3557 Fix typo 2021-06-02 15:58:23 +02:00
Chris Cranford
047c505bc1 DBZ-3557 Add snapshot.locking.mode option for Oracle 2021-06-02 15:58:23 +02:00
Gunnar Morling
c4f5cbca6c DBZ-3328 Removing unused field 2021-06-02 12:18:48 +02:00
Chris Cranford
0af3959c2d DBZ-3328 Use object arrays to write column values 
Previously we used a wrapper class, LogMinerColumnValueImpl, to store
both the column name and value; however this introduced some overhead
in object allocation.  This change mostly focused on the removal of
that implementation and its interface in favor of creating object
arrays up-front and writing the column values directly.

Included as well as the following changes:

* Deprecated LogMinerColumnValue, impl, and wrapper
* Removed SEQUENCE# from LogMiner query, no longer needed
* Adapted tests to runtime changes with object arrays
 2021-06-02 12:18:48 +02:00
Chris Cranford
f178a6e235 DBZ-3328 Remove superfluous state from LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
7dd980e505 DBZ-3328 Fix test failures 2021-06-02 12:18:48 +02:00
Gunnar Morling
4dcda868b5 DBZ-3328 Adding factory methods for LogMinerDmlEntryImpl 2021-06-02 12:18:48 +02:00
Chris Cranford
19e650dc25 DBZ-3328 Updated comment 2021-06-02 12:18:48 +02:00
Chris Cranford
49f3ee6172 DBZ-3328 Performance cleanup 
* Use loop rather than streams
* Remove usage of Optional
* No need to add superfluous null-valued columns
 2021-06-02 12:18:48 +02:00
Chris Cranford
52906cf154 DBZ-3328 Avoid copying in Oracle LogMiner DML parser 2021-06-02 12:18:48 +02:00
Chris Cranford
ae9a32ab83 DBZ-3565 Make log.mining.history.xxx options internal 2021-06-02 10:47:54 +02:00
Chris Cranford
fd5afb04ea DBZ-3565 Fix formatting 2021-06-02 10:47:54 +02:00
Chris Cranford
eb22eaf85f DBZ-3565 Always use NeverHistoryRecorder if retention hours are 0 2021-06-02 10:47:54 +02:00
Chris Cranford
68c2c40097 DBZ-3565 Rename Oracle LogMiner history retention hours option 
* Moved option to `log.mining.` namespace rather than `database.`
* Updated the documentation and field description accordingly.
 2021-06-02 10:47:54 +02:00
Chris Cranford
9a5d48524a DBZ-3556 Remove ByteBuffer usage and refactor 
* Combines BLOB chunks into a single hex-string for conversion
* Moved several strings to static variables
 2021-05-31 10:03:24 +02:00
Gunnar Morling
28e36d55b1 DBZ-3554 Formatting 2021-05-26 13:04:25 +02:00
Chris Cranford
abb19d7437 DBZ-3554 Exclude ORA_TEMP_% tables from LogMiner DDL detection 2021-05-26 12:56:09 +02:00
Gunnar Morling
50bfd93e64 DBZ-3556 Moving getHexToRawByteArray() to value converters 2021-05-26 09:10:55 +02:00
Chris Cranford
901a74e604 DBZ-3556 Reduce database round-trip for LOB handling 2021-05-26 08:56:57 +02:00
Jiri Pechanec
39df21cdc1 DBZ-3460 New Oracle version in README 2021-05-25 08:02:56 +02:00
Patrick Chu
9bdbec995f DBZ-3545 Check for "IS NULL" in SelectLobParser 2021-05-21 10:13:16 +02:00
Debezium Builder
ead4ee7226 [maven-release-plugin] prepare for next development iteration 2021-05-20 19:07:44 +02:00
Debezium Builder
9e16df7d4b [maven-release-plugin] prepare release v1.6.0.Beta1 2021-05-20 19:07:44 +02:00
Chris Cranford
172c17d207 DBZ-2948 Fix IndexOutOfBoundsException with LOB select parser 2021-05-20 08:21:08 +02:00
Chris Cranford
754462a436 DBZ-2948 Fix potential null value being assigned to offset SCN 2021-05-20 08:21:08 +02:00
Chris Cranford
4aeb6069a3 DBZ-814 Ignore unsupported column types 2021-05-20 08:21:08 +02:00
Chris Cranford
8306bb5f15 DBZ-2948 Increase size of large CLOB/BLOB values 2021-05-20 08:21:08 +02:00
Chris Cranford
467a7f21f6 DBZ-2948 Implement BLOB/CLOB support for Oracle Xstream 2021-05-20 08:21:08 +02:00
Chris Cranford
fb7378ef52 DBZ-2948 Fix formatting 2021-05-20 08:21:08 +02:00
Chris Cranford
49703d9dc9 DBZ-2948 Implement BLOB/CLOB support for Oracle LogMiner 2021-05-20 08:21:08 +02:00
Chris Cranford
837a70f131
DBZ-3472 Relax retry logic for "No more data to read from socket" 
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
 2021-05-20 07:58:31 +02:00
Chris Cranford
d147d1f517
DBZ-3240 Remove database.tablename.case.insensitive deprecated option 2021-05-19 20:44:59 +02:00
Chris Cranford
d5c8dcff9f DBZ-3539 Mark xstream dependency scope as provided 2021-05-19 17:22:27 +02:00
Gunnar Morling
50c285031a
DBZ-3456 Minor clean-up 2021-05-19 13:42:03 +02:00
Thomas Aregger
d1670b636c
DBZ-3456 Timezone difference not considered in LagFromSourceInMilliseconds calculation; 
* Retrieve v$logmnr_contents.change_time in UTC
* Respect time zones when calculating time difference
* Allow constructors to be annotated with VisibleForTesting
 2021-05-19 13:41:02 +02:00
Chris Cranford
118cee24a7 DBZ-3256 Formatting 2021-05-19 09:40:19 +02:00
Chris Cranford
81190df6a8 DBZ-3256 Document query fragments 2021-05-19 09:40:19 +02:00
Chris Cranford
b7c1d798a3 DBZ-3256 Consolidate Oracle redo/archive log queries 
* Moves de-duplication to database using SQL query, i.e. no duplicate SCN ranges
* Provides a consistent view of logs rather than relying on multiple queries
 2021-05-19 09:40:19 +02:00
Chris Cranford
ab2c3f41e6 DBZ-3533 Drop tables after signal tests concluded 2021-05-18 14:24:54 -04:00
Chris Cranford
a33af6a2d7 DBZ-2916 Fix test failures 2021-05-18 13:53:43 -04:00
Thomas Aregger
2d87fa9b3d DBZ-3482 Parse timestamps with short form for months with locale "en" 2021-05-18 11:05:13 -04:00
Thomas Aregger
0027eb9f9c DBZ-3482 Add missing format model 
When the format model is omitted, the default is used. The default is determined from NLS settings
 2021-05-18 11:05:13 -04:00
Thomas Aregger
5009a9d586 DBZ-3482 Change date string to match provided format model 2021-05-18 11:05:13 -04:00
Thomas Aregger
f31909ab12 DBZ-3482 Use format model for DATE data types that is independent of clients NLS settings 2021-05-18 11:05:13 -04:00
Chris Cranford
9b011c75a3 DBZ-3322 Suggested test case change 2021-05-18 15:49:19 +02:00
Chris Cranford
967b945e0f DBZ-3322 Bubble up exceptions from RowMapper 2021-05-18 15:49:19 +02:00
Chris Cranford
00d75c282b DBZ-3322 Handle Oracle partially committed transactions 2021-05-18 15:49:19 +02:00