Commit Graph

384 Commits

Author SHA1 Message Date
Chris Cranford
01ece5cbdb DBZ-2999 Fix unnecessary logging of current redo logs 2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053 DBZ-2999 Improve Logminer logging 2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1 DBZ-2982 Suggested changes 2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a DBZ-2982 Fix formatting 2021-02-03 11:45:20 -05:00
mpermar
76a518334a DBZ-2982 Add suffix to log mining properties and proper Duration type 2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1 DBZ-2982 Remove trailing space
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05 DBZ-2982 Add some additional logging on sleep time and batch sizing 2021-02-03 11:45:20 -05:00
mpermar
c442f478cb DBZ-2982 Allow to customize log mining properties 2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8 DBZ-2420 Use custom Oracle connector validation for database.hostname 2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig 2021-02-03 11:10:57 -05:00
Debezium Builder
4c84157e6d [maven-release-plugin] prepare for next development iteration 2021-01-28 07:46:34 -05:00
Debezium Builder
1ba7253981 [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:46:34 -05:00
Jiri Pechanec
57246a246e DBZ-2891 Express send/receive semantics 2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2 DBZ-2891 Set watermark in the XStream thread 2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1 DBZ-2891 Added test case 2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2 DBZ-2855 Fix Max SCN 2021-01-27 20:13:16 -05:00
martper2
1de2736249 DBZ-2855: Missing log file error when current SCN is longer than what Long supports 2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c DBZ-2733 Fix DecimalMode for Oracle Logminer 2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13 DBZ-2980 Suggested changes 2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc DBZ-2980 Additional logging for number and type of sql operations 2021-01-26 12:58:50 -05:00
martper2
3727273d9e DBZ-2981 Debezium swallows DML exception in certain cases 2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc DBZ-2949 Guard against LAST_DDL_TIME with value of 0 2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation 2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e DBZ-2711 Implement only global minimum supplemental logging validation 2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1 DBZ-2518 Implement Scn as a domain type 2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188 DBZ-2920 Fix Logminer DML operations using continuation 2021-01-26 13:50:41 +01:00
Debezium Builder
25c6e93ed8 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:45:22 -05:00
Debezium Builder
4b6d894af0 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:45:22 -05:00
Chris Cranford
71437acda4 DBZ-2784 Suggested changes 2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664 DBZ-2784 Support date columns for Oracle Logminer
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c DBZ-2825 Fix test failures 2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8 DBZ-2825 Suggested changes 2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a DBZ-2825 Fix formatting 2021-01-06 14:15:27 +01:00
Chris Cranford
2fc25f9045 DBZ-2825 Change granularity to hours 2021-01-06 14:15:27 +01:00
Chris Cranford
7578da1322 DBZ-2825 Implement log.mining.archive.log.days 2021-01-06 14:15:27 +01:00
Chris Cranford
b0794f33ae DBZ-2825 Fix archive log support for Oracle LogMiner 2021-01-06 14:15:27 +01:00
Jiri Pechanec
a1cfd0b11a DBZ-2890 Remove SLF4J from Oracle distro 2021-01-06 09:35:27 +01:00
Chris Cranford
8d64463e57 DBZ-2849 Fix value conversion with non-compliant Avro column names 2021-01-05 12:43:49 +01:00
Chris Cranford
d0bce38efb DBZ-2859 Fix formatting 2021-01-04 14:00:11 -05:00
martper2
90e41c6fa2 DBZ-2859 Support TNS Names and full RAC connection strings 2021-01-04 13:52:28 -05:00
Chris Cranford
ca83fd0606 DBZ-2856 Fix passing connection adapter to Surefire tests 2020-12-17 11:38:18 +01:00
Debezium Builder
f1f4176f31 [maven-release-plugin] prepare for next development iteration 2020-12-16 14:18:41 -05:00
Debezium Builder
5500847e77 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:18:41 -05:00
Debezium Builder
92df4fe5d5 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:35:05 -05:00
Debezium Builder
4022898ccc [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:35:05 -05:00
Chris Cranford
10ffaaea57 DBZ-2797 Remove explicitly hardcoded tablespaces 2020-12-09 09:52:17 +01:00
Chris Cranford
61c5fbb45c DBZ-2801 Fix validation 2020-12-08 14:59:27 -05:00
Chris Cranford
848bc2609c DBZ-2801 Only require database.out.server.name for XStreams 2020-12-08 18:04:35 +01:00
Chris Cranford
5d7faf42a9 DBZ-2759 Capture all commit and rollback redo entries
The Oracle LogMiner implementation restricted the COMMIT and ROLLBACK entries
based on a subset of user accounts.  This predicate lead to situations where
some environments using these users experienced lost transactions as they
were captured by the transaction buffer and later abandoned since no matching
commit or rollback was ever detected.

The implementation now processes all COMMIT and ROLLBACK operations to make
sure that the transaction buffer is properly managed.
2020-11-20 07:24:18 +01:00
Chris Cranford
3403aa5a0e DBZ-2763 LogMiner history retention disabled by default 2020-11-20 07:17:46 +01:00
Debezium Builder
2658fa6d5e [maven-release-plugin] prepare for next development iteration 2020-11-16 15:30:33 -05:00
Debezium Builder
23644b0509 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:30:33 -05:00
Chris Cranford
5abcd4992f DBZ-2729 Suggested changes 2020-11-16 07:27:27 +01:00
Chris Cranford
a9d5985bb0 DBZ-2729 Introduce HistoryRecorder hook for custom implementations 2020-11-16 07:27:27 +01:00
Chris Cranford
4828883861 DBZ-2729 Subtle code polish
* Rework definition of new configuration options
* Add/fix some java documentation
* Use OracleConnection rather than raw JBDC connection for RAC flush connections
2020-11-16 07:27:27 +01:00
AndreyIg
83dad594b4 DBZ-2729 Implement Oracle LogMiner features/fixes
1. Oracle RAC support
2. Historical Tracking
3. Better JMX metrics
4. Mining archive logs
5. Bugfixes & minor enhancements
2020-11-16 07:27:27 +01:00
Jiri Pechanec
02fd590119 DBZ-1446 Use error code instead of exception message; elevate log message level 2020-11-11 10:17:59 +01:00
Chris Cranford
76e27c8c26 DBZ-1446 Avoid Oracle "no snapshot found based on specified time" during snapshot 2020-11-11 10:17:59 +01:00
Chris Cranford
679e3b7a92 DBZ-2679 Handle LCR events with database names with domains 2020-11-04 08:42:20 +01:00
ani-sha
33b4a39930 DBZ-2690 Remove Oracle specific changes 2020-11-04 07:20:57 +01:00
Chris Cranford
64b7df2026 DBZ-2683 Add unit test 2020-11-03 11:11:50 +01:00
mengqiu
fda628120b DBZ-2683 Support partition tables。 2020-11-03 11:11:50 +01:00
Debezium Builder
8fbd455530 [maven-release-plugin] prepare for next development iteration 2020-10-22 03:55:16 -04:00
Debezium Builder
e5460f9d5d [maven-release-plugin] prepare release v1.4.0.Alpha1 2020-10-22 03:55:16 -04:00
Chris Cranford
9232bed3a3 DBZ-2624 Avoid SQLException with LogMiner 2020-10-22 07:46:11 +02:00
Jiri Pechanec
6e39ebe9ee DBZ-2653 User rollback from parent class 2020-10-20 14:43:22 +02:00
Chris Cranford
86c1347eb2 DBZ-2629 Suggested changes 2020-10-20 14:43:22 +02:00
Chris Cranford
61be493ce1 DBZ-2629 Fix LogMiner stopping due to ORA-01013 2020-10-20 14:43:22 +02:00
Debezium Builder
1bfe162c21 [maven-release-plugin] prepare for next development iteration 2020-10-01 09:17:19 -04:00
Debezium Builder
60c9e0e778 [maven-release-plugin] prepare release v1.3.0.Final 2020-10-01 09:17:19 -04:00
Jiri Pechanec
57017140b4 DBZ-2607 Query param must not be in string 2020-10-01 07:38:00 +02:00
Gunnar Morling
d1d9e3c6fe DBZ-2607 Using prepared statement parameter 2020-09-30 10:14:10 -04:00
Chris Cranford
1adb216461 DBZ-2607 Fix NullPointerException when getting all table ids 2020-09-30 10:14:10 -04:00
Chris Cranford
6972dab987 DBZ-2555 Cleanup test assertions 2020-09-25 10:42:49 +02:00
Chris Cranford
9e730cc994 DBZ-2555 Fix LogMiner schema change event dispatch 2020-09-25 10:42:49 +02:00
Debezium Builder
a9a929c8d5 [maven-release-plugin] prepare for next development iteration 2020-09-24 05:06:09 -04:00
Debezium Builder
c14475c0ba [maven-release-plugin] prepare release v1.3.0.CR1 2020-09-24 05:06:09 -04:00
Chris Cranford
756681146f DBZ-2531 Suggested changes 2020-09-24 09:31:25 +02:00
Gunnar Morling
c8f25fbc96 DBZ-2531 Wording fix 2020-09-24 09:31:25 +02:00
Chris Cranford
aedb0b9a57 DBZ-2531 Implement connection retry for Oracle 2020-09-24 09:31:25 +02:00
Debezium Builder
dda9ba96e3 [maven-release-plugin] prepare for next development iteration 2020-09-16 12:30:21 -04:00
Debezium Builder
a14424beb4 [maven-release-plugin] prepare release v1.3.0.Beta2 2020-09-16 12:30:21 -04:00
Chris Cranford
72751a40c7 DBZ-137 More suggested fixes 2020-09-16 09:55:04 +02:00
Chris Cranford
31a6e47e90 DBZ-137 Suggested fixes 2020-09-16 09:55:04 +02:00
Chris Cranford
551264594f DBZ-137 Align to main repo changes 2020-09-16 09:55:04 +02:00
Chris Cranford
cec23ca747 DBZ-137 Introduced oracle POM property version.oracle.driver 2020-09-16 09:55:04 +02:00
Chris Cranford
d7c3f04a07 DBZ-137 Added todos and a try-with-resource blocks 2020-09-16 09:55:04 +02:00
Chris Cranford
d4b0143cdd DBZ-137 Suggested fixes 2020-09-16 09:55:04 +02:00
AndreyIg
d344ca48f8 DBZ-137 log miner oracle contribution 2020-09-16 09:55:04 +02:00
rkerner
8e8f53ce6b DBZ-2462 avoid divisive languange in incubator connectors
* apply PR feedback changes
2020-09-10 15:22:34 +02:00
rkerner
e08d7173f0 DBZ-2462 avoid divisive languange in incubator connectors 2020-09-10 15:22:34 +02:00
Debezium Builder
1add8bba02 [maven-release-plugin] prepare for next development iteration 2020-08-28 05:14:24 -04:00
Debezium Builder
ccd3db7a16 [maven-release-plugin] prepare release v1.3.0.Beta1 2020-08-28 05:14:24 -04:00
Jiri Pechanec
43995a1b06 DBZ-2423 Support default port in JDBC driver 2020-08-28 09:50:04 +02:00
Chris Cranford
2b87e8e453 DBZ-2452 Allow snapshotting tables/schemas with hyphens 2020-08-28 09:48:39 +02:00
Debezium Builder
a905cf0f8d [maven-release-plugin] prepare for next development iteration 2020-08-06 00:54:16 -04:00
Debezium Builder
5c6396cfa9 [maven-release-plugin] prepare release v1.3.0.Alpha1 2020-08-06 00:54:15 -04:00
Debezium Builder
5561e97f6d [maven-release-plugin] prepare for next development iteration 2020-07-16 04:48:24 -04:00
Debezium Builder
2e90aa90a6 [maven-release-plugin] prepare release v1.2.1.Final 2020-07-16 04:48:23 -04:00
Debezium Builder
489996089e [maven-release-plugin] prepare for next development iteration 2020-06-24 18:04:34 +02:00
Debezium Builder
a2403f6dcb [maven-release-plugin] prepare release v1.2.0.Final 2020-06-24 18:04:34 +02:00
Debezium Builder
e5a8ad6d4f [maven-release-plugin] prepare for next development iteration 2020-06-19 00:48:44 -04:00
Debezium Builder
927a99ebd0 [maven-release-plugin] prepare release v1.2.0.CR2 2020-06-19 00:48:44 -04:00
Jiri Pechanec
7ef83b059a DBZ-1916 Formatting 2020-06-18 05:53:37 +02:00
Chris Cranford
864fc7ee28 DBZ-1916 Add tests for datatype.propagate.source.type 2020-06-16 13:29:06 +02:00
Debezium Builder
27e0b22e48 [maven-release-plugin] prepare for next development iteration 2020-06-11 02:17:06 -04:00
Debezium Builder
4d8d2eddad [maven-release-plugin] prepare release v1.2.0.CR1 2020-06-11 02:17:06 -04:00
Chris Cranford
59dd2b6211 DBZ-1814 Fix compilation failures 2020-06-11 06:19:54 +02:00
Chris Cranford
56b8a68703 DBZ-775 Add tests for column masking/truncation and message key columns 2020-06-01 13:04:20 +02:00
Jiri Pechanec
2e6b13b827 DBZ-1312 Change whitelist format to schema.table ids 2020-05-22 17:16:24 +02:00
Jiri Pechanec
58e6cb02d4 DBZ-2056 Test for schema topic 2020-05-19 20:25:14 +02:00
Debezium Builder
b8d5346eba [maven-release-plugin] prepare for next development iteration 2020-05-19 03:48:59 -04:00
Debezium Builder
31bc1ffb2e [maven-release-plugin] prepare release v1.2.0.Beta2 2020-05-19 03:48:59 -04:00
Jiri Pechanec
53cf6869f3 DBZ-2088 Use POSIX tar 2020-05-18 14:30:08 +02:00
Jiri Pechanec
04cb6da78c DBZ-1904 Test for Db2 schema topic 2020-05-07 09:20:31 +02:00
Jiri Pechanec
034e66a5cd DBZ-1904 Schema history topic support 2020-05-07 09:20:31 +02:00
Jiri Pechanec
8c50678b56 DBZ-1878 Use Oracle driver from central 2020-04-23 14:23:22 +02:00
Debezium Builder
73c5b71b5d [maven-release-plugin] prepare for next development iteration 2020-04-16 02:28:09 -04:00
Debezium Builder
4ac17380cd [maven-release-plugin] prepare release v1.2.0.Alpha1 2020-04-16 02:28:09 -04:00
Chris Cranford
644c84b3b1
DBZ-1859 Adjusting to changed ChangeEventSourceCoordinator constructor 2020-04-15 16:41:55 +02:00
Jiri Pechanec
9546b56254 DBZ-1905 Validate database history topic 2020-04-14 12:40:38 +02:00
Grant Cooksey
084df1a2c0
DBZ-1942 Oracle connector integration tests poll JMX
The oracle integration tests use a number of Thread.sleep() calls to wait for
the snapshotting phase to finish before testing streaming changes but sometimes
this can be unreliable, especially on a slow running db. Instead of sleeping,
polling the jmx metrics to watch for when the snapshot phase ends is preferable.
2020-04-07 11:08:30 +02:00
Gunnar Morling
82d7103acf DBZ-1898 🗑️ Removing unused class SnapshotChangeRecordEmitter 2020-03-25 13:14:09 +01:00
Debezium Builder
8abab70642 [maven-release-plugin] prepare for next development iteration 2020-03-24 01:29:05 -04:00
Debezium Builder
d1b3504262 [maven-release-plugin] prepare release v1.1.0.Final 2020-03-24 01:29:04 -04:00
Gunnar Morling
d23676a7fb DBZ-1863 Centralizing coordinator shutdown 2020-03-12 11:30:14 +01:00
Debezium Builder
cc0edc10c3 [maven-release-plugin] prepare for next development iteration 2020-03-11 10:04:53 -04:00
Debezium Builder
6363404aa5 [maven-release-plugin] prepare release v1.1.0.CR1 2020-03-11 10:04:53 -04:00
Gunnar Morling
f290606633 DBZ-1723 Adjusting to changes in BaseSourceTask 2020-03-11 14:05:28 +01:00
Chris Cranford
e84db3030b DBZ-1726 RelationalSnapshotChangeEventSource API changes 2020-03-11 10:44:01 +01:00
Gunnar Morling
c01d74140e DBZ-1134 Passing converter registry for Db2 and Oracle 2020-03-05 09:47:42 +01:00
Jiri Pechanec
0c7d6ec950 DBZ-1760 Allow skipping of invalid events 2020-02-25 10:47:01 +01:00
Debezium Builder
5456cc5de7 [maven-release-plugin] prepare for next development iteration 2020-02-13 03:26:00 -05:00
Debezium Builder
78ad0fcae1 [maven-release-plugin] prepare release v1.1.0.Beta2 2020-02-13 03:26:00 -05:00
Gunnar Morling
f5704322cc DBZ-1766 Unifying handling of offset commits; updating lastOffset to commit only after a record is committed 2020-02-12 15:45:31 +01:00
Debezium Builder
92a5004320 [maven-release-plugin] prepare for next development iteration 2020-02-05 09:08:24 -05:00
Debezium Builder
c0a65fc74d [maven-release-plugin] prepare release v1.1.0.Beta1 2020-02-05 09:08:24 -05:00
Jiri Pechanec
1d829982f0 DBZ-1052 Transaction metadata for Oracle 2020-02-04 10:00:55 +01:00
Debezium Builder
d23a1d4cea [maven-release-plugin] prepare for next development iteration 2020-01-16 05:46:13 -05:00
Debezium Builder
e4d664506d [maven-release-plugin] prepare release v1.1.0.Alpha1 2020-01-16 05:46:13 -05:00
Jiri Pechanec
153aa27ff6 DBZ-1552 Support for decimal mode in Oracle config 2020-01-06 10:21:58 +01:00
Debezium Builder
bdcaf2b8c1 [maven-release-plugin] prepare for next development iteration 2019-12-18 01:51:04 -05:00
Debezium Builder
b5493832bf [maven-release-plugin] prepare release v1.0.0.Final 2019-12-18 01:51:04 -05:00
Debezium Builder
4853d37254 [maven-release-plugin] prepare for next development iteration 2019-12-10 06:44:22 -05:00
Debezium Builder
bde9bb33f0 [maven-release-plugin] prepare release v1.0.0.CR1 2019-12-10 06:44:21 -05:00
Gunnar Morling
5e490d4394 DBZ-585 Renaming 'initial_schema_only' snapshot mode for Oracle into 'schema_only' 2019-12-10 09:05:55 +01:00
sheldon.fuchs
1d3a7760a3 DBZ-1631 - alter select to perform timestamp_to_scn on most recent ddl instead of attemping on all 2019-12-04 12:18:11 +01:00
Jiri Pechanec
f1de1eff33 DBZ-825 Unify decimal upscaling 2019-11-22 12:45:25 +01:00
Debezium Builder
d25f5a7cf1 [maven-release-plugin] prepare for next development iteration 2019-11-14 03:01:41 -05:00
Debezium Builder
b7a46dd8bc [maven-release-plugin] prepare release v1.0.0.Beta3 2019-11-14 03:01:41 -05:00