Commit Graph

204 Commits

Author SHA1 Message Date
Chris Cranford
bb24606188 DBZ-2920 Fix Logminer DML operations using continuation 2021-01-26 13:50:41 +01:00
Chris Cranford
71437acda4 DBZ-2784 Suggested changes 2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664 DBZ-2784 Support date columns for Oracle Logminer
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c DBZ-2825 Fix test failures 2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8 DBZ-2825 Suggested changes 2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a DBZ-2825 Fix formatting 2021-01-06 14:15:27 +01:00
Chris Cranford
2fc25f9045 DBZ-2825 Change granularity to hours 2021-01-06 14:15:27 +01:00
Chris Cranford
7578da1322 DBZ-2825 Implement log.mining.archive.log.days 2021-01-06 14:15:27 +01:00
Chris Cranford
b0794f33ae DBZ-2825 Fix archive log support for Oracle LogMiner 2021-01-06 14:15:27 +01:00
Chris Cranford
8d64463e57 DBZ-2849 Fix value conversion with non-compliant Avro column names 2021-01-05 12:43:49 +01:00
Chris Cranford
d0bce38efb DBZ-2859 Fix formatting 2021-01-04 14:00:11 -05:00
martper2
90e41c6fa2 DBZ-2859 Support TNS Names and full RAC connection strings 2021-01-04 13:52:28 -05:00
Chris Cranford
ca83fd0606 DBZ-2856 Fix passing connection adapter to Surefire tests 2020-12-17 11:38:18 +01:00
Chris Cranford
10ffaaea57 DBZ-2797 Remove explicitly hardcoded tablespaces 2020-12-09 09:52:17 +01:00
Chris Cranford
61c5fbb45c DBZ-2801 Fix validation 2020-12-08 14:59:27 -05:00
Chris Cranford
848bc2609c DBZ-2801 Only require database.out.server.name for XStreams 2020-12-08 18:04:35 +01:00
Chris Cranford
5d7faf42a9 DBZ-2759 Capture all commit and rollback redo entries
The Oracle LogMiner implementation restricted the COMMIT and ROLLBACK entries
based on a subset of user accounts.  This predicate lead to situations where
some environments using these users experienced lost transactions as they
were captured by the transaction buffer and later abandoned since no matching
commit or rollback was ever detected.

The implementation now processes all COMMIT and ROLLBACK operations to make
sure that the transaction buffer is properly managed.
2020-11-20 07:24:18 +01:00
Chris Cranford
3403aa5a0e DBZ-2763 LogMiner history retention disabled by default 2020-11-20 07:17:46 +01:00
Chris Cranford
5abcd4992f DBZ-2729 Suggested changes 2020-11-16 07:27:27 +01:00
Chris Cranford
a9d5985bb0 DBZ-2729 Introduce HistoryRecorder hook for custom implementations 2020-11-16 07:27:27 +01:00
Chris Cranford
4828883861 DBZ-2729 Subtle code polish
* Rework definition of new configuration options
* Add/fix some java documentation
* Use OracleConnection rather than raw JBDC connection for RAC flush connections
2020-11-16 07:27:27 +01:00
AndreyIg
83dad594b4 DBZ-2729 Implement Oracle LogMiner features/fixes
1. Oracle RAC support
2. Historical Tracking
3. Better JMX metrics
4. Mining archive logs
5. Bugfixes & minor enhancements
2020-11-16 07:27:27 +01:00
Jiri Pechanec
02fd590119 DBZ-1446 Use error code instead of exception message; elevate log message level 2020-11-11 10:17:59 +01:00
Chris Cranford
76e27c8c26 DBZ-1446 Avoid Oracle "no snapshot found based on specified time" during snapshot 2020-11-11 10:17:59 +01:00
Chris Cranford
679e3b7a92 DBZ-2679 Handle LCR events with database names with domains 2020-11-04 08:42:20 +01:00
ani-sha
33b4a39930 DBZ-2690 Remove Oracle specific changes 2020-11-04 07:20:57 +01:00
Chris Cranford
64b7df2026 DBZ-2683 Add unit test 2020-11-03 11:11:50 +01:00
mengqiu
fda628120b DBZ-2683 Support partition tables。 2020-11-03 11:11:50 +01:00
Chris Cranford
9232bed3a3 DBZ-2624 Avoid SQLException with LogMiner 2020-10-22 07:46:11 +02:00
Jiri Pechanec
6e39ebe9ee DBZ-2653 User rollback from parent class 2020-10-20 14:43:22 +02:00
Chris Cranford
86c1347eb2 DBZ-2629 Suggested changes 2020-10-20 14:43:22 +02:00
Chris Cranford
61be493ce1 DBZ-2629 Fix LogMiner stopping due to ORA-01013 2020-10-20 14:43:22 +02:00
Jiri Pechanec
57017140b4 DBZ-2607 Query param must not be in string 2020-10-01 07:38:00 +02:00
Gunnar Morling
d1d9e3c6fe DBZ-2607 Using prepared statement parameter 2020-09-30 10:14:10 -04:00
Chris Cranford
1adb216461 DBZ-2607 Fix NullPointerException when getting all table ids 2020-09-30 10:14:10 -04:00
Chris Cranford
6972dab987 DBZ-2555 Cleanup test assertions 2020-09-25 10:42:49 +02:00
Chris Cranford
9e730cc994 DBZ-2555 Fix LogMiner schema change event dispatch 2020-09-25 10:42:49 +02:00
Chris Cranford
756681146f DBZ-2531 Suggested changes 2020-09-24 09:31:25 +02:00
Gunnar Morling
c8f25fbc96 DBZ-2531 Wording fix 2020-09-24 09:31:25 +02:00
Chris Cranford
aedb0b9a57 DBZ-2531 Implement connection retry for Oracle 2020-09-24 09:31:25 +02:00
Chris Cranford
72751a40c7 DBZ-137 More suggested fixes 2020-09-16 09:55:04 +02:00
Chris Cranford
31a6e47e90 DBZ-137 Suggested fixes 2020-09-16 09:55:04 +02:00
Chris Cranford
551264594f DBZ-137 Align to main repo changes 2020-09-16 09:55:04 +02:00
Chris Cranford
d7c3f04a07 DBZ-137 Added todos and a try-with-resource blocks 2020-09-16 09:55:04 +02:00
Chris Cranford
d4b0143cdd DBZ-137 Suggested fixes 2020-09-16 09:55:04 +02:00
AndreyIg
d344ca48f8 DBZ-137 log miner oracle contribution 2020-09-16 09:55:04 +02:00
rkerner
8e8f53ce6b DBZ-2462 avoid divisive languange in incubator connectors
* apply PR feedback changes
2020-09-10 15:22:34 +02:00
rkerner
e08d7173f0 DBZ-2462 avoid divisive languange in incubator connectors 2020-09-10 15:22:34 +02:00
Jiri Pechanec
43995a1b06 DBZ-2423 Support default port in JDBC driver 2020-08-28 09:50:04 +02:00
Chris Cranford
2b87e8e453 DBZ-2452 Allow snapshotting tables/schemas with hyphens 2020-08-28 09:48:39 +02:00
Jiri Pechanec
7ef83b059a DBZ-1916 Formatting 2020-06-18 05:53:37 +02:00
Chris Cranford
864fc7ee28 DBZ-1916 Add tests for datatype.propagate.source.type 2020-06-16 13:29:06 +02:00
Chris Cranford
59dd2b6211 DBZ-1814 Fix compilation failures 2020-06-11 06:19:54 +02:00
Chris Cranford
56b8a68703 DBZ-775 Add tests for column masking/truncation and message key columns 2020-06-01 13:04:20 +02:00
Jiri Pechanec
2e6b13b827 DBZ-1312 Change whitelist format to schema.table ids 2020-05-22 17:16:24 +02:00
Jiri Pechanec
58e6cb02d4 DBZ-2056 Test for schema topic 2020-05-19 20:25:14 +02:00
Jiri Pechanec
04cb6da78c DBZ-1904 Test for Db2 schema topic 2020-05-07 09:20:31 +02:00
Jiri Pechanec
034e66a5cd DBZ-1904 Schema history topic support 2020-05-07 09:20:31 +02:00
Chris Cranford
644c84b3b1
DBZ-1859 Adjusting to changed ChangeEventSourceCoordinator constructor 2020-04-15 16:41:55 +02:00
Jiri Pechanec
9546b56254 DBZ-1905 Validate database history topic 2020-04-14 12:40:38 +02:00
Grant Cooksey
084df1a2c0
DBZ-1942 Oracle connector integration tests poll JMX
The oracle integration tests use a number of Thread.sleep() calls to wait for
the snapshotting phase to finish before testing streaming changes but sometimes
this can be unreliable, especially on a slow running db. Instead of sleeping,
polling the jmx metrics to watch for when the snapshot phase ends is preferable.
2020-04-07 11:08:30 +02:00
Gunnar Morling
82d7103acf DBZ-1898 🗑️ Removing unused class SnapshotChangeRecordEmitter 2020-03-25 13:14:09 +01:00
Gunnar Morling
d23676a7fb DBZ-1863 Centralizing coordinator shutdown 2020-03-12 11:30:14 +01:00
Gunnar Morling
f290606633 DBZ-1723 Adjusting to changes in BaseSourceTask 2020-03-11 14:05:28 +01:00
Chris Cranford
e84db3030b DBZ-1726 RelationalSnapshotChangeEventSource API changes 2020-03-11 10:44:01 +01:00
Gunnar Morling
c01d74140e DBZ-1134 Passing converter registry for Db2 and Oracle 2020-03-05 09:47:42 +01:00
Jiri Pechanec
0c7d6ec950 DBZ-1760 Allow skipping of invalid events 2020-02-25 10:47:01 +01:00
Gunnar Morling
f5704322cc DBZ-1766 Unifying handling of offset commits; updating lastOffset to commit only after a record is committed 2020-02-12 15:45:31 +01:00
Jiri Pechanec
1d829982f0 DBZ-1052 Transaction metadata for Oracle 2020-02-04 10:00:55 +01:00
Jiri Pechanec
153aa27ff6 DBZ-1552 Support for decimal mode in Oracle config 2020-01-06 10:21:58 +01:00
Gunnar Morling
5e490d4394 DBZ-585 Renaming 'initial_schema_only' snapshot mode for Oracle into 'schema_only' 2019-12-10 09:05:55 +01:00
sheldon.fuchs
1d3a7760a3 DBZ-1631 - alter select to perform timestamp_to_scn on most recent ddl instead of attemping on all 2019-12-04 12:18:11 +01:00
Jiri Pechanec
f1de1eff33 DBZ-825 Unify decimal upscaling 2019-11-22 12:45:25 +01:00
Jiri Pechanec
99ee249cd5 DBZ-1555 TableId parts precedence is configurable 2019-11-12 16:43:28 -05:00
Jiri Pechanec
4f9e9a94ca DBZ-1392 Reformat Oracle plugin 2019-11-08 14:22:32 +01:00
Jiri Pechanec
4526c244ef DBZ-1569 Test inaccessible no-PK table 2019-11-08 12:53:05 +01:00
Jiri Pechanec
ed4210abdf Fix whitespaces 2019-10-08 11:14:53 +02:00
Chris Cranford
1437fc48bc DBZ-1391 Do not allow code after closing brace 2019-10-02 20:45:28 +02:00
Gunnar Morling
b8cd549f2e DBZ-1015 Key mapper support for Oracle 2019-09-26 15:03:51 +03:00
Gunnar Morling
345252880e DBZ-1497 Adjusting to changed INTERVAL type mapping 2019-09-26 15:03:51 +03:00
Chris Cranford
dcb62e4e18 DBZ-1044 Sanitize column/topic names to always be valid AVRO names 2019-09-23 17:14:35 +02:00
Gunnar Morling
85f00dd902 DBZ-777 Adjusting to changed SPI 2019-08-16 08:28:22 +02:00
Jiri Pechanec
796c0933b0 DBZ-777 Snapshot event metadata set in common snapshot source 2019-08-16 08:28:22 +02:00
Jiri Pechanec
f9daa53a21 DBZ-1356 Define contextName 2019-07-02 15:25:06 +02:00
Jiri Pechanec
0154af0e38 DBZ-1356 Metrics for schema history 2019-07-02 15:25:06 +02:00
Gunnar Morling
5e89dcd0e0 DBZ-1317 Removing redundant method 2019-06-13 14:38:46 +02:00
Gunnar Morling
540b50d406 DBZ-835 Adding @FixFor annotation 2019-06-13 12:42:16 +02:00
Jiri Pechanec
bf033e6fc8 DBZ-835 Test for no tombstone 2019-06-13 10:24:46 +02:00
Jiri Pechanec
9b57b3f2da DBZ-1242 Align API call 2019-06-11 12:47:47 +02:00
Gunnar Morling
641fc21179 DBZ-1283 Ensuring DB history topic name and server name don't conflict 2019-06-03 10:58:10 +02:00
Jiri Pechanec
dc76aa4ea2 DBZ-1295 3state snapshot for Oracle 2019-05-31 10:59:08 +02:00
Jiri Pechanec
0fe886257a DBZ-1235 Source info schema assertion 2019-05-28 11:44:03 +02:00
Jiri Pechanec
2f42bd74d2 DBZ-1235 Oracle converted to use source info maker 2019-05-28 11:44:03 +02:00
Gunnar Morling
f6ece2a76a DBZ-212 Adding missing import 2019-05-02 09:36:06 +02:00
Jiri Pechanec
fcbe26d1f8 DBZ-1223 Use LCR position as the record offset 2019-05-02 09:26:27 +02:00
krizhan
89be9a0e55 DBZ-212 Refactored LOGICAL_NAME to Parent Abstract Class 2019-04-23 12:31:17 +02:00
Jiri Pechanec
5c490dc933 DBZ-362 Fix checkstyle whitespace violations 2019-03-28 10:34:20 +01:00
Jiri Pechanec
7df543ce5d DBZ-137 Make parser to handle cas-insentive id names 2019-03-25 10:32:18 +01:00
ignatan
27c6f3816d DBZ-137 implement Oracle DDL Antlr parser 2019-03-25 10:32:18 +01:00
Jiri Pechanec
5bdea0394d DBZ-1039 Ifs without braces are not allowed 2019-03-25 10:25:10 +01:00