Commit Graph

377 Commits

Author SHA1 Message Date
Chris Cranford
db64e1092c DBZ-3151 Fix NullPointerException with Pattern matching 2021-02-23 15:02:49 +01:00
Chris Cranford
013b24e3f8 DBZ-3165 Fix test failure 2021-02-23 15:02:49 +01:00
Chris Cranford
49f8f5d70c DBZ-3009 Suggested changes
* Fixed prior commit mistake with log.mining.strategy default
* Added comment on excluded schema logic when building LogMiner query
2021-02-23 12:29:20 +01:00
Chris Cranford
fde3d2ff81 DBZ-3009 Exclude system schemas in LogMiner session queries 2021-02-23 12:29:20 +01:00
Chris Cranford
514c513f96 DBZ-3009 Fix tests compatibility w/Xstream 2021-02-23 12:29:20 +01:00
Chris Cranford
461b784974 DBZ-3009 Support multiple schemas with Oracle LogMiner 2021-02-23 12:29:20 +01:00
Chris Cranford
85cfdd2236 DBZ-3034 Remove build deprecation warnings 2021-02-23 10:52:49 +01:00
Chris Cranford
a9d3b889ee DBZ-3119 Implement Config validation 2021-02-22 20:00:11 +01:00
Chris Cranford
2727b151fc DBZ-3165 Remove dependency on JAXB 2021-02-22 18:37:30 +01:00
Chris Cranford
556886b522 DBZ-3151 Use pattern for SYS_NC_OID$, SYS_NC_ROWINFO$, and SYS_NCnnnnn$ names 2021-02-22 15:23:18 +01:00
Chris Cranford
f962524de7 DBZ-3151 Properly handle system-generated hidden column unique indexes 2021-02-22 15:23:18 +01:00
Chris Cranford
738b365bc5 DBZ-3109 Account for multiple log group types 2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd DBZ-3078 Use max.queue.size for fetch size 2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776 DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61 DBZ-3078 Connector adjustments for new DML parser 2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218 DBZ-3078 Initial implementation of FastDmlParser 2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start 2021-02-19 19:03:45 +01:00
Chris Cranford
88b2f73842 DBZ-3001 Do not resolve database version lazily 2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05 DBZ-3001 Control MAX Scn for LogMiner based on Oracle version 2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7 DBZ-3110 Introduce RequireDatabaseOption test annotation 2021-02-19 17:01:25 +01:00
Chris Cranford
304f38e15a DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler 2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c DBZ-3090 Commit events in same thread that processes results for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad DBZ-3090 Fix emitting transaction end event for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2 DBZ-2754 Fix test failures 2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799 DBZ-2754 Fix test compilation failures 2021-02-17 20:11:01 -05:00
Gunnar Morling
0980492bb0 DBZ-2754 Using Duration instead of long for durations 2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487 DBZ-2754 Add log.mining.transaction.retention.hours config option 2021-02-17 12:13:16 +01:00
Chris Cranford
d3a51a1080 DBZ-3057 Provide table filters to reading of database schemas 2021-02-16 09:41:36 +01:00
Chris Cranford
3fd64f5827 DBZ-3057 Fix reading table unique indices with non-quoted table names 2021-02-16 09:41:36 +01:00
Debezium Builder
279a19bfd0 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:32:03 -05:00
Debezium Builder
68dd5b92e9 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:32:03 -05:00
Debezium Builder
57317b894c [maven-release-plugin] prepare for next development iteration 2021-02-05 00:20:36 -05:00
Debezium Builder
4816f3a539 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-05 00:20:36 -05:00
Chris Cranford
933ca55b74 DBZ-3055 Use JdbcConnection#query instead 2021-02-05 05:42:59 +01:00
Chris Cranford
e973c11818 DBZ-3055 Capture table state when LogMiner session fails 2021-02-05 05:42:59 +01:00
Chris Cranford
ccb2329e99 DBZ-2999 Fix double execution of LogMiner session 2021-02-04 16:14:14 -05:00
Chris Cranford
15e78f66bc DBZ-2939 Added ORA-01333 as valid retriable exception 2021-02-04 06:07:43 +01:00
Chris Cranford
fffe1fb6ea DBZ-2980 Fix logging parameters 2021-02-03 18:09:40 -05:00
Chris Cranford
d56fc5b2bd DBZ-2982 Fix LogMinerMetrics bean registration 2021-02-03 18:08:25 -05:00
Chris Cranford
a9d514588c DBZ-2999 Standardize casing for LogMiner 2021-02-03 13:01:23 -05:00
Chris Cranford
760915eab6 DBZ-2999 Log SCN ranges for Redo and Archive logs 2021-02-03 13:01:23 -05:00
Chris Cranford
5da2d4b91f DBZ-2999 Capture V$LOGMNR_LOG contents upon ORA-01291 exception 2021-02-03 13:01:23 -05:00
Chris Cranford
58985e0c90 DBZ-2999 Few more logging improvements 2021-02-03 13:01:23 -05:00
Chris Cranford
01ece5cbdb DBZ-2999 Fix unnecessary logging of current redo logs 2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053 DBZ-2999 Improve Logminer logging 2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1 DBZ-2982 Suggested changes 2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a DBZ-2982 Fix formatting 2021-02-03 11:45:20 -05:00
mpermar
76a518334a DBZ-2982 Add suffix to log mining properties and proper Duration type 2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1 DBZ-2982 Remove trailing space
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05 DBZ-2982 Add some additional logging on sleep time and batch sizing 2021-02-03 11:45:20 -05:00
mpermar
c442f478cb DBZ-2982 Allow to customize log mining properties 2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8 DBZ-2420 Use custom Oracle connector validation for database.hostname 2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig 2021-02-03 11:10:57 -05:00
Debezium Builder
4c84157e6d [maven-release-plugin] prepare for next development iteration 2021-01-28 07:46:34 -05:00
Debezium Builder
1ba7253981 [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:46:34 -05:00
Jiri Pechanec
57246a246e DBZ-2891 Express send/receive semantics 2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2 DBZ-2891 Set watermark in the XStream thread 2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1 DBZ-2891 Added test case 2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2 DBZ-2855 Fix Max SCN 2021-01-27 20:13:16 -05:00
martper2
1de2736249 DBZ-2855: Missing log file error when current SCN is longer than what Long supports 2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c DBZ-2733 Fix DecimalMode for Oracle Logminer 2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13 DBZ-2980 Suggested changes 2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc DBZ-2980 Additional logging for number and type of sql operations 2021-01-26 12:58:50 -05:00
martper2
3727273d9e DBZ-2981 Debezium swallows DML exception in certain cases 2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc DBZ-2949 Guard against LAST_DDL_TIME with value of 0 2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation 2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e DBZ-2711 Implement only global minimum supplemental logging validation 2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1 DBZ-2518 Implement Scn as a domain type 2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188 DBZ-2920 Fix Logminer DML operations using continuation 2021-01-26 13:50:41 +01:00
Debezium Builder
25c6e93ed8 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:45:22 -05:00
Debezium Builder
4b6d894af0 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:45:22 -05:00
Chris Cranford
71437acda4 DBZ-2784 Suggested changes 2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664 DBZ-2784 Support date columns for Oracle Logminer
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c DBZ-2825 Fix test failures 2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8 DBZ-2825 Suggested changes 2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a DBZ-2825 Fix formatting 2021-01-06 14:15:27 +01:00
Chris Cranford
2fc25f9045 DBZ-2825 Change granularity to hours 2021-01-06 14:15:27 +01:00
Chris Cranford
7578da1322 DBZ-2825 Implement log.mining.archive.log.days 2021-01-06 14:15:27 +01:00
Chris Cranford
b0794f33ae DBZ-2825 Fix archive log support for Oracle LogMiner 2021-01-06 14:15:27 +01:00
Jiri Pechanec
a1cfd0b11a DBZ-2890 Remove SLF4J from Oracle distro 2021-01-06 09:35:27 +01:00
Chris Cranford
8d64463e57 DBZ-2849 Fix value conversion with non-compliant Avro column names 2021-01-05 12:43:49 +01:00
Chris Cranford
d0bce38efb DBZ-2859 Fix formatting 2021-01-04 14:00:11 -05:00
martper2
90e41c6fa2 DBZ-2859 Support TNS Names and full RAC connection strings 2021-01-04 13:52:28 -05:00
Chris Cranford
ca83fd0606 DBZ-2856 Fix passing connection adapter to Surefire tests 2020-12-17 11:38:18 +01:00
Debezium Builder
f1f4176f31 [maven-release-plugin] prepare for next development iteration 2020-12-16 14:18:41 -05:00
Debezium Builder
5500847e77 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:18:41 -05:00
Debezium Builder
92df4fe5d5 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:35:05 -05:00
Debezium Builder
4022898ccc [maven-release-plugin] prepare release v1.4.0.Beta1 2020-12-10 00:35:05 -05:00
Chris Cranford
10ffaaea57 DBZ-2797 Remove explicitly hardcoded tablespaces 2020-12-09 09:52:17 +01:00
Chris Cranford
61c5fbb45c DBZ-2801 Fix validation 2020-12-08 14:59:27 -05:00
Chris Cranford
848bc2609c DBZ-2801 Only require database.out.server.name for XStreams 2020-12-08 18:04:35 +01:00
Chris Cranford
5d7faf42a9 DBZ-2759 Capture all commit and rollback redo entries
The Oracle LogMiner implementation restricted the COMMIT and ROLLBACK entries
based on a subset of user accounts.  This predicate lead to situations where
some environments using these users experienced lost transactions as they
were captured by the transaction buffer and later abandoned since no matching
commit or rollback was ever detected.

The implementation now processes all COMMIT and ROLLBACK operations to make
sure that the transaction buffer is properly managed.
2020-11-20 07:24:18 +01:00
Chris Cranford
3403aa5a0e DBZ-2763 LogMiner history retention disabled by default 2020-11-20 07:17:46 +01:00
Debezium Builder
2658fa6d5e [maven-release-plugin] prepare for next development iteration 2020-11-16 15:30:33 -05:00
Debezium Builder
23644b0509 [maven-release-plugin] prepare release v1.4.0.Alpha2 2020-11-16 15:30:33 -05:00
Chris Cranford
5abcd4992f DBZ-2729 Suggested changes 2020-11-16 07:27:27 +01:00
Chris Cranford
a9d5985bb0 DBZ-2729 Introduce HistoryRecorder hook for custom implementations 2020-11-16 07:27:27 +01:00
Chris Cranford
4828883861 DBZ-2729 Subtle code polish
* Rework definition of new configuration options
* Add/fix some java documentation
* Use OracleConnection rather than raw JBDC connection for RAC flush connections
2020-11-16 07:27:27 +01:00
AndreyIg
83dad594b4 DBZ-2729 Implement Oracle LogMiner features/fixes
1. Oracle RAC support
2. Historical Tracking
3. Better JMX metrics
4. Mining archive logs
5. Bugfixes & minor enhancements
2020-11-16 07:27:27 +01:00
Jiri Pechanec
02fd590119 DBZ-1446 Use error code instead of exception message; elevate log message level 2020-11-11 10:17:59 +01:00