Commit Graph

298 Commits

Author SHA1 Message Date
Chris Cranford
043e07a33a DBZ-3145 Introduce LogFile implementation 2021-03-12 08:00:06 +01:00
Chris Cranford
858cfbcb7a DBZ-3145 Removed unused code & irrelevant todo 2021-03-12 08:00:06 +01:00
Chris Cranford
8bf8a7d40a DBZ-3145 Use Scn domain type rather than long 2021-03-12 08:00:06 +01:00
Chris Cranford
bb90d68903 DBZ-3145 Do not rely on Oracle version-specific max SCN values 2021-03-12 08:00:06 +01:00
Jiri Pechanec
0b12e8a02c [release] Prevents NPE as parent method is not called 2021-03-11 08:58:06 +01:00
Jiri Pechanec
457598914d DBZ-3258 Parse space in table name 2021-03-11 08:01:25 +01:00
Gunnar Morling
e0c651395d DBZ-3141 Comment fix 2021-03-10 19:12:34 +01:00
Jiri Pechanec
de0d540a9f DBZ-3141 Change schema signal for Oracle 2021-03-10 19:12:34 +01:00
Chris Cranford
09fa9d38ab DBZ-3235 Do not fail parsing Oracle LogMiner SQL without a WHERE-clause 2021-03-09 07:22:12 +01:00
Chris Cranford
efc735d55c DBZ-3241 Use LogMiner adapter as default for Oracle connector 2021-03-06 10:33:43 +01:00
Chris Cranford
5f0e09d0b8 DBZ-3242 Fix test failure 2021-03-05 17:55:18 -05:00
Chris Cranford
b98dae6436 DBZ-3242 Disable log.mining.transaction.retention.hours by default
* Default value `0` disables the check
* Any negative value will show a configuration problem
* Any positive value over `0` will enable the retention check
2021-03-05 18:14:23 +01:00
Chris Cranford
8a7276cebc DBZ-3219 Fix column include/exclude support for Oracle 2021-03-05 10:35:00 +01:00
Chris Cranford
b0092dcfb4 DBZ-3190 Deprecate database.tablename.case.insensitive option
* Option deprecated
* If provided, value continues to be used with warning logged
* If not provided, value will be resolved by database version
2021-03-05 10:17:40 +01:00
Chris Cranford
8854a5c1a6 DBZ-3237 Cleanup test method artifacts 2021-03-05 09:12:32 +01:00
Chris Cranford
be80834838 DBZ-3208 Fix regression with Oracle XStreams 2021-03-04 20:33:08 +01:00
Chris Cranford
3dd0626e9f DBZ-3154 Updated README, Suggested changes 2021-03-02 17:24:33 +01:00
Chris Cranford
f0bdc22714 DBZ-3154 Use constant references 2021-03-02 17:24:33 +01:00
Chris Cranford
61cfe48b56 DBZ-3154 Update test suite to run in CDB & non-CDB modes. 2021-03-02 17:24:33 +01:00
Chris Cranford
8ac227b59c DBZ-3128 Revert fix for DBZ-2679. 2021-03-02 14:10:40 +01:00
Chris Cranford
1ed51fe1f9 DBZ-3208 Don't emit NUMBER(1) as boolean types
* NUMBER(1) column types emit as numeric
* Added OOTB converter, NumberOneToBooleanConverter
2021-03-02 09:05:41 +01:00
Chris Cranford
4d1d9bafee DBZ-3036 Detect and skip Oracle IOT special tables 2021-02-26 08:11:44 +01:00
Chris Cranford
ddb1498d1d DBZ-3194 Allow ORA-01284 errors to be retried 2021-02-26 08:08:38 +01:00
Chris Cranford
addec8f8a3 DBZ-3200 Fix potential division-by-zero with CommitThroughput metric 2021-02-26 08:07:35 +01:00
Chris Cranford
07322485b6 DBZ-3193 Fix IndexOutOfBoundsException with "IS NULL" predicate 2021-02-25 23:04:24 +01:00
Chris Cranford
2d919288f8 DBZ-3038 Fix LogMinerMetricsTest failure 2021-02-25 07:41:44 -05:00
Chris Cranford
8463249803 DBZ-3038 Fix LogMinerMetricsTest failure 2021-02-25 07:38:35 -05:00
Chris Cranford
2dedf1e27a DBZ-3038 Capture additional LogMiner JMX Metrics
* Min/Max duration to start a mining session
* Min/Max number of logs mined in a given session
* Min/Max duration of a mining batch loop
* Some metrics cleanup
2021-02-25 11:42:12 +01:00
Chris Cranford
879449d1c3 DBZ-2875 Start streaming LogMiner changes after offset SCN 2021-02-25 11:37:59 +01:00
Chris Cranford
63358d12b5 DBZ-3167 Add tests for column include/exclude & legacy options 2021-02-23 17:26:38 +01:00
Chris Cranford
8708817fdf DBZ-3167 Removed column.blacklist, cleaned up config definition 2021-02-23 17:26:38 +01:00
Jiri Pechanec
717278ac71 DBZ-3172 Convert NUMBER to boolean 2021-02-23 11:15:01 -05:00
Chris Cranford
db64e1092c DBZ-3151 Fix NullPointerException with Pattern matching 2021-02-23 15:02:49 +01:00
Chris Cranford
013b24e3f8 DBZ-3165 Fix test failure 2021-02-23 15:02:49 +01:00
Chris Cranford
49f8f5d70c DBZ-3009 Suggested changes
* Fixed prior commit mistake with log.mining.strategy default
* Added comment on excluded schema logic when building LogMiner query
2021-02-23 12:29:20 +01:00
Chris Cranford
fde3d2ff81 DBZ-3009 Exclude system schemas in LogMiner session queries 2021-02-23 12:29:20 +01:00
Chris Cranford
514c513f96 DBZ-3009 Fix tests compatibility w/Xstream 2021-02-23 12:29:20 +01:00
Chris Cranford
461b784974 DBZ-3009 Support multiple schemas with Oracle LogMiner 2021-02-23 12:29:20 +01:00
Chris Cranford
85cfdd2236 DBZ-3034 Remove build deprecation warnings 2021-02-23 10:52:49 +01:00
Chris Cranford
a9d3b889ee DBZ-3119 Implement Config validation 2021-02-22 20:00:11 +01:00
Chris Cranford
2727b151fc DBZ-3165 Remove dependency on JAXB 2021-02-22 18:37:30 +01:00
Chris Cranford
556886b522 DBZ-3151 Use pattern for SYS_NC_OID$, SYS_NC_ROWINFO$, and SYS_NCnnnnn$ names 2021-02-22 15:23:18 +01:00
Chris Cranford
f962524de7 DBZ-3151 Properly handle system-generated hidden column unique indexes 2021-02-22 15:23:18 +01:00
Chris Cranford
738b365bc5 DBZ-3109 Account for multiple log group types 2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd DBZ-3078 Use max.queue.size for fetch size 2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776 DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61 DBZ-3078 Connector adjustments for new DML parser 2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218 DBZ-3078 Initial implementation of FastDmlParser 2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start 2021-02-19 19:03:45 +01:00
Chris Cranford
88b2f73842 DBZ-3001 Do not resolve database version lazily 2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05 DBZ-3001 Control MAX Scn for LogMiner based on Oracle version 2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7 DBZ-3110 Introduce RequireDatabaseOption test annotation 2021-02-19 17:01:25 +01:00
Chris Cranford
304f38e15a DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler 2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c DBZ-3090 Commit events in same thread that processes results for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad DBZ-3090 Fix emitting transaction end event for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2 DBZ-2754 Fix test failures 2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799 DBZ-2754 Fix test compilation failures 2021-02-17 20:11:01 -05:00
Gunnar Morling
0980492bb0 DBZ-2754 Using Duration instead of long for durations 2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487 DBZ-2754 Add log.mining.transaction.retention.hours config option 2021-02-17 12:13:16 +01:00
Chris Cranford
d3a51a1080 DBZ-3057 Provide table filters to reading of database schemas 2021-02-16 09:41:36 +01:00
Chris Cranford
3fd64f5827 DBZ-3057 Fix reading table unique indices with non-quoted table names 2021-02-16 09:41:36 +01:00
Chris Cranford
933ca55b74 DBZ-3055 Use JdbcConnection#query instead 2021-02-05 05:42:59 +01:00
Chris Cranford
e973c11818 DBZ-3055 Capture table state when LogMiner session fails 2021-02-05 05:42:59 +01:00
Chris Cranford
ccb2329e99 DBZ-2999 Fix double execution of LogMiner session 2021-02-04 16:14:14 -05:00
Chris Cranford
15e78f66bc DBZ-2939 Added ORA-01333 as valid retriable exception 2021-02-04 06:07:43 +01:00
Chris Cranford
fffe1fb6ea DBZ-2980 Fix logging parameters 2021-02-03 18:09:40 -05:00
Chris Cranford
d56fc5b2bd DBZ-2982 Fix LogMinerMetrics bean registration 2021-02-03 18:08:25 -05:00
Chris Cranford
a9d514588c DBZ-2999 Standardize casing for LogMiner 2021-02-03 13:01:23 -05:00
Chris Cranford
760915eab6 DBZ-2999 Log SCN ranges for Redo and Archive logs 2021-02-03 13:01:23 -05:00
Chris Cranford
5da2d4b91f DBZ-2999 Capture V$LOGMNR_LOG contents upon ORA-01291 exception 2021-02-03 13:01:23 -05:00
Chris Cranford
58985e0c90 DBZ-2999 Few more logging improvements 2021-02-03 13:01:23 -05:00
Chris Cranford
01ece5cbdb DBZ-2999 Fix unnecessary logging of current redo logs 2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053 DBZ-2999 Improve Logminer logging 2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1 DBZ-2982 Suggested changes 2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a DBZ-2982 Fix formatting 2021-02-03 11:45:20 -05:00
mpermar
76a518334a DBZ-2982 Add suffix to log mining properties and proper Duration type 2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1 DBZ-2982 Remove trailing space
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05 DBZ-2982 Add some additional logging on sleep time and batch sizing 2021-02-03 11:45:20 -05:00
mpermar
c442f478cb DBZ-2982 Allow to customize log mining properties 2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8 DBZ-2420 Use custom Oracle connector validation for database.hostname 2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig 2021-02-03 11:10:57 -05:00
Jiri Pechanec
57246a246e DBZ-2891 Express send/receive semantics 2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2 DBZ-2891 Set watermark in the XStream thread 2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1 DBZ-2891 Added test case 2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2 DBZ-2855 Fix Max SCN 2021-01-27 20:13:16 -05:00
martper2
1de2736249 DBZ-2855: Missing log file error when current SCN is longer than what Long supports 2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c DBZ-2733 Fix DecimalMode for Oracle Logminer 2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13 DBZ-2980 Suggested changes 2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc DBZ-2980 Additional logging for number and type of sql operations 2021-01-26 12:58:50 -05:00
martper2
3727273d9e DBZ-2981 Debezium swallows DML exception in certain cases 2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc DBZ-2949 Guard against LAST_DDL_TIME with value of 0 2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation 2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e DBZ-2711 Implement only global minimum supplemental logging validation 2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1 DBZ-2518 Implement Scn as a domain type 2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188 DBZ-2920 Fix Logminer DML operations using continuation 2021-01-26 13:50:41 +01:00
Chris Cranford
71437acda4 DBZ-2784 Suggested changes 2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664 DBZ-2784 Support date columns for Oracle Logminer
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c DBZ-2825 Fix test failures 2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8 DBZ-2825 Suggested changes 2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a DBZ-2825 Fix formatting 2021-01-06 14:15:27 +01:00