Chris Cranford
043e07a33a
DBZ-3145 Introduce LogFile implementation
2021-03-12 08:00:06 +01:00
Chris Cranford
858cfbcb7a
DBZ-3145 Removed unused code & irrelevant todo
2021-03-12 08:00:06 +01:00
Chris Cranford
8bf8a7d40a
DBZ-3145 Use Scn domain type rather than long
2021-03-12 08:00:06 +01:00
Chris Cranford
bb90d68903
DBZ-3145 Do not rely on Oracle version-specific max SCN values
2021-03-12 08:00:06 +01:00
Jiri Pechanec
0b12e8a02c
[release] Prevents NPE as parent method is not called
2021-03-11 08:58:06 +01:00
Jiri Pechanec
457598914d
DBZ-3258 Parse space in table name
2021-03-11 08:01:25 +01:00
Gunnar Morling
e0c651395d
DBZ-3141 Comment fix
2021-03-10 19:12:34 +01:00
Jiri Pechanec
de0d540a9f
DBZ-3141 Change schema signal for Oracle
2021-03-10 19:12:34 +01:00
Chris Cranford
09fa9d38ab
DBZ-3235 Do not fail parsing Oracle LogMiner SQL without a WHERE-clause
2021-03-09 07:22:12 +01:00
Chris Cranford
efc735d55c
DBZ-3241 Use LogMiner adapter as default for Oracle connector
2021-03-06 10:33:43 +01:00
Chris Cranford
5f0e09d0b8
DBZ-3242 Fix test failure
2021-03-05 17:55:18 -05:00
Chris Cranford
b98dae6436
DBZ-3242 Disable log.mining.transaction.retention.hours by default
...
* Default value `0` disables the check
* Any negative value will show a configuration problem
* Any positive value over `0` will enable the retention check
2021-03-05 18:14:23 +01:00
Chris Cranford
8a7276cebc
DBZ-3219 Fix column include/exclude support for Oracle
2021-03-05 10:35:00 +01:00
Chris Cranford
b0092dcfb4
DBZ-3190 Deprecate database.tablename.case.insensitive option
...
* Option deprecated
* If provided, value continues to be used with warning logged
* If not provided, value will be resolved by database version
2021-03-05 10:17:40 +01:00
Chris Cranford
8854a5c1a6
DBZ-3237 Cleanup test method artifacts
2021-03-05 09:12:32 +01:00
Chris Cranford
be80834838
DBZ-3208 Fix regression with Oracle XStreams
2021-03-04 20:33:08 +01:00
Chris Cranford
3dd0626e9f
DBZ-3154 Updated README, Suggested changes
2021-03-02 17:24:33 +01:00
Chris Cranford
f0bdc22714
DBZ-3154 Use constant references
2021-03-02 17:24:33 +01:00
Chris Cranford
61cfe48b56
DBZ-3154 Update test suite to run in CDB & non-CDB modes.
2021-03-02 17:24:33 +01:00
Chris Cranford
8ac227b59c
DBZ-3128 Revert fix for DBZ-2679.
2021-03-02 14:10:40 +01:00
Chris Cranford
1ed51fe1f9
DBZ-3208 Don't emit NUMBER(1) as boolean types
...
* NUMBER(1) column types emit as numeric
* Added OOTB converter, NumberOneToBooleanConverter
2021-03-02 09:05:41 +01:00
Chris Cranford
4d1d9bafee
DBZ-3036 Detect and skip Oracle IOT special tables
2021-02-26 08:11:44 +01:00
Chris Cranford
ddb1498d1d
DBZ-3194 Allow ORA-01284 errors to be retried
2021-02-26 08:08:38 +01:00
Chris Cranford
addec8f8a3
DBZ-3200 Fix potential division-by-zero with CommitThroughput metric
2021-02-26 08:07:35 +01:00
Chris Cranford
07322485b6
DBZ-3193 Fix IndexOutOfBoundsException with "IS NULL" predicate
2021-02-25 23:04:24 +01:00
Chris Cranford
2d919288f8
DBZ-3038 Fix LogMinerMetricsTest failure
2021-02-25 07:41:44 -05:00
Chris Cranford
8463249803
DBZ-3038 Fix LogMinerMetricsTest failure
2021-02-25 07:38:35 -05:00
Chris Cranford
2dedf1e27a
DBZ-3038 Capture additional LogMiner JMX Metrics
...
* Min/Max duration to start a mining session
* Min/Max number of logs mined in a given session
* Min/Max duration of a mining batch loop
* Some metrics cleanup
2021-02-25 11:42:12 +01:00
Chris Cranford
879449d1c3
DBZ-2875 Start streaming LogMiner changes after offset SCN
2021-02-25 11:37:59 +01:00
Chris Cranford
63358d12b5
DBZ-3167 Add tests for column include/exclude & legacy options
2021-02-23 17:26:38 +01:00
Chris Cranford
8708817fdf
DBZ-3167 Removed column.blacklist, cleaned up config definition
2021-02-23 17:26:38 +01:00
Jiri Pechanec
717278ac71
DBZ-3172 Convert NUMBER to boolean
2021-02-23 11:15:01 -05:00
Chris Cranford
db64e1092c
DBZ-3151 Fix NullPointerException with Pattern matching
2021-02-23 15:02:49 +01:00
Chris Cranford
013b24e3f8
DBZ-3165 Fix test failure
2021-02-23 15:02:49 +01:00
Chris Cranford
49f8f5d70c
DBZ-3009 Suggested changes
...
* Fixed prior commit mistake with log.mining.strategy default
* Added comment on excluded schema logic when building LogMiner query
2021-02-23 12:29:20 +01:00
Chris Cranford
fde3d2ff81
DBZ-3009 Exclude system schemas in LogMiner session queries
2021-02-23 12:29:20 +01:00
Chris Cranford
514c513f96
DBZ-3009 Fix tests compatibility w/Xstream
2021-02-23 12:29:20 +01:00
Chris Cranford
461b784974
DBZ-3009 Support multiple schemas with Oracle LogMiner
2021-02-23 12:29:20 +01:00
Chris Cranford
85cfdd2236
DBZ-3034 Remove build deprecation warnings
2021-02-23 10:52:49 +01:00
Chris Cranford
a9d3b889ee
DBZ-3119 Implement Config validation
2021-02-22 20:00:11 +01:00
Chris Cranford
2727b151fc
DBZ-3165 Remove dependency on JAXB
2021-02-22 18:37:30 +01:00
Chris Cranford
556886b522
DBZ-3151 Use pattern for SYS_NC_OID$, SYS_NC_ROWINFO$, and SYS_NCnnnnn$ names
2021-02-22 15:23:18 +01:00
Chris Cranford
f962524de7
DBZ-3151 Properly handle system-generated hidden column unique indexes
2021-02-22 15:23:18 +01:00
Chris Cranford
738b365bc5
DBZ-3109 Account for multiple log group types
2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd
DBZ-3078 Use max.queue.size for fetch size
2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776
DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
...
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61
DBZ-3078 Connector adjustments for new DML parser
2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218
DBZ-3078 Initial implementation of FastDmlParser
2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd
DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start
2021-02-19 19:03:45 +01:00
Chris Cranford
88b2f73842
DBZ-3001 Do not resolve database version lazily
2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05
DBZ-3001 Control MAX Scn for LogMiner based on Oracle version
2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7
DBZ-3110 Introduce RequireDatabaseOption test annotation
2021-02-19 17:01:25 +01:00
Chris Cranford
304f38e15a
DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler
2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c
DBZ-3090 Commit events in same thread that processes results for LogMiner
2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad
DBZ-3090 Fix emitting transaction end event for LogMiner
2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2
DBZ-2754 Fix test failures
2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799
DBZ-2754 Fix test compilation failures
2021-02-17 20:11:01 -05:00
Gunnar Morling
0980492bb0
DBZ-2754 Using Duration instead of long for durations
2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487
DBZ-2754 Add log.mining.transaction.retention.hours
config option
2021-02-17 12:13:16 +01:00
Chris Cranford
d3a51a1080
DBZ-3057 Provide table filters to reading of database schemas
2021-02-16 09:41:36 +01:00
Chris Cranford
3fd64f5827
DBZ-3057 Fix reading table unique indices with non-quoted table names
2021-02-16 09:41:36 +01:00
Chris Cranford
933ca55b74
DBZ-3055 Use JdbcConnection#query instead
2021-02-05 05:42:59 +01:00
Chris Cranford
e973c11818
DBZ-3055 Capture table state when LogMiner session fails
2021-02-05 05:42:59 +01:00
Chris Cranford
ccb2329e99
DBZ-2999 Fix double execution of LogMiner session
2021-02-04 16:14:14 -05:00
Chris Cranford
15e78f66bc
DBZ-2939 Added ORA-01333 as valid retriable exception
2021-02-04 06:07:43 +01:00
Chris Cranford
fffe1fb6ea
DBZ-2980 Fix logging parameters
2021-02-03 18:09:40 -05:00
Chris Cranford
d56fc5b2bd
DBZ-2982 Fix LogMinerMetrics bean registration
2021-02-03 18:08:25 -05:00
Chris Cranford
a9d514588c
DBZ-2999 Standardize casing for LogMiner
2021-02-03 13:01:23 -05:00
Chris Cranford
760915eab6
DBZ-2999 Log SCN ranges for Redo and Archive logs
2021-02-03 13:01:23 -05:00
Chris Cranford
5da2d4b91f
DBZ-2999 Capture V$LOGMNR_LOG contents upon ORA-01291 exception
2021-02-03 13:01:23 -05:00
Chris Cranford
58985e0c90
DBZ-2999 Few more logging improvements
2021-02-03 13:01:23 -05:00
Chris Cranford
01ece5cbdb
DBZ-2999 Fix unnecessary logging of current redo logs
2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053
DBZ-2999 Improve Logminer logging
2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1
DBZ-2982 Suggested changes
2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a
DBZ-2982 Fix formatting
2021-02-03 11:45:20 -05:00
mpermar
76a518334a
DBZ-2982 Add suffix to log mining properties and proper Duration type
2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1
DBZ-2982 Remove trailing space
...
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05
DBZ-2982 Add some additional logging on sleep time and batch sizing
2021-02-03 11:45:20 -05:00
mpermar
c442f478cb
DBZ-2982 Allow to customize log mining properties
2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8
DBZ-2420 Use custom Oracle connector validation for database.hostname
2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde
DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig
2021-02-03 11:10:57 -05:00
Jiri Pechanec
57246a246e
DBZ-2891 Express send/receive semantics
2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2
DBZ-2891 Set watermark in the XStream thread
2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1
DBZ-2891 Added test case
2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2
DBZ-2855 Fix Max SCN
2021-01-27 20:13:16 -05:00
martper2
1de2736249
DBZ-2855: Missing log file error when current SCN is longer than what Long supports
2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c
DBZ-2733 Fix DecimalMode for Oracle Logminer
2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13
DBZ-2980 Suggested changes
2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc
DBZ-2980 Additional logging for number and type of sql operations
2021-01-26 12:58:50 -05:00
martper2
3727273d9e
DBZ-2981 Debezium swallows DML exception in certain cases
2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc
DBZ-2949 Guard against LAST_DDL_TIME with value of 0
2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e
DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation
2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e
DBZ-2711 Implement only global minimum supplemental logging validation
2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1
DBZ-2518 Implement Scn as a domain type
2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188
DBZ-2920 Fix Logminer DML operations using continuation
2021-01-26 13:50:41 +01:00
Chris Cranford
71437acda4
DBZ-2784 Suggested changes
2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664
DBZ-2784 Support date columns for Oracle Logminer
...
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c
DBZ-2825 Fix test failures
2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8
DBZ-2825 Suggested changes
2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a
DBZ-2825 Fix formatting
2021-01-06 14:15:27 +01:00