Commit Graph

390 Commits

Author SHA1 Message Date
Chris Cranford
addec8f8a3 DBZ-3200 Fix potential division-by-zero with CommitThroughput metric 2021-02-26 08:07:35 +01:00
Chris Cranford
07322485b6 DBZ-3193 Fix IndexOutOfBoundsException with "IS NULL" predicate 2021-02-25 23:04:24 +01:00
Chris Cranford
2d919288f8 DBZ-3038 Fix LogMinerMetricsTest failure 2021-02-25 07:41:44 -05:00
Chris Cranford
8463249803 DBZ-3038 Fix LogMinerMetricsTest failure 2021-02-25 07:38:35 -05:00
Chris Cranford
2dedf1e27a DBZ-3038 Capture additional LogMiner JMX Metrics
* Min/Max duration to start a mining session
* Min/Max number of logs mined in a given session
* Min/Max duration of a mining batch loop
* Some metrics cleanup
2021-02-25 11:42:12 +01:00
Chris Cranford
879449d1c3 DBZ-2875 Start streaming LogMiner changes after offset SCN 2021-02-25 11:37:59 +01:00
Debezium Builder
c3980e5c17 [maven-release-plugin] prepare for next development iteration 2021-02-23 14:10:58 -05:00
Debezium Builder
454ba981f6 [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 14:10:58 -05:00
Debezium Builder
306efe9956 [maven-release-plugin] prepare for next development iteration 2021-02-23 13:32:13 -05:00
Debezium Builder
4995a207d9 [maven-release-plugin] prepare release v1.5.0.Beta1 2021-02-23 13:32:13 -05:00
Chris Cranford
63358d12b5 DBZ-3167 Add tests for column include/exclude & legacy options 2021-02-23 17:26:38 +01:00
Chris Cranford
8708817fdf DBZ-3167 Removed column.blacklist, cleaned up config definition 2021-02-23 17:26:38 +01:00
Jiri Pechanec
717278ac71 DBZ-3172 Convert NUMBER to boolean 2021-02-23 11:15:01 -05:00
Chris Cranford
db64e1092c DBZ-3151 Fix NullPointerException with Pattern matching 2021-02-23 15:02:49 +01:00
Chris Cranford
013b24e3f8 DBZ-3165 Fix test failure 2021-02-23 15:02:49 +01:00
Chris Cranford
49f8f5d70c DBZ-3009 Suggested changes
* Fixed prior commit mistake with log.mining.strategy default
* Added comment on excluded schema logic when building LogMiner query
2021-02-23 12:29:20 +01:00
Chris Cranford
fde3d2ff81 DBZ-3009 Exclude system schemas in LogMiner session queries 2021-02-23 12:29:20 +01:00
Chris Cranford
514c513f96 DBZ-3009 Fix tests compatibility w/Xstream 2021-02-23 12:29:20 +01:00
Chris Cranford
461b784974 DBZ-3009 Support multiple schemas with Oracle LogMiner 2021-02-23 12:29:20 +01:00
Chris Cranford
85cfdd2236 DBZ-3034 Remove build deprecation warnings 2021-02-23 10:52:49 +01:00
Chris Cranford
a9d3b889ee DBZ-3119 Implement Config validation 2021-02-22 20:00:11 +01:00
Chris Cranford
2727b151fc DBZ-3165 Remove dependency on JAXB 2021-02-22 18:37:30 +01:00
Chris Cranford
556886b522 DBZ-3151 Use pattern for SYS_NC_OID$, SYS_NC_ROWINFO$, and SYS_NCnnnnn$ names 2021-02-22 15:23:18 +01:00
Chris Cranford
f962524de7 DBZ-3151 Properly handle system-generated hidden column unique indexes 2021-02-22 15:23:18 +01:00
Chris Cranford
738b365bc5 DBZ-3109 Account for multiple log group types 2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd DBZ-3078 Use max.queue.size for fetch size 2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776 DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61 DBZ-3078 Connector adjustments for new DML parser 2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218 DBZ-3078 Initial implementation of FastDmlParser 2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start 2021-02-19 19:03:45 +01:00
Chris Cranford
88b2f73842 DBZ-3001 Do not resolve database version lazily 2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05 DBZ-3001 Control MAX Scn for LogMiner based on Oracle version 2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7 DBZ-3110 Introduce RequireDatabaseOption test annotation 2021-02-19 17:01:25 +01:00
Chris Cranford
304f38e15a DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler 2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c DBZ-3090 Commit events in same thread that processes results for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad DBZ-3090 Fix emitting transaction end event for LogMiner 2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2 DBZ-2754 Fix test failures 2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799 DBZ-2754 Fix test compilation failures 2021-02-17 20:11:01 -05:00
Gunnar Morling
0980492bb0 DBZ-2754 Using Duration instead of long for durations 2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487 DBZ-2754 Add log.mining.transaction.retention.hours config option 2021-02-17 12:13:16 +01:00
Chris Cranford
d3a51a1080 DBZ-3057 Provide table filters to reading of database schemas 2021-02-16 09:41:36 +01:00
Chris Cranford
3fd64f5827 DBZ-3057 Fix reading table unique indices with non-quoted table names 2021-02-16 09:41:36 +01:00
Debezium Builder
279a19bfd0 [maven-release-plugin] prepare for next development iteration 2021-02-06 01:32:03 -05:00
Debezium Builder
68dd5b92e9 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-06 01:32:03 -05:00
Debezium Builder
57317b894c [maven-release-plugin] prepare for next development iteration 2021-02-05 00:20:36 -05:00
Debezium Builder
4816f3a539 [maven-release-plugin] prepare release v1.5.0.Alpha1 2021-02-05 00:20:36 -05:00
Chris Cranford
933ca55b74 DBZ-3055 Use JdbcConnection#query instead 2021-02-05 05:42:59 +01:00
Chris Cranford
e973c11818 DBZ-3055 Capture table state when LogMiner session fails 2021-02-05 05:42:59 +01:00
Chris Cranford
ccb2329e99 DBZ-2999 Fix double execution of LogMiner session 2021-02-04 16:14:14 -05:00
Chris Cranford
15e78f66bc DBZ-2939 Added ORA-01333 as valid retriable exception 2021-02-04 06:07:43 +01:00
Chris Cranford
fffe1fb6ea DBZ-2980 Fix logging parameters 2021-02-03 18:09:40 -05:00
Chris Cranford
d56fc5b2bd DBZ-2982 Fix LogMinerMetrics bean registration 2021-02-03 18:08:25 -05:00
Chris Cranford
a9d514588c DBZ-2999 Standardize casing for LogMiner 2021-02-03 13:01:23 -05:00
Chris Cranford
760915eab6 DBZ-2999 Log SCN ranges for Redo and Archive logs 2021-02-03 13:01:23 -05:00
Chris Cranford
5da2d4b91f DBZ-2999 Capture V$LOGMNR_LOG contents upon ORA-01291 exception 2021-02-03 13:01:23 -05:00
Chris Cranford
58985e0c90 DBZ-2999 Few more logging improvements 2021-02-03 13:01:23 -05:00
Chris Cranford
01ece5cbdb DBZ-2999 Fix unnecessary logging of current redo logs 2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053 DBZ-2999 Improve Logminer logging 2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1 DBZ-2982 Suggested changes 2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a DBZ-2982 Fix formatting 2021-02-03 11:45:20 -05:00
mpermar
76a518334a DBZ-2982 Add suffix to log mining properties and proper Duration type 2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1 DBZ-2982 Remove trailing space
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05 DBZ-2982 Add some additional logging on sleep time and batch sizing 2021-02-03 11:45:20 -05:00
mpermar
c442f478cb DBZ-2982 Allow to customize log mining properties 2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8 DBZ-2420 Use custom Oracle connector validation for database.hostname 2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig 2021-02-03 11:10:57 -05:00
Debezium Builder
4c84157e6d [maven-release-plugin] prepare for next development iteration 2021-01-28 07:46:34 -05:00
Debezium Builder
1ba7253981 [maven-release-plugin] prepare release v1.4.1.Final 2021-01-28 07:46:34 -05:00
Jiri Pechanec
57246a246e DBZ-2891 Express send/receive semantics 2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2 DBZ-2891 Set watermark in the XStream thread 2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1 DBZ-2891 Added test case 2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2 DBZ-2855 Fix Max SCN 2021-01-27 20:13:16 -05:00
martper2
1de2736249 DBZ-2855: Missing log file error when current SCN is longer than what Long supports 2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c DBZ-2733 Fix DecimalMode for Oracle Logminer 2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13 DBZ-2980 Suggested changes 2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc DBZ-2980 Additional logging for number and type of sql operations 2021-01-26 12:58:50 -05:00
martper2
3727273d9e DBZ-2981 Debezium swallows DML exception in certain cases 2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc DBZ-2949 Guard against LAST_DDL_TIME with value of 0 2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation 2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e DBZ-2711 Implement only global minimum supplemental logging validation 2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1 DBZ-2518 Implement Scn as a domain type 2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188 DBZ-2920 Fix Logminer DML operations using continuation 2021-01-26 13:50:41 +01:00
Debezium Builder
25c6e93ed8 [maven-release-plugin] prepare for next development iteration 2021-01-07 03:45:22 -05:00
Debezium Builder
4b6d894af0 [maven-release-plugin] prepare release v1.4.0.Final 2021-01-07 03:45:22 -05:00
Chris Cranford
71437acda4 DBZ-2784 Suggested changes 2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664 DBZ-2784 Support date columns for Oracle Logminer
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c DBZ-2825 Fix test failures 2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8 DBZ-2825 Suggested changes 2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a DBZ-2825 Fix formatting 2021-01-06 14:15:27 +01:00
Chris Cranford
2fc25f9045 DBZ-2825 Change granularity to hours 2021-01-06 14:15:27 +01:00
Chris Cranford
7578da1322 DBZ-2825 Implement log.mining.archive.log.days 2021-01-06 14:15:27 +01:00
Chris Cranford
b0794f33ae DBZ-2825 Fix archive log support for Oracle LogMiner 2021-01-06 14:15:27 +01:00
Jiri Pechanec
a1cfd0b11a DBZ-2890 Remove SLF4J from Oracle distro 2021-01-06 09:35:27 +01:00
Chris Cranford
8d64463e57 DBZ-2849 Fix value conversion with non-compliant Avro column names 2021-01-05 12:43:49 +01:00
Chris Cranford
d0bce38efb DBZ-2859 Fix formatting 2021-01-04 14:00:11 -05:00
martper2
90e41c6fa2 DBZ-2859 Support TNS Names and full RAC connection strings 2021-01-04 13:52:28 -05:00
Chris Cranford
ca83fd0606 DBZ-2856 Fix passing connection adapter to Surefire tests 2020-12-17 11:38:18 +01:00
Debezium Builder
f1f4176f31 [maven-release-plugin] prepare for next development iteration 2020-12-16 14:18:41 -05:00
Debezium Builder
5500847e77 [maven-release-plugin] prepare release v1.4.0.CR1 2020-12-16 14:18:41 -05:00
Debezium Builder
92df4fe5d5 [maven-release-plugin] prepare for next development iteration 2020-12-10 00:35:05 -05:00