Chris Cranford
754462a436
DBZ-2948 Fix potential null value being assigned to offset SCN
2021-05-20 08:21:08 +02:00
Chris Cranford
4aeb6069a3
DBZ-814 Ignore unsupported column types
2021-05-20 08:21:08 +02:00
Chris Cranford
8306bb5f15
DBZ-2948 Increase size of large CLOB/BLOB values
2021-05-20 08:21:08 +02:00
Chris Cranford
467a7f21f6
DBZ-2948 Implement BLOB/CLOB support for Oracle Xstream
2021-05-20 08:21:08 +02:00
Chris Cranford
fb7378ef52
DBZ-2948 Fix formatting
2021-05-20 08:21:08 +02:00
Chris Cranford
49703d9dc9
DBZ-2948 Implement BLOB/CLOB support for Oracle LogMiner
2021-05-20 08:21:08 +02:00
Chris Cranford
837a70f131
DBZ-3472 Relax retry logic for "No more data to read from socket"
...
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-05-20 07:58:31 +02:00
Chris Cranford
d147d1f517
DBZ-3240 Remove database.tablename.case.insensitive
deprecated option
2021-05-19 20:44:59 +02:00
Gunnar Morling
50c285031a
DBZ-3456 Minor clean-up
2021-05-19 13:42:03 +02:00
Thomas Aregger
d1670b636c
DBZ-3456 Timezone difference not considered in LagFromSourceInMilliseconds
calculation;
...
* Retrieve v$logmnr_contents.change_time in UTC
* Respect time zones when calculating time difference
* Allow constructors to be annotated with VisibleForTesting
2021-05-19 13:41:02 +02:00
Chris Cranford
118cee24a7
DBZ-3256 Formatting
2021-05-19 09:40:19 +02:00
Chris Cranford
81190df6a8
DBZ-3256 Document query fragments
2021-05-19 09:40:19 +02:00
Chris Cranford
b7c1d798a3
DBZ-3256 Consolidate Oracle redo/archive log queries
...
* Moves de-duplication to database using SQL query, i.e. no duplicate SCN ranges
* Provides a consistent view of logs rather than relying on multiple queries
2021-05-19 09:40:19 +02:00
Chris Cranford
ab2c3f41e6
DBZ-3533 Drop tables after signal tests concluded
2021-05-18 14:24:54 -04:00
Chris Cranford
a33af6a2d7
DBZ-2916 Fix test failures
2021-05-18 13:53:43 -04:00
Thomas Aregger
2d87fa9b3d
DBZ-3482 Parse timestamps with short form for months with locale "en"
2021-05-18 11:05:13 -04:00
Thomas Aregger
0027eb9f9c
DBZ-3482 Add missing format model
...
When the format model is omitted, the default is used. The default is determined from NLS settings
2021-05-18 11:05:13 -04:00
Thomas Aregger
5009a9d586
DBZ-3482 Change date string to match provided format model
2021-05-18 11:05:13 -04:00
Thomas Aregger
f31909ab12
DBZ-3482 Use format model for DATE data types that is independent of clients NLS settings
2021-05-18 11:05:13 -04:00
Chris Cranford
9b011c75a3
DBZ-3322 Suggested test case change
2021-05-18 15:49:19 +02:00
Chris Cranford
967b945e0f
DBZ-3322 Bubble up exceptions from RowMapper
2021-05-18 15:49:19 +02:00
Chris Cranford
00d75c282b
DBZ-3322 Handle Oracle partially committed transactions
2021-05-18 15:49:19 +02:00
Chris Cranford
b13cbb1077
DBZ-2916 Add support for Oracle DDL statement parsing
2021-05-18 14:58:20 +02:00
Chris Cranford
0c8c0255a9
DBZ-3377 Restart Oracle connector on ORA-01291, missing logfile
2021-05-17 11:01:25 +02:00
Chris Cranford
d5bf7a3c0b
DBZ-832 Add Oracle test for table without primary key
2021-05-13 06:50:15 +02:00
John Wu
05ce63e06a
DBZ-3516 LogMining redo log switch not being detected
2021-05-12 14:40:16 -04:00
Chris Cranford
8f953dc9fe
DBZ-3400 Remove Oracle Antlr DML parser
2021-05-11 17:56:55 +02:00
Chris Cranford
1d46cdb6b7
DBZ-3332 Limit oldest archive log query to only active records
2021-05-11 12:42:49 +02:00
kewenchao
47f380b565
DBZ-3397 Avoiding exception if system language is not English
2021-04-20 09:14:36 +02:00
Patrick Chu
e37abe5f92
DBZ-3413 Add additional unit tests for insert and update
2021-04-19 08:53:19 -04:00
Patrick Chu
ecae5b6b91
DBZ-3413 Handle double single quotes in LogMinerDmlParser
...
Double single quotes are treated as 2 quotes instead of 1 escaped quote in the WHERE clause parsing function.
2021-04-19 08:53:19 -04:00
Chris Cranford
7bd3e51e12
DBZ-1721 Fix DDL ParserException ID NUMBER(4) GENERATED BY
...
* Sync Oracle DDL grammar with latest upstream changes
* Implemented identity sequence spec for auto-generated column types
* Added Oracle examples to DDL parser project
* Corrected syntax failure after syncing grammar with upstream
2021-04-08 13:23:23 +02:00
Chris Cranford
bf0138064b
DBZ-3365 Use Instantiator implementation
2021-04-08 11:56:35 +02:00
Chris Cranford
e5f8491fbb
DBZ-3365 Fix formatting
2021-04-08 11:56:35 +02:00
Chris Cranford
c406527ccb
DBZ-3365 Remove unused imports
2021-04-08 11:56:35 +02:00
Chris Cranford
0f35b0455d
DBZ-3365 Allow building Oracle connector on CI
2021-04-08 11:56:35 +02:00
Chris Cranford
f95a2f877e
DBZ-3367 Correctly parse function string-args with parenthesis characters
2021-03-31 12:44:55 +02:00
Chris Cranford
776180a0df
DBZ-3347 Emit schema change events with correct source partition
2021-03-30 07:26:06 +02:00
Chris Cranford
dd24a94a62
DBZ-2911 Fix Oracle test compatibility
2021-03-30 05:53:38 +02:00
Chris Cranford
705b98f79f
DBZ-3341 Handle multiple local locations
2021-03-26 18:48:02 +01:00
Chris Cranford
6b7c7bc252
DBZ-3341 Only mine local destination archive logs
2021-03-26 18:48:02 +01:00
Chris Cranford
aee3550dc6
DBZ-3348 Oracle LogMiner can incorrectly resolve starting SCN is available
2021-03-26 08:22:34 +01:00
Chris Cranford
23baf34ee1
DBZ-3344 Fix Oracle test failures
2021-03-25 11:06:31 +01:00
Chris Cranford
d8f0d2ba5a
DBZ-2537 Rework Oracle's streaming metrics
...
* Consolidated LogMinerMetrics and TransactionalBufferMetrics
* Renamed LogMinerMetrics to OracleStreamingChangeEventSourceMetrics
* Standardized metrics method names & types
* Updated documentation to reflect metrics changes
2021-03-23 15:25:14 -04:00
Chris Cranford
1d9594ed88
DBZ-3290 Suggested changes
...
* Use {debezium-version} variable in examples
* Correct typos
* Document non-support for CLOB/BLOB data types
* Fix rendering of <= with unicode character
* Moved XStream documentation into separate section
* Moved database.oracle.version to internal
* Removed reference to database.oracle.version
* Resolve XStream POS version from OracleDatabaseVersion as fallback
when internal.database.oracle.version is not supplied.
2021-03-23 15:25:14 -04:00
Jiri Pechanec
9e994967ed
DBZ-3257 Use new method in tests
2021-03-23 09:48:54 +01:00
Chris Cranford
6d686d7543
DBZ-3257 Use DebeziumException instead
2021-03-23 06:12:04 +01:00
Chris Cranford
9aa1ba1471
DBZ-3257 Revert Clob behavior for Oracle LogMiner to avoid null values
...
* Snapshot now emits clob/nclob values correctly (all adapters)
* Fixed bug with LogMiner emitting clob/nclob values when using new parser
2021-03-23 06:12:04 +01:00
Chris Cranford
b85044cb14
DBZ-3319 Recalculate current log sequence
2021-03-22 20:04:00 -04:00
Chris Cranford
d75319a3ca
DBZ-3319 Fix race condition with log switch detection
...
Rather than relying on log switch detection by looking at the name
of the current log file, this change uses the unique and always
increasing sequence to derive the log switch state to avoid any
type of ambiguity.
2021-03-22 09:04:54 +01:00
Chris Cranford
a8a22bd828
DBZ-3268 Remove unused code
2021-03-19 18:07:12 +01:00
Chris Cranford
fae784001e
DBZ-3268 Emit TIMESTAMP WITH LOCAL TIME ZONE columns in UTC
2021-03-19 18:07:12 +01:00
Chris Cranford
d47db6e098
DBZ-3268 Use dedicated connection for XStream API
...
Once a connection is bound to XStream API, issuing any other type of query
or operation can lead to failures due to concurrent use of the connection
by Debezium and XStream's native methods. This commit adds a dedicated
connection used specifically by XStream to avoid this concurrency issue,
so that data types such as TIMESTAMP WITH LOCAL TIME ZONE works.
2021-03-19 18:07:12 +01:00
Chris Cranford
7a98fcd96c
DBZ-3268 Implement timestamp with local timezone support
2021-03-19 18:07:12 +01:00
Chris Cranford
6b8f61386b
DBZ-3268 Fix Oracle time.precision.mode support
2021-03-19 18:07:12 +01:00
Chris Cranford
31ffa5e816
DBZ-2994 Fix ClassCastException & compilation error
2021-03-18 22:23:41 -04:00
Chris Cranford
41b571fb37
DBZ-3292 Apply suggested changes
2021-03-18 21:59:38 +01:00
Chris Cranford
dc92001676
DBZ-3292 Prefer archived logs over redo logs for same SCN range.
2021-03-18 21:59:38 +01:00
Jiri Pechanec
495be2659b
DBZ-2511 Dedicated logger for schema name adjuster
2021-03-18 14:42:34 +01:00
Chris Cranford
97da4333a3
DBZ-2994 Return current SCN as string in LogMinerMetrics
2021-03-17 20:37:24 +01:00
Chris Cranford
bd7adb40ed
DBZ-2994 Fix test failures for Oracle XStreams
2021-03-17 20:37:24 +01:00
Chris Cranford
36f17a7630
DBZ-2994 Removed Scn.ZERO and Scn.INVALID in favor of Scn.NULL
2021-03-17 20:37:24 +01:00
Chris Cranford
f91a01fb86
DBZ-2994 Use null default rather than Scn.ZERO
2021-03-17 20:37:24 +01:00
Chris Cranford
da02ca2a23
DBZ-2994 Suggested changes
2021-03-17 20:37:24 +01:00
Chris Cranford
f3412c02da
DBZ-2994 Removed SCN2_KEY and COMMIT2_SCN_KEY from offsets
2021-03-17 20:37:24 +01:00
Chris Cranford
204ef73422
DBZ-2994 Moved Scn to parent package
...
Since the Scn class is used by the snapshot process, it makes sense to move
this class up by one package since it can now be leveraged by both adapters
as needed.
2021-03-17 20:37:24 +01:00
Chris Cranford
a9d59710a7
DBZ-2994 Use string-representation of SCN in offsets & source info
2021-03-17 20:37:24 +01:00
Chris Cranford
769f8dc4f4
DBZ-2457 Use BigInteger rather than BigDecimal for SCN values
2021-03-17 20:37:24 +01:00
Chris Cranford
787b459771
DBZ-3305 Fix IndexOutOfBoundsException for LogMiner Update DMLs
2021-03-17 12:07:58 +01:00
Chris Cranford
39dd1e6980
DBZ-3295 Fix typo in comments
2021-03-17 06:54:53 -04:00
Chris Cranford
f2593c2737
DBZ-3295 Restrict all LogMiner results to specified SCN boundary
2021-03-17 06:54:53 -04:00
Gunnar Morling
1f02d25738
DBZ-3271 Removing unused methods
2021-03-17 09:54:25 +01:00
Gunnar Morling
911b5e9a3b
DBZ-3271 Unifying filter handling across relational connectors
2021-03-17 09:54:25 +01:00
Chris Cranford
15fd604b1f
DBZ-3250 Add integration test
2021-03-16 18:12:10 +01:00
Chris Cranford
634be509d2
DBZ-3236 Make ORA-26653 is a retriable exception
2021-03-16 09:49:29 +01:00
Chris Cranford
3e82185e29
DBZ-3254 Log exception on failed connection validation
2021-03-12 08:01:39 +01:00
Chris Cranford
599341dece
DBZ-3145 Suggested changes
2021-03-12 08:00:06 +01:00
Chris Cranford
043e07a33a
DBZ-3145 Introduce LogFile implementation
2021-03-12 08:00:06 +01:00
Chris Cranford
858cfbcb7a
DBZ-3145 Removed unused code & irrelevant todo
2021-03-12 08:00:06 +01:00
Chris Cranford
8bf8a7d40a
DBZ-3145 Use Scn domain type rather than long
2021-03-12 08:00:06 +01:00
Chris Cranford
bb90d68903
DBZ-3145 Do not rely on Oracle version-specific max SCN values
2021-03-12 08:00:06 +01:00
Jiri Pechanec
0b12e8a02c
[release] Prevents NPE as parent method is not called
2021-03-11 08:58:06 +01:00
Jiri Pechanec
457598914d
DBZ-3258 Parse space in table name
2021-03-11 08:01:25 +01:00
Gunnar Morling
e0c651395d
DBZ-3141 Comment fix
2021-03-10 19:12:34 +01:00
Jiri Pechanec
de0d540a9f
DBZ-3141 Change schema signal for Oracle
2021-03-10 19:12:34 +01:00
Chris Cranford
09fa9d38ab
DBZ-3235 Do not fail parsing Oracle LogMiner SQL without a WHERE-clause
2021-03-09 07:22:12 +01:00
Chris Cranford
efc735d55c
DBZ-3241 Use LogMiner adapter as default for Oracle connector
2021-03-06 10:33:43 +01:00
Chris Cranford
5f0e09d0b8
DBZ-3242 Fix test failure
2021-03-05 17:55:18 -05:00
Chris Cranford
b98dae6436
DBZ-3242 Disable log.mining.transaction.retention.hours by default
...
* Default value `0` disables the check
* Any negative value will show a configuration problem
* Any positive value over `0` will enable the retention check
2021-03-05 18:14:23 +01:00
Chris Cranford
8a7276cebc
DBZ-3219 Fix column include/exclude support for Oracle
2021-03-05 10:35:00 +01:00
Chris Cranford
b0092dcfb4
DBZ-3190 Deprecate database.tablename.case.insensitive option
...
* Option deprecated
* If provided, value continues to be used with warning logged
* If not provided, value will be resolved by database version
2021-03-05 10:17:40 +01:00
Chris Cranford
8854a5c1a6
DBZ-3237 Cleanup test method artifacts
2021-03-05 09:12:32 +01:00
Chris Cranford
be80834838
DBZ-3208 Fix regression with Oracle XStreams
2021-03-04 20:33:08 +01:00
Chris Cranford
3dd0626e9f
DBZ-3154 Updated README, Suggested changes
2021-03-02 17:24:33 +01:00
Chris Cranford
f0bdc22714
DBZ-3154 Use constant references
2021-03-02 17:24:33 +01:00
Chris Cranford
61cfe48b56
DBZ-3154 Update test suite to run in CDB & non-CDB modes.
2021-03-02 17:24:33 +01:00
Chris Cranford
8ac227b59c
DBZ-3128 Revert fix for DBZ-2679.
2021-03-02 14:10:40 +01:00
Chris Cranford
1ed51fe1f9
DBZ-3208 Don't emit NUMBER(1) as boolean types
...
* NUMBER(1) column types emit as numeric
* Added OOTB converter, NumberOneToBooleanConverter
2021-03-02 09:05:41 +01:00
Chris Cranford
4d1d9bafee
DBZ-3036 Detect and skip Oracle IOT special tables
2021-02-26 08:11:44 +01:00
Chris Cranford
ddb1498d1d
DBZ-3194 Allow ORA-01284 errors to be retried
2021-02-26 08:08:38 +01:00
Chris Cranford
addec8f8a3
DBZ-3200 Fix potential division-by-zero with CommitThroughput metric
2021-02-26 08:07:35 +01:00
Chris Cranford
07322485b6
DBZ-3193 Fix IndexOutOfBoundsException with "IS NULL" predicate
2021-02-25 23:04:24 +01:00
Chris Cranford
2d919288f8
DBZ-3038 Fix LogMinerMetricsTest failure
2021-02-25 07:41:44 -05:00
Chris Cranford
8463249803
DBZ-3038 Fix LogMinerMetricsTest failure
2021-02-25 07:38:35 -05:00
Chris Cranford
2dedf1e27a
DBZ-3038 Capture additional LogMiner JMX Metrics
...
* Min/Max duration to start a mining session
* Min/Max number of logs mined in a given session
* Min/Max duration of a mining batch loop
* Some metrics cleanup
2021-02-25 11:42:12 +01:00
Chris Cranford
879449d1c3
DBZ-2875 Start streaming LogMiner changes after offset SCN
2021-02-25 11:37:59 +01:00
Chris Cranford
63358d12b5
DBZ-3167 Add tests for column include/exclude & legacy options
2021-02-23 17:26:38 +01:00
Chris Cranford
8708817fdf
DBZ-3167 Removed column.blacklist, cleaned up config definition
2021-02-23 17:26:38 +01:00
Jiri Pechanec
717278ac71
DBZ-3172 Convert NUMBER to boolean
2021-02-23 11:15:01 -05:00
Chris Cranford
db64e1092c
DBZ-3151 Fix NullPointerException with Pattern matching
2021-02-23 15:02:49 +01:00
Chris Cranford
013b24e3f8
DBZ-3165 Fix test failure
2021-02-23 15:02:49 +01:00
Chris Cranford
49f8f5d70c
DBZ-3009 Suggested changes
...
* Fixed prior commit mistake with log.mining.strategy default
* Added comment on excluded schema logic when building LogMiner query
2021-02-23 12:29:20 +01:00
Chris Cranford
fde3d2ff81
DBZ-3009 Exclude system schemas in LogMiner session queries
2021-02-23 12:29:20 +01:00
Chris Cranford
514c513f96
DBZ-3009 Fix tests compatibility w/Xstream
2021-02-23 12:29:20 +01:00
Chris Cranford
461b784974
DBZ-3009 Support multiple schemas with Oracle LogMiner
2021-02-23 12:29:20 +01:00
Chris Cranford
85cfdd2236
DBZ-3034 Remove build deprecation warnings
2021-02-23 10:52:49 +01:00
Chris Cranford
a9d3b889ee
DBZ-3119 Implement Config validation
2021-02-22 20:00:11 +01:00
Chris Cranford
2727b151fc
DBZ-3165 Remove dependency on JAXB
2021-02-22 18:37:30 +01:00
Chris Cranford
556886b522
DBZ-3151 Use pattern for SYS_NC_OID$, SYS_NC_ROWINFO$, and SYS_NCnnnnn$ names
2021-02-22 15:23:18 +01:00
Chris Cranford
f962524de7
DBZ-3151 Properly handle system-generated hidden column unique indexes
2021-02-22 15:23:18 +01:00
Chris Cranford
738b365bc5
DBZ-3109 Account for multiple log group types
2021-02-19 21:42:05 +01:00
Chris Cranford
dfdd0858dd
DBZ-3078 Use max.queue.size for fetch size
2021-02-19 21:39:27 +01:00
Chris Cranford
25f1eb5776
DBZ-3078 More LogMiner DML parser, Metrics and Benchmark changes
...
* Consolidated converts to simply OracleValueConverters
* Defined a common interface for legacy and new DML parsers
* Parser failures now through exception rather than skip event
* Added support for "Unsupported Type" in DML parsing (spatial columns)
* Units encoded into JMX metrics names
* Additional JMX metrics added & some metrics calculations improved
* Introduced JMH benchmarks for Oracle LogMiner parser & end-to-end
2021-02-19 21:39:27 +01:00
Chris Cranford
9c2edc7e61
DBZ-3078 Connector adjustments for new DML parser
2021-02-19 21:39:27 +01:00
Chris Cranford
92b9558218
DBZ-3078 Initial implementation of FastDmlParser
2021-02-19 21:39:27 +01:00
Chris Cranford
aa584c08cd
DBZ-3153 Capture LogMiner parameters when LogMiner session fails to start
2021-02-19 19:03:45 +01:00
Chris Cranford
88b2f73842
DBZ-3001 Do not resolve database version lazily
2021-02-19 17:29:20 +01:00
Chris Cranford
d061f58b05
DBZ-3001 Control MAX Scn for LogMiner based on Oracle version
2021-02-19 17:29:20 +01:00
Chris Cranford
9f2e2971b7
DBZ-3110 Introduce RequireDatabaseOption test annotation
2021-02-19 17:01:25 +01:00
Chris Cranford
304f38e15a
DBZ-3090 Cleanup LogMiner TransactionBuffer commit handler
2021-02-18 07:59:55 +01:00
Chris Cranford
4dbd9f3e4c
DBZ-3090 Commit events in same thread that processes results for LogMiner
2021-02-18 07:59:55 +01:00
Chris Cranford
570e35eaad
DBZ-3090 Fix emitting transaction end event for LogMiner
2021-02-18 07:59:55 +01:00
Chris Cranford
2810683ad2
DBZ-2754 Fix test failures
2021-02-17 20:16:00 -05:00
Chris Cranford
3043a6f799
DBZ-2754 Fix test compilation failures
2021-02-17 20:11:01 -05:00
Gunnar Morling
0980492bb0
DBZ-2754 Using Duration instead of long for durations
2021-02-17 12:13:16 +01:00
Chris Cranford
2be6238487
DBZ-2754 Add log.mining.transaction.retention.hours
config option
2021-02-17 12:13:16 +01:00
Chris Cranford
d3a51a1080
DBZ-3057 Provide table filters to reading of database schemas
2021-02-16 09:41:36 +01:00
Chris Cranford
3fd64f5827
DBZ-3057 Fix reading table unique indices with non-quoted table names
2021-02-16 09:41:36 +01:00
Chris Cranford
933ca55b74
DBZ-3055 Use JdbcConnection#query instead
2021-02-05 05:42:59 +01:00
Chris Cranford
e973c11818
DBZ-3055 Capture table state when LogMiner session fails
2021-02-05 05:42:59 +01:00
Chris Cranford
ccb2329e99
DBZ-2999 Fix double execution of LogMiner session
2021-02-04 16:14:14 -05:00
Chris Cranford
15e78f66bc
DBZ-2939 Added ORA-01333 as valid retriable exception
2021-02-04 06:07:43 +01:00
Chris Cranford
fffe1fb6ea
DBZ-2980 Fix logging parameters
2021-02-03 18:09:40 -05:00
Chris Cranford
d56fc5b2bd
DBZ-2982 Fix LogMinerMetrics bean registration
2021-02-03 18:08:25 -05:00
Chris Cranford
a9d514588c
DBZ-2999 Standardize casing for LogMiner
2021-02-03 13:01:23 -05:00
Chris Cranford
760915eab6
DBZ-2999 Log SCN ranges for Redo and Archive logs
2021-02-03 13:01:23 -05:00
Chris Cranford
5da2d4b91f
DBZ-2999 Capture V$LOGMNR_LOG contents upon ORA-01291 exception
2021-02-03 13:01:23 -05:00
Chris Cranford
58985e0c90
DBZ-2999 Few more logging improvements
2021-02-03 13:01:23 -05:00
Chris Cranford
01ece5cbdb
DBZ-2999 Fix unnecessary logging of current redo logs
2021-02-03 13:01:23 -05:00
Chris Cranford
c58cc44053
DBZ-2999 Improve Logminer logging
2021-02-03 13:01:23 -05:00
Chris Cranford
864b87d2e1
DBZ-2982 Suggested changes
2021-02-03 11:45:20 -05:00
Chris Cranford
2631a6de2a
DBZ-2982 Fix formatting
2021-02-03 11:45:20 -05:00
mpermar
76a518334a
DBZ-2982 Add suffix to log mining properties and proper Duration type
2021-02-03 11:45:20 -05:00
mpermar
26ddfcfec1
DBZ-2982 Remove trailing space
...
Co-authored-by: Chris Cranford <ccranfor@redhat.com>
2021-02-03 11:45:20 -05:00
mpermar
ca1b85ee05
DBZ-2982 Add some additional logging on sleep time and batch sizing
2021-02-03 11:45:20 -05:00
mpermar
c442f478cb
DBZ-2982 Allow to customize log mining properties
2021-02-03 11:45:20 -05:00
Chris Cranford
b0b26e43c8
DBZ-2420 Use custom Oracle connector validation for database.hostname
2021-02-03 11:10:57 -05:00
ani-sha
b430e83dde
DBZ-2420 Use database configs from RelationalDatabaseConnectorConfig
2021-02-03 11:10:57 -05:00
Jiri Pechanec
57246a246e
DBZ-2891 Express send/receive semantics
2021-01-28 10:22:56 +01:00
Jiri Pechanec
7a6b50b1f2
DBZ-2891 Set watermark in the XStream thread
2021-01-28 10:22:56 +01:00
Chris Cranford
dcd2914ab1
DBZ-2891 Added test case
2021-01-28 10:22:56 +01:00
martper2
b9f46af9a2
DBZ-2855 Fix Max SCN
2021-01-27 20:13:16 -05:00
martper2
1de2736249
DBZ-2855: Missing log file error when current SCN is longer than what Long supports
2021-01-27 20:13:16 -05:00
Chris Cranford
10aab1445c
DBZ-2733 Fix DecimalMode for Oracle Logminer
2021-01-26 13:08:47 -05:00
Chris Cranford
923c6f9c13
DBZ-2980 Suggested changes
2021-01-26 12:58:50 -05:00
martper2
6bdc20c4bc
DBZ-2980 Additional logging for number and type of sql operations
2021-01-26 12:58:50 -05:00
martper2
3727273d9e
DBZ-2981 Debezium swallows DML exception in certain cases
2021-01-26 12:53:44 -05:00
Chris Cranford
83fee1cbfc
DBZ-2949 Guard against LAST_DDL_TIME with value of 0
2021-01-26 13:55:13 +01:00
Chris Cranford
fcd497557e
DBZ-2711 Implement table-level ALL Supplemental Data Logging Validation
2021-01-26 13:53:58 +01:00
Anton Kondratev
c359d2c40e
DBZ-2711 Implement only global minimum supplemental logging validation
2021-01-26 13:53:58 +01:00
Chris Cranford
5a7ac0cfe1
DBZ-2518 Implement Scn as a domain type
2021-01-26 13:52:05 +01:00
Chris Cranford
bb24606188
DBZ-2920 Fix Logminer DML operations using continuation
2021-01-26 13:50:41 +01:00
Chris Cranford
71437acda4
DBZ-2784 Suggested changes
2021-01-07 09:09:30 +01:00
Chris Cranford
4a63680664
DBZ-2784 Support date columns for Oracle Logminer
...
This change also corrects the precision of dates emitted when using
the Oracle Logminer adapter so they're identical to Xstreams adapter.
2021-01-07 09:09:30 +01:00
Chris Cranford
f97d643e1c
DBZ-2825 Fix test failures
2021-01-06 14:48:04 -05:00
Chris Cranford
7b5f0401c8
DBZ-2825 Suggested changes
2021-01-06 14:15:27 +01:00
Chris Cranford
60e53e561a
DBZ-2825 Fix formatting
2021-01-06 14:15:27 +01:00
Chris Cranford
2fc25f9045
DBZ-2825 Change granularity to hours
2021-01-06 14:15:27 +01:00
Chris Cranford
7578da1322
DBZ-2825 Implement log.mining.archive.log.days
2021-01-06 14:15:27 +01:00
Chris Cranford
b0794f33ae
DBZ-2825 Fix archive log support for Oracle LogMiner
2021-01-06 14:15:27 +01:00
Chris Cranford
8d64463e57
DBZ-2849 Fix value conversion with non-compliant Avro column names
2021-01-05 12:43:49 +01:00
Chris Cranford
d0bce38efb
DBZ-2859 Fix formatting
2021-01-04 14:00:11 -05:00
martper2
90e41c6fa2
DBZ-2859 Support TNS Names and full RAC connection strings
2021-01-04 13:52:28 -05:00
Chris Cranford
ca83fd0606
DBZ-2856 Fix passing connection adapter to Surefire tests
2020-12-17 11:38:18 +01:00
Chris Cranford
10ffaaea57
DBZ-2797 Remove explicitly hardcoded tablespaces
2020-12-09 09:52:17 +01:00
Chris Cranford
61c5fbb45c
DBZ-2801 Fix validation
2020-12-08 14:59:27 -05:00
Chris Cranford
848bc2609c
DBZ-2801 Only require database.out.server.name for XStreams
2020-12-08 18:04:35 +01:00
Chris Cranford
5d7faf42a9
DBZ-2759 Capture all commit and rollback redo entries
...
The Oracle LogMiner implementation restricted the COMMIT and ROLLBACK entries
based on a subset of user accounts. This predicate lead to situations where
some environments using these users experienced lost transactions as they
were captured by the transaction buffer and later abandoned since no matching
commit or rollback was ever detected.
The implementation now processes all COMMIT and ROLLBACK operations to make
sure that the transaction buffer is properly managed.
2020-11-20 07:24:18 +01:00
Chris Cranford
3403aa5a0e
DBZ-2763 LogMiner history retention disabled by default
2020-11-20 07:17:46 +01:00
Chris Cranford
5abcd4992f
DBZ-2729 Suggested changes
2020-11-16 07:27:27 +01:00
Chris Cranford
a9d5985bb0
DBZ-2729 Introduce HistoryRecorder hook for custom implementations
2020-11-16 07:27:27 +01:00
Chris Cranford
4828883861
DBZ-2729 Subtle code polish
...
* Rework definition of new configuration options
* Add/fix some java documentation
* Use OracleConnection rather than raw JBDC connection for RAC flush connections
2020-11-16 07:27:27 +01:00
AndreyIg
83dad594b4
DBZ-2729 Implement Oracle LogMiner features/fixes
...
1. Oracle RAC support
2. Historical Tracking
3. Better JMX metrics
4. Mining archive logs
5. Bugfixes & minor enhancements
2020-11-16 07:27:27 +01:00
Jiri Pechanec
02fd590119
DBZ-1446 Use error code instead of exception message; elevate log message level
2020-11-11 10:17:59 +01:00
Chris Cranford
76e27c8c26
DBZ-1446 Avoid Oracle "no snapshot found based on specified time" during snapshot
2020-11-11 10:17:59 +01:00
Chris Cranford
679e3b7a92
DBZ-2679 Handle LCR events with database names with domains
2020-11-04 08:42:20 +01:00
ani-sha
33b4a39930
DBZ-2690 Remove Oracle specific changes
2020-11-04 07:20:57 +01:00
Chris Cranford
64b7df2026
DBZ-2683 Add unit test
2020-11-03 11:11:50 +01:00
mengqiu
fda628120b
DBZ-2683 Support partition tables。
2020-11-03 11:11:50 +01:00
Chris Cranford
9232bed3a3
DBZ-2624 Avoid SQLException with LogMiner
2020-10-22 07:46:11 +02:00
Jiri Pechanec
6e39ebe9ee
DBZ-2653 User rollback from parent class
2020-10-20 14:43:22 +02:00
Chris Cranford
86c1347eb2
DBZ-2629 Suggested changes
2020-10-20 14:43:22 +02:00
Chris Cranford
61be493ce1
DBZ-2629 Fix LogMiner stopping due to ORA-01013
2020-10-20 14:43:22 +02:00
Jiri Pechanec
57017140b4
DBZ-2607 Query param must not be in string
2020-10-01 07:38:00 +02:00
Gunnar Morling
d1d9e3c6fe
DBZ-2607 Using prepared statement parameter
2020-09-30 10:14:10 -04:00
Chris Cranford
1adb216461
DBZ-2607 Fix NullPointerException when getting all table ids
2020-09-30 10:14:10 -04:00
Chris Cranford
6972dab987
DBZ-2555 Cleanup test assertions
2020-09-25 10:42:49 +02:00
Chris Cranford
9e730cc994
DBZ-2555 Fix LogMiner schema change event dispatch
2020-09-25 10:42:49 +02:00
Chris Cranford
756681146f
DBZ-2531 Suggested changes
2020-09-24 09:31:25 +02:00
Gunnar Morling
c8f25fbc96
DBZ-2531 Wording fix
2020-09-24 09:31:25 +02:00
Chris Cranford
aedb0b9a57
DBZ-2531 Implement connection retry for Oracle
2020-09-24 09:31:25 +02:00
Chris Cranford
72751a40c7
DBZ-137 More suggested fixes
2020-09-16 09:55:04 +02:00
Chris Cranford
31a6e47e90
DBZ-137 Suggested fixes
2020-09-16 09:55:04 +02:00
Chris Cranford
551264594f
DBZ-137 Align to main repo changes
2020-09-16 09:55:04 +02:00
Chris Cranford
d7c3f04a07
DBZ-137 Added todos and a try-with-resource blocks
2020-09-16 09:55:04 +02:00
Chris Cranford
d4b0143cdd
DBZ-137 Suggested fixes
2020-09-16 09:55:04 +02:00
AndreyIg
d344ca48f8
DBZ-137 log miner oracle contribution
2020-09-16 09:55:04 +02:00
rkerner
8e8f53ce6b
DBZ-2462 avoid divisive languange in incubator connectors
...
* apply PR feedback changes
2020-09-10 15:22:34 +02:00
rkerner
e08d7173f0
DBZ-2462 avoid divisive languange in incubator connectors
2020-09-10 15:22:34 +02:00
Jiri Pechanec
43995a1b06
DBZ-2423 Support default port in JDBC driver
2020-08-28 09:50:04 +02:00
Chris Cranford
2b87e8e453
DBZ-2452 Allow snapshotting tables/schemas with hyphens
2020-08-28 09:48:39 +02:00
Jiri Pechanec
7ef83b059a
DBZ-1916 Formatting
2020-06-18 05:53:37 +02:00
Chris Cranford
864fc7ee28
DBZ-1916 Add tests for datatype.propagate.source.type
2020-06-16 13:29:06 +02:00
Chris Cranford
59dd2b6211
DBZ-1814 Fix compilation failures
2020-06-11 06:19:54 +02:00
Chris Cranford
56b8a68703
DBZ-775 Add tests for column masking/truncation and message key columns
2020-06-01 13:04:20 +02:00
Jiri Pechanec
2e6b13b827
DBZ-1312 Change whitelist format to schema.table ids
2020-05-22 17:16:24 +02:00
Jiri Pechanec
58e6cb02d4
DBZ-2056 Test for schema topic
2020-05-19 20:25:14 +02:00
Jiri Pechanec
04cb6da78c
DBZ-1904 Test for Db2 schema topic
2020-05-07 09:20:31 +02:00
Jiri Pechanec
034e66a5cd
DBZ-1904 Schema history topic support
2020-05-07 09:20:31 +02:00
Chris Cranford
644c84b3b1
DBZ-1859 Adjusting to changed ChangeEventSourceCoordinator constructor
2020-04-15 16:41:55 +02:00
Jiri Pechanec
9546b56254
DBZ-1905 Validate database history topic
2020-04-14 12:40:38 +02:00
Grant Cooksey
084df1a2c0
DBZ-1942 Oracle connector integration tests poll JMX
...
The oracle integration tests use a number of Thread.sleep() calls to wait for
the snapshotting phase to finish before testing streaming changes but sometimes
this can be unreliable, especially on a slow running db. Instead of sleeping,
polling the jmx metrics to watch for when the snapshot phase ends is preferable.
2020-04-07 11:08:30 +02:00
Gunnar Morling
82d7103acf
DBZ-1898 🗑️ Removing unused class SnapshotChangeRecordEmitter
2020-03-25 13:14:09 +01:00
Gunnar Morling
d23676a7fb
DBZ-1863 Centralizing coordinator shutdown
2020-03-12 11:30:14 +01:00
Gunnar Morling
f290606633
DBZ-1723 Adjusting to changes in BaseSourceTask
2020-03-11 14:05:28 +01:00
Chris Cranford
e84db3030b
DBZ-1726 RelationalSnapshotChangeEventSource API changes
2020-03-11 10:44:01 +01:00
Gunnar Morling
c01d74140e
DBZ-1134 Passing converter registry for Db2 and Oracle
2020-03-05 09:47:42 +01:00
Jiri Pechanec
0c7d6ec950
DBZ-1760 Allow skipping of invalid events
2020-02-25 10:47:01 +01:00
Gunnar Morling
f5704322cc
DBZ-1766 Unifying handling of offset commits; updating lastOffset to commit only after a record is committed
2020-02-12 15:45:31 +01:00
Jiri Pechanec
1d829982f0
DBZ-1052 Transaction metadata for Oracle
2020-02-04 10:00:55 +01:00
Jiri Pechanec
153aa27ff6
DBZ-1552 Support for decimal mode in Oracle config
2020-01-06 10:21:58 +01:00
Gunnar Morling
5e490d4394
DBZ-585 Renaming 'initial_schema_only' snapshot mode for Oracle into 'schema_only'
2019-12-10 09:05:55 +01:00
sheldon.fuchs
1d3a7760a3
DBZ-1631 - alter select to perform timestamp_to_scn on most recent ddl instead of attemping on all
2019-12-04 12:18:11 +01:00
Jiri Pechanec
f1de1eff33
DBZ-825 Unify decimal upscaling
2019-11-22 12:45:25 +01:00
Jiri Pechanec
99ee249cd5
DBZ-1555 TableId parts precedence is configurable
2019-11-12 16:43:28 -05:00
Jiri Pechanec
4f9e9a94ca
DBZ-1392 Reformat Oracle plugin
2019-11-08 14:22:32 +01:00
Jiri Pechanec
4526c244ef
DBZ-1569 Test inaccessible no-PK table
2019-11-08 12:53:05 +01:00
Jiri Pechanec
ed4210abdf
Fix whitespaces
2019-10-08 11:14:53 +02:00
Chris Cranford
1437fc48bc
DBZ-1391 Do not allow code after closing brace
2019-10-02 20:45:28 +02:00
Gunnar Morling
b8cd549f2e
DBZ-1015 Key mapper support for Oracle
2019-09-26 15:03:51 +03:00