Chris Cranford
2db345d1ed
DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE
2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab
DBZ-4036 Only pass one SCN to the timestamp function
2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3
DBZ-4036 move scn_to_timestamp to a seperate function.
2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7
DBZ-4036 extract configuration
2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d
DBZ-4036 handle SCN gap.
2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc
DBZ-4188 Skip LogMiner tests while using XStream
2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f
DBZ-4000 Support parse table and columns comment
2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438
DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable
2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection;
...
Also delaying event parsing until after duplication check.
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea
DBZ-4161 Merge logging and object name length checks
2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b
DBZ-4161 Log warning on long table/column names
2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867
DBZ-4140 scn -> SCN in messages
2021-10-18 12:12:30 +02:00
Chris Cranford
0ae985e5f8
DBZ-4140 Avoid NPE with getMaxArchiveLogScn by using query retries
2021-10-18 12:12:30 +02:00
Chris Cranford
c86a7cba60
DBZ-4064 Fix test failures
2021-10-15 09:17:43 +02:00
Chris Cranford
38fc16c869
DBZ-4064 Fix NullPointerException with LogMinerEventRow initialization
2021-10-15 09:17:43 +02:00
Chris Cranford
7494a1cd29
DBZ-4151 Prevent possible OutOfMemoryError with tracking schema changes
2021-10-14 16:47:22 +02:00
Sergei Morozov
4a03c5df17
DBZ-2975: Include database name into topic and schema names
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-10-12 15:40:02 +02:00
Zongwen Li
636c09e040
DBZ-3986 [oracle] Add the SCHEMA_ONLY_RECOVERY snapshot mode
2021-10-12 15:03:01 +02:00
Chris Cranford
e3294146b5
DBZ-4118 Do not write multiple rows to flush table
2021-10-12 10:29:10 +02:00
Chris Cranford
150f45354a
DBZ-4135 Fix handling of alter table MODIFY column DDL
2021-10-12 10:11:08 +02:00
Chris Cranford
abc3bb42d6
DBZ-4106 Don't continuously reconfigure DatabaseHistory
2021-10-05 20:15:58 +02:00
Gunnar Morling
477efc4033
DBZ-4078 Making sure base lifecycle hook is called
2021-10-04 10:09:51 +02:00
Chris Cranford
6482733915
DBZ-3978 Fix formatting
2021-10-01 14:14:39 -04:00
Willie Zhu
33def4cb48
DBZ-3978 only skip dispatching event for excluded user name
2021-10-01 14:14:39 -04:00
Chris Cranford
d94951ea62
DBZ-3978 Move integration test
2021-10-01 14:14:39 -04:00
Chris Cranford
806246edb0
DBZ-3978 Change loglevel to trace
2021-10-01 14:14:39 -04:00
Chris Cranford
16267cee23
DBZ-3978 Make fields final
2021-10-01 14:14:39 -04:00
Willie Zhu
0a9fced8bb
DBZ-3978 add userName as a constructor argument.Add integration test.
2021-10-01 14:14:39 -04:00
Willie Zhu
0fa6f9f464
DBZ-3978 Exclude usernames at transaction level
2021-10-01 14:14:39 -04:00
Jiri Pechanec
f910fc930b
[release] Switch to 1.8 snapshot
2021-10-01 14:50:16 +02:00
Debezium Builder
12b0ae9046
[maven-release-plugin] prepare for next development iteration
2021-10-01 13:26:33 +02:00
Debezium Builder
652162fd85
[maven-release-plugin] prepare release v1.7.0.Final
2021-10-01 13:26:33 +02:00
Chris Cranford
582a169f92
DBZ-4067 Correctly calculate mining session boundaries
...
It is not guaranteed that the flush strategy will force all LGWR buffer entries
to be written to the redo logs in which case the mining boundaries must then be
calculated based on the lastProcessedScn rather than the current batch endScn.
This prevents event loss between mining sessions when this timing scenario
occurs.
2021-10-01 09:15:04 +02:00
Chris Cranford
5d05fadf04
DBZ-3712 Add poll interval configuration option
2021-09-29 11:52:27 -04:00
Chris Cranford
e85b6e1780
DBZ-3712 Support start/change archive.log.only.mode gracefully
2021-09-28 17:52:35 +02:00
Chris Cranford
7cca4aaa75
DBZ-4037 Gracefully handle unsupported RAW data types
2021-09-28 11:57:23 +02:00
Debezium Builder
bec0b6b67e
[maven-release-plugin] prepare for next development iteration
2021-09-23 06:31:25 +00:00
Debezium Builder
cf8da39725
[maven-release-plugin] prepare release v1.7.0.CR2
2021-09-23 06:31:25 +00:00
Chris Cranford
a14e13ff01
DBZ-4010 Allow ORA-01327 exceptions to be retried
2021-09-21 13:44:26 +02:00
Debezium Builder
c15e0b303b
[maven-release-plugin] prepare for next development iteration
2021-09-16 08:10:45 +00:00
Debezium Builder
23d9790121
[maven-release-plugin] prepare release v1.7.0.CR1
2021-09-16 08:10:44 +00:00
René Kerner
b92e5c5efe
DBZ-3943 Add ConfigDef unit tests to verify all Debezium Field instances have a proper documentation/description set;
...
Also adding missing descriptions.
2021-09-09 13:35:41 +02:00
Chris Cranford
093408bba8
DBZ-3954 Restrict capturing change events to configured PDB
2021-09-02 09:06:28 +02:00
Chris Cranford
47c3273985
DBZ-3892 Reuse precompiled pattern instance
2021-09-01 13:10:00 -04:00
Chris Cranford
8dc4a08c70
DBZ-3892 Correctly parse concatenated UNISTR values
2021-09-01 13:10:00 -04:00
Anisha Mohanty
153e0920e1
DBZ-2525 Generifying exclusion of columns from snapshotting in all relational connectors;
...
* Using RelationalDatabaseSchema in RelationalSnapshotChangeEventSource for consistency.
* Adding test for table/column names which are keywords
2021-08-30 12:20:56 +02:00
Chris Cranford
0f07b43012
DBZ-3898 Skip excluded schema DDL events
2021-08-26 09:20:33 +02:00
Debezium Builder
2ce6bcb2ab
[maven-release-plugin] prepare for next development iteration
2021-08-25 05:20:56 -04:00
Debezium Builder
d3a7efe423
[maven-release-plugin] prepare release v1.7.0.Beta1
2021-08-25 05:20:56 -04:00
Chris Cranford
5263bbe2ec
DBZ-3911 Fix SQLException due to column name typo
2021-08-24 21:41:02 +02:00
Chris Cranford
7e588c6173
DBZ-3896 Support multi-statement table DDLs
2021-08-23 22:48:52 +02:00
Chris Cranford
973fa248ed
DBZ-3902 Fix test failure shouldNotEmitDdlEventsForNonTableObjects
2021-08-23 11:44:14 -04:00
Chris Cranford
b6244591d7
DBZ-3893 Make allocation more explicit
2021-08-23 10:00:20 -04:00
Chris Cranford
26b70316b9
DBZ-3893 Treat EMPTY_XLOB() as an empty LOB value instead of NULL
2021-08-23 10:00:20 -04:00
李宗文
b0c0d879e5
DBZ-3876 Improve the SCN update method in MemoryLogMinerEventProcessor
2021-08-23 09:29:31 -04:00
Chris Cranford
82e09ecd60
DBZ-3813 Change error message
2021-08-18 10:00:06 +02:00
Chris Cranford
b898c6031f
DBZ-3813 Fix method name typo
2021-08-18 10:00:06 +02:00
Chris Cranford
f695bacf6f
DBZ-3813 Add recommended tests
2021-08-18 10:00:06 +02:00
Chris Cranford
7242284b1e
DBZ-3813 Add rac.nodes
port validation
2021-08-18 10:00:06 +02:00
Sergei Morozov
a40ad7132d
DBZ-2975: Remove partition from offset context
2021-08-11 07:34:37 +02:00
Sergei Morozov
77e2ac8a12
DBZ-2975: Introduce io.debezium.pipeline.spi.Offsets
2021-08-11 07:34:37 +02:00
Sergei Morozov
c7ac5fca52
DBZ-2975: Move Partition to io.debezium.pipeline.spi
2021-08-11 07:34:37 +02:00
Debezium Builder
d3c4482d06
[maven-release-plugin] prepare for next development iteration
2021-07-30 02:39:08 -04:00
Debezium Builder
35dcfc5426
[maven-release-plugin] prepare release v1.7.0.Alpha1
2021-07-30 02:39:08 -04:00
Chris Cranford
e2c0c1d3c0
DBZ-3692 Fix NullPointerException
...
This NPE check effectively only enables Incremental Snapshot behavior for Oracle
if a signal data collection id is provided; otherwise its disabled
2021-07-30 06:12:10 +02:00
Chris Cranford
e1b003c4f4
DBZ-3752 Formatting fix
2021-07-30 06:12:10 +02:00
Chris Cranford
492008d771
DBZ-3752 Fix test mocks after rebase
2021-07-30 06:12:10 +02:00
Chris Cranford
709a50a652
DBZ-3752 More suggested changes
...
* Added `infinispan-buffer` profile for testing with infinispan
* Made `online_catalog` the default for testing
* Added protostream-processor back to the POM
2021-07-30 06:12:10 +02:00
Chris Cranford
1c0b4fd5af
DBZ-3752 Suggested changes
2021-07-30 06:12:10 +02:00
Chris Cranford
0cbce95a0c
DBZ-3752 Memory & Infinispan Buffering implementations
2021-07-30 06:12:10 +02:00
Chris Cranford
26461bc07d
DBZ-3692 Introduce completion callback for incremental snapshots
2021-07-29 13:51:42 +02:00
Chris Cranford
393a44a55f
DBZ-3692 Oracle incremental snapshot support
2021-07-29 13:51:42 +02:00
Chris Cranford
10ab20a157
DBZ-2552 Refactor & introduce LogWriterFlushStrategy
2021-07-28 13:25:03 +02:00
Chris Cranford
1fd68e6fa9
DBZ-2552 Refactored several methods to connection class
2021-07-28 13:25:03 +02:00
Chris Cranford
6a1267b26c
DBZ-2552 Refactored constants usage
2021-07-28 13:25:03 +02:00
Chris Cranford
a7498ca340
DBZ-2552 Remove non-runtime code
2021-07-28 13:25:03 +02:00
Chris Cranford
0fa869388e
DBZ-2552 Minor code cleanup
2021-07-28 13:25:03 +02:00
Chris Cranford
bd0dd5ec9c
DBZ-2552 Refactored database state capture logic
2021-07-28 13:25:03 +02:00
Chris Cranford
48b01dd837
DBZ-2552 Refactored supplemental logging logic
2021-07-28 13:25:03 +02:00
Chris Cranford
e49e3f9211
DBZ-2552 Refactored getting current redo log filenames
2021-07-28 13:25:03 +02:00
Chris Cranford
60a90851c6
DBZ-2552 Refactored mining session ending SCN logic
2021-07-28 13:25:03 +02:00
Chris Cranford
5898dc4b0a
DBZ-2552 Refactored start/end mining session logic
2021-07-28 13:25:03 +02:00
Chris Cranford
e02c2eb912
DBZ-2552 Remove unused or irrelevant code
2021-07-28 13:25:03 +02:00
Chris Cranford
8eed85037f
DBZ-2552 Refactored SCN queries
2021-07-28 13:25:03 +02:00
Chris Cranford
b8c2d6e64a
DBZ-2552 Refactored getting database system time
2021-07-28 13:25:03 +02:00
Chris Cranford
4ca93c6ff8
DBZ-2552 Refactored setting NLS parameters for mining session
2021-07-28 13:25:03 +02:00
Chris Cranford
a0e1acdf3e
DBZ-2552 Refactored create flush table logic
2021-07-28 13:25:03 +02:00
Chris Cranford
9a1e181ed7
DBZ-2552 Refactored build data dictionary logic
2021-07-28 13:25:03 +02:00
Chris Cranford
fe499bf3d2
DBZ-2552 Refactored Oracle LGWR flush logic
2021-07-28 13:25:03 +02:00
Chris Cranford
d450f58b37
DBZ-3756 Add UGA/PGA memory statistics to JMX metrics
2021-07-16 11:07:48 -04:00
Chris Cranford
52e198e3b5
DBZ-3683 Relax restrictions on connector user
2021-07-16 16:28:31 +02:00
Gunnar Morling
cbb5a78a6d
DBZ-3671 More concise variable name
2021-07-05 12:27:04 +02:00
Gunnar Morling
bc21c14489
DBZ-3671 Apply suggestions from code review
2021-07-05 12:26:59 +02:00
Chris Cranford
4e0c54d782
DBZ-3671 Add test for user exclusion SQL condition
2021-07-05 12:26:59 +02:00
Chris Cranford
ddf25b144c
DBZ-3671 Remove trailing space in query
2021-07-05 12:26:59 +02:00
Patrick Chu
77f268abe6
DBZ-3671 Add property to exclude users in logminer query
2021-07-05 12:26:59 +02:00
Chris Cranford
ed31ea9ffb
DBZ-3668 Adjust ServiceLoader for SPI change
2021-07-03 16:31:52 +07:00
Gunnar Morling
b84c3c870d
DBZ-3668 Extracting SPI package
2021-07-03 16:31:52 +07:00
Chris Cranford
77f57ee703
DBZ-3668 Fix formatting
2021-07-03 16:31:52 +07:00
Chris Cranford
7f7e23b110
DBZ-3668 Add ServiceLoader hook CloudEvents converter
2021-07-03 16:31:52 +07:00
Chris Cranford
3f759a8daa
DBZ-3668 Add CloudEventsConverter support for Oracle connector
2021-07-03 16:31:52 +07:00
Sergei Morozov
db105baeba
DBZ-2975: Add partition awareness to source task components
...
Co-authored-by: Mike Kamornikov <mikekamornikov@gmail.com>
2021-07-03 10:56:34 +02:00
Gunnar Morling
5b76bf1b71
DBZ-3632 Pulling up getJdbcConfig() to RelationalDatabaseConnectorConfig
2021-07-01 15:11:01 +02:00
Gunnar Morling
e8af7176e9
DBZ-3155 Removing JSqlParser from POM files
2021-07-01 10:57:45 +02:00
Chris Cranford
b625124e09
DBZ-3155 Move LogMinerDmlEntry & impl
2021-07-01 10:57:45 +02:00
Chris Cranford
c7622cbc18
DBZ-3155 Remove legacy DDL JSqlParser implementation
2021-07-01 10:57:45 +02:00
Chris Cranford
d804f41775
DBZ-3581 Remove deprecated log.mining.history.xxx
features
2021-07-01 09:31:18 +02:00
Chris Cranford
237a71ea3c
DBZ-3684 OracleSchemaMigrationIT - Fix possible false positive test failure
2021-07-01 09:10:42 +02:00
Chris Cranford
51825b0b47
DBZ-3677 Change connection validation failure message log level
2021-07-01 09:08:08 +02:00
Debezium Builder
9d3f6b2a86
[maven-release-plugin] prepare for next development iteration
2021-06-30 03:45:06 -04:00
Debezium Builder
c8c5fc4b56
[maven-release-plugin] prepare release v1.6.0.Final
2021-06-30 03:45:06 -04:00
Chris Cranford
db8475be42
DBZ-1211 Add extra test assertions
2021-06-29 11:14:19 +02:00
Chris Cranford
bcf5441284
DBZ-1211 Add test case
2021-06-29 11:14:19 +02:00
Jiri Pechanec
472b82abb7
DBZ-3622 Decouple database and schema history record writes
2021-06-29 10:36:41 +02:00
Chris Cranford
01e87c11ed
DBZ-3676 When LOB support is disabled, use adaptive SCN mining windows
2021-06-29 09:46:49 +02:00
Chris Cranford
09fa730d98
DBZ-3661 Introduce Oracle log.mining.archive.destination.name
option
2021-06-29 09:25:57 +02:00
Gunnar Morling
ab3cf09165
DBZ-3665 Formatting
2021-06-28 15:53:36 +02:00
Chris Cranford
b9a79dcdd0
DBZ-3665 Provide better error description when enabling archive log only mode
2021-06-28 15:53:36 +02:00
Chris Cranford
d5d1ca8db2
DBZ-3664 Fix formatting
2021-06-28 02:57:33 -04:00
Gunnar Morling
3d30b7371f
DBZ-3664 Wording fix
2021-06-28 08:25:34 +02:00
Chris Cranford
4a844aa36b
DBZ-3664 Adjust log level for max batch reached message
2021-06-28 08:25:34 +02:00
Chris Cranford
4db80f86f0
DBZ-3672 Remove unused code
2021-06-26 22:03:14 +02:00
Debezium Builder
ae053414ac
[maven-release-plugin] prepare for next development iteration
2021-06-24 01:50:07 -04:00
Debezium Builder
af3f942a74
[maven-release-plugin] prepare release v1.6.0.CR1
2021-06-24 01:50:07 -04:00
Chris Cranford
185e598d91
DBZ-3645 Fix test failures for Oracle Xstream
2021-06-23 08:00:43 -04:00
Chris Cranford
61b22d9574
DBZ-3645 Adjust metrics calculations & logging levels
2021-06-23 09:55:29 +02:00
Chris Cranford
16eb60d8f1
DBZ-3645 Adjust SCN end point calculation w/sanity checks
2021-06-23 09:55:29 +02:00
Chris Cranford
c9e62a6806
DBZ-3645 Make Oracle LOB support opt-in
2021-06-23 09:55:29 +02:00
Chris Cranford
f6edfdc49a
DBZ-3365 Revert "Remove unused imports", commit 080d701
2021-06-23 00:54:18 -04:00
Chris Cranford
080d7014db
DBZ-3365 Remove unused imports
2021-06-22 11:45:28 -04:00
Chris Cranford
8b90786b35
DBZ-3634 Enable DDL events to be filtered by include/exclude lists
2021-06-22 11:26:57 +02:00
Chris Cranford
3113cb9175
DBZ-3639 Send heartbeat events during periods of low activity.
2021-06-21 11:03:01 +02:00
Chris Cranford
537437e6fa
DBZ-3631 Suggested changes & formatting fixes
2021-06-21 09:28:03 +02:00
Chris Cranford
bb40bd9d67
DBZ-3631 Introduce ChunkColumnValues wrapper optimization
2021-06-21 09:28:03 +02:00
Chris Cranford
19d7ad401a
DBZ-3631 Use traditional loop instead of stream
2021-06-18 08:42:31 +02:00
Chris Cranford
2310e45f3c
DBZ-3631 Align Xstream to emit null when BLOB/CLOB fields are set to null.
...
While LogMiner already did this, the Xstream implementation was not checking for
this use case and was instead emitting empty strings or empty byte buffer values
rather than explicit nulls if there was no data.
2021-06-18 08:42:31 +02:00
Chris Cranford
29b7f1fa44
DBZ-3631 Fix Oracle trx reconciliation not finding PK columns
2021-06-17 09:10:33 +02:00
Chris Cranford
b4ac2f9c1c
DBZ-3616 Avoid logging processed trx warnings & emit DDL changes once
2021-06-16 10:17:41 +02:00
Chris Cranford
aedb6118da
DBZ-3612 Do not parse Oracle ALTER TABLE ddl for unknown tables
2021-06-16 10:07:32 +02:00
Debezium Builder
48ca58a609
[maven-release-plugin] prepare for next development iteration
2021-06-10 06:03:12 -04:00
Debezium Builder
0961517859
[maven-release-plugin] prepare release v1.6.0.Beta2
2021-06-10 06:03:12 -04:00
Chris Cranford
8783eae098
DBZ-3599 Fix Oracle RAC url variable substitution
2021-06-09 16:03:31 +02:00
Gunnar Morling
1ce65fa628
DBZ-2975 Avoiding raw types in some places;
...
Also parameterizing offset loader contract, so to avoid casts later on.
2021-06-09 16:02:33 +02:00
Sergei Morozov
657a6d2542
DBZ-2975: Extract offset context from object states to method signatures
2021-06-09 16:02:33 +02:00
Chris Cranford
473eb2c02c
DBZ-3561 Introduce archive log only mode for Oracle
2021-06-09 10:18:17 +02:00
Chris Cranford
9cc6239bc0
DBZ-3591 Fix SelectLobParser throwing NPE for unknown tables
2021-06-07 15:15:21 +02:00
Chris Cranford
4d3c1f7e72
DBZ-3062 Use captured instead of monitored
2021-06-07 11:19:54 +02:00
Chris Cranford
a2fc19f409
DBZ-3062 Oracle connector support snapshot.include.collection.list
2021-06-07 11:19:54 +02:00
Chris Cranford
de2fe7149b
DBZ-3563 Deduplicate logs based on sequence number and not scn ranges
2021-06-07 11:17:11 +02:00
jackey.zhang
c32e290fac
DBZ-3587 fix NPE when builder is null
2021-06-04 07:19:15 +02:00