Chris Cranford
8ef9a6f015
DBZ-6355 Reduce logging verbosity
2023-04-27 09:28:29 -04:00
Chris Cranford
e81af64adc
DBZ-6355 Add ORA-01555 fallback based on change time
2023-04-27 09:28:29 -04:00
Chris Cranford
1fbb6f228d
DBZ-6355 Fix test failures
2023-04-27 09:28:29 -04:00
Chris Cranford
3d7c87401f
DBZ-6355 Fix format
2023-04-27 09:28:29 -04:00
Sergey Eizner
b954afd2cc
DBZ-6355 Fix log message
2023-04-27 09:28:29 -04:00
Chris Cranford
9f28ef17e4
DBZ-6355 Don't abandon transactions if calculated SCN is before oldest buffered SCN
2023-04-27 09:28:29 -04:00
Chris Cranford
34f6b221c6
DBZ-6355 Remove unused code
2023-04-27 09:28:29 -04:00
Chris Cranford
a0fedf9439
DBZ-6355 Rework test
2023-04-27 09:28:29 -04:00
eizners
fa42a1b0ce
DBZ-6355 fix unit tests errors
2023-04-27 09:28:29 -04:00
Sergey Eizner
cac5485176
DBZ-6355 Change to the last offset
2023-04-27 09:28:29 -04:00
Chris Cranford
e6e19fb578
DBZ-6329 Trim value of rs_id
2023-04-23 18:29:07 +02:00
Chris Cranford
f624e39bbc
DBZ-6329 Make sure Oracle source rs_id field populated
2023-04-23 18:29:07 +02:00
Debezium Builder
bb1b79f3bd
[maven-release-plugin] prepare for next development iteration
2023-04-20 09:09:43 +02:00
Debezium Builder
5483b4de99
[maven-release-plugin] prepare release v2.2.0.Final
2023-04-20 09:09:43 +02:00
Jiri Pechanec
ee5ba8e56f
DBZ-2979 Fix Oracle Xstream tests
2023-04-19 15:57:49 +02:00
Chris Cranford
16385994d8
DBZ-5395 Improve Oracle offset management when LOB enabled
2023-04-19 11:24:10 +02:00
Chris Cranford
1805f6e75e
DBZ-6276 Marked test ignored by default
...
The default Debezium Oracle images are pre-configured with archive log mode
enabled and this isn't something we can simply turn off and back on in the
test suite proper. This test must be invoked manually and separately, so it
is disabled by default in the overall test suite execution.
2023-04-19 10:52:18 +02:00
Mark Bereznitsky
4df3895d65
DBZ-6276 changed Oracle archive log check to fail if conditions require it
2023-04-19 10:52:18 +02:00
Jiri Pechanec
2181251a9f
DBZ-2979 Fix Oracle tests
2023-04-19 10:50:41 +02:00
Ronak Jain
2c2b87b846
DBZ-2979 If column.include.list/column.exclude.list are used and the target table receives an update for the excluded (or not included) column - such events should be ignored
...
* [Unstable][Untested] Add config in Oracle Connector
Addresses/Closes DBZ-2979
2023-04-19 09:04:29 +02:00
Debezium Builder
976a47a3a3
[maven-release-plugin] prepare for next development iteration
2023-04-14 08:46:06 +00:00
Debezium Builder
1ca8399e8b
[maven-release-plugin] prepare release v2.2.0.CR1
2023-04-14 08:46:06 +00:00
Chris Cranford
36bc3ce07a
DBZ-6129 Use Infinispan Jakarta EE based artifacts
2023-04-13 17:18:23 -04:00
Chris Cranford
84d57628b7
DBZ-6155 Avoid batch size "ping-pong" in Oracle metrics
...
This avoids a scenario where we want to increment the batch size; however, the
current batch size is equal to the max and therefore triggers a decrement and
the next iteration increments. The new behavior will be that we don't trigger
this ping pong. With this change, we can track specifically when we reach the
max batch size and only log the warning once. If the batch size drops, and it
later increments, the warning will be logged again but this should be expected.
2023-04-10 16:51:11 -04:00
doupengwei
352d616173
DBZ-6155 Adjust LogMiner batch size based on the default batch size rather than current batch size.
...
Using current batch size for comparison is wrong in case that when currentScn is topScn as described in DBZ-6155.
In the other case (when topScn is behind currentScn) can eventually lead to this situation.
when topScn would fall behind currentScn more and more as we would compare currentScn - topScn with bigger and bigger number (current batch size).
Comapring with logMiningBatchSizeMin could result in very small window which would mean we will send many small queries instead of several bigger ones during mining.
Therefore reverting back to do the adjustments based on the defaultBatchSize.
2023-04-10 16:51:11 -04:00
harveyyue
c525f34cd0
DBZ-6070 DDL events not stored in schema history topic for excluded tables
2023-04-06 12:10:30 +02:00
Chris Cranford
2ef6bd66e4
DBZ-6273 Fix Infinispan serialization of table names with spaces
2023-04-01 17:04:06 -04:00
Chris Cranford
3bb82d6b73
DBZ-6275 Correctly sync Infinispan cache on event counter reset
2023-04-01 16:37:25 -04:00
Chris Cranford
6419c0e704
DBZ-6274 Fix ClusterLoader deprecation using embedded Infinispan
...
The embedded Infinipsan configuration used a deprecated index model, and
moved to a non-deprecated model called SIFS using segments.
2023-04-01 15:29:12 -04:00
Chris Cranford
42f375f570
DBZ-6274 Align test configurations for remote Infinispan caches
...
The "fetch-state" attribute was deprecated and is no longer a valid option
with Infinispan 14, which causes the tests to fail to execute. Additionally,
the "segmented" attribute must be set to true going forward as the file
store implementation no longer supports non-segmented configurations.
2023-04-01 15:29:12 -04:00
Debezium Builder
5c650fd054
[maven-release-plugin] prepare for next development iteration
2023-03-31 10:00:16 +00:00
Debezium Builder
68ffc4833b
[maven-release-plugin] prepare release v2.2.0.Beta1
2023-03-31 10:00:16 +00:00
Jiri Pechanec
04def67900
DBZ-6221 Remove print statements
2023-03-28 14:45:12 +02:00
Chris Cranford
f9bb5eb82f
DBZ-6221 Correctly interpret CHARACTER/CHARACTER VARYING data types while streaming
2023-03-28 14:45:12 +02:00
Debezium Builder
55d65e9618
[maven-release-plugin] prepare for next development iteration
2023-03-08 11:38:17 +00:00
Debezium Builder
6d183c3dc1
[maven-release-plugin] prepare release v2.2.0.Alpha3
2023-03-08 11:38:16 +00:00
Jiri Pechanec
f62caf9c83
DBZ-6143 Make tests running with xstream
2023-03-08 09:15:48 +01:00
Jiri Pechanec
3da2434c6c
DBZ-823 Restrict the type with generics
2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee
DBZ-823 Add JavaDoc to new interfaces
2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211
DBZ-823 Don't use getter based name
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6
DBZ-823 Use better name for CF with main connection
2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0
DBZ-823 CR changes
2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9
DBZ-823 Optionally parallelize initial snapshots
2023-03-03 12:47:15 +01:00
Vojtech Juranek
fcb0e77bbb
DBZ-3594 Warn when obtaning table schema which should be alread present
...
We load all the schemas of the captured tables when the connector
starts. If we process a record from a table which schema is not
available, this means we have some bug in the intial schema loading.
Don't fail in such case, but print a warning about that.
2023-02-23 09:26:07 -05:00
Chris Cranford
e320abc834
DBZ-6143 Unify Oracle TIMESTAMP WITH TIME ZONE format
...
When taking a snapshot, the Oracle connector was converting the TIMESTAMP
WITH TIME ZONE value to GMT and per the documentation, the value should
be emitted in the time zone of the data.
The snapshot emitted value in GMT is temporally accurate, so there is no
data inconsistency, but the emitted format itself was inconsistent when
looking at how the column data was emitted during a snapshot versus in a
streaming event.
2023-02-23 10:43:38 +01:00
Chris Cranford
dd9ca95bec
DBZ-6125 Fix potential stale offsets when using PDBs
...
DBZ-5648 introduced a regression where transaction start, commit, and rollback
events were only being read from within the scope of the configured PDB that
the connector was capturing changes instead of the entire Oracle database.
This can lead to situations where the offsets may not be advanced as quickly
in a low traffic PDB environment, potentially causing stale offsets.
2023-02-20 13:29:11 +01:00
Chris Cranford
a89212efef
DBZ-6120 Correctly handle quoting table/schema names
2023-02-20 13:26:49 +01:00
Debezium Builder
2245ceda44
[maven-release-plugin] prepare for next development iteration
2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a
[maven-release-plugin] prepare release v2.2.0.Alpha2
2023-02-16 11:28:25 +00:00
Chris Cranford
58f3770ad1
DBZ-6079 Change query.fetch.size
default from 0
to 2000
for Oracle
2023-02-16 08:15:22 +01:00
Chris Cranford
6b40103eaa
DBZ-6107 Fix bulk updates when LOB is enabled
2023-02-16 07:29:37 +01:00
Chris Cranford
7cd7cad094
DBZ-6091 Fix SSN NumericOverflow exception
2023-02-14 09:44:21 +01:00
Chris Cranford
0771923416
DBZ-6094 Reduce frequency of "Transaction already processed" debug message
2023-02-14 09:09:44 +01:00
harveyyue
57b902ff8c
DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector
2023-02-02 13:21:45 +01:00
Debezium Builder
04f5291a2d
[maven-release-plugin] prepare for next development iteration
2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e
[maven-release-plugin] prepare release v2.2.0.Alpha1
2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb
DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result
2023-01-19 09:24:02 +01:00
Jiri Pechanec
e8729bb0eb
DBZ-5996 Properly handle zoned timestamp width in Oracle
2023-01-18 10:42:36 +01:00
Jiri Pechanec
bcd6787cdc
DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config"
...
This reverts commit 6d8bcd42fd
.
2023-01-17 10:40:20 +01:00
govi20
6d8bcd42fd
DBZ-3653 Introduce incremental.snapshot.isolation.mode config
2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5
DBZ-4669 Reformat after plugin version consolidation
2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6
DBZ-2439 Remove redundant modifiers
2023-01-11 06:44:53 +01:00
Chris Cranford
c57338d7c9
DBZ-5907 Fix transaction event undo
2023-01-09 12:43:03 +01:00
Chris Cranford
e7ef0d9b37
DBZ-3866 Add internal read-only LogMiner support
2023-01-05 07:40:37 +01:00
Debezium Builder
cf1720e4cb
[maven-release-plugin] prepare for next development iteration
2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd
[maven-release-plugin] prepare release v2.1.0.Final
2022-12-22 10:11:53 +00:00
Debezium Builder
177a60a9d3
[maven-release-plugin] prepare for next development iteration
2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c
[maven-release-plugin] prepare release v2.1.0.Beta1
2022-12-16 09:33:38 +00:00
Jiri Pechanec
97f3edf906
DBZ-5880 Handle null explicitly
2022-12-16 09:24:52 +01:00
Jiri Pechanec
c9fe6d5ef7
DBZ-5880 Removed redundant code
2022-12-16 08:44:54 +01:00
Vojtech Juranek
02705903f1
DBZ-5880 Skip failing intTypes test when run with Apicurio
...
* Add annotation and jUnit rule for skipping test when it's run against
Apicurio registry.
* Skip `AbstractOracleDatatypesTest#intTypes` tests which fails with
Apicurio. Which is partially tests in `OracleNumberNegativeScaleIT`
2022-12-16 08:44:54 +01:00
Vojtech Juranek
56ad55ae7b
DBZ-5880 Create converter for numbers with negative scales
...
Oracle allows the scale to be negatove for `NUMBER` data type.
Conversion of such number to Avro would fail as Avro doesn't allow
negative scales. Provide a converter which converts the number to
zero scale number. For completeness the converter provides also
conversion to other supported types - string and double.
N.B.: if the conversion to Avro fails actually depends on
implementation, e.g. Kafka schema registy allows also negative scales.
2022-12-16 08:44:54 +01:00
Vojtech Juranek
163ea307aa
DBZ-5838 Skip Avro validation in tests which fail due to apicurio-registry #2980
2022-12-12 14:44:05 +01:00
Vojtech Juranek
0105823dad
DBZ-5838 Start Apicurio registry in its own profile
...
Oracle build is run differently on internal Jenkins than other
connectors and also Apicurio has to be started in a different way.
2022-12-12 14:44:05 +01:00
Vojtech Juranek
9494552a3a
DBZ-5838 Add missing Apicurio converter dependency
2022-12-12 14:44:05 +01:00
Jiri Pechanec
7f17bdfba5
DBZ-2432 Fix formatting
2022-12-08 13:10:26 +01:00
Marcelo Avancini
7754163c5d
DBZ-2432: Fixing misuse of assertj
...
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
2022-12-08 13:10:26 +01:00
Vojtech Juranek
e1b65cd6f7
DBZ-5889 Run integration tests in specified order
...
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
2022-12-08 13:00:41 +01:00
Debezium Builder
81896ed334
[maven-release-plugin] prepare for next development iteration
2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c
[maven-release-plugin] prepare release v2.1.0.Alpha2
2022-11-30 07:52:23 +00:00
Egyed Tamas
ef6f1caa50
DBZ-5854 Bump Infinispan dependencies' versions.
2022-11-29 16:12:53 -05:00
Chris Cranford
06610a2bf0
DBZ-5850 Fix test OracleConnectorIT shouldIgnoreAllTablesInExcludedSchemas
2022-11-22 11:05:40 +01:00
tooptoop4
4d57765596
DBZ-5833 AbstractLogMinerEventProcessor DEBUG to TRACE loglevel
2022-11-14 09:22:35 -05:00
Debezium Builder
e311dd1a67
[maven-release-plugin] prepare for next development iteration
2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a
[maven-release-plugin] prepare release v2.1.0.Alpha1
2022-11-10 13:29:05 +00:00
Chris Cranford
21f870d5db
DBZ-5759 Log current active transactions metadata
2022-11-10 07:31:28 +01:00
Chris Cranford
6842f701f1
DBZ-5759 Log online redo log sizes
2022-11-10 07:31:28 +01:00
Chris Cranford
22593e5fe1
DBZ-5648 Move LogMiner RegEx handling into Java
2022-11-10 07:23:52 +01:00
Vojtech Juranek
97138bb3e8
DBZ-5791 Make ORA-01089 retriable based on its message
2022-11-09 10:55:56 -05:00
Vojtech Juranek
96e4326d35
DBZ-2131 Use system property to determine if Apicurio should be used
2022-11-09 08:44:45 +01:00
Vojtech Juranek
df2ad6d3c1
DBZ-2131 Add Apicurion profile for Oracle
2022-11-09 08:44:45 +01:00
Vojtech Juranek
54b5582130
DBZ-2131 Unify intendation in Oracle pom.xml
2022-11-09 08:44:45 +01:00
Chris Cranford
54bde9b3bb
DBZ-5773 Correctly discard LOB_ERASE events
2022-11-08 17:37:38 -05:00
Vojtech Juranek
15308b8d78
DBZ-5738 Skip nested tables and their parent tables
...
Nested tables are currently not supported.
2022-11-08 15:37:26 -05:00
Vojtech Juranek
f347c1c844
DBZ-5626 Don't check ofsset for AWLAYS mode
...
While `ALWAYS` mode allows also snapshot on schema error, it allows
snapshot also on other ocassions. Don't throw exception when offset
is missing and schema is set to `ALWAYS`.
2022-11-08 11:03:05 -05:00
Vojtech Juranek
28aa715867
DBZ-5626 Do the snapshot also in case of schema history errors
...
`ALWAYS` should mean always and also this should be in line with Postgres
`ALWAYS` option.
2022-11-03 15:41:29 +01:00
Vojtech Juranek
3fcfd9a0e8
DBZ-5626 Add ALWAYS snapshot mode for Oracle connector
...
For AWLAYS snapshot mode it's important to obtain up-to-date SCN,
therefore offset, if exists, is ignored during snapshot.
2022-11-03 08:59:27 +01:00
Chris Cranford
993a547c2f
DBZ-5756 Add Compression Advisor tables as system-excluded tables
2022-11-02 13:58:25 +01:00
jcechace
6aa7331888
DBZ-5779 Migrated debezium-connector-oracle to AssertJ
2022-11-02 08:50:26 +01:00
Chris Cranford
dc5de5ae87
DBZ-5760 Only log full row data at TRACE level
2022-10-26 08:13:34 +02:00
Chris Cranford
93e4eb0092
DBZ-5482 TransactionBoundaryMode ALL mode more reliable
2022-10-19 13:31:00 +02:00
Chris Cranford
7c07c3faaf
DBZ-5682 Allow unique index NULL values in trx reconciliation
2022-10-19 13:28:40 +02:00
Debezium Builder
4d35fb8011
[maven-release-plugin] prepare for next development iteration
2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99
[maven-release-plugin] prepare release v2.0.0.Final
2022-10-14 11:26:32 +00:00
thangdc94
f6be36612f
DBZ-5276 Remove redundant import
2022-10-14 08:22:56 +02:00
thangdc94
c53af41deb
DBZ-5276 Fix wrong log switching condition
2022-10-14 08:22:56 +02:00
thangdc94
4a9539266d
DBZ-5276 Fix Group by condition for thread
2022-10-14 08:22:56 +02:00
thangdc94
d233e969e7
DBZ-5276 Prevent add duplicate log file
2022-10-14 08:22:56 +02:00
Debezium Builder
884254aba1
[maven-release-plugin] prepare for next development iteration
2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6
[maven-release-plugin] prepare release v2.0.0.CR1
2022-10-07 09:27:51 +00:00
Chris Cranford
8ec0846deb
DBZ-5541 Fix Oracle test compatibility failure
2022-10-05 13:25:08 -04:00
harveyyue
f6b72f060c
DBZ-5671 Remove logic name parameter from sub connector config
2022-10-03 11:40:17 -04:00
Vojtech Juranek
97532042b3
DBZ-5657 Allow to use Docker maven plugin external properties
...
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.
[1] https://dmp.fabric8.io/#combining-property-config
2022-09-29 05:41:09 +02:00
Chris Cranford
4e3b4ebae7
DBZ-5645 Skip rollback trx cache when LOB is disabled
2022-09-22 18:09:33 -04:00
Chris Cranford
79ca0becae
DBZ-5635 Reduce undo trx log verbosity when LOB enabled
2022-09-22 13:18:06 +02:00
Ismail Simsek
b966f4b65b
DBZ-5591 Snapshot process setting source.ts_ms
2022-09-20 17:12:54 -04:00
Chris Cranford
13bfcc8270
DBZ-5581 Extend test cases with NULL assignment
2022-09-20 08:35:59 +02:00
Chris Cranford
5484948127
DBZ-5581 Apply unavailable value placeholder on when parsing SELECT_LOB_LOCATOR event types
2022-09-20 08:35:59 +02:00
harveyyue
288c93434f
DBZ-5585 Remove classloader parameter from JdbcConnection
2022-09-19 17:15:29 +02:00
harveyyue
20d56734d4
DBZ-5585 Modify the Instantiator to not require classloader
2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552
[maven-release-plugin] prepare for next development iteration
2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b
[maven-release-plugin] prepare release v2.0.0.Beta2
2022-09-16 06:36:39 +00:00
Jiri Pechanec
3dc16b722b
DBZ-4842 LogMiner specific test
2022-09-16 05:27:43 +02:00
harveyyue
f21ebc98fe
DBZ-5609 Oracle connector couldn't parse type_name mdsys.sdo_geometry
2022-09-14 15:57:41 -04:00
Vojtech Juranek
acc6be6df3
DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig
...
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
2022-09-13 09:25:54 +02:00
Anisha Mohanty
9fd204b383
DBZ-5044 Introduce respective SchemaFactory for all connectors
2022-09-08 10:35:20 +02:00
Vojtech Juranek
402df78381
DBZ-5043 Rename schema.history to schema.history.internal
2022-09-07 12:57:31 +02:00
Vojtech Juranek
b797201263
DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH
2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5
DBZ-5043 Replace 'database history' with 'database schema history'
...
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79
DBZ-5043 Rename DatabaseHistory to SchemaHistory
...
Rename also all related classes and varibales.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25
DBZ-5043 Replace database.server.name with topic.prefix
2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6
DBZ-5043 Use topic prefix as the logical name
...
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.
Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
2022-09-07 12:57:31 +02:00
Vojtech Juranek
25aa6c4acc
DBZ-5043 Change namespace to database.history
to schema.history
2022-09-07 12:57:31 +02:00
Vadzim Ramanenka
917de37a01
DBZ-5557: Supply partition when comiting offsets with source database
...
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
2022-09-05 14:04:23 +02:00
ggaborg
244de2bd96
DBZ-3293 Add signal table automatically to include list
2022-09-01 20:16:47 +02:00
Chris Cranford
b5754a19ec
DBZ-5439 Remove rsid and ssn from CommitScn format
2022-09-01 09:32:17 +02:00
Chris Cranford
c0f92e24ea
DBZ-5439 Updated tests, use TreeSet trx id deterministic order
2022-09-01 09:32:17 +02:00
thangdc94
57210095d2
DBZ-5439 Fix testcase
2022-09-01 09:32:17 +02:00
thangdc94
c755720637
DBZ-5439 Backward compatible with old commit scn
2022-09-01 09:32:17 +02:00
thangdc94
cfa8b780ed
DBZ-5439 Add transaction id associate with commit scn
2022-09-01 09:32:17 +02:00
harveyyue
7ccd40129c
DBZ-5569 Oracle connector's max.queue.size.in.bytes is invalid
2022-08-31 09:39:29 -04:00
Chris Cranford
92ca57d731
DBZ-5229 Restore Kafka-based database history options in SchemaGenerator
2022-08-30 10:32:12 -04:00
pkgonan
b031770300
DBZ-5544 Support BASE64_URL_SAFE in BinaryHandlingMode
2022-08-24 09:50:23 +02:00
Chris Cranford
14c9f8855b
DBZ-5327 Fix Oracle/Db2 test failures
2022-08-19 11:33:01 -04:00
Chris Cranford
176529e83b
DBZ-5521 Fix concatenation operator handling in LogMiner DML parser
2022-08-19 11:19:45 +02:00
Chris Cranford
37b97970a6
DBZ-5497 Skip truncate operations by default
...
* Promote truncate skip default from PostgreSQL to core library
* Adjust behavior for Oracle with truncates skipped by default
2022-08-19 11:05:29 +02:00
Vivek Wassan
d89e71ebeb
DBZ-5327 Smart Backfills
2022-08-17 10:05:55 +02:00
Chris Cranford
41a9324044
DBZ-5441 Gracefully skip Oracle non-relational tables
2022-07-29 12:56:27 -04:00
harveyyue
5f430f1a8e
DBZ-5457 Deprecate legacy topic selector for all connectors
2022-07-28 12:58:59 -04:00
Debezium Builder
1ab51ae8d0
[maven-release-plugin] prepare for next development iteration
2022-07-26 18:13:10 +00:00
Debezium Builder
d247a48b79
[maven-release-plugin] prepare release v2.0.0.Beta1
2022-07-26 18:13:09 +00:00
Chris Cranford
412498db41
DBZ-5295 Avoid NPE With Xstream emitter
2022-07-26 11:05:17 -04:00
Chris Cranford
2c2cb9213a
DBZ-5248 Avoid NumberFormatException in OracleConnectorIT tests
2022-07-20 13:21:59 -04:00
Chris Cranford
f8d097ebc3
DBZ-5419 Fix OracleSchemaMigrationIT (non-CDB) test failure
2022-07-19 09:23:16 -04:00
Anisha Mohanty
04941330c3
DBZ-5390 Reorder relational_property definition to give priority to out_of_line_constraint
2022-07-14 08:55:21 +02:00
Chris Cranford
f62fab4364
DBZ-5404 Use fail from fest assertions
2022-07-14 08:40:42 +02:00
harveyyue
6ea7abc8fc
DBZ-4180 Pluggable topic selector
2022-07-13 14:45:25 +02:00
Jiri Pechanec
d8baac7c46
DBZ-5229 Reorganize code for inheritance use
2022-07-12 17:31:19 +02:00
Hossein Torabi
1ea02be9c2
DBZ-5229 define centralized and modular aproach for debezium storage
2022-07-12 17:31:19 +02:00
Chris Cranford
35e3eae52f
DBZ-5295 Add delete row test case
2022-07-12 11:59:34 +02:00
Chris Cranford
843f133d4d
DBZ-5295 Use connection quote method, rework unavailable value check
2022-07-12 11:59:34 +02:00
Chris Cranford
5f443dd9e1
DBZ-5295 Fix format errors
2022-07-12 11:59:34 +02:00
Chris Cranford
6735904075
DBZ-5295 Cache LOB column status in schema model
2022-07-12 11:59:34 +02:00
Chris Cranford
32947ae512
DBZ-5295 Remove unnecessary test output
2022-07-12 11:59:34 +02:00
Chris Cranford
d2a76a7ffc
DBZ-5295 Reselect LOB columns on primary key update
2022-07-12 11:59:34 +02:00
Chris Cranford
deaa34d71e
DBZ-5356 Avoid NPE during index evaluation
2022-07-12 11:01:10 +02:00
Chris Cranford
ddbd682d8d
DBZ-5381 Add a pretty loggable format for commit_scn
2022-07-12 06:55:13 +02:00
Chris Cranford
f7696ffac7
DBZ-5358 Rename to "user_name", position at end of struct
2022-07-11 10:10:21 -04:00
Nathan Smit
28ce4f0aa2
DBZ-5358 added name of user who executed transaction to source info block
2022-07-11 10:10:21 -04:00
Chris Cranford
28c26741d6
DBZ-5351 Add warning for LogMiner rows with unsupported op type
2022-07-06 17:23:45 -04:00
Chris Cranford
9cca260197
DBZ-5373 Propagate Oracle Xstream commit timestamp to transaction metadata
2022-07-06 16:25:18 -04:00
Debezium Builder
6fd1441af3
[maven-release-plugin] prepare for next development iteration
2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634
[maven-release-plugin] prepare release v2.0.0.Alpha3
2022-07-01 09:21:48 +00:00
Chris Cranford
30d95358b8
DBZ-5245 Track commit scn per redo thread
2022-07-01 06:39:19 +02:00
Chris Cranford
406e060df4
DBZ-5234 Rename oracle-ide
to oracle-all
2022-07-01 06:08:31 +02:00
Chris Cranford
c651996861
DBZ-5250 Update Oracle README.md, clarifying 11g requirements
2022-06-30 17:09:45 -04:00
Chris Cranford
2be190bcdd
DBZ-5281 Use separate connection for snapshot-based LogMiner queries
2022-06-30 10:37:32 +02:00
Chris Cranford
65fa2c73a5
DBZ-5281 Fix test compatibility with Oracle non-CDB
2022-06-30 10:37:32 +02:00
Mickael Maison
5ff71aa992
DBZ-5335 Fix formatting issues in the connectors configdefs
2022-06-30 09:35:54 +02:00
Chris Cranford
cf1e711299
DBZ-5266 Skip tests when using Oracle Xstream
2022-06-29 19:59:35 -04:00
harveyyue
20dc353262
DBZ-5170 Mysql Commit Timestamp
2022-06-27 15:50:52 +02:00
Chris Cranford
fd296557b5
DBZ-5266 Correctly advance commit_scn
with LOB support
2022-06-27 15:24:11 +02:00
Chris Cranford
811ba8a4af
DBZ-4902 Fix compatibility with Oracle connector
2022-06-27 08:45:37 -04:00
Chris Cranford
cfc63776fa
DBZ-5300 Exclude ADT indices as relational primary keys
2022-06-27 10:38:56 +02:00
Chris Cranford
5d4d659b37
DBZ-5285 Fix store.only.captured.tables.ddl to work during streaming
2022-06-27 09:02:22 +02:00
Chris Cranford
ced5cc6827
DBZ-5234 Add oracle-ide
profile, simplifies IDE integrations
...
Some IDE environments do not support maven-compiler-plugin include/exclude
filter configurations well and this profile is meant to bridge that gap by
enabling all sources and dependencies for IDE compiles.
2022-06-27 06:04:58 +02:00
Chris Cranford
f4b6cfafe6
DBZ-5234 Update documentation references
2022-06-24 12:19:23 +02:00
Chris Cranford
124bc6a515
DBZ-5234 Align GitHub actions with Oracle profile changes
...
* Removed oracle-ci profile entirely, no longer required
The default build with no profiles explicitly uses the previous oracle-ci behavior.
* Removed the use of the oracle profile, the Oracle connector enabled by default
* Removed the xstream-dependency usage, Xstream dependencies aren't enabled by default.
2022-06-24 12:19:23 +02:00
Chris Cranford
35f4c232a3
DBZ-5234 Rework Oracle build profiles
...
* Oracle will always be built with LogMiner by default
* Oracle tests are always compiled, integration tests skipped by default
* Integration tests require oracle-tests profile to be executed
* Xstream requires oracle-xstream profile
* Instant client dependencies are excluded by default
* The assembly profile enables Xstream bits automatically
2022-06-24 12:19:23 +02:00
Chris Cranford
a1d35b402e
DBZ-5303 Rework SkipOnDatabaseOption, allow for enabled/disabled toggles
2022-06-23 18:58:05 -04:00
Chris Cranford
cab3c664a1
DBZ-5301 FIx LogMinerHelperIT to work on Oracle RAC with multiple nodes
2022-06-23 18:54:57 -04:00
Jiri Pechanec
44107961e5
DBZ-4367 Align test with new schema changes behaviour
2022-06-17 08:53:47 +02:00
Jiri Pechanec
86abed2f9b
DBZ-4834 Fix test
2022-06-16 14:52:47 +02:00
Chris Cranford
263ba5aad6
DBZ-5256 Add internal.log.mining.transaction.snapshot.boundary.mode
option
...
This internal option is meant to replace the old `log.mining.query.logs.for.snapshot.offset`.
This now enum-based setting provides much more flexibility by being able to completely
disable the in-progress transaction check (now the default), only grab transactions that are
in-progress from V$TRANSACTION, or finally be able to grab all in-progress transactions that
are both from V$TRANSACTION and by scanning the logs.
2022-06-16 12:44:45 +02:00
Chris Cranford
3fb5bf1339
DBZ-4451 Introduce SchemaChangeEvent factory methods
2022-06-16 09:19:41 +02:00
Chris Cranford
b6549670c8
DBZ-4451 Allow test to be extended by connectors
2022-06-16 09:19:41 +02:00
Chris Cranford
863abcd081
DBZ-4451 Store previous table id in alter schema change events
...
When a table is renamed with the ALTER TABLE statement, the schema
history record not only will reference the current table's unique id
in the "id" metadata, but will also refer to the old table name in
the "previousId" metadata field.
2022-06-16 09:19:41 +02:00
Chris Cranford
20bb2adea5
DBZ-4834 Fix incremental snapshot of table added to include list
2022-06-16 08:39:16 +02:00
Chris Cranford
44159c95be
DBZ-5225 Add EVENT_SCN_KEY
key
2022-06-16 08:27:32 +02:00
Bob Roldan
18688077bf
DBZ-5225 Align source.scn
with the event's scn
2022-06-16 08:27:32 +02:00
Chris Cranford
4d30e6be47
DBZ-5257 Source info table order deterministic for rename schema changes
2022-06-16 08:19:38 +02:00
Chris Cranford
14a3b46ee5
DBZ-5258 Fix test assertions using static database names
2022-06-15 18:05:56 -04:00
Chris Cranford
46bef9c3ae
DBZ-4890 BigDecimal scale match Field when column uses negative scale
2022-06-15 12:27:56 +02:00
Chris Cranford
e142203a86
DBZ-5226 Improve test wait-time performance
2022-06-09 15:15:22 -04:00
Debezium Builder
6fff3a2876
[maven-release-plugin] prepare for next development iteration
2022-06-09 11:49:26 +00:00
Debezium Builder
b2e2e351df
[maven-release-plugin] prepare release v2.0.0.Alpha2
2022-06-09 11:49:26 +00:00
Vojtech Juranek
bbb625f29e
DBZ-5045 Use correct buffer type value after deprecated infinispan
was removed
2022-06-08 14:32:07 +02:00
Vojtech Juranek
ec9625bd70
DBZ-5045 Remove deprecated Oracle DB ORACLE_VERSION option
2022-06-08 09:11:00 +02:00
Vojtech Juranek
ff5ddd7959
DBZ-5045 Remove deprecated FIELD_PAYLOAD_ID
...
`table.field.event.payload.id` is replaced by `table.field.event.key`.
Also fix default value of `table.field.event.key` which was missing.
2022-06-08 09:11:00 +02:00
Vojtech Juranek
01d8e4fe27
DBZ-5045 Remove deprecated Oracle LOG_MINING_BUFFER_LOCATION option
2022-06-08 09:11:00 +02:00
Vojtech Juranek
091e2f3162
DBZ-5045 Remove deprecated Oracle INFINISPAN option
2022-06-08 09:11:00 +02:00
Vojtech Juranek
f84893a8b4
DBZ-5045 Remove deprecated SCHEMA_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
261188482f
DBZ-5045 Remove deprecated SCHEMA_WHITELIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
6abbcee6a3
DBZ-5045 Remove deprecated TABLE_BLACKLIST
2022-06-08 09:11:00 +02:00
Vojtech Juranek
db08e894fc
DBZ-5045 Remove deprecated TABLE_WHITELIST
2022-06-08 09:11:00 +02:00
Jiri Pechanec
7d16c879f3
DBZ-5202 Extract constants; Use Java 8 API
2022-06-07 09:04:03 +02:00
Chris Cranford
310e788c22
DBZ-5202 Add retry/delay to offset transaction id resolution
2022-06-07 09:04:03 +02:00
Chris Cranford
ec940e8220
DBZ-5085 Enforce read-consistency determining snapshot offsets
2022-06-02 08:29:13 +02:00
Jiri Pechanec
b61d99d0c6
DBZ-5136 Fix Oracle tests
2022-06-02 07:41:00 +02:00
Chris Cranford
9d71296b5c
DBZ-4251 Support stopping incremental snapshots
2022-06-02 07:30:07 +02:00
Chris Cranford
f3671afaf7
DBZ-5139 Apply threshold to all processors, added tests
2022-06-01 17:52:44 -04:00
Ethan Zou
1ac6abf63e
DBZ-5139 Abandon transaction who has too many events according to new configuration 'log.mining.buffer.memory.transaction.events.threshold'
2022-06-01 17:52:44 -04:00
Jiri Pechanec
88b7ae2050
DBZ-5136 Move sourceInfo to common class
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
c64b8af31a
DBZ-5136 reintroduce the CommonOffsetContext class and refactor common functionality into it
2022-06-01 16:56:29 +02:00
Mark Bereznitsky
2d72dae649
DBZ-5136 further refining of the algorithm for determining position in snapshot and IT test fixes
2022-06-01 16:56:29 +02:00
Jiri Pechanec
08e8c3d795
DBZ-5136 Move common class to common package
2022-06-01 16:56:29 +02:00
Andrew Walker
d23735c658
DBZ-5136: Fix missing reference
2022-06-01 16:56:29 +02:00
Andrew Walker
d0759461a4
DBZ-5136: Convert RelationalOffsetContext to CommonOffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
b6222d42bf
DBZ-5136: Add first flag and refactor OffsetContext
2022-06-01 16:56:29 +02:00
Andrew Walker
593c2769e6
DBZ-5136: Add last in table flag
2022-06-01 16:56:29 +02:00
Chris Cranford
15e9231c30
DBZ-5179 Use LRUCacheMap
to avoid high memory usage
2022-06-01 15:53:55 +02:00
Chris Cranford
a900ababcd
DBZ-5042 Use PDB name when set in Oracle configuration
2022-05-27 14:20:30 -04:00
Vojtech Juranek
fa07f67cdb
DBZ-5042 Add DB name logging support into Oracle connector
2022-05-27 14:20:30 -04:00
Chris Cranford
1ae7bec46e
DBZ-5146 Remove log.mining.view.fetch.size
, use query.fetch.size
instead.
2022-05-26 19:26:14 -04:00
Chris Cranford
60b1b3cc1d
DBZ-5147 Fix test failures
2022-05-26 18:37:24 -04:00
Chris Cranford
2978898641
DBZ-5147 Adjust log levels, apply test rules
2022-05-26 18:37:24 -04:00
Chris Cranford
7ab0cea8f1
DBZ-5147 Add event.processing.failure.handling.mode
for Oracle
2022-05-26 18:37:24 -04:00
Chris Cranford
7d8c9486d6
DBZ-5119 Move Heartbeat creation to ConnectorConfig & descendants
2022-05-25 09:59:59 +02:00
Chris Cranford
7ff7826743
DBZ-5119 Pull heartbeat.action.query
support into debezium-core
2022-05-24 12:54:40 +02:00
Chris Cranford
15eb7807c4
DBZ-5119 Add heartbeat.action.query
support for Oracle
2022-05-24 12:54:40 +02:00
Chris Cranford
2b78fca8ce
DBZ-5148 Retry starting Oracle LogMiner after ORA-01291
2022-05-23 10:30:18 +02:00
Chris Cranford
7577500696
DBZ-5140 Do not log transaction warning when lob-enabled is true
2022-05-18 14:11:36 -04:00
Chris Cranford
9a81339b54
DBZ-4782 Rework if-branches
2022-05-13 12:51:38 +02:00
Chris Cranford
e1579f8738
DBZ-4782 Flush SCN values upon schema changes
2022-05-13 12:51:38 +02:00
Chris Cranford
d0c6b59527
DBZ-4973 Cleanup logging calls
2022-05-10 11:33:33 -04:00
Chris Cranford
db9a104ea4
DBZ-4973 Remove unused code
2022-05-10 11:33:33 -04:00
Chris Cranford
035d6b4c14
DBZ-5090 Improve test use case
2022-05-10 09:45:34 -04:00
Chris Cranford
0d595025fd
DBZ-5090 Undo events across multiple mining sessions
2022-05-10 09:45:34 -04:00
Debezium Builder
901825810a
[maven-release-plugin] prepare for next development iteration
2022-04-28 13:51:13 +00:00
Debezium Builder
05dcb45647
[maven-release-plugin] prepare release v2.0.0.Alpha1
2022-04-28 13:51:12 +00:00
Chris Cranford
43ae067ef8
DBZ-5006 Add suggested test coverage
2022-04-27 08:52:29 -04:00
Chris Cranford
7e845f83cb
DBZ-3318 Scope tests to Oracle LogMiner adapter
2022-04-27 08:52:29 -04:00
Chris Cranford
cea4b51a3b
DBZ-4963 Scope tests to Oracle LogMiner adapter
2022-04-27 08:52:29 -04:00
Chris Cranford
09e58c5a5c
DBZ-5006 Allow "/" characters in Oracle table names
2022-04-27 08:52:29 -04:00
Jan Doms
f698a59481
DBZ-5005 adjust LogMiner batch size based on comparison with currently used batch size
2022-04-26 14:08:00 -04:00
Chris Cranford
9e08093900
DBZ-5029 Scope several OracleConnectorIT tests to LogMiner only
...
* shouldCaptureChangeForTableWithUnsupportedColumnType
* shouldContinueToUpdateOffsetsEvenWhenTableIsNotChanged
2022-04-21 16:10:39 +02:00
Chris Cranford
cee77e5b96
DBZ-5028 Scope OracleOffsetContextTest to the LogMiner adapter
2022-04-21 15:51:02 +02:00
Chris Cranford
5f9b2fa822
DBZ-4963 Use Optional & Stopwatch, disable lengthy test by default
2022-04-21 08:05:59 +02:00
Chris Cranford
c804509673
DBZ-4963 Introduce log.mining.session.max.ms
config option for Oracle
2022-04-21 08:05:59 +02:00
Chris Cranford
f24be1f533
DBZ-4994 Fix LOB locator event parsing with escaped single quotes
2022-04-19 09:07:36 +02:00
Chris Cranford
f667402fe0
DBZ-4987 Propagate up all exceptions from LCR handler
2022-04-19 07:23:39 +02:00
Chris Cranford
89fb497602
DBZ-4976 Add unit test
2022-04-14 11:58:50 +02:00
Chris Cranford
0ffd2e2ec3
DBZ-4976 Rework null checks & add nullability comments
2022-04-14 11:58:50 +02:00
Anisha Mohanty
736a3b149b
DBZ-4976 Handle NPEs for column definitions of Oracle DDL statements
2022-04-14 11:58:50 +02:00
Chris Cranford
1d68c8ed53
DBZ-4978 Avoid NPE during Oracle connector shutdown
2022-04-14 10:18:40 +02:00
Chris Cranford
7b95aa7bcb
DBZ-4953 Correctly handle TRUNCATE when LOB is enabled
2022-04-11 07:45:12 +02:00
Chris Cranford
e984754c2a
DBZ-4932 Use LCR v1 format with Oracle 12.0 and 12.1
2022-04-11 07:09:39 +02:00
Chris Cranford
a793d9e2ca
DBZ-4936 Restrict test to only memory-based buffer
2022-04-08 14:21:17 -04:00
Chris Cranford
22d300731f
DBZ-3318 Add integration test for database.url
2022-04-08 11:14:30 -04:00
Chris Cranford
c7e1006dd3
DBZ-4879 Correctly resolve archive-log-only SCN mining range
2022-04-08 12:05:57 +02:00
Chris Cranford
3740d27366
DBZ-4936 Don't re-emit transaction on restart with commit SCN equal to offset commit SCN
2022-04-08 09:21:38 +02:00
Debezium Builder
4a6de64c25
[maven-release-plugin] prepare for next development iteration
2022-04-05 14:49:52 +00:00
Debezium Builder
683851fd90
[maven-release-plugin] prepare release v1.9.0.Final
2022-04-05 14:49:51 +00:00
Chris Cranford
785623658c
DBZ-4937 Correctly read/write snapshot_scn and snapshot_pending_trx offsets
2022-04-01 13:56:04 -04:00
Chris Cranford
13a96549bc
DBZ-4907 Increment Commit SCN when any COMMIT is detected
2022-03-31 10:02:38 -04:00
Chris Cranford
36ad6f23db
DBZ-4891 Remove unused variable
2022-03-30 16:06:04 -04:00
Chris Cranford
6f7fa743ed
DBZ-4862 Correctly parse double single-quotes in SEL_LOB_LOCATOR events
2022-03-30 16:06:04 -04:00
asibanovs
1fe8dbb1cd
DBZ-4891 Fix Oracle Logminer's escaped single quotes parsing in DMLs, related unit test and fix for the old DBZ-3414 test.
2022-03-30 16:06:04 -04:00
Debezium Builder
ab7fe3b96a
[maven-release-plugin] prepare for next development iteration
2022-03-25 16:45:06 +00:00
Debezium Builder
d19fc234ee
[maven-release-plugin] prepare release v1.9.0.CR1
2022-03-25 16:45:06 +00:00
Sergei Morozov
b258674782
DBZ-3535: Introduce schema.name.adjustment.mode
2022-03-24 09:37:05 +01:00
Jiri Pechanec
60b80f6365
DBZ-4869 Add hint to warn message
2022-03-23 10:50:03 +01:00
Chris Cranford
64f22e3498
DBZ-4869 Log warning rather than exception on incorrect table-level logging level
2022-03-23 10:50:03 +01:00
Jiri Pechanec
71ffde5eaa
DBZ-4900 Use Duration instead of millis
2022-03-23 09:01:59 +01:00
Chris Cranford
2dd488effb
DBZ-4900 Use exponential back-off for log availability check
2022-03-23 09:01:59 +01:00
Ethan Zou
efdb5d21fc
DBZ-4850 Add several retriable SQL error codes
2022-03-22 11:52:27 -04:00
Chris Cranford
80cda74e63
DBZ-4897 Suggested edits
2022-03-22 16:47:21 +01:00
Chris Cranford
337305f0e6
DBZ-4897 Parse Oracle character-based column default values with parens
2022-03-22 16:47:21 +01:00
Chris Cranford
45648632f3
DBZ-4880 Correctly interpret NCLOB in Oracle DDL parser
2022-03-18 11:05:36 +01:00
Chris Cranford
c90993a652
DBZ-4852 DBZ-4853 DDL parser pass unsupported column types as OracleTypes.OTHER
2022-03-18 11:05:36 +01:00
Jiri Pechanec
341ec1260e
DBZ-4878 Add partition to Oracle xstream
2022-03-18 07:55:43 +01:00
kate
d2899a276a
DBZ-4878 Add partition to Oracle logminer
2022-03-18 07:55:43 +01:00
Chris Cranford
c8ecea8df9
DBZ-4842 Relax supplemental log check when table does not exist
2022-03-17 09:52:47 +01:00
Gunnar Morling
d20a6f00e7
DBZ-4801 Using JdbcConfiguration in JdbcConnection
2022-03-07 17:53:45 +01:00
Chris Cranford
fd38f771fa
DBZ-4819 Correct timing concerns to get FlushStrategyIT stable
2022-03-04 11:28:27 -05:00
Debezium Builder
fece16039c
[maven-release-plugin] prepare for next development iteration
2022-03-03 17:00:08 +00:00
Debezium Builder
e0d8a0d809
[maven-release-plugin] prepare release v1.9.0.Beta1
2022-03-03 17:00:08 +00:00
Chris Cranford
252549c674
DBZ-4287 Remove redundant getCurrentRedoLogSequences usage
2022-03-03 07:48:12 -05:00
Willie Zhu
66007df053
DBZ-4287 set the currentRedoLogSequences at the time when we update the redo log file list
2022-03-03 07:48:12 -05:00
Chris Cranford
7de14775ee
DBZ-4635 Prevent NPE from offsets during Oracle connector upgrade
2022-02-28 21:55:23 +01:00
Chris Cranford
9103a220b7
DBZ-4744 Correctly parse signal table name when using domain name
2022-02-22 15:27:21 +01:00
Chris Cranford
0ed2defc93
DBZ-4718 Process transaction retention on each mining iteration
2022-02-22 14:50:23 +01:00
Dominique Chanet
10dfc3be87
DBZ-4737 rename hasNoLogFilesStartingBeforeOrAtScn to hasLogFilesStartingBeforeOrAtScn
2022-02-16 09:10:51 -05:00
Dominique Chanet
fe523359f9
DBZ-4737 fix SqlUtils test
2022-02-16 09:10:51 -05:00
Dominique Chanet
49323423ac
DBZ-4737 fix log file discovery
2022-02-16 09:10:51 -05:00
Sergei Morozov
2d14b5b09f
DBZ-4478: Multi-partition metrics for SQL Server
2022-02-16 11:31:38 +01:00
Sergei Morozov
6d0aa9408c
DBZ-4478: Add Partition parameter to io.debezium.pipeline.source.spi.*Listener interfaces
2022-02-16 11:31:38 +01:00
Chris Cranford
e1d9544599
DBZ-4715 Use ZoneOffset rather than long for database offset seconds
2022-02-15 09:39:08 +01:00
Chris Cranford
76e4420d30
DBZ-4715 Fix stream event's source timestamp tz resolution
2022-02-15 09:39:08 +01:00
Dominique Chanet
26b53bbf22
DBZ-4737 Fix error when rewinding to oldest archive log SCN
...
In LogMinerStreamingChangeEventSource, the `startScn` variable is used
as an exclusive lower bound for log mining sessions. The meaning of this
variable was a little muddled, sometimes (incorrectly) being considered
an inclusive lower bound. This PR aims to rectify that and avoid future
confusion on the matter.
2022-02-14 13:17:57 -05:00
limer2
3af5f0a4f0
DBZ-4723 Correct typo mistake to make use of property "log.mining.view.fetch.size".
2022-02-09 03:03:26 -05:00
Debezium Builder
7a47f478a4
[maven-release-plugin] prepare for next development iteration
2022-02-09 07:23:10 +00:00
Debezium Builder
b1dd35025e
[maven-release-plugin] prepare release v1.9.0.Alpha2
2022-02-09 07:23:10 +00:00
Chris Cranford
7ec2abd89e
DBZ-4305 Skip test when using Oracle 21
2022-02-08 23:15:15 -05:00
Chris Cranford
47b2a53a90
DBZ-4701 Align Oracle to adhere to executeWithoutCommitting semantics
2022-02-08 13:19:50 -05:00
René Kerner
8b47bf2d8f
DBZ-4665 Extend Debezium Schema Generator;
...
* finish renaming of API/APIFormat occurences to use Schema instead
* add creation of directory structure per connector when creating descriptors: `postgres.json` --> `postgres/postgres.json`
* add configuration to add a schema filename prefix (`postgres.json` --> `debezium-postgres.json`)
* add configuration to add a schema filename suffix (`postgres.json` --> `postgres-1.9.0-SNAPSHOT.json`)
* add some minor logging (available schema formats, selected format, processed connectors) and throw errors on failed state (no schema formats found, no connectors found)
* remove Oracle connector schema generation as it is not annotated yet
* automatically resolving all dependencies required by the schema generator
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2022-02-07 16:19:50 +01:00
Chris Cranford
57934a0838
DBZ-4367 Fix test failure due to auto-commit state
2022-02-05 11:32:14 -05:00
Chris Cranford
c59e749a15
DBZ-4367 Fix Xstream compilation problem
2022-02-05 11:32:14 -05:00
Dominique Chanet
38266e7ead
DBZ-4367 process initial review comments
2022-02-05 11:32:14 -05:00
Dominique Chanet
9cc059beb5
DBZ-4367: LogMiner mine from oldest pending TX instead of snapshot SCN
...
Start mining from the start SCN of the oldest still-pending transaction
at the time the initial snapshot was taken. This ensures that no events
get lost when that transaction is committed post-snapshot.
2022-02-05 11:32:14 -05:00
Chris Cranford
176a5d6dc3
DBZ-4703 Enable DEBUG logging for LcrEventHandler for tests
2022-02-04 19:33:00 -05:00
Chris Cranford
74f75867e4
DBZ-4702 Document & fix test - XStream does not support ROWID data type
2022-02-04 18:57:11 -05:00
Mark Drilling
8a5279d304
DBZ-4314 Define Oracle category grouping and ordering ( #3151 )
2022-02-02 15:33:01 -06:00
Chris Cranford
56a30bcb1d
DBZ-4650 Mark incompatible Xstream tests as LogMiner-only
2022-02-01 08:54:19 -05:00
Chris Cranford
dcd8607108
DBZ-4584 Support case-sensitive Oracle incremental snapshots
2022-01-31 09:14:46 +01:00
Debezium Builder
33e2f5cd0f
[maven-release-plugin] prepare for next development iteration
2022-01-26 19:00:20 +00:00
Debezium Builder
a77b6f8b8e
[maven-release-plugin] prepare release v1.9.0.Alpha1
2022-01-26 19:00:20 +00:00
Chris Cranford
0f22958369
DBZ-4595 Support Oracle ROWID data type
2022-01-25 08:43:35 +01:00
Chris Cranford
c95ef56fb8
DBZ-4567 DDL and DML events exclude built-in schemas
2022-01-25 08:25:34 +01:00
nathan-smit-1
d188366c3d
DBZ-4404 Added signal table support for Oracle 11G
2022-01-24 18:19:37 -05:00
Gunnar Morling
0c62da2aa5
DBZ-4520 Making static collections immutable
2022-01-21 18:03:57 +01:00
Jiri Pechanec
664d989e42
DBZ-4577 Provide custom error message handling
2022-01-21 10:24:19 +01:00
Jiri Pechanec
8fd3243a86
DBZ-2224 Test logging based on logback
2022-01-18 11:24:21 +01:00
Chris Cranford
532fdd3972
DBZ-4536 Rework checks based on feedback
2022-01-18 07:43:58 +01:00
Chris Cranford
3887dca5bf
DBZ-4536 Make OracleErrorHandler more flexible of retriable errors
2022-01-18 07:43:58 +01:00
Chris Cranford
8f53b7abea
DBZ-4366 Re-organize code, re-use static values
2022-01-17 16:14:49 -05:00
Dominique Chanet
eb7c5b02c6
DBZ-4366 basic support for DBMS_LOB package
...
Make less assumptions about the order of SELECT_LOB_LOCATOR and
LOB_WRITE events when a LOB value is constructed. The current approach
also supports interleaved LOB creation (piecemeal creation of 2 large
LOB values in different rows or columns at the same time).
There is still no support for partial LOB manipulations (trimming a LOB,
appending a couple of bytes, overwriting just a couple of bytes in the
middle, ...). To properly support that, a wholly different approach is
needed.
The internal representation of BLOB values for LogMiner has been changed
from `HEXTORAW('...')` and `BlobChunkList` to a simple byte array for
efficiency.
2022-01-17 16:14:49 -05:00
Sergei Morozov
17fba7258b
DBZ-4541: Promote failure to register metrics to exception
2022-01-14 19:50:57 +01:00
Chris Cranford
8e7c47b407
DBZ-4542 Fix LogMinerHelperIT test failure w GH Oracle CI
2022-01-12 14:09:15 -05:00
Jiri Pechanec
5f11790920
DBZ-732 Execute Oracle ITs on CI
2022-01-12 13:00:54 -05:00
Sergei Morozov
0329859cda
DBZ-4459: Introduce interfaces and default implementations for change event source metrics
2022-01-12 14:32:19 +01:00
Chris Cranford
6ea3688f46
DBZ-4526 Relax cache name limitations on Infinispan embedded cache configs
2022-01-11 14:20:45 +01:00
Chris Cranford
2ce8921872
DBZ-4408 Remove log.mining.log.file.query.max.retries
2022-01-11 14:06:45 +01:00
Anisha Mohanty
d6c5ad2e7c
DBZ-4460 Renaming all openapi occurrences to schema
2022-01-07 15:05:34 +01:00
Anisha Mohanty
3d1988cf6f
DBZ-4460 Set default values for format & output directory
2022-01-07 15:05:34 +01:00
Anisha Mohanty
06860b3691
DBZ-4460 Apply the plug-in to all connector modules
2022-01-07 15:05:34 +01:00
harveyyue
291e8ac221
DBZ-4351 Add create/update/delete event seen metrics for monitor upstream dml operation
2022-01-06 19:03:46 +01:00
poonam-meghnani
26cbf7d2e7
DBZ-4499 fixed check style issues
2022-01-06 11:29:41 -05:00
poonam-meghnani
9955a019fa
DBZ-4499 fixed checkstyle issues
2022-01-06 11:29:41 -05:00
poonam-meghnani
34505b385e
DBZ-4499 checkstyle change
2022-01-06 11:29:41 -05:00
poonam-meghnani
b55a8ea06f
DBZ-4499 Enable Oracle connector to execute INITIAL_ONLY snapshot.mode
2022-01-06 11:29:41 -05:00
harveyyue
792187f669
DBZ-4472 Make connector task partition readability for log
2021-12-20 15:58:14 +01:00
Debezium Builder
67c9663c98
[maven-release-plugin] prepare for next development iteration
2021-12-16 10:11:29 +00:00
Debezium Builder
8d532d895f
[maven-release-plugin] prepare release v1.8.0.Final
2021-12-16 10:11:28 +00:00
Jiri Pechanec
d3e53dfa3a
DBZ-4446 Option to disable Infinispan in Oracle
2021-12-13 13:59:06 +01:00
Chris Cranford
63731a2a09
DBZ-3940 Unify EventRouter tests for connectors
2021-12-13 13:52:31 +01:00
Chris Cranford
f99ad7512f
DBZ-3940 Add connector-driven EventRouter configuration
2021-12-13 13:52:31 +01:00
Chris Cranford
33c0266dcf
DBZ-4426 Log message when Oracle schema locks are disabled by configuration
2021-12-11 01:17:46 -05:00
Debezium Builder
f53e6c00df
[maven-release-plugin] prepare for next development iteration
2021-12-09 20:16:04 +00:00
Debezium Builder
826837701a
[maven-release-plugin] prepare release v1.8.0.CR1
2021-12-09 20:16:04 +00:00
Chris Cranford
950ee4d212
DBZ-4425 Fix Oracle Infinispan unavailable value serialization
2021-12-08 20:43:19 -05:00
Chris Cranford
cdf31f67c2
DBZ-4422 Fix inconsistencies with XStream LOB handling
2021-12-08 20:43:19 -05:00
Chris Cranford
141c034a20
DBZ-4385 Javadoc fixes
2021-12-08 15:00:53 -05:00
Chris Cranford
e3141556f8
DBZ-4385 Don't specify mining strategy in tests
2021-12-08 15:00:53 -05:00
Tom Billiet
ec9f122e0a
DBZ-4385 Truncate support for Oracle
2021-12-08 15:00:53 -05:00
Chris Cranford
8f007e08a2
DBZ-4388 Don't set default value if resolution fails
2021-12-07 16:38:22 +01:00
Chris Cranford
b6377d565c
DBZ-3635 Made option internal & undocumented
2021-12-07 14:48:03 +01:00
Chris Cranford
9f9758c6d3
DBZ-3635 Allow fetching of transaction logs to be retried.
2021-12-07 14:48:03 +01:00
Chris Cranford
975c2a1e32
DBZ-4400 Fix not-null CLOB column support when LOB disabled
2021-12-06 07:29:35 -05:00
Chris Cranford
51eec83564
DBZ-4400 Fix not-null BLOB column support when LOB disabled
2021-12-06 07:29:35 -05:00
Chris Cranford
e26b240117
DBZ-4400 Support binary.handling.mode
for Oracle
2021-12-06 07:29:35 -05:00
Chris Cranford
60945b426a
DBZ-4376 Fix NPE when database.dbname or database.pdb.name is in non-uppercase
2021-12-01 22:34:15 +01:00
Chris Cranford
54cb7bea25
DBZ-4384 Correctly skip emitting events when LOB_ERASE is detected
2021-12-01 14:04:48 +01:00
Debezium Builder
b5439b54bf
[maven-release-plugin] prepare for next development iteration
2021-11-30 09:38:47 +00:00
Debezium Builder
125f6e5aa2
[maven-release-plugin] prepare release v1.8.0.Beta1
2021-11-30 09:38:47 +00:00
Chris Cranford
652f41f7fb
DBZ-4272 Add drop column schema change to test
2021-11-30 09:28:44 +01:00
Chris Cranford
3a8d1ff838
DBZ-4272 Incrementally snapshot after schema change without NPE
2021-11-30 09:28:44 +01:00
Chris Cranford
707dac863c
DBZ-4360 Correctly parse default values with trailing spaces
2021-11-29 14:19:04 +01:00
Chris Cranford
d7a9784c82
DBZ-1539 Remove field group
2021-11-29 12:54:50 +01:00
Chris Cranford
de15807a11
DBZ-1539 Cleanup tests
2021-11-29 12:54:50 +01:00
Tom Billiet
46b47a42b2
DBZ-1539 Add interval.handling.mode to oracle connector
2021-11-29 12:54:50 +01:00
Chris Cranford
e39ef147f0
DBZ-4276 Extend LOB tests when LOB is disabled
2021-11-24 11:21:39 +01:00
Chris Cranford
b8b803defe
DBZ-4236 Unify Oracle LogMiner event processors
2021-11-22 12:17:23 +01:00
Chris Cranford
f600efdffb
DBZ-4169 Consolidate rollback and recently committed trx caches
2021-11-18 20:47:09 +01:00
Chris Cranford
e0065536f0
DBZ-4169 Suggested changes
2021-11-18 20:47:09 +01:00
Chris Cranford
5599938669
DBZ-4169 Enforce existence of Hotrod client server list option when necessary
2021-11-18 20:47:09 +01:00
Chris Cranford
1f06f1a038
DBZ-4169 Extract strings to constants
2021-11-18 20:47:09 +01:00
Chris Cranford
bcbff0b7e3
DBZ-4169 Raise error when using log.mining.buffer.location
option
2021-11-18 20:47:09 +01:00
Chris Cranford
48b5602ead
DBZ-4169 Cleanup Oracle POM
2021-11-18 20:47:09 +01:00
Chris Cranford
9e52ae8137
DBZ-4169 Consolidate CacheProvider impls into Processor impls
2021-11-18 20:47:09 +01:00
Chris Cranford
ab40b77120
DBZ-4169 Flush out configuration options; fix ConfigDef test
2021-11-18 20:47:09 +01:00
Chris Cranford
cc130b9f56
DBZ-4169 Cleanup cache creation
2021-11-18 20:47:09 +01:00
Chris Cranford
640d5cbd18
DBZ-4169 Cleanup TestHelper
2021-11-18 20:47:09 +01:00
Chris Cranford
f42c47b63b
DBZ-4169 Support remote Infinispan caches
2021-11-18 20:47:09 +01:00
Chris Cranford
97f08a0de3
DBZ-4308 Avoid NPE during table/column length checks
2021-11-17 17:14:26 -05:00
Chris Cranford
e3da449303
DBZ-4276 Expose unavailable value placeholder for PG and Oracle only
2021-11-16 20:29:59 +01:00
Chris Cranford
d1453eb954
DBZ-4276 Improve map initialization
2021-11-16 20:29:59 +01:00
Chris Cranford
ca17352221
DBZ-4276 Unify unavailable value placeholder handling
...
Deprecate the `toasted.value.placeholder` option in PostgreSQL in favor
of the new `unavailable.value.placeholder` option that is shared by all
relational connectors.
2021-11-16 20:29:59 +01:00
Chris Cranford
0fbfd88f6c
DBZ-4276 Add unavailable.value.placeholder
support for Oracle
2021-11-16 20:29:59 +01:00
Chris Cranford
7720c653e5
DBZ-4279 For test compatibility with Xstream
2021-11-14 16:47:51 -05:00
Debezium Builder
f93e901dce
[maven-release-plugin] prepare for next development iteration
2021-11-11 09:21:59 +00:00
Debezium Builder
895a16bf19
[maven-release-plugin] prepare release v1.8.0.Alpha2
2021-11-11 09:21:59 +00:00
Gunnar Morling
a03de4e9d0
DBZ-3611 Clarifying purpose of test
2021-11-11 09:24:05 +01:00
Chris Cranford
85101f0ad7
DBZ-3611 Avoid NPE with database include/exclude lists
2021-11-11 09:24:05 +01:00
Chris Cranford
d77098c3f0
DBZ-3710 Emit SYSDATE as 1970-01-01T00:00:00Z for zone-based temporal values
2021-11-10 09:43:25 +01:00
Chris Cranford
5c2523cd73
DBZ-3710 Suggested changes
2021-11-10 09:43:25 +01:00
Chris Cranford
5afda302ec
DBZ-3710 Javadoc updates
2021-11-10 09:43:25 +01:00
Chris Cranford
78f79afff3
DBZ-3710 Change mapper methods to static scope
2021-11-10 09:43:25 +01:00
Chris Cranford
5ec9381702
DBZ-3710 Unify DefaultValueMapper (Oracle/SQL Server/PostgreSQL)
2021-11-10 09:43:25 +01:00
Chris Cranford
3fd784c51d
DBZ-4208 Add test case for sequence-based defaults
2021-11-10 09:43:25 +01:00
Chris Cranford
343318b5d4
DBZ-3710 Support Oracle column default values
2021-11-10 09:43:25 +01:00
Chris Cranford
b30fe481eb
DBZ-4255 Reduce verbosity of logging Oracle memory metrics
2021-11-09 14:10:17 -05:00
Chris Cranford
b3faab170a
DBZ-4222 Correctly assign min metrics values when unset
2021-11-09 10:08:49 +01:00
Chris Cranford
14f6114dd0
DBZ-4222 Initialize log names/status in metrics when streaming starts
2021-11-09 10:08:49 +01:00
Chris Cranford
ed59438b89
DBZ-4222 Correctly update last and total batch duration metrics
2021-11-09 10:08:49 +01:00
Chris Cranford
04e3e6be64
DBZ-4222 Do not recalculate fetch query metrics twice
2021-11-09 10:08:49 +01:00
Chris Cranford
0c3d4f31ef
DBZ-4230 Gracefully handle ORA-00310 during streaming
2021-11-08 15:23:12 +01:00
Chris Cranford
64f030da14
DBZ-4252 Remove unused code
2021-11-06 10:30:39 +01:00
harveyyue
aa3ae05e22
DBZ-4107 Incremental snapshot doesn't work without primary key
2021-11-05 13:31:26 +01:00
Chris Cranford
b650a5cfa9
DBZ-4240 Resolve asterisk precision as default number precision
2021-11-05 08:24:17 +01:00
Chris Cranford
403ddb54c9
DBZ-4204 Allow ORA-04030 exceptions to be retried
2021-11-05 08:13:16 +01:00
Chris Cranford
84aa46fb27
DBZ-4159 Make Oracle Infinispan trx cache layout forward compatible
2021-11-05 08:10:45 +01:00
jiabao.sun
24ead16c24
DBZ-3966 Remove defaultValue and keep defaultValueExpression
2021-11-04 10:47:17 +01:00
jiabao.sun
77c4113697
DBZ-3966 JsonTableChangeSerializer support serialization for defaultValue and enumValues
2021-11-04 10:47:17 +01:00
Chris Cranford
ce28e939d6
DBZ-4159 Javadoc updates
2021-11-03 18:17:49 +01:00
Chris Cranford
954b81a75f
DBZ-4159 Cache LogMinerEvent instances in separate cache
2021-11-03 18:17:49 +01:00
Chris Cranford
4f69443ad8
DBZ-4233 CHAR / NCHAR precision not derived from DDL
2021-11-03 07:11:00 +01:00
Chris Cranford
d0c96f440b
DBZ-4077 Fix NPE with Oracle test suite
2021-11-03 07:08:35 +01:00
ahodavdekar
1d81b6db19
DBZ-4077 Exposing the transaction metadata topic name as a config option
2021-11-02 06:07:05 +01:00
Gunnar Morling
fd06a4e2a4
DBZ-2975 Using Offsets in recover() contract;
...
Keeping legacy method until the legacy MySQL connector implementation has been removed.
2021-11-01 10:17:49 +01:00
Chris Cranford
833791ffa4
DBZ-4194 Extend alias support for DELETE statements
2021-10-28 01:33:50 -04:00
harveyyue
a9cbb8f2ae
DBZ-4194 DML statement couldn't be parsed
2021-10-28 01:33:50 -04:00
Chris Cranford
c25963fbd7
DBZ-4206 Parse Oracle DDL using SDO_GEOMETRY data types
2021-10-28 07:28:20 +02:00
Debezium Builder
2026a48302
[maven-release-plugin] prepare for next development iteration
2021-10-27 06:47:27 +00:00
Debezium Builder
97106c1fd9
[maven-release-plugin] prepare release v1.8.0.Alpha1
2021-10-27 06:47:26 +00:00
Chris Cranford
acfd5123c7
DBZ-4161 Restrict test to LogMiner only
2021-10-26 16:00:44 -04:00
Chris Cranford
2a6df35dbb
DBZ-3978 Restrict test to LogMiner only
2021-10-26 16:00:18 -04:00
Chris Cranford
9f27cddbc5
DBZ-4186 Fix OracleSchemaMigrationIT test failures for Xstream
2021-10-22 09:01:56 +02:00
Chris Cranford
2db345d1ed
DBZ-4036 Adjust DEFAULT_SCN_GAP_SIZE
2021-10-21 17:42:11 -04:00
Chris Cranford
36c0dfd1ab
DBZ-4036 Only pass one SCN to the timestamp function
2021-10-21 17:42:11 -04:00
Willie Zhu
f4297f99b3
DBZ-4036 move scn_to_timestamp to a seperate function.
2021-10-21 17:42:10 -04:00
Willie Zhu
f30e40ddf7
DBZ-4036 extract configuration
2021-10-21 17:42:10 -04:00
Willie Zhu
365532379d
DBZ-4036 handle SCN gap.
2021-10-21 17:42:10 -04:00
Jiri Pechanec
a956aa53bc
DBZ-4188 Skip LogMiner tests while using XStream
2021-10-21 11:31:15 -04:00
harveyyue
90e9bea93f
DBZ-4000 Support parse table and columns comment
2021-10-20 15:19:31 +02:00
Chris Cranford
54df559438
DBZ-3807 Make Oracle connector build with infinispan-buffer profile stable
2021-10-20 09:38:51 +02:00
Chris Cranford
78dedc080a
DBZ-3834 Do not use row hashing for event duplication detection;
...
Also delaying event parsing until after duplication check.
Co-authored-by: Gunnar Morling <gunnar.morling@googlemail.com>
2021-10-19 16:54:13 +02:00
Chris Cranford
8424a58dea
DBZ-4161 Merge logging and object name length checks
2021-10-19 12:26:02 +02:00
Chris Cranford
c6d753526b
DBZ-4161 Log warning on long table/column names
2021-10-18 13:59:55 +02:00
Gunnar Morling
188d94c867
DBZ-4140 scn -> SCN in messages
2021-10-18 12:12:30 +02:00