alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
10,726 Commits 3 Branches 0 Tags 51 MiB
b21b057729
Commit Graph

1443 Commits

Author SHA1 Message Date
Chris Cranford
928aa26cdb DBZ-7107 Fix source info test failures 2024-02-16 12:52:20 +01:00
Debezium Builder
10e327602c [maven-release-plugin] prepare for next development iteration 2024-02-13 09:20:04 +00:00
Debezium Builder
0c5b05738c [maven-release-plugin] prepare release v2.6.0.Alpha2 2024-02-13 09:20:04 +00:00
Vojtech Juranek
4452e3d095 DBZ-7024 Move EmbeddedConfig into separate class 
`EmbeddedConfig` needs to be shared with other implmentations of
`DebeziumEngine` as long as Debezium embedded depends on the Kafka
model.
 2024-02-12 13:43:21 +01:00
Chris Cranford
9fbcd6baa1 DBZ-7456 Skip PK change LOB column reselect if column is excluded 2024-02-09 16:43:13 -05:00
Chris Cranford
e2d03d9936 DBZ-7425 Use adapter-specific offset loaders when copying offsets 2024-02-07 19:40:30 -05:00
Chris Cranford
a597a82c19 DBZ-7439 Remove unnecessary log/output entries 2024-02-07 15:00:27 +01:00
Chris Cranford
de9364bb4d DBZ-7439 Fix test compatibility 2024-02-07 15:00:27 +01:00
Ondrej Babec
c806a04531 DBZ-7439 [ci] Add Oracle 23 initialisation scripts 
* Create oracle-init dir with SQL init scripts
* Create init-db.sh to set default password and run init scripts
* Update test.sh to run init-db.sh for oracle-23
 2024-02-07 15:00:27 +01:00
Chris Cranford
3d22ed30a3 DBZ-7439 [ci] Update TF with Oracle 23 
* Introduce new InstantClient version property
  Needed because ojdbc8 versions for Oracle 23 have different version semantics
  Also adjusted documentation/build pipelines
* Introduce oracle-23 profile
  Allows testing Oracle 23 separately from distribution builds
 2024-02-07 15:00:27 +01:00
mfvitale
f78d0cbd19 DBZ-7301 Add SnapshotterService to ChangeEventSourceFactory and SnapshotChangeEventSource 2024-02-06 07:12:42 +01:00
jchipmunk
c51ef3099a DBZ-7445 LogMiner batch size does not increase automatically 
The condition for increasing the LogMiner batch size must depend on log.mining.batch.size.max, and not on log.mining.batch.size.min.
 2024-02-05 12:28:16 -05:00
Chris Cranford
c669857760 DBZ-7446 Fix test failure 2024-02-05 12:26:39 -05:00
jchipmunk
04b8597239 DBZ-7446 Reduce string creation during SQL_REDO column read 
Oracle Connector can create a new string when reading SQL_REDO column only if CSF column value is 1.
 2024-02-05 12:26:39 -05:00
Chris Cranford
2bfa92e6af DBZ-7429 Resolve primary key values from after struct 2024-01-31 12:05:07 +01:00
nicholas-fwang
7d99605886 DBZ-7143 Add case when EventConvertingFailureHandlingMode is null 2024-01-29 13:48:19 +01:00
nicholas-fwang
eeea0f1e70 DBZ-7143 Add event.converting.failure.handling.mode option 2024-01-29 13:48:19 +01:00
Debezium Builder
65d63ed42d [maven-release-plugin] prepare for next development iteration 2024-01-21 10:12:45 +00:00
Debezium Builder
485fa82a8f [maven-release-plugin] prepare release v2.6.0.Alpha1 2024-01-21 10:12:44 +00:00
Chris Cranford
98bd969624 DBZ-7345 Use equality check instead 2024-01-17 13:07:19 +01:00
Chris Cranford
317daed728 DBZ-7345 Oracle log de-dupe on sequence and redo thread 2024-01-17 13:07:19 +01:00
Vojtech Juranek
33c8430a84 DBZ-7356 Update comment to include relevant DBZ issue 2024-01-17 09:45:43 +01:00
Peter Hamer
e2c0a59ec3 DBZ-7347 Update notification tests. 2024-01-17 09:42:27 +01:00
Chris Cranford
c2eac1714e DBZ-7313 Use parameterized types 2024-01-16 07:32:53 -05:00
Jiri Kulhanek
12a99f33f7 DBZ-7313: close stream 2024-01-16 07:32:53 -05:00
Jiri Kulhanek
f7a06d0c96 DBZ-7313: check if debug log is enabled 2024-01-16 07:32:53 -05:00
Chris Cranford
d689fe1244 DBZ-7313 Fix formatting 2024-01-16 07:32:53 -05:00
Jiri Kulhanek
4d14ef3c22 DBZ-7313: Oracle Infinispan abandoned trasactions minor enhancements 2024-01-16 07:32:53 -05:00
mfvitale
20fbe73bc8 DBZ-7311 Use a more meaningful name for identify an on demand blocking snapshot 2024-01-08 12:52:03 +01:00
mfvitale
47cbdee526 DBZ-7311 Permits to execute a blocking snapshot even if snapshot.mode=never 2024-01-08 12:52:03 +01:00
Chris Cranford
0f5e654193 DBZ-7315 Fix Oracle include/exclude lists with spaces 2024-01-05 10:52:32 +01:00
Mickael Maison
70e7186868 DBZ-7298 Add service loader manifests for all Connect plugins 
Add manifests for source/sink connectors, converters and transformations.
 2024-01-04 09:22:29 +01:00
Ilyas Ahsan
62cb43a72e DBZ-7288 Unittest for hasCommitAlreadyBeenHandled in CommitScn Class 
fix formatting
 2024-01-03 08:29:50 -05:00
Debezium Builder
3853d20f44 [maven-release-plugin] prepare for next development iteration 2023-12-21 06:52:01 +00:00
Debezium Builder
5d35e9caaa [maven-release-plugin] prepare release v2.5.0.Final 2023-12-21 06:52:01 +00:00
Jiri Pechanec
d05848ea89 DBZ-6764 Use correct user for registration 2023-12-20 14:26:55 +01:00
ani-sha
4b36ed9975 DBZ-7177 DBZ-6764 Use correct context name and add suggestions for code review 2023-12-20 08:56:56 +01:00
ani-sha
5a27d42257 DBZ-7177 Add isStreaming check for all tests, remove unused files 2023-12-20 08:56:56 +01:00
ani-sha
a12b1a9872 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
ani-sha
e535e5b78d DBZ-7177 Add suggestions from code review, adjust code style changes 2023-12-20 08:56:56 +01:00
ani-sha
2555a1cee2 DBZ-6764 DBZ-7178 DBZ-7177 Use MBeanServer to query metrics for REST endpoint and create new metrics descriptor 2023-12-20 08:56:56 +01:00
ani-sha
2165d9bed1 DBZ-6764 Connector metrics implementation for REST extension 2023-12-20 08:56:56 +01:00
Roman Kudryashov
516aa87fad DBZ-7235 Add option to customize CloudEvents schema name 2023-12-20 06:53:37 +01:00
Jiri Pechanec
4472b4bcd6 DBZ-7251 Enable fitering of Oracle connector 2023-12-19 17:29:37 +01:00
Vojtech Juranek
676876689c DBZ-7257 Fix regression in parsin Oracle 12 version 2023-12-19 16:27:08 +01:00
Vojtech Juranek
043f11e261 DBZ-7257 Add test for paring Oracle versions 2023-12-19 16:27:08 +01:00
harveyyue
225277c5c0 DBZ-7251 Return generic DataCollectionId instead of REST response DataCollection in getMatchingCollections method 2023-12-19 12:53:57 +01:00
harveyyue
4719396ffc DBZ-7145 Introduce a common parent connect for all Debezium source connectors 2023-12-19 12:53:57 +01:00
harveyyue
5553059fb8 DBZ-7167 Provide a public API from the connector implementations to retrieve the list of matching collections or tables based on the different include-/exclude lists 2023-12-19 12:53:57 +01:00
Vojtech Juranek
37ebb8ecae DBZ-7275 Close connection registerd with bean registry 
New connection created for bean registry is never closed. Close it
during when stopping the task.
 2023-12-19 10:22:02 +01:00
Vojtech Juranek
e48786c194 DBZ-7276 Grant DELETE on signalling table in the incremental snapshot tests 
Delete is needed for `insert_delete` watermarking strategy.
 2023-12-19 06:23:25 +01:00
Debezium Builder
2c1def7241 [maven-release-plugin] prepare for next development iteration 2023-12-14 09:43:13 +00:00
Debezium Builder
ef8260f802 [maven-release-plugin] prepare release v2.5.0.CR1 2023-12-14 09:43:12 +00:00
Chris Cranford
25ef5fa7d0 DBZ-4321 Fix test failures with Oracle XStream 2023-12-13 11:27:40 -05:00
Chris Cranford
2b02b3982e DBZ-4321 Rework configuration options 2023-12-13 11:27:40 -05:00
Chris Cranford
ada157d117 DBZ-4321 Introduce BeanRegistry and ServiceRegistry 
As a part of this work to handle injection in a cleaner way, this commit
adds two new broad concepts called `BeanRegistry` and `ServiceRegistry`.

A BeanRegistry is a glorified registry of different objects that are not
necessarily services but may be desired by a service. This contract will
allow Debezium to integrate in the future with other CDI providers.

A ServiceRegistry is more of an internal concept, where various systems
can be started based on their dependency order and provides a universal
way to split larger parts of the code into smaller, focused modules that
can be accessed using the Service Locator pattern.
 2023-12-13 11:27:40 -05:00
Chris Cranford
26b3881941 DBZ-4321 Add MongoDB hook & polish injection handler 2023-12-13 11:27:40 -05:00
Chris Cranford
59027ed5ed DBZ-4321 New PostProcessor contract and Column Reselection 2023-12-13 11:27:40 -05:00
Chris Cranford
9a5d04578e DBZ-7237 Align LOB behavior in snapshot and streaming 
The snapshot phase was not setting the unavailable value placeholder when the
user had configured LOB as off, this aligns that behavior to be consistent
with the behavior from streaming.
 2023-12-12 10:36:23 +01:00
Chris Cranford
d27154dc60 DBZ-7218 Log warnings if log destination misconfigured 2023-12-11 07:51:24 -05:00
Jiri Kulhanek
28188692d7 DBZ-7236 simple fix of inversed if logic 2023-12-07 05:00:39 -05:00
Chris Cranford
aea6cc003d
[ci] Use a relaxed property check for tests 2023-12-06 18:04:59 -05:00
mfvitale
4fedfbba03 DBZ-6834 Provide INSERT/DELETE semantics for incremental snapshot watermarking 2023-12-06 14:10:26 +01:00
Debezium Builder
0fd1c0dc9a [maven-release-plugin] prepare for next development iteration 2023-12-04 13:55:35 +00:00
Debezium Builder
3e2d75f0da [maven-release-plugin] prepare release v2.5.0.Beta1 2023-12-04 13:55:35 +00:00
Chris Cranford
9976f9848f DBZ-7207 Allow XStream attach errors to be retried 2023-12-01 11:44:28 +01:00
Jiri Kulhanek
8192620d71 DBZ-7208 - implemented check for NPE 2023-11-30 20:28:43 -05:00
Chris Cranford
7ddbeceb82 DBZ-7192 Checkstyle fixes 2023-11-30 00:06:05 -05:00
Jiri Kulhanek
18c672ab6f DBZ-7192: move abandonedTransactionsCache to common abstract layer 
also makes sure that events are correctly removed in ISPN event processor after transaction is abandoned.
Also fixes scenario with event number based threshold abandonment in ISPN - events comming afterwards would be still processed.
 2023-11-30 00:06:05 -05:00
Jiri Kulhanek
c0f141f51f DBZ-7192: move abandoned transactions impl to Abstract layer 
So it is available for ISPN. ISPN does not store list of abandoned transactions

fix rebase

cosmetic changes
 2023-11-30 00:06:05 -05:00
mfvitale
5ddf75cbea DBZ-6878 Fix NotificationsIT for Oracle 2023-11-29 12:08:11 -05:00
“vsantonastaso”
8c1c369449 DBZ-6878 add table specific notification in initial snapshot 2023-11-29 08:32:21 +01:00
Chris Cranford
425543d1e0 DBZ-7194 Add GGSHAREDCAP to excluded schemas 2023-11-28 19:56:57 -05:00
Chris Cranford
937677cc89 DBZ-7194 Use a more relaxed version pattern 2023-11-28 19:56:57 -05:00
baabgai
02ad10550f DBZ-7194 Update OracleDatabaseVersion.java 
match only to the first occurrence of 'Release ' Substring in Oracle Banner
 2023-11-28 19:56:57 -05:00
Jiri Kulhanek
71d80af0b7 DBZ-7169 - populating processed transaction cache only if lobs enabled - in sync with memory event processor 2023-11-27 17:55:56 -05:00
Chris Cranford
aa229424a4 DBZ-7158 Treat Oracle RAC redo thread log sequences independently 2023-11-23 14:14:46 +01:00
rkerner
aeaba3ae70 DBZ-6762 Add "validate filters" endpoint/s for connector-specific Connect REST Extensions 
closes to https://issues.redhat.com/browse/DBZ-6762
 2023-11-22 06:10:40 +01:00
Chris Cranford
4e1d03c5aa DBZ-7153 Fix test failures for undo operations 2023-11-18 09:11:31 -05:00
Jiri Kulhanek
371237d167 DBZ-7153 - memory cache recreated during startup (from ISPN cache) 2023-11-18 09:11:31 -05:00
Kosta Kostelnik
3508913a3d DBZ-7153 - using an in-mem cache to process faster 2023-11-18 09:11:31 -05:00
Debezium Builder
1521445908 [maven-release-plugin] prepare for next development iteration 2023-11-10 10:26:05 +00:00
Debezium Builder
6c6f6e9138 [maven-release-plugin] prepare release v2.5.0.Alpha2 2023-11-10 10:26:05 +00:00
Chris Cranford
34df6ade4d DBZ-6942 Verify no log sequence gaps on log switch 
There is a corner case where it's possible the Oracle connector may query
the Oracle metadata tables quicker than the ARC process can generate an
archive log history record in V$ARCHIVED_LOG, and this can lead to a race
condition where we may incorrectly advance the connector forward to start
mining a group of logs when a log sequence gap exists in the log ranges.

For users who use the online_catalog strategy, there are some checks that
LogMiner does automatically which it skips, and one is with log sequence
gaps. This fix enforces that check by Debezium even for users who may use
the faster online_catalog mode so that no logs are omitted and events
could be missed.
 2023-11-10 09:49:10 +01:00
Chris Cranford
b834a3a66a DBZ-6963 Test should only apply to LogMiner 2023-11-09 10:58:01 +01:00
Chris Cranford
81d30a1224 DBZ-6963 Fix test failure 2023-11-09 10:58:01 +01:00
Chris Cranford
a4346222a7 DBZ-6963 Checkstyle fixes 2023-11-09 10:58:01 +01:00
Chris Cranford
b69dbd53e6 DBZ-6963 Do not merge events if table has no LOB columns 
There was a possible situation where if a long transaction consisted of
updating and inserting into the same table with identical keys with a
given sequence that the commit handler would merge several events for a
table without LOB columns, resulting in a difference in expected events
in the Kafka topic vs what was seen in LogMiner.
 2023-11-09 10:58:01 +01:00
Vojtech Juranek
9d26dd4cf4 DBZ-7007 Move embedded engine config into separate interface 
This config will be re-used by possible other implementations of
DebeiumEngine API in the embedded package. As DebeziumEngine API
can have completely different implementations and thus also config,
the class is called `EmbeddedEngineConfig` as it's assumed to be used
only by embedded engine "family" of implementations.

To keep backward compatibility, the config options are extracted into
an interface and `EmbeddedEngine` implements this interface, thus
allowing to use these options in custom classes without any need for the
code changes.
 2023-11-06 10:50:21 +01:00
Chris Cranford
e67620d30e DBZ-7047 Add comment about abstract method usage 2023-11-02 08:58:28 -04:00
Chris Cranford
d67f145971 DBZ-7047 Fixed logic to match previous behavior 2023-11-02 08:58:28 -04:00
Chris Cranford
3803a277d6 DBZ-7047 Clean-up more cache iterator/stream call sites. 2023-11-02 08:58:28 -04:00
Chris Cranford
de0969899f DBZ-7047 Only iterate active transactions when DEBUG enabled 2023-11-02 08:58:28 -04:00
Chris Cranford
16d70a1642 DBZ-7047 Utilize closeable iterators 
It is recommended by Infinispan that specific calls that return a collection
of elements should be treated as a closable object so that any and all the
potential resources associated with the operation are closed.
 2023-11-02 08:58:28 -04:00
Chris Cranford
642b720982 DBZ-7047 Don't use parallel streaming 
Using parallel streams, this causes a severe loss of performance.
 2023-11-02 08:58:28 -04:00
rkerner
de6c1976f9 DBZ-6763 Add integration tests for the Debezium Connect REST extension for the Oracle connector / Oracle Connect REST extension 
closes to https://issues.redhat.com/browse/DBZ-6763
 2023-11-02 09:00:45 +01:00
Debezium Builder
78c5204444 [maven-release-plugin] prepare for next development iteration 2023-10-26 15:39:35 +00:00
Debezium Builder
356e488e83 [maven-release-plugin] prepare release v2.5.0.Alpha1 2023-10-26 15:39:35 +00:00
Chris Cranford
a1b88e98be DBZ-7071 Introduce internal schema change exclusion option 
Add a new internal `log.mining.schema_changes.username.exclude.list` to allow users
to customize the default behavior for excluding the SYS and SYSTEM usernames from
DDL changes.
 2023-10-25 09:19:11 +02:00
Chris Cranford
5c9870bcfa DBZ-7067 Improve Oracle logging for COMMITs 2023-10-24 22:39:21 -04:00
Chris Cranford
6e814e17a3 DBZ-6975 Fix test failures 2023-10-18 17:56:12 -04:00
Chris Cranford
b96be67937 DBZ-7018 Limit continuation in test to 10 rows 2023-10-13 08:40:34 -04:00
Chris Cranford
2479d811fb DBZ-7018 Allow SQL statements greater than 40kb 
In some corner cases, users may have unusually large SQL statements that
need to be buffered due to the number of columns paired with the data in
those columns. Previously we capped this to 4000*10 or 40kb primarily to
address situations with LOB operations that could lead to OOM scenarios.
The new code rather logs a warning when exceeding 100kb and hard faults
ony when the connector sees Integer.MAX_VALUE number of SQL lines for a
single SQL buffer.
 2023-10-13 08:40:34 -04:00
Chris Cranford
472d010f7c DBZ-7006 Properly handle escaped CLOB single-quotes 2023-10-11 14:39:12 +02:00
Chris Cranford
e2b871ae7b DBZ-6975 Correctly handle escaped single-quotes in UNISTR arguments 2023-10-11 14:37:44 +02:00
Chris Cranford
67ede63ccc DBZ-6899 Add test-excludes for XStream 2023-10-04 13:47:43 -04:00
Chris Cranford
a3b51b48b9 DBZ-6899 Refactor Oracle streamings metrics 2023-10-04 13:47:43 -04:00
Debezium Builder
40a8f4026d [maven-release-plugin] prepare for next development iteration 2023-10-03 14:18:54 +00:00
Debezium Builder
412c6f7979 [maven-release-plugin] prepare release v2.4.0.Final 2023-10-03 14:18:54 +00:00
Roman Kudryashov
98c426dec4 DBZ-3642 CloudEventsConverter can retrieve metadata info from headers 2023-09-26 13:06:09 +02:00
Debezium Builder
cc1de0aa51 [maven-release-plugin] prepare for next development iteration 2023-09-22 09:00:45 +00:00
Debezium Builder
6809978083 [maven-release-plugin] prepare release v2.4.0.CR1 2023-09-22 09:00:45 +00:00
Jiri Pechanec
bbc8b5b4d6 DBZ-6945 DROP event does not contain table structure 2023-09-22 10:45:00 +02:00
rkerner
6d3528d4fb DBZ-4395 Add connector specific Debezium Connect REST Extension/s and move logic from UI backend to the Debezium Connect REST Extension (part 2 of the re-architecturing/re-factoring) 
DBZ-6761 Add "validate connection" endpoints in connector specific Connect REST extensions

closes to https://issues.redhat.com/browse/DBZ-4395
closes to https://issues.redhat.com/browse/DBZ-6761
 2023-09-21 13:29:59 +02:00
mfvitale
68eb4b2df2 DBZ-6828 Process drop table events during blocking snapshot 2023-09-20 08:18:33 +02:00
mfvitale
ae199d2053 DBZ-6828 Blocking snapshot will generate schema events only for signaled tables 2023-09-20 08:18:33 +02:00
Chris Cranford
e282817f5c DBZ-6869 Ignore pending transactions with zero START_SCN 
Pending transactions with a START_SCN of 0 are considered transactions
that have started before the oldest available archive log and these
will be ignored as the entire transaction cannot be mined.
 2023-09-19 15:42:56 -04:00
Chris Cranford
f429118d98 DBZ-6938 Exclude UNUSED redo logs 2023-09-19 15:36:26 -04:00
Chris Cranford
9039a12731 DBZ-6938 Make retry scn-log-check per redo thread 2023-09-19 15:36:26 -04:00
Chris Cranford
3a729932d3 DBZ-6895 Always dispatch heartbeats on commit and checkpoints 2023-09-19 09:00:26 +02:00
Chris Cranford
9bccb2baaf DBZ-6895 Refactor to use Json deserializers 2023-09-19 09:00:26 +02:00
Chris Cranford
1b31c663ff DBZ-6895 Fix OpenLogReplicator confirmation 2023-09-19 09:00:26 +02:00
Jiri Pechanec
f8e4e589d8 DBZ-6903 Use distinct dir for protobuf generated sources 2023-09-13 11:50:47 -04:00
Debezium Builder
65169a9315 [maven-release-plugin] prepare for next development iteration 2023-09-13 09:41:46 +00:00
Debezium Builder
845e3e9d09 [maven-release-plugin] prepare release v2.4.0.Beta2 2023-09-13 09:41:46 +00:00
Chris Cranford
6e10618c94 DBZ-2543 Checkstyle fixes 2023-09-12 18:20:07 -04:00
Chris Cranford
1d9b81b58c DBZ-2543 Confirm only checkpoints 2023-09-12 18:20:07 -04:00
Chris Cranford
e8e11cd40a DBZ-2543 Fix value converter failures 2023-09-12 18:20:07 -04:00
Chris Cranford
46fa3bef4d DBZ-2543 Refactor value conversion logic 2023-09-12 18:20:07 -04:00
Chris Cranford
ca6ccbcd35 DBZ-2543 Remove unnecessary test class 2023-09-12 18:20:07 -04:00
Chris Cranford
e841e6c74d DBZ-2543 Use protoc plugin setup like PostgreSQL 2023-09-12 18:20:07 -04:00
Chris Cranford
c076d9526b DBZ-2543 Remove vert.x dependency 2023-09-12 18:20:07 -04:00
Chris Cranford
2cae1b396d DBZ-2543 Add OpenLogReplicator configuration properties 
Added source, host, and port configurable OpenLogReplicator connector properties.
 2023-09-12 18:20:07 -04:00
Chris Cranford
0955d0e7d6 DBZ-2543 Disable XML tests for OpenLogReplicator 2023-09-12 18:20:07 -04:00
Chris Cranford
07c7a8236e DBZ-2543 Disable ROWID tests for OpenLogReplicator 2023-09-12 18:20:07 -04:00
Chris Cranford
a87533e4a8 DBZ-2543 Interval data types support 2023-09-12 18:20:07 -04:00
Chris Cranford
51b95e3bfb DBZ-2543 Add timestamp with local time zone support 2023-09-12 18:20:07 -04:00
Chris Cranford
c9f6f4596e DBZ-2543 Clean-up value resolution logic 2023-09-12 18:20:07 -04:00
Chris Cranford
73aa4a6b35 DBZ-2543 Properly decode non-variable RAW data 2023-09-12 18:20:07 -04:00
Chris Cranford
1e803edee8 DBZ-2543 Cleanup timestamptz parsing and DDL handling 2023-09-12 18:20:07 -04:00
Chris Cranford
d130fde297 DBZ-2543 Improve timestamp handling for precision modes 2023-09-12 18:20:07 -04:00
Chris Cranford
26db0b3961 DBZ-2543 Support timestamps with time zone data types 2023-09-12 18:20:07 -04:00
Chris Cranford
748420605e DBZ-2543 Add support for new db field in streaming events 2023-09-12 18:20:07 -04:00
Chris Cranford
2d4d34428d DBZ-2543 Add some streaming metrics 2023-09-12 18:20:07 -04:00
Chris Cranford
d977e9b0f1 DBZ-2543 Initial OpenLogReplicator adapter 2023-09-12 18:20:07 -04:00
Chris Cranford
dd5f1ac0f9 DBZ-6880 Include details about unsupported operations 2023-09-08 14:16:02 -04:00
Chris Cranford
b5700a62c9 DBZ-6880 Move some Oracle log messages to DEBUG 2023-09-08 14:16:02 -04:00
Chris Cranford
a0c67aa0e8 DBZ-6860 Fix NPE Oracle shouldContinueToUpdateOffsetsEvenWhenTableIsNotChanged 2023-08-31 19:13:55 -04:00
Chris Cranford
6aa6b58fdc DBZ-6859 Restore Oracle connector test suite logging 2023-08-31 17:09:25 -04:00
Debezium Builder
d97a18e8dc [maven-release-plugin] prepare for next development iteration 2023-08-29 11:41:08 +00:00
Debezium Builder
5ce25f2cfe [maven-release-plugin] prepare release v2.4.0.Beta1 2023-08-29 11:41:08 +00:00
Ondrej Babec
f03eda1cc4 DBZ-6827 Testing farm onboarding 2023-08-28 10:39:30 +02:00
Chris Cranford
e093a7bdd2
[ci] Fix some failing Oracle tests 2023-08-23 12:53:19 -04:00
Chris Cranford
e3bbc47367
DBZ-6808 Fix tests: Allow global configuration with embedded Infinispan 2023-08-23 10:00:40 -04:00
Chris Cranford
b44cae62e3
DBZ-6798 Fix tests: Expose SCN-based metrics as BigInteger 2023-08-23 10:00:33 -04:00
Chris Cranford
0b2e65c741 DBZ-6615 Fix test failures 2023-08-17 06:24:55 +02:00
Chris Cranford
d5e86e1380 DBZ-6615 Add OldestScnAgeInMilliseconds LogMiner based metric. 
This returns the age in milliseconds from the poll time for the age of the oldest
transaction's starting system change number in the transaction buffer.
 2023-08-17 06:24:55 +02:00
Jeremy Ford
829b969491 DBZ-6808 Allow the embedded infinispan global configuration to be configurable 2023-08-15 12:53:29 +02:00
mfvitale
542b3619fa DBZ-6731 Blocking snapshot takes configuration from signal payload 2023-08-15 12:43:43 +02:00
Chris Cranford
aad842522b DBZ-6798 Expose SCN-based metrics as BigInteger 
The SCN data types were previously exposed as `String` types, which is not
consumable by Grafana and Prometheus. By using `BigInteger`, we can now
make these accessible on dashboards.
 2023-08-15 06:06:49 +02:00
Debezium Builder
3c72f071b0 [maven-release-plugin] prepare for next development iteration 2023-08-09 10:33:06 +00:00
Debezium Builder
915c465440 [maven-release-plugin] prepare release v2.4.0.Alpha2 2023-08-09 10:33:06 +00:00
Chris Cranford
dc23f18456 DBZ-6782 Properly solve XMLTYPE data types during DDL changes 2023-08-09 06:46:31 +02:00
mfvitale
61651a94b5 DBZ-6566 Force blocking snapshot even if a snapshot has already executed 2023-08-03 09:22:24 +02:00
mfvitale
85d725fde8 DBZ-6566 Support Blocking snapshot for Oracle 2023-08-03 09:22:24 +02:00
Chris Cranford
fe2573cf86 DBZ-6751 Fix failing test OracleSchemaMigrationIT 2023-08-03 02:49:47 -04:00
Chris Cranford
c920479336 DBZ-6733 Skip mining distance calc. if upper bounds not within distance 2023-08-02 08:38:50 +02:00
Chris Cranford
dbeac568b0 DBZ-6729 Use default of 10000 for snapshot/query fetch sizes 2023-07-31 13:47:53 +02:00
jcechace
699a1612ae DBZ-6670 Replace error handler instead of recreate in order to keep retry counter 2023-07-25 13:46:56 +02:00
mfvitale
b8462e8fe0 DBZ-6599 Support single line statement without semicolon ending 2023-07-20 10:10:16 -04:00
Chris Cranford
afb2ecec63 DBZ-6677 Fix IndexOutOfBoundsException with ALTER TABLE listener 
When a user supplies a column visibility clause in an ALTER TABLE statement,
there are no "modify_col_properties" clauses present, and this will lead to
the aforementioned exception. The listener should be tolerant of this case
and should not initialize any column editors.
 2023-07-18 09:46:27 +02:00
Chris Cranford
72acea5628 DBZ-6673 Fix flaky Oracle test 
The shouldCaptureChangesForTransactionsAcrossSnapshotBoundaryWithoutReemittingDDLChanges test
only expects the tables created by the entire test to exist but tables from other tests not,
and it would appear this commonly happens when another test fails to cleanup after itself.

This fix is to guarantee that the Oracle database state is set properly so that tests from
within this class are executed with the right number of tables expected to exist.
 2023-07-18 09:40:41 +02:00
Debezium Builder
267dfda8a6 [maven-release-plugin] prepare for next development iteration 2023-07-17 10:40:52 +00:00
Debezium Builder
0d3cef6a29 [maven-release-plugin] prepare release v2.4.0.Alpha1 2023-07-17 10:40:52 +00:00
Chris Cranford
de8cf36b2c DBZ-6660 Introduce internal.log.mining.max.scn.deviation.ms 
We hypothesize that there could be a situation where we may be mining precisely
around the CURRENT_SCN and this may lead to situations where LGWR may not have
flushed all records for the same SCN before being mined by the connector.
 2023-07-17 10:22:46 +02:00
Chris Cranford
877a19e278 DBZ-6660 Add redo thread id to abandoned transaction warning 2023-07-17 10:22:46 +02:00
Chris Cranford
d660909fc1 DBZ-3605 Cleanup documentation, dependencies, and SAX requirements 2023-07-17 10:21:11 +02:00
Chris Cranford
34882f9468 DBZ-3605 Add support for RAW data type 2023-07-17 10:21:11 +02:00
Chris Cranford
94d363a004 DBZ-3605 Add support for Oracle XMLTYPE data types 2023-07-17 10:21:11 +02:00
Chris Cranford
b6f299b09c DBZ-6650 Align LogMiner included DML event behavior for truncates 2023-07-14 11:21:39 +02:00
Chris Cranford
56ddbe21d5 DBZ-6650 Avoid ConcurrentModificationException during dispatch 2023-07-14 11:21:39 +02:00
harveyyue
5bc7fd1f7c DBZ-6603 Support for custom tags in the connector metrics 2023-07-13 09:52:33 +02:00
mfvitale
b0b9975782 DBZ-6633 Throw a RetriableException when a SQLRecoverableException occurs during OracleConnection instantiation 2023-07-05 16:50:26 -04:00
Chris Cranford
0518999152 DBZ-6610 Fix retrying nested ORA-01327 exception 2023-06-28 08:45:33 +02:00
mfvitale
d5febcc054 DBZ-6417 Provide extensible signal action mechanism through SPI 2023-06-23 15:03:27 +02:00
mfvitale
9ed928a1c9 DBZ-6416 Improve tests stability 2023-06-22 13:22:34 +02:00
mfvitale
34e28ac52d DBZ-6416 Add initial snapshot notifications 2023-06-22 13:22:34 +02:00
Debezium Builder
60f730d383 [maven-release-plugin] prepare for next development iteration 2023-06-20 13:21:31 +00:00
Debezium Builder
150396e4c8 [maven-release-plugin] prepare release v2.3.0.Final 2023-06-20 13:21:31 +00:00
Jiri Pechanec
b8607db61c DBZ-6528 Use correct connection 2023-06-19 20:23:17 +02:00
Vojtech Juranek
8172434dda DBZ-6513 Fix the computation of Oracle's negative interval 2023-06-16 07:32:20 +02:00
Jiri Pechanec
067683e56a DBZ-6076 Consistent config for all connectors 2023-06-15 11:55:28 +02:00
Anil Dasari
0431a8b9fc DBZ-6076: Add support for custom SourceInfoStructMaker for adding new fields to source field 2023-06-15 11:55:28 +02:00
Chris Cranford
45d6f2c5ef DBZ-6193 Upgrade Infinispan to 14.0.11.Final 2023-06-15 06:25:50 +02:00
Chris Cranford
ef8059f3ff DBZ-6528 Fix Oracle NPE when storing only captured table schemas with signals 2023-06-14 10:48:19 +02:00
Chris Cranford
ab28e12d2e DBZ-6359 Allow specifying SIDs in Oracle rac.nodes parameter 2023-06-14 08:48:23 +02:00
Jiri Pechanec
c41e70a116 DBZ-6499 Atribute not needed to be passed as param 2023-06-13 07:09:01 +02:00
Chris Cranford
e025230d44 DBZ-6499 Support restarting JDBC connections 
Introduces a new configuration option, `log.mining.restart.connection`,
which closes and re-opens the JDBC connection when an Oracle Log switch
occurs or when the optionally configured log mining session max lifetime
is reached.
 2023-06-13 07:09:01 +02:00
Debezium Builder
5d1b00588a [maven-release-plugin] prepare for next development iteration 2023-06-09 09:23:38 +00:00
Debezium Builder
d1e6107517 [maven-release-plugin] prepare release v2.3.0.CR1 2023-06-09 09:23:37 +00:00