alexey.rassokhin/tet123
1
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity
8,374 Commits 3 Branches 0 Tags 51 MiB
ac24e54332
Commit Graph

1079 Commits

Author SHA1 Message Date
Jiri Pechanec
7d92dc0211 DBZ-823 Don't use getter based name 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6 DBZ-823 Use better name for CF with main connection 2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Vojtech Juranek
fcb0e77bbb DBZ-3594 Warn when obtaning table schema which should be alread present 
We load all the schemas of the captured tables when the connector
starts. If we process a record from a table which schema is not
available, this means we have some bug in the intial schema loading.
Don't fail in such case, but print a warning about that.
 2023-02-23 09:26:07 -05:00
Chris Cranford
e320abc834 DBZ-6143 Unify Oracle TIMESTAMP WITH TIME ZONE format 
When taking a snapshot, the Oracle connector was converting the TIMESTAMP
WITH TIME ZONE value to GMT and per the documentation, the value should
be emitted in the time zone of the data.

The snapshot emitted value in GMT is temporally accurate, so there is no
data inconsistency, but the emitted format itself was inconsistent when
looking at how the column data was emitted during a snapshot versus in a
streaming event.
 2023-02-23 10:43:38 +01:00
Chris Cranford
dd9ca95bec DBZ-6125 Fix potential stale offsets when using PDBs 
DBZ-5648 introduced a regression where transaction start, commit, and rollback
events were only being read from within the scope of the configured PDB that
the connector was capturing changes instead of the entire Oracle database.
This can lead to situations where the offsets may not be advanced as quickly
in a low traffic PDB environment, potentially causing stale offsets.
 2023-02-20 13:29:11 +01:00
Chris Cranford
a89212efef DBZ-6120 Correctly handle quoting table/schema names 2023-02-20 13:26:49 +01:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Chris Cranford
6b40103eaa DBZ-6107 Fix bulk updates when LOB is enabled 2023-02-16 07:29:37 +01:00
Chris Cranford
7cd7cad094 DBZ-6091 Fix SSN NumericOverflow exception 2023-02-14 09:44:21 +01:00
Chris Cranford
0771923416 DBZ-6094 Reduce frequency of "Transaction already processed" debug message 2023-02-14 09:09:44 +01:00
harveyyue
57b902ff8c DBZ-5743 Introduce alternative AVRO_UNICODE mode for field name selector 2023-02-02 13:21:45 +01:00
Debezium Builder
04f5291a2d [maven-release-plugin] prepare for next development iteration 2023-01-19 11:32:10 +00:00
Debezium Builder
027527963e [maven-release-plugin] prepare release v2.2.0.Alpha1 2023-01-19 11:32:10 +00:00
Anil Dasari
e1f9d64fbb DBZ-5852:Snapshotter#snapshotCompleted is invoked regardless of snapshot result 2023-01-19 09:24:02 +01:00
Jiri Pechanec
e8729bb0eb DBZ-5996 Properly handle zoned timestamp width in Oracle 2023-01-18 10:42:36 +01:00
Jiri Pechanec
bcd6787cdc DBZ-6008 Revert "DBZ-3653 Introduce incremental.snapshot.isolation.mode config" 
This reverts commit 6d8bcd42fd.
 2023-01-17 10:40:20 +01:00
govi20
6d8bcd42fd DBZ-3653 Introduce incremental.snapshot.isolation.mode config 2023-01-11 08:55:33 +01:00
Jiri Pechanec
8ca5e0a9b5 DBZ-4669 Reformat after plugin version consolidation 2023-01-11 06:44:53 +01:00
Mark Lambert
e5d16b14a6 DBZ-2439 Remove redundant modifiers 2023-01-11 06:44:53 +01:00
Chris Cranford
c57338d7c9 DBZ-5907 Fix transaction event undo 2023-01-09 12:43:03 +01:00
Chris Cranford
e7ef0d9b37 DBZ-3866 Add internal read-only LogMiner support 2023-01-05 07:40:37 +01:00
Debezium Builder
cf1720e4cb [maven-release-plugin] prepare for next development iteration 2022-12-22 10:11:54 +00:00
Debezium Builder
b4ea9b46cd [maven-release-plugin] prepare release v2.1.0.Final 2022-12-22 10:11:53 +00:00
Debezium Builder
177a60a9d3 [maven-release-plugin] prepare for next development iteration 2022-12-16 09:33:38 +00:00
Debezium Builder
f805db8c3c [maven-release-plugin] prepare release v2.1.0.Beta1 2022-12-16 09:33:38 +00:00
Jiri Pechanec
97f3edf906 DBZ-5880 Handle null explicitly 2022-12-16 09:24:52 +01:00
Jiri Pechanec
c9fe6d5ef7 DBZ-5880 Removed redundant code 2022-12-16 08:44:54 +01:00
Vojtech Juranek
02705903f1 DBZ-5880 Skip failing intTypes test when run with Apicurio 
* Add annotation and jUnit rule for skipping test when it's run against
  Apicurio registry.
* Skip `AbstractOracleDatatypesTest#intTypes` tests which fails with
  Apicurio. Which is partially tests in `OracleNumberNegativeScaleIT`
 2022-12-16 08:44:54 +01:00
Vojtech Juranek
56ad55ae7b DBZ-5880 Create converter for numbers with negative scales 
Oracle allows the scale to be negatove for `NUMBER` data type.
Conversion of such number to Avro would fail as Avro doesn't allow
negative scales. Provide a converter which converts the number to
zero scale number. For completeness the converter provides also
conversion to other supported types - string and double.

N.B.: if the conversion to Avro fails actually depends on
implementation, e.g. Kafka schema registy allows also negative scales.
 2022-12-16 08:44:54 +01:00
Vojtech Juranek
163ea307aa DBZ-5838 Skip Avro validation in tests which fail due to apicurio-registry #2980 2022-12-12 14:44:05 +01:00
Vojtech Juranek
0105823dad DBZ-5838 Start Apicurio registry in its own profile 
Oracle build is run differently on internal Jenkins than other
connectors and also Apicurio has to be started in a different way.
 2022-12-12 14:44:05 +01:00
Vojtech Juranek
9494552a3a DBZ-5838 Add missing Apicurio converter dependency 2022-12-12 14:44:05 +01:00
Jiri Pechanec
7f17bdfba5 DBZ-2432 Fix formatting 2022-12-08 13:10:26 +01:00
Marcelo Avancini
7754163c5d DBZ-2432: Fixing misuse of assertj 
- Some usages of assertj was not callig the actual assert of the DSL, fixing it
- Changing the Assertions to be staticlly imported
 2022-12-08 13:10:26 +01:00
Vojtech Juranek
e1b65cd6f7 DBZ-5889 Run integration tests in specified order 
Run the tests alwyas in thr same order to make it more easy to debug
failures. If needed, the order can be changed (e.g. to `random`) by
overriding propeperty `runOrder`.
 2022-12-08 13:00:41 +01:00
Debezium Builder
81896ed334 [maven-release-plugin] prepare for next development iteration 2022-11-30 07:52:24 +00:00
Debezium Builder
1aac97b87c [maven-release-plugin] prepare release v2.1.0.Alpha2 2022-11-30 07:52:23 +00:00
Egyed Tamas
ef6f1caa50 DBZ-5854 Bump Infinispan dependencies' versions. 2022-11-29 16:12:53 -05:00
Chris Cranford
06610a2bf0 DBZ-5850 Fix test OracleConnectorIT shouldIgnoreAllTablesInExcludedSchemas 2022-11-22 11:05:40 +01:00
tooptoop4
4d57765596 DBZ-5833 AbstractLogMinerEventProcessor DEBUG to TRACE loglevel 2022-11-14 09:22:35 -05:00
Debezium Builder
e311dd1a67 [maven-release-plugin] prepare for next development iteration 2022-11-10 13:29:06 +00:00
Debezium Builder
e3bf53440a [maven-release-plugin] prepare release v2.1.0.Alpha1 2022-11-10 13:29:05 +00:00
Chris Cranford
21f870d5db DBZ-5759 Log current active transactions metadata 2022-11-10 07:31:28 +01:00
Chris Cranford
6842f701f1 DBZ-5759 Log online redo log sizes 2022-11-10 07:31:28 +01:00
Chris Cranford
22593e5fe1 DBZ-5648 Move LogMiner RegEx handling into Java 2022-11-10 07:23:52 +01:00
Vojtech Juranek
97138bb3e8 DBZ-5791 Make ORA-01089 retriable based on its message 2022-11-09 10:55:56 -05:00
Vojtech Juranek
96e4326d35 DBZ-2131 Use system property to determine if Apicurio should be used 2022-11-09 08:44:45 +01:00
Vojtech Juranek
df2ad6d3c1 DBZ-2131 Add Apicurion profile for Oracle 2022-11-09 08:44:45 +01:00
Vojtech Juranek
54b5582130 DBZ-2131 Unify intendation in Oracle pom.xml 2022-11-09 08:44:45 +01:00
Chris Cranford
54bde9b3bb DBZ-5773 Correctly discard LOB_ERASE events 2022-11-08 17:37:38 -05:00
Vojtech Juranek
15308b8d78 DBZ-5738 Skip nested tables and their parent tables 
Nested tables are currently not supported.
 2022-11-08 15:37:26 -05:00
Vojtech Juranek
f347c1c844 DBZ-5626 Don't check ofsset for AWLAYS mode 
While `ALWAYS` mode allows also snapshot on schema error, it allows
snapshot also on other ocassions. Don't throw exception when offset
is missing and schema is set to `ALWAYS`.
 2022-11-08 11:03:05 -05:00
Vojtech Juranek
28aa715867 DBZ-5626 Do the snapshot also in case of schema history errors 
`ALWAYS` should mean always and also this should be in line with Postgres
`ALWAYS` option.
 2022-11-03 15:41:29 +01:00
Vojtech Juranek
3fcfd9a0e8 DBZ-5626 Add ALWAYS snapshot mode for Oracle connector 
For AWLAYS snapshot mode it's important to obtain up-to-date SCN,
therefore offset, if exists, is ignored during snapshot.
 2022-11-03 08:59:27 +01:00
Chris Cranford
993a547c2f DBZ-5756 Add Compression Advisor tables as system-excluded tables 2022-11-02 13:58:25 +01:00
jcechace
6aa7331888 DBZ-5779 Migrated debezium-connector-oracle to AssertJ 2022-11-02 08:50:26 +01:00
Chris Cranford
dc5de5ae87 DBZ-5760 Only log full row data at TRACE level 2022-10-26 08:13:34 +02:00
Chris Cranford
93e4eb0092 DBZ-5482 TransactionBoundaryMode ALL mode more reliable 2022-10-19 13:31:00 +02:00
Chris Cranford
7c07c3faaf DBZ-5682 Allow unique index NULL values in trx reconciliation 2022-10-19 13:28:40 +02:00
Debezium Builder
4d35fb8011 [maven-release-plugin] prepare for next development iteration 2022-10-14 11:26:32 +00:00
Debezium Builder
7bd1551c99 [maven-release-plugin] prepare release v2.0.0.Final 2022-10-14 11:26:32 +00:00
thangdc94
f6be36612f DBZ-5276 Remove redundant import 2022-10-14 08:22:56 +02:00
thangdc94
c53af41deb DBZ-5276 Fix wrong log switching condition 2022-10-14 08:22:56 +02:00
thangdc94
4a9539266d DBZ-5276 Fix Group by condition for thread 2022-10-14 08:22:56 +02:00
thangdc94
d233e969e7 DBZ-5276 Prevent add duplicate log file 2022-10-14 08:22:56 +02:00
Debezium Builder
884254aba1 [maven-release-plugin] prepare for next development iteration 2022-10-07 09:27:52 +00:00
Debezium Builder
a0f3263fa6 [maven-release-plugin] prepare release v2.0.0.CR1 2022-10-07 09:27:51 +00:00
Chris Cranford
8ec0846deb
DBZ-5541 Fix Oracle test compatibility failure 2022-10-05 13:25:08 -04:00
harveyyue
f6b72f060c DBZ-5671 Remove logic name parameter from sub connector config 2022-10-03 11:40:17 -04:00
Vojtech Juranek
97532042b3 DBZ-5657 Allow to use Docker maven plugin external properties 
Allow to override Docker maven plugin properties [1] from command line
to be able to change various Docker parameters more easily when starting
the container.

[1] https://dmp.fabric8.io/#combining-property-config
 2022-09-29 05:41:09 +02:00
Chris Cranford
4e3b4ebae7 DBZ-5645 Skip rollback trx cache when LOB is disabled 2022-09-22 18:09:33 -04:00
Chris Cranford
79ca0becae DBZ-5635 Reduce undo trx log verbosity when LOB enabled 2022-09-22 13:18:06 +02:00
Ismail Simsek
b966f4b65b DBZ-5591 Snapshot process setting source.ts_ms 2022-09-20 17:12:54 -04:00
Chris Cranford
13bfcc8270 DBZ-5581 Extend test cases with NULL assignment 2022-09-20 08:35:59 +02:00
Chris Cranford
5484948127 DBZ-5581 Apply unavailable value placeholder on when parsing SELECT_LOB_LOCATOR event types 2022-09-20 08:35:59 +02:00
harveyyue
288c93434f DBZ-5585 Remove classloader parameter from JdbcConnection 2022-09-19 17:15:29 +02:00
harveyyue
20d56734d4 DBZ-5585 Modify the Instantiator to not require classloader 2022-09-19 17:15:29 +02:00
Debezium Builder
218d414552 [maven-release-plugin] prepare for next development iteration 2022-09-16 06:36:40 +00:00
Debezium Builder
567f57c47b [maven-release-plugin] prepare release v2.0.0.Beta2 2022-09-16 06:36:39 +00:00
Jiri Pechanec
3dc16b722b DBZ-4842 LogMiner specific test 2022-09-16 05:27:43 +02:00
harveyyue
f21ebc98fe DBZ-5609 Oracle connector couldn't parse type_name mdsys.sdo_geometry 2022-09-14 15:57:41 -04:00
Vojtech Juranek
acc6be6df3 DBZ-5043 Move TOPIC_PREFIX into CommonConnectorConfig 
`TOPIC_PREFIX` is now mandatory to all connectors therefore it make
sense to have it in common config. Beside that, it also makes it more
easy to use it in Debezium UI without any workarounds - if the field is
not member of the given connector config, the field has to be
explicitely added into known fields otherwise is invisible for UI.
 2022-09-13 09:25:54 +02:00
Anisha Mohanty
9fd204b383 DBZ-5044 Introduce respective SchemaFactory for all connectors 2022-09-08 10:35:20 +02:00
Vojtech Juranek
402df78381 DBZ-5043 Rename schema.history to schema.history.internal 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b797201263 DBZ-5043 Rename DB_HISTORY_PATH to SCHEMA_HISTORY_PATH 2022-09-07 12:57:31 +02:00
Vojtech Juranek
b6c31f3da5 DBZ-5043 Replace 'database history' with 'database schema history' 
Reflect renaming database history to schema history in comments,
configuration descriptions and log and error messages.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
0494a16a79 DBZ-5043 Rename DatabaseHistory to SchemaHistory 
Rename also all related classes and varibales.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
0823cedf25 DBZ-5043 Replace database.server.name with topic.prefix 2022-09-07 12:57:31 +02:00
Vojtech Juranek
161a7229b6 DBZ-5043 Use topic prefix as the logical name 
With this change the user cannot direcly set connector logical name and
thus in the future it can be remove without breaking user config.
If the turn out that the logical name is useful and user should be able
to configure it, dedicated config option can be added.

Originally it was prposed in the Jira to replace it with connector name,
but it turned out that logical name defaults to `database.server.name`
and is heavily used in the tests and JMX, so it would require another
big refactoring. Thus, use topic prefix for now. Once we know further
direction (remove logical name or add new option), do this refactoring.
 2022-09-07 12:57:31 +02:00
Vojtech Juranek
25aa6c4acc DBZ-5043 Change namespace to database.history to schema.history 2022-09-07 12:57:31 +02:00
Vadzim Ramanenka
917de37a01 DBZ-5557: Supply partition when comiting offsets with source database 
Keep track of partitions offsets being committed belong to in
`BaseSourceTask`. Supply the partition along with the offset in calls to
`commitOffset`.
 2022-09-05 14:04:23 +02:00
ggaborg
244de2bd96 DBZ-3293 Add signal table automatically to include list 2022-09-01 20:16:47 +02:00
Chris Cranford
b5754a19ec DBZ-5439 Remove rsid and ssn from CommitScn format 2022-09-01 09:32:17 +02:00
Chris Cranford
c0f92e24ea DBZ-5439 Updated tests, use TreeSet trx id deterministic order 2022-09-01 09:32:17 +02:00
thangdc94
57210095d2 DBZ-5439 Fix testcase 2022-09-01 09:32:17 +02:00
thangdc94
c755720637 DBZ-5439 Backward compatible with old commit scn 2022-09-01 09:32:17 +02:00