Commit Graph

7025 Commits

Author SHA1 Message Date
Henry Cai
7acb65d96d DBZ-5374: docker-maven-plugin needs to be upgraded for Mac Apple M1
Running 'mvn clean verify' for vitess connector (which includes launch docker for integration tests) would fail when run on an Mac M1 laptop:

    [*ERROR*] Failed to execute goal io.fabric8:docker-maven-plugin:0.31.0:build (start) on project debezium-connector-vitess: Execution start of goal io.fabric8:docker-maven-plugin:0.31.0:build failed: An API incompatibility was encountered while executing io.fabric8:docker-maven-plugin:0.31.0:build: java.lang.UnsatisfiedLinkError: could not load FFI provider jnr.ffi.provider.jffi.Provider

The problem is specific to Apple M1 laptop, and is discussed further in: https://github.com/fabric8io/docker-maven-plugin/issues/1257

This is already fixed in docker-maven-plugin 0.39.1
2022-07-07 14:25:54 +02:00
Chris Cranford
28c26741d6 DBZ-5351 Add warning for LogMiner rows with unsupported op type 2022-07-06 17:23:45 -04:00
Chris Cranford
9cca260197 DBZ-5373 Propagate Oracle Xstream commit timestamp to transaction metadata 2022-07-06 16:25:18 -04:00
harveyyue
0842e5cd0e DBZ-5366 MySQL Connector column hash v2 does not work 2022-07-06 14:23:57 -04:00
Paweł Malon
707a43d3bc DBZ-5367 Fixed the problem where JSON expanding failed for Outbox event payloads that contained nested arrays where first array was empty and further array contained a Struct
With proposed changes empty arrays are skipped, as it allows us to delay defining the schema for them until an array with elements is found, as it seems that there is no way to modify a schema that was already defined for a given field
2022-07-06 13:47:54 -04:00
Chris Cranford
a2d4ac470b DBZ-5336 Add note about escaping dot (.) characters
Updated incremental snapshot documentation to note that tables that have
a dot (.) in their name should be escaped with double-quotes.
2022-07-06 13:31:50 -04:00
Chris Cranford
7a27e0db25 DBZ-5349 Run Oracle connector tests on pushes 2022-07-01 12:49:15 -04:00
Debezium Builder
1e1f89338e [release] Development version for testing module deps 2022-07-01 09:32:26 +00:00
Debezium Builder
6fd1441af3 [maven-release-plugin] prepare for next development iteration 2022-07-01 09:21:49 +00:00
Debezium Builder
99402af634 [maven-release-plugin] prepare release v2.0.0.Alpha3 2022-07-01 09:21:48 +00:00
Debezium Builder
cac041f4d8 [release] Stable 2.0.0.Alpha3 for testing module deps 2022-07-01 09:17:59 +00:00
Jiri Pechanec
af5fef13d0 [release] Changelog for 2.0.0.Alpha3 2022-07-01 10:59:20 +02:00
Chris Cranford
30d95358b8 DBZ-5245 Track commit scn per redo thread 2022-07-01 06:39:19 +02:00
Chris Cranford
406e060df4 DBZ-5234 Rename oracle-ide to oracle-all 2022-07-01 06:08:31 +02:00
Chris Cranford
00aeb190a3 DBZ-4875 Deploy javadocs with nightly snapshots 2022-07-01 05:49:37 +02:00
Chris Cranford
c651996861 DBZ-5250 Update Oracle README.md, clarifying 11g requirements 2022-06-30 17:09:45 -04:00
Chris Cranford
2891fb4bc0 DBZ-5332 Maven profile assignments 2022-06-30 17:38:05 +02:00
Chris Cranford
13181e81bb DBZ-5332 Add Oracle 19.3 non-CDB to test matrix 2022-06-30 17:38:05 +02:00
jcechace
7f1b8074e9 DBZ-5338 Removed invalid whitespaces from oracle test pipeline 2022-06-30 14:42:18 +02:00
yangrong688
774d1e4141 [docs] Fix typo for javadoc newSlotInfo 2022-06-30 12:27:06 +02:00
harveyyue
2a2b5462db DBZ-5328 field.exclude.list doesn't accept dashes (-) in database name 2022-06-30 10:47:56 +02:00
Vojtech Juranek
499aece7eb DBZ-5240 Add partitioned tables into supported table types
Postgres supports partitioned tables. Debezium requires tables to have
primary key to be able to snapshot them. Primary key support for
partitioned was added in Postgres 11, see [1]. Add partitioned table
type into supported table tables so that Debezium fetches the schema
and can do the snapshot for partitioned tables.

N.B.: On Postgres < 11 is still possible to define primary key
constraint on partitioned sub-tables. In such cases sub-tables are
snapshotted, but parent table is not.

Fix RecordsSnapshotProducerIT#shouldGenerateSnapshotsForPartitionedTables
test after adding support for partitioned tables. Test assumed that
the parent table is not snapshotted and filters out duplicate records
which results into lossing `LAST` snapshot record. Keepting original
test by filtering parent table.

[1] https://www.postgresql.org/docs/11/release-11.html
2022-06-30 10:46:54 +02:00
Vojtech Juranek
ac06623459 DBZ-5240 Move table types into separate method
This will allow connectors to override the default values and return
types the connector supports.
2022-06-30 10:46:54 +02:00
Chris Cranford
2be190bcdd DBZ-5281 Use separate connection for snapshot-based LogMiner queries 2022-06-30 10:37:32 +02:00
Chris Cranford
65fa2c73a5 DBZ-5281 Fix test compatibility with Oracle non-CDB 2022-06-30 10:37:32 +02:00
Gunnar Morling
cb53332561 DBZ-5335 Formatting 2022-06-30 09:54:13 +02:00
Gunnar Morling
11127f3702
DBZ-5335 Adding Mickael Maison to contributors list 2022-06-30 09:36:44 +02:00
Mickael Maison
5ff71aa992 DBZ-5335 Fix formatting issues in the connectors configdefs 2022-06-30 09:35:54 +02:00
Chris Cranford
cf1e711299
DBZ-5266 Skip tests when using Oracle Xstream 2022-06-29 19:59:35 -04:00
roldanbob
6b92730f42
[docs] Fix typo
Fix use of line continuation (+) character in a table cell, which caused the character to render in the published doc
2022-06-28 12:27:08 -04:00
roldanbob
dfdcad9d52
[docs] Fix typo in downstream Title annotation
Corrects erroneous reference to Db2 vs. MongoDB
2022-06-28 12:05:37 -04:00
jcechace
4853cd23de DBZ-5310 Fixed Oracle driver version resolution for downstream ci 2022-06-28 12:55:16 +02:00
Jiri Novotny
30c91ad5e0 DBZ-5280 change test-infrastructure image names for better clarity 2022-06-28 11:50:20 +02:00
Mike Kamornikov
cd84fb17ed DBZ-5291: Fix binlog filename comparison 2022-06-28 06:08:59 +02:00
harveyyue
68a78f73bb DBZ-5170 Update transaction ts_ms field to related doc 2022-06-27 15:50:52 +02:00
harveyyue
20dc353262 DBZ-5170 Mysql Commit Timestamp 2022-06-27 15:50:52 +02:00
Naveen Kumar KR
b75c9e635b DBZ-5277 ChangeEventQueue - Support Multiple Writer (doEnqueue) and Reader (poll) Threads
* ReentrantLock based write and read coordination
* Condition based Inter Thread communication for isFull and isNotFull conditions
2022-06-27 15:37:00 +02:00
Naveen Kumar KR
823a49fff4 DBZ-5277 ChangeEventQueue Test with Multiple Writer and Reader Threads
Assertion would fail if one or both of the scenario occurs

1) Deadlock between Writer and Reader Threads
2) Thread Starvation between Writer and Reader Threads
2022-06-27 15:37:00 +02:00
Naveen Kumar KR
1de0df29e6 DBZ-5277 ChangeEventQueue JMH Benchmark - Multiple Producers and Single Consumer 2022-06-27 15:37:00 +02:00
Chris Cranford
fd296557b5 DBZ-5266 Correctly advance commit_scn with LOB support 2022-06-27 15:24:11 +02:00
Jiri Pechanec
54c84bdb9a DBZ-4902 Add contributor 2022-06-27 14:56:29 +02:00
Jiri Pechanec
02e999cd9a [release] Add contributor 2022-06-27 14:53:33 +02:00
Chris Cranford
811ba8a4af
DBZ-4902 Fix compatibility with Oracle connector 2022-06-27 08:45:37 -04:00
Jiri Pechanec
9ada2f28ce DBZ-4902 Change for exponential strategy 2022-06-27 14:29:51 +02:00
kanha gupta
1b17372d2d DBZ-4902 Replace long durations with Duration 2022-06-27 14:29:51 +02:00
Chris Cranford
cfc63776fa DBZ-5300 Exclude ADT indices as relational primary keys 2022-06-27 10:38:56 +02:00
Chris Cranford
5d4d659b37 DBZ-5285 Fix store.only.captured.tables.ddl to work during streaming 2022-06-27 09:02:22 +02:00
Chris Cranford
ef99595d91 DBZ-5270 Reduce table schema capture logging verbosity
When enabling the `database.history.store.only.captured.tables.ddl`,
the logging in RelationalSnapshotChangeEventSource does not take into
account this setting when logging, leading to a false impression of
what tables will actually be captured in the schema history.
2022-06-27 08:47:34 +02:00
Jiri Pechanec
c34ec41eb7 DBZ-5296 Add contributor 2022-06-27 08:43:08 +02:00
Mikhail Dubrovin
26a167b1e9 DBZ-5296 Correct documentation of Event Router in expand.json mode 2022-06-27 08:43:08 +02:00