Commit Graph

8036 Commits

Author SHA1 Message Date
ggaborg
e875e784a0 DBZ-823 CR changes 2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9 DBZ-823 Optionally parallelize initial snapshots 2023-03-03 12:47:15 +01:00
Jiri Pechanec
0656de70c9 DBZ-6156 Add an extra test case 2023-03-03 11:20:21 +01:00
Gunnar Morling
e9c6429154 [docs] Removing redundant TX ids from CloudEvents docs 2023-03-03 05:50:00 +01:00
ggaborg
72647e92db DBZ-6171 Github workflows not working for Cassandra job (step Build Debezium Connector Cassandra) 2023-03-03 05:49:18 +01:00
jcechace
aedb4fdd6a DBZ-6032 Making MongoDbConnectorConfig.REPLICA_SETS internal 2023-03-03 05:46:33 +01:00
jcechace
7d3cca89bd DBZ-6032 MongoConnection allways rethrows InterruptedException 2023-03-03 05:46:33 +01:00
jcechace
67d3f5b373 DBZ-6032 Removing obsolete retry configuration 2023-03-03 05:46:33 +01:00
jcechace
f305bcd9ab DBZ-6032 Further simplifying connection logic 2023-03-03 05:46:33 +01:00
jcechace
ecdb4729af DBZ-6032 Introducing connection package to mongo connector 2023-03-03 05:46:33 +01:00
jcechace
922191cdd7 DBZ-6032 Connection management refactoring 2023-03-03 05:46:33 +01:00
Jeremy Ford
2f44fcc064 [docs] Add additional properites for http sink 2023-03-02 13:28:49 +01:00
Jiri Pechanec
f499d92064 DBZ-5951 Init Maven repo with DSE artifacts 2023-03-02 08:30:02 +01:00
harveyyue
ee9e5f3419 DBZ-6144 Upgrade impsort-maven-plugin from 1.7.0 to 1.8.0 2023-03-01 10:12:25 -05:00
Bobby Tiernay
fe3135f28d DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step. 2023-02-28 20:17:05 +01:00
Anisha Mohanty
a46bc2903b DBZ-6115 Oracle CI on pull request events 2023-02-28 13:53:33 +01:00
Bob Roldan
621dae76f2 DBZ-6073 Move note text and eliminate embedded community conditional 2023-02-28 13:40:11 +01:00
Chris Cranford
a9d4663456 DBZ-6163 Properly handle zoned timestamp within PostgreSQL 2023-02-28 13:32:57 +01:00
harveyyue
440192851d DBZ-6156 Add hostname validator to connector configuration 2023-02-28 13:22:14 +01:00
Bob Roldan
e0f2fc4095 DBZ-6130 Remove references to using properties files to configure SMTs 2023-02-27 13:22:01 -05:00
Chris Cranford
7384a1695e DBZ-6150 Upgrade to Quarkus 2.16.3.Final 2023-02-27 12:39:45 +01:00
Bobby Tiernay
37a6fea350 DBZ-6152: Remove hardcoded list of system database exclusions that are not required for change streaming. 2023-02-24 09:43:39 +01:00
Bobby Tiernay
5d80712781 DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
fcb0e77bbb DBZ-3594 Warn when obtaning table schema which should be alread present
We load all the schemas of the captured tables when the connector
starts. If we process a record from a table which schema is not
available, this means we have some bug in the intial schema loading.
Don't fail in such case, but print a warning about that.
2023-02-23 09:26:07 -05:00
Vojtech Juranek
0868bfd55e DBZ-3594 Remove unused deprecated method 2023-02-23 09:26:07 -05:00
Chris Cranford
e320abc834 DBZ-6143 Unify Oracle TIMESTAMP WITH TIME ZONE format
When taking a snapshot, the Oracle connector was converting the TIMESTAMP
WITH TIME ZONE value to GMT and per the documentation, the value should
be emitted in the time zone of the data.

The snapshot emitted value in GMT is temporally accurate, so there is no
data inconsistency, but the emitted format itself was inconsistent when
looking at how the column data was emitted during a snapshot versus in a
streaming event.
2023-02-23 10:43:38 +01:00
Xinbin Huang
76a8f8dbe1 DBZ-6118: Update ExtractNewDocumentState to parse change stream output 2023-02-23 09:09:04 +01:00
Xinbin Huang
2c57b93384 DBZ-6118: Cleanup Mongo oplog code logic 2023-02-23 09:09:04 +01:00
Vojtech Juranek
ffc9c2f80d [docs] Fix poll.interval.ms default value 2023-02-22 13:49:40 -05:00
Chris Cranford
24fe8fe572 DBZ-6136 Add toJson to TestContainers ConnectorConfiguration impl 2023-02-21 18:31:57 +01:00
Eugene Abramchuk
fcc44edf0b DBZ-6113 Correct max reconnect attempts
Originally there are max+1 attempts
2023-02-21 08:10:26 +01:00
dependabot[bot]
a587b3b7ef [ci] Bump tj-actions/changed-files from 35.5.2 to 35.5.6
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files) from 35.5.2 to 35.5.6.
- [Release notes](https://github.com/tj-actions/changed-files/releases)
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md)
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.5.2...v35.5.6)

---
updated-dependencies:
- dependency-name: tj-actions/changed-files
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-21 07:52:16 +01:00
Xinbin Huang
a3d75e798a DBZ-6116: Support String type for key in Mongo incremental snapshot 2023-02-20 13:55:54 +01:00
Chris Cranford
dd9ca95bec DBZ-6125 Fix potential stale offsets when using PDBs
DBZ-5648 introduced a regression where transaction start, commit, and rollback
events were only being read from within the scope of the configured PDB that
the connector was capturing changes instead of the entire Oracle database.
This can lead to situations where the offsets may not be advanced as quickly
in a low traffic PDB environment, potentially causing stale offsets.
2023-02-20 13:29:11 +01:00
Chris Cranford
a89212efef DBZ-6120 Correctly handle quoting table/schema names 2023-02-20 13:26:49 +01:00
Mehmet Firat KOMURCU
4c9ab87704 DBZ-6123 fix typo "evemts" to "events" in docs.
fix typo in sql server docs
2023-02-20 08:29:54 +01:00
Debezium Builder
bf347da71a [release] Development version for testing module deps 2023-02-16 11:35:58 +00:00
Debezium Builder
2245ceda44 [maven-release-plugin] prepare for next development iteration 2023-02-16 11:28:25 +00:00
Debezium Builder
20f3b16e8a [maven-release-plugin] prepare release v2.2.0.Alpha2 2023-02-16 11:28:25 +00:00
Debezium Builder
0fce13b4e9 [release] Stable 2.2.0.Alpha2 for testing module deps 2023-02-16 11:26:07 +00:00
Jiri Pechanec
68a6a32323 [release] Changelog for 2.2.0.Alpha2 2023-02-16 12:09:05 +01:00
Bob Roldan
bb0f972af4 DBZ-6006 Update MongoDB flattening docs for downstream 2023-02-16 08:27:31 +01:00
Chris Cranford
58f3770ad1 DBZ-6079 Change query.fetch.size default from 0 to 2000 for Oracle 2023-02-16 08:15:22 +01:00
Jiri Pechanec
8f286dd3ca DBZ-6049 Fix release process for separated server repo 2023-02-16 08:13:11 +01:00
Jiri Pechanec
49e37e70ea DBZ-6049 Changes for separate server repo 2023-02-16 08:13:11 +01:00
Jiri Pechanec
8d08bcd57a DBZ-5825 Add Cassandra repo 2023-02-16 08:09:59 +01:00
Jiri Pechanec
3341292ba8 DBZ-5825 Switch to Java 20 2023-02-16 08:09:59 +01:00
Jiri Pechanec
b20e1e6eee DBZ-5825 Add Spanner and Server repos 2023-02-16 08:09:59 +01:00
Chris Cranford
fbd495d63f DBZ-5825 Use Java 19 in Java Outreach action 2023-02-16 08:09:59 +01:00
Chris Cranford
6b40103eaa DBZ-6107 Fix bulk updates when LOB is enabled 2023-02-16 07:29:37 +01:00