subodh
b781960019
DBZ-6179 Fix swallowing of exception cause of finally block in RelationalSnapshotChangeEventSource
2023-03-06 10:28:57 +01:00
PlugaruT
6ad3df4d19
DBZ-6023 Change surrogate key provided in integration tests
2023-03-06 10:25:59 +01:00
Jiri Pechanec
98dcdb8f55
DBZ-6023 Remove nnecessary code
2023-03-06 10:25:59 +01:00
PlugaruT
3e05965d24
DBZ-6023 Add integration tests
2023-03-06 10:25:59 +01:00
PlugaruT
7d0492fee5
DBZ-6023 Unit tests for buildChunkQuery and buildMaxPrimaryKeyQuery methods
2023-03-06 10:25:59 +01:00
PlugaruT
472162e46e
DBZ-6023 Add support for providing a surrogate key when triggering incremental snapshots
...
For tables that have a composite Primary Key, SQL queries for incremental snapshot perform bad. This change allows to provide a surrogate key that will be used for the queries. The key should be unique in order for the snapshot to guarantee consistency.
2023-03-06 10:25:59 +01:00
Jiri Pechanec
0585c6beb8
DBZ-823 Add NULL instance for the class
2023-03-03 12:47:15 +01:00
Jiri Pechanec
fef5fa26f3
DBZ-823 Mark parallel snapshotting as incubating in documentation
2023-03-03 12:47:15 +01:00
Jiri Pechanec
d492ec892c
DBZ-823 Use enum for enumeration
2023-03-03 12:47:15 +01:00
Jiri Pechanec
3da2434c6c
DBZ-823 Restrict the type with generics
2023-03-03 12:47:15 +01:00
Jiri Pechanec
5e666f00ee
DBZ-823 Add JavaDoc to new interfaces
2023-03-03 12:47:15 +01:00
Jiri Pechanec
7d92dc0211
DBZ-823 Don't use getter based name
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0f4adb9fe6
DBZ-823 Use better name for CF with main connection
2023-03-03 12:47:15 +01:00
ggaborg
e875e784a0
DBZ-823 CR changes
2023-03-03 12:47:15 +01:00
ggaborg
065dc997b9
DBZ-823 Optionally parallelize initial snapshots
2023-03-03 12:47:15 +01:00
Jiri Pechanec
0656de70c9
DBZ-6156 Add an extra test case
2023-03-03 11:20:21 +01:00
Gunnar Morling
e9c6429154
[docs] Removing redundant TX ids from CloudEvents docs
2023-03-03 05:50:00 +01:00
ggaborg
72647e92db
DBZ-6171 Github workflows not working for Cassandra job (step Build Debezium Connector Cassandra)
2023-03-03 05:49:18 +01:00
jcechace
aedb4fdd6a
DBZ-6032 Making MongoDbConnectorConfig.REPLICA_SETS internal
2023-03-03 05:46:33 +01:00
jcechace
7d3cca89bd
DBZ-6032 MongoConnection allways rethrows InterruptedException
2023-03-03 05:46:33 +01:00
jcechace
67d3f5b373
DBZ-6032 Removing obsolete retry configuration
2023-03-03 05:46:33 +01:00
jcechace
f305bcd9ab
DBZ-6032 Further simplifying connection logic
2023-03-03 05:46:33 +01:00
jcechace
ecdb4729af
DBZ-6032 Introducing connection package to mongo connector
2023-03-03 05:46:33 +01:00
jcechace
922191cdd7
DBZ-6032 Connection management refactoring
2023-03-03 05:46:33 +01:00
Jeremy Ford
2f44fcc064
[docs] Add additional properites for http sink
2023-03-02 13:28:49 +01:00
Jiri Pechanec
f499d92064
DBZ-5951 Init Maven repo with DSE artifacts
2023-03-02 08:30:02 +01:00
harveyyue
ee9e5f3419
DBZ-6144 Upgrade impsort-maven-plugin from 1.7.0 to 1.8.0
2023-03-01 10:12:25 -05:00
Bobby Tiernay
fe3135f28d
DBZ-6131: Support change stream filtering using MongoDBs aggregation pipeline step.
2023-02-28 20:17:05 +01:00
Anisha Mohanty
a46bc2903b
DBZ-6115 Oracle CI on pull request events
2023-02-28 13:53:33 +01:00
Bob Roldan
621dae76f2
DBZ-6073 Move note text and eliminate embedded community conditional
2023-02-28 13:40:11 +01:00
Chris Cranford
a9d4663456
DBZ-6163 Properly handle zoned timestamp within PostgreSQL
2023-02-28 13:32:57 +01:00
harveyyue
440192851d
DBZ-6156 Add hostname validator to connector configuration
2023-02-28 13:22:14 +01:00
Bob Roldan
e0f2fc4095
DBZ-6130 Remove references to using properties files to configure SMTs
2023-02-27 13:22:01 -05:00
Chris Cranford
7384a1695e
DBZ-6150 Upgrade to Quarkus 2.16.3.Final
2023-02-27 12:39:45 +01:00
Bobby Tiernay
37a6fea350
DBZ-6152: Remove hardcoded list of system database exclusions that are not required for change streaming.
2023-02-24 09:43:39 +01:00
Bobby Tiernay
5d80712781
DBZ-5201: Add MongoDB connector support for server-side filtering of replica set change streams.
...
This change migrates from doing client-side filtering of streaming
change events to performing it server-side via MongoDB's support
for aggregation pipelines. This can drastically cut down on the amount
of data sent between the client and server. In addition, a new approach
to heartbeating has been added which relies on the `postBatchResumeToken`
to advance the the cursor even when no changes occur on the pipeline.
2023-02-23 18:14:08 +01:00
Vojtech Juranek
fcb0e77bbb
DBZ-3594 Warn when obtaning table schema which should be alread present
...
We load all the schemas of the captured tables when the connector
starts. If we process a record from a table which schema is not
available, this means we have some bug in the intial schema loading.
Don't fail in such case, but print a warning about that.
2023-02-23 09:26:07 -05:00
Vojtech Juranek
0868bfd55e
DBZ-3594 Remove unused deprecated method
2023-02-23 09:26:07 -05:00
Chris Cranford
e320abc834
DBZ-6143 Unify Oracle TIMESTAMP WITH TIME ZONE format
...
When taking a snapshot, the Oracle connector was converting the TIMESTAMP
WITH TIME ZONE value to GMT and per the documentation, the value should
be emitted in the time zone of the data.
The snapshot emitted value in GMT is temporally accurate, so there is no
data inconsistency, but the emitted format itself was inconsistent when
looking at how the column data was emitted during a snapshot versus in a
streaming event.
2023-02-23 10:43:38 +01:00
Xinbin Huang
76a8f8dbe1
DBZ-6118: Update ExtractNewDocumentState to parse change stream output
2023-02-23 09:09:04 +01:00
Xinbin Huang
2c57b93384
DBZ-6118: Cleanup Mongo oplog code logic
2023-02-23 09:09:04 +01:00
Vojtech Juranek
ffc9c2f80d
[docs] Fix poll.interval.ms default value
2023-02-22 13:49:40 -05:00
Chris Cranford
24fe8fe572
DBZ-6136 Add toJson to TestContainers ConnectorConfiguration impl
2023-02-21 18:31:57 +01:00
Eugene Abramchuk
fcc44edf0b
DBZ-6113 Correct max reconnect attempts
...
Originally there are max+1 attempts
2023-02-21 08:10:26 +01:00
dependabot[bot]
a587b3b7ef
[ci] Bump tj-actions/changed-files from 35.5.2 to 35.5.6
...
Bumps [tj-actions/changed-files](https://github.com/tj-actions/changed-files ) from 35.5.2 to 35.5.6.
- [Release notes](https://github.com/tj-actions/changed-files/releases )
- [Changelog](https://github.com/tj-actions/changed-files/blob/main/HISTORY.md )
- [Commits](https://github.com/tj-actions/changed-files/compare/v35.5.2...v35.5.6 )
---
updated-dependencies:
- dependency-name: tj-actions/changed-files
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-02-21 07:52:16 +01:00
Xinbin Huang
a3d75e798a
DBZ-6116: Support String type for key in Mongo incremental snapshot
2023-02-20 13:55:54 +01:00
Chris Cranford
dd9ca95bec
DBZ-6125 Fix potential stale offsets when using PDBs
...
DBZ-5648 introduced a regression where transaction start, commit, and rollback
events were only being read from within the scope of the configured PDB that
the connector was capturing changes instead of the entire Oracle database.
This can lead to situations where the offsets may not be advanced as quickly
in a low traffic PDB environment, potentially causing stale offsets.
2023-02-20 13:29:11 +01:00
Chris Cranford
a89212efef
DBZ-6120 Correctly handle quoting table/schema names
2023-02-20 13:26:49 +01:00
Mehmet Firat KOMURCU
4c9ab87704
DBZ-6123 fix typo "evemts" to "events" in docs.
...
fix typo in sql server docs
2023-02-20 08:29:54 +01:00
Debezium Builder
bf347da71a
[release] Development version for testing module deps
2023-02-16 11:35:58 +00:00